2024-09-11T10:48:02.597 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T10:48:02.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T10:48:02.828 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900804' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc rgw: ec-data-pool: false frontend: beast thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: daaf78de334647fc0c800f4ac495cc9475a26bae owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 5147 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: daaf78de334647fc0c800f4ac495cc9475a26bae targets: smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGOdUeXwjJ1S0M0Zvvf+wQQNBdLWd7QbuGYQQQwuW1pflBihqWrMRRKR1Bb/nahlC8Mqc5zzhy/kVvLUzuk6TBo= smithi145.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAk7Li4Cf4XJ3dwOWSReYhDTUohL/pgots4iDyIIBO30HZ57T+jY2dHwNzNl0fgBtqwtLtKBibyQxMnQCd7SHu0= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_21:40:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T10:48:02.828 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa; will attempt to use it 2024-09-11T10:48:02.829 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa/tasks 2024-09-11T10:48:02.829 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T10:48:02.831 INFO:teuthology.task.internal:Checking packages... 2024-09-11T10:48:02.851 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T10:48:02.851 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T10:48:02.851 INFO:teuthology.packaging:ref: None 2024-09-11T10:48:02.851 INFO:teuthology.packaging:tag: None 2024-09-11T10:48:02.851 INFO:teuthology.packaging:branch: squid 2024-09-11T10:48:02.851 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T10:48:02.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-11T10:48:03.058 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T10:48:03.060 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T10:48:03.067 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T10:48:03.067 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T10:48:03.082 INFO:teuthology.task.internal:Saving configuration 2024-09-11T10:48:03.094 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T10:48:03.101 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T10:48:03.125 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 10:42:20.658515', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILzg+JLpbaw85eNnClod3/bNaWlVVGjEydKHUT7qD5fr'} 2024-09-11T10:48:03.146 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi145.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 10:42:20.659982', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFwP7w4xN21nYz2PurY31ddVXKYbob+kOf8qPXIvmlUW'} 2024-09-11T10:48:03.147 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T10:48:03.153 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-11T10:48:03.153 INFO:teuthology.task.internal:roles: ubuntu@smithi145.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-11T10:48:03.153 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T10:48:03.221 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb14c976e60>, signals=[15]) 2024-09-11T10:48:03.221 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T10:48:03.227 INFO:teuthology.task.internal:Opening connections... 2024-09-11T10:48:03.228 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-11T10:48:03.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:48:03.307 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T10:48:03.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:48:03.387 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T10:48:03.394 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-11T10:48:03.399 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-11T10:48:03.400 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04" 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T10:48:03.447 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T10:48:03.448 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy 2024-09-11T10:48:03.448 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-11T10:48:03.471 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-09-11T10:48:03.476 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-09-11T10:48:03.476 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-09-11T10:48:03.526 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T10:48:03.526 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="Ubuntu" 2024-09-11T10:48:03.526 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="22.04" 2024-09-11T10:48:03.526 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T10:48:03.526 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_CODENAME=jammy 2024-09-11T10:48:03.527 INFO:teuthology.orchestra.run.smithi145.stdout:ID=ubuntu 2024-09-11T10:48:03.527 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE=debian 2024-09-11T10:48:03.527 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T10:48:03.527 INFO:teuthology.orchestra.run.smithi145.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T10:48:03.527 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T10:48:03.527 INFO:teuthology.orchestra.run.smithi145.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T10:48:03.527 INFO:teuthology.orchestra.run.smithi145.stdout:UBUNTU_CODENAME=jammy 2024-09-11T10:48:03.527 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-09-11T10:48:03.546 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T10:48:03.555 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T10:48:03.563 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T10:48:03.563 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-11T10:48:03.565 DEBUG:teuthology.orchestra.run.smithi145:> test '!' -e /home/ubuntu/cephtest 2024-09-11T10:48:03.573 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T10:48:03.580 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T10:48:03.580 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-11T10:48:03.612 DEBUG:teuthology.orchestra.run.smithi145:> test -z $(ls -A /var/lib/ceph) 2024-09-11T10:48:03.688 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T10:48:03.745 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T10:48:03.759 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T10:48:03.760 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T10:48:03.760 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T10:48:03.760 DEBUG:teuthology.orchestra.run.smithi145:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T10:48:03.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T10:48:03.765 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-11T10:48:03.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T10:48:03.766 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-11T10:48:03.811 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-56-generic 2024-09-11T10:48:03.811 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.15.0-56-generic 2024-09-11T10:48:03.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2024-09-11T10:48:03.814 INFO:teuthology.orchestra.run.smithi145.stdout:5.15.0-56-generic 2024-09-11T10:48:03.814 INFO:teuthology.task.kernel:Running kernel on smithi145: 5.15.0-56-generic 2024-09-11T10:48:03.815 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get clean 2024-09-11T10:48:03.926 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-11T10:48:03.943 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get update 2024-09-11T10:48:04.078 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T10:48:04.175 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T10:48:04.211 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T10:48:04.211 INFO:teuthology.orchestra.run.smithi145.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T10:48:04.256 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T10:48:04.273 INFO:teuthology.orchestra.run.smithi145.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T10:48:04.307 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T10:48:04.379 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T10:48:04.413 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T10:48:04.415 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T10:48:04.415 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T10:48:04.416 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T10:48:04.434 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T10:48:04.438 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T10:48:04.438 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T10:48:04.445 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T10:48:04.450 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T10:48:04.451 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T10:48:04.451 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T10:48:04.452 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T10:48:04.471 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T10:48:04.471 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T10:48:04.612 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T10:48:04.630 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T10:48:04.655 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T10:48:04.750 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T10:48:04.769 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T10:48:05.065 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T10:48:05.085 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T10:48:05.086 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T10:48:05.100 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T10:48:05.101 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T10:48:05.110 INFO:teuthology.orchestra.run.smithi145.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T10:48:05.110 INFO:teuthology.orchestra.run.smithi145.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T10:48:05.112 INFO:teuthology.orchestra.run.smithi145.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T10:48:05.115 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T10:48:05.116 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T10:48:05.117 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T10:48:05.122 INFO:teuthology.orchestra.run.smithi145.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T10:48:05.137 INFO:teuthology.orchestra.run.smithi145.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T10:48:05.137 INFO:teuthology.orchestra.run.smithi145.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T10:48:05.183 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T10:48:05.198 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T10:48:05.198 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T10:48:05.205 INFO:teuthology.orchestra.run.smithi145.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T10:48:05.206 INFO:teuthology.orchestra.run.smithi145.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T10:48:05.222 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T10:48:05.235 INFO:teuthology.orchestra.run.smithi145.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T10:48:05.236 INFO:teuthology.orchestra.run.smithi145.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T10:48:05.236 INFO:teuthology.orchestra.run.smithi145.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T10:48:05.242 INFO:teuthology.orchestra.run.smithi145.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T10:48:05.243 INFO:teuthology.orchestra.run.smithi145.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T10:48:05.253 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T10:48:05.257 INFO:teuthology.orchestra.run.smithi145.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T10:48:05.258 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T10:48:05.259 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T10:48:05.261 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T10:48:05.261 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T10:48:05.263 INFO:teuthology.orchestra.run.smithi145.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T10:48:05.276 INFO:teuthology.orchestra.run.smithi145.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T10:48:05.282 INFO:teuthology.orchestra.run.smithi145.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T10:48:05.283 INFO:teuthology.orchestra.run.smithi145.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T10:48:05.285 INFO:teuthology.orchestra.run.smithi145.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T10:48:05.310 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T10:48:05.310 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T10:48:05.312 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T10:48:05.313 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T10:48:05.318 INFO:teuthology.orchestra.run.smithi145.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T10:48:05.321 INFO:teuthology.orchestra.run.smithi145.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T10:48:05.322 INFO:teuthology.orchestra.run.smithi145.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T10:48:05.322 INFO:teuthology.orchestra.run.smithi145.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T10:48:05.323 INFO:teuthology.orchestra.run.smithi145.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T10:48:05.332 INFO:teuthology.orchestra.run.smithi145.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T10:48:05.333 INFO:teuthology.orchestra.run.smithi145.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T10:48:05.333 INFO:teuthology.orchestra.run.smithi145.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T10:48:05.335 INFO:teuthology.orchestra.run.smithi145.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T10:48:05.346 INFO:teuthology.orchestra.run.smithi145.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T10:48:05.367 INFO:teuthology.orchestra.run.smithi145.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T10:48:05.368 INFO:teuthology.orchestra.run.smithi145.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T10:48:05.368 INFO:teuthology.orchestra.run.smithi145.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T10:48:05.369 INFO:teuthology.orchestra.run.smithi145.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T10:48:05.370 INFO:teuthology.orchestra.run.smithi145.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T10:48:05.391 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T10:48:05.392 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T10:48:05.392 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T10:48:05.393 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T10:48:05.393 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T10:48:05.414 INFO:teuthology.orchestra.run.smithi145.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T10:48:10.547 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 15.8 MB in 2s (7,472 kB/s) 2024-09-11T10:48:11.471 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 15.8 MB in 3s (5,827 kB/s) 2024-09-11T10:48:11.937 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T10:48:11.954 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T10:48:12.019 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T10:48:12.231 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-11T10:48:12.232 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-11T10:48:12.421 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T10:48:12.421 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T10:48:12.421 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T10:48:12.422 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T10:48:12.422 INFO:teuthology.orchestra.run.smithi102.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T10:48:12.422 INFO:teuthology.orchestra.run.smithi102.stdout: python2.7-minimal 2024-09-11T10:48:12.422 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T10:48:12.423 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-11T10:48:12.423 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T10:48:12.423 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T10:48:12.424 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T10:48:12.425 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-11T10:48:12.425 INFO:teuthology.orchestra.run.smithi102.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T10:48:12.425 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-09-11T10:48:12.425 INFO:teuthology.orchestra.run.smithi102.stdout: thermald 2024-09-11T10:48:12.477 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-11T10:48:12.477 INFO:teuthology.orchestra.run.smithi102.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T10:48:12.477 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T10:48:12.477 INFO:teuthology.orchestra.run.smithi102.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T10:48:12.479 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2024-09-11T10:48:12.479 INFO:teuthology.orchestra.run.smithi102.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T10:48:12.530 INFO:teuthology.orchestra.run.smithi102.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T10:48:12.531 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 113 MB of archives. 2024-09-11T10:48:12.531 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T10:48:12.531 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T10:48:12.915 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-09-11T10:48:12.933 DEBUG:teuthology.orchestra.run.smithi145:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T10:48:12.972 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T10:48:13.000 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-09-11T10:48:13.055 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T10:48:13.210 INFO:teuthology.orchestra.run.smithi145.stdout:Building dependency tree... 2024-09-11T10:48:13.210 INFO:teuthology.orchestra.run.smithi145.stdout:Reading state information... 2024-09-11T10:48:13.397 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T10:48:13.397 INFO:teuthology.orchestra.run.smithi145.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T10:48:13.397 INFO:teuthology.orchestra.run.smithi145.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T10:48:13.398 INFO:teuthology.orchestra.run.smithi145.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T10:48:13.398 INFO:teuthology.orchestra.run.smithi145.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T10:48:13.398 INFO:teuthology.orchestra.run.smithi145.stdout: python2.7-minimal 2024-09-11T10:48:13.398 INFO:teuthology.orchestra.run.smithi145.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T10:48:13.400 INFO:teuthology.orchestra.run.smithi145.stdout:The following additional packages will be installed: 2024-09-11T10:48:13.400 INFO:teuthology.orchestra.run.smithi145.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T10:48:13.400 INFO:teuthology.orchestra.run.smithi145.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T10:48:13.400 INFO:teuthology.orchestra.run.smithi145.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T10:48:13.401 INFO:teuthology.orchestra.run.smithi145.stdout:Suggested packages: 2024-09-11T10:48:13.402 INFO:teuthology.orchestra.run.smithi145.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T10:48:13.402 INFO:teuthology.orchestra.run.smithi145.stdout:Recommended packages: 2024-09-11T10:48:13.402 INFO:teuthology.orchestra.run.smithi145.stdout: thermald 2024-09-11T10:48:13.451 INFO:teuthology.orchestra.run.smithi145.stdout:The following NEW packages will be installed: 2024-09-11T10:48:13.451 INFO:teuthology.orchestra.run.smithi145.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T10:48:13.451 INFO:teuthology.orchestra.run.smithi145.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T10:48:13.451 INFO:teuthology.orchestra.run.smithi145.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T10:48:13.453 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages will be upgraded: 2024-09-11T10:48:13.453 INFO:teuthology.orchestra.run.smithi145.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T10:48:13.505 INFO:teuthology.orchestra.run.smithi145.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T10:48:13.505 INFO:teuthology.orchestra.run.smithi145.stdout:Need to get 113 MB of archives. 2024-09-11T10:48:13.505 INFO:teuthology.orchestra.run.smithi145.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T10:48:13.505 INFO:teuthology.orchestra.run.smithi145.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T10:48:13.841 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T10:48:13.841 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T10:48:13.842 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T10:48:13.963 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T10:48:13.988 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T10:48:14.005 INFO:teuthology.orchestra.run.smithi145.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T10:48:14.133 INFO:teuthology.orchestra.run.smithi145.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T10:48:14.395 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 113 MB in 2s (75.5 MB/s) 2024-09-11T10:48:14.726 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T10:48:14.948 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T10:48:14.948 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T10:48:14.948 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T10:48:15.068 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T10:48:15.139 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T10:48:15.538 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 113 MB in 2s (67.5 MB/s) 2024-09-11T10:48:15.698 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T10:48:16.835 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T10:48:16.839 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T10:48:16.906 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:17.717 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T10:48:17.721 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T10:48:17.971 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:18.975 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T10:48:18.996 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T10:48:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:19.494 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T10:48:19.515 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T10:48:19.553 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:20.198 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T10:48:20.218 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T10:48:20.327 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:20.792 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T10:48:20.813 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T10:48:20.842 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:26.213 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T10:48:26.340 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T10:48:26.614 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T10:48:26.711 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T10:48:27.022 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T10:48:27.045 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T10:48:27.088 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T10:48:27.562 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T10:48:27.689 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T10:48:28.005 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T10:48:28.135 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T10:48:28.421 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T10:48:28.443 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T10:48:28.487 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T10:48:32.330 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T10:48:32.367 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T10:48:32.404 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:34.434 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T10:48:34.471 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T10:48:34.509 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:35.117 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T10:48:35.243 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T10:48:35.576 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T10:48:35.706 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:35.832 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T10:48:35.978 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:37.235 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T10:48:37.292 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T10:48:37.292 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T10:48:37.292 INFO:teuthology.orchestra.run.smithi102.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T10:48:37.292 INFO:teuthology.orchestra.run.smithi102.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T10:48:37.356 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T10:48:37.463 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:37.690 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T10:48:37.828 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:37.954 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T10:48:38.083 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:38.856 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:39.388 INFO:teuthology.orchestra.run.smithi145.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T10:48:39.388 INFO:teuthology.orchestra.run.smithi145.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T10:48:39.388 INFO:teuthology.orchestra.run.smithi145.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T10:48:39.388 INFO:teuthology.orchestra.run.smithi145.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T10:48:39.543 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:41.132 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T10:48:41.258 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T10:48:41.385 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:41.453 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:41.453 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T10:48:41.454 INFO:teuthology.orchestra.run.smithi102.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T10:48:42.847 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T10:48:42.956 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T10:48:43.099 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T10:48:43.161 INFO:teuthology.orchestra.run.smithi145.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T10:48:43.161 INFO:teuthology.orchestra.run.smithi145.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T10:48:56.325 INFO:teuthology.orchestra.run.smithi102.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T10:48:56.326 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub' 2024-09-11T10:48:56.329 INFO:teuthology.orchestra.run.smithi102.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T10:48:56.354 INFO:teuthology.orchestra.run.smithi102.stdout:Generating grub configuration file ... 2024-09-11T10:48:56.627 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T10:48:56.653 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T10:48:56.963 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T10:48:56.968 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T10:48:57.036 INFO:teuthology.orchestra.run.smithi102.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T10:48:57.042 INFO:teuthology.orchestra.run.smithi102.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T10:48:57.207 INFO:teuthology.orchestra.run.smithi102.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T10:48:57.207 INFO:teuthology.orchestra.run.smithi102.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T10:48:57.208 INFO:teuthology.orchestra.run.smithi102.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T10:48:57.245 INFO:teuthology.orchestra.run.smithi102.stdout:done 2024-09-11T10:48:57.437 INFO:teuthology.orchestra.run.smithi145.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T10:48:57.437 INFO:teuthology.orchestra.run.smithi145.stdout:Sourcing file `/etc/default/grub' 2024-09-11T10:48:57.470 INFO:teuthology.orchestra.run.smithi145.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T10:48:57.494 INFO:teuthology.orchestra.run.smithi145.stdout:Generating grub configuration file ... 2024-09-11T10:48:57.647 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 21 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.15.0.119.119 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T10:48:57.676 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T10:48:57.677 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2024-09-11T10:48:57.677 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2024-09-11T10:48:57.677 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2024-09-11T10:48:57.677 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2024-09-11T10:48:57.678 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T10:48:57.678 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T10:48:57.678 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T10:48:57.678 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T10:48:57.678 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T10:48:57.678 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get clean 2024-09-11T10:48:57.807 INFO:teuthology.orchestra.run.smithi145.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T10:48:57.821 INFO:teuthology.orchestra.run.smithi145.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T10:48:57.834 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-11T10:48:57.944 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T10:48:57.945 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T10:48:57.955 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T10:48:57.973 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T10:48:58.117 INFO:teuthology.orchestra.run.smithi145.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T10:48:58.122 INFO:teuthology.orchestra.run.smithi145.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T10:48:58.198 INFO:teuthology.orchestra.run.smithi145.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T10:48:58.203 INFO:teuthology.orchestra.run.smithi145.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T10:48:58.383 INFO:teuthology.orchestra.run.smithi145.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T10:48:58.383 INFO:teuthology.orchestra.run.smithi145.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T10:48:58.383 INFO:teuthology.orchestra.run.smithi145.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T10:48:58.438 INFO:teuthology.orchestra.run.smithi145.stdout:done 2024-09-11T10:48:58.945 DEBUG:teuthology.orchestra.run.smithi145:> dpkg -s linux-image-generic 2024-09-11T10:48:58.961 INFO:teuthology.orchestra.run.smithi145.stdout:Package: linux-image-generic 2024-09-11T10:48:58.961 INFO:teuthology.orchestra.run.smithi145.stdout:Status: install ok installed 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Priority: optional 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Section: kernel 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Installed-Size: 21 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: amd64 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Source: linux-meta 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Version: 5.15.0.119.119 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Recommends: thermald 2024-09-11T10:48:58.962 INFO:teuthology.orchestra.run.smithi145.stdout:Description: Generic Linux kernel image 2024-09-11T10:48:58.963 INFO:teuthology.orchestra.run.smithi145.stdout: This package will always depend on the latest generic kernel image 2024-09-11T10:48:58.963 INFO:teuthology.orchestra.run.smithi145.stdout: available. 2024-09-11T10:48:58.963 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T10:48:58.963 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T10:48:58.963 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T10:48:58.963 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-11T10:48:58.963 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi145.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T10:48:58.963 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get clean 2024-09-11T10:48:59.154 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get update 2024-09-11T10:48:59.331 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T10:48:59.349 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T10:48:59.408 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T10:48:59.408 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T10:48:59.412 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T10:48:59.479 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T10:48:59.561 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T10:48:59.617 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-11T10:48:59.618 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-11T10:48:59.796 INFO:teuthology.orchestra.run.smithi102.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T10:48:59.796 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T10:48:59.796 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T10:48:59.797 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T10:48:59.797 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T10:48:59.797 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T10:48:59.797 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T10:48:59.797 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T10:48:59.836 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T10:48:59.837 DEBUG:teuthology.orchestra.run.smithi102:> dpkg -s linux-image-generic 2024-09-11T10:48:59.853 INFO:teuthology.orchestra.run.smithi102.stdout:Package: linux-image-generic 2024-09-11T10:48:59.854 INFO:teuthology.orchestra.run.smithi102.stdout:Status: install ok installed 2024-09-11T10:48:59.854 INFO:teuthology.orchestra.run.smithi102.stdout:Priority: optional 2024-09-11T10:48:59.854 INFO:teuthology.orchestra.run.smithi102.stdout:Section: kernel 2024-09-11T10:48:59.854 INFO:teuthology.orchestra.run.smithi102.stdout:Installed-Size: 21 2024-09-11T10:48:59.854 INFO:teuthology.orchestra.run.smithi102.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T10:48:59.855 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: amd64 2024-09-11T10:48:59.855 INFO:teuthology.orchestra.run.smithi102.stdout:Source: linux-meta 2024-09-11T10:48:59.855 INFO:teuthology.orchestra.run.smithi102.stdout:Version: 5.15.0.119.119 2024-09-11T10:48:59.855 INFO:teuthology.orchestra.run.smithi102.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T10:48:59.856 INFO:teuthology.orchestra.run.smithi102.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T10:48:59.856 INFO:teuthology.orchestra.run.smithi102.stdout:Recommends: thermald 2024-09-11T10:48:59.856 INFO:teuthology.orchestra.run.smithi102.stdout:Description: Generic Linux kernel image 2024-09-11T10:48:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: This package will always depend on the latest generic kernel image 2024-09-11T10:48:59.856 INFO:teuthology.orchestra.run.smithi102.stdout: available. 2024-09-11T10:48:59.857 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-11T10:48:59.905 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.34K39pplTV 2024-09-11T10:48:59.905 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub/grub.cfg /tmp/tmp.34K39pplTV 2024-09-11T10:48:59.970 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.34K39pplTV 2024-09-11T10:49:00.082 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.34K39pplTV is 10KB 2024-09-11T10:49:00.094 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.34K39pplTV 2024-09-11T10:49:00.099 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T10:49:00.153 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T10:49:00.153 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T10:49:00.153 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T10:49:00.217 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T10:49:00.217 DEBUG:teuthology.orchestra.run.smithi102:> sudo update-grub 2024-09-11T10:49:00.858 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-09-11T10:49:00.876 DEBUG:teuthology.orchestra.run.smithi145:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T10:49:00.942 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-09-11T10:49:01.161 INFO:teuthology.orchestra.run.smithi145.stdout:Building dependency tree... 2024-09-11T10:49:01.162 INFO:teuthology.orchestra.run.smithi145.stdout:Reading state information... 2024-09-11T10:49:01.351 INFO:teuthology.orchestra.run.smithi145.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T10:49:01.352 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T10:49:01.352 INFO:teuthology.orchestra.run.smithi145.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T10:49:01.352 INFO:teuthology.orchestra.run.smithi145.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T10:49:01.352 INFO:teuthology.orchestra.run.smithi145.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T10:49:01.352 INFO:teuthology.orchestra.run.smithi145.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T10:49:01.353 INFO:teuthology.orchestra.run.smithi145.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T10:49:01.353 INFO:teuthology.orchestra.run.smithi145.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T10:49:01.394 INFO:teuthology.orchestra.run.smithi145.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T10:49:01.397 DEBUG:teuthology.orchestra.run.smithi145:> dpkg -s linux-image-generic 2024-09-11T10:49:01.409 INFO:teuthology.orchestra.run.smithi145.stdout:Package: linux-image-generic 2024-09-11T10:49:01.409 INFO:teuthology.orchestra.run.smithi145.stdout:Status: install ok installed 2024-09-11T10:49:01.409 INFO:teuthology.orchestra.run.smithi145.stdout:Priority: optional 2024-09-11T10:49:01.409 INFO:teuthology.orchestra.run.smithi145.stdout:Section: kernel 2024-09-11T10:49:01.409 INFO:teuthology.orchestra.run.smithi145.stdout:Installed-Size: 21 2024-09-11T10:49:01.409 INFO:teuthology.orchestra.run.smithi145.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T10:49:01.409 INFO:teuthology.orchestra.run.smithi145.stdout:Architecture: amd64 2024-09-11T10:49:01.410 INFO:teuthology.orchestra.run.smithi145.stdout:Source: linux-meta 2024-09-11T10:49:01.410 INFO:teuthology.orchestra.run.smithi145.stdout:Version: 5.15.0.119.119 2024-09-11T10:49:01.410 INFO:teuthology.orchestra.run.smithi145.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T10:49:01.410 INFO:teuthology.orchestra.run.smithi145.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T10:49:01.410 INFO:teuthology.orchestra.run.smithi145.stdout:Recommends: thermald 2024-09-11T10:49:01.410 INFO:teuthology.orchestra.run.smithi145.stdout:Description: Generic Linux kernel image 2024-09-11T10:49:01.410 INFO:teuthology.orchestra.run.smithi145.stdout: This package will always depend on the latest generic kernel image 2024-09-11T10:49:01.410 INFO:teuthology.orchestra.run.smithi145.stdout: available. 2024-09-11T10:49:01.410 DEBUG:teuthology.orchestra.run.smithi145:> mktemp 2024-09-11T10:49:01.450 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2024-09-11T10:49:01.451 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T10:49:01.453 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-11T10:49:01.457 INFO:teuthology.orchestra.run.smithi145.stdout:/tmp/tmp.NBYFFMhn2L 2024-09-11T10:49:01.460 DEBUG:teuthology.orchestra.run.smithi145:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NBYFFMhn2L 2024-09-11T10:49:01.512 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0666 /tmp/tmp.NBYFFMhn2L 2024-09-11T10:49:01.623 DEBUG:teuthology.orchestra.remote:smithi145:/tmp/tmp.NBYFFMhn2L is 10KB 2024-09-11T10:49:01.636 DEBUG:teuthology.orchestra.run.smithi145:> rm -fr /tmp/tmp.NBYFFMhn2L 2024-09-11T10:49:01.638 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T10:49:01.641 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T10:49:01.644 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T10:49:01.692 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T10:49:01.692 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T10:49:01.693 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T10:49:01.762 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T10:49:01.762 DEBUG:teuthology.orchestra.run.smithi145:> sudo update-grub 2024-09-11T10:49:01.877 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T10:49:01.882 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T10:49:01.923 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T10:49:01.927 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T10:49:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T10:49:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T10:49:02.046 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T10:49:02.065 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-11T10:49:02.074 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-11T10:49:03.072 INFO:teuthology.orchestra.run.smithi145.stderr:Sourcing file `/etc/default/grub' 2024-09-11T10:49:03.073 INFO:teuthology.orchestra.run.smithi145.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T10:49:03.075 INFO:teuthology.orchestra.run.smithi145.stderr:Generating grub configuration file ... 2024-09-11T10:49:03.270 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T10:49:03.275 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T10:49:03.561 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T10:49:03.566 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T10:49:03.603 INFO:teuthology.orchestra.run.smithi145.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T10:49:03.607 INFO:teuthology.orchestra.run.smithi145.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T10:49:03.709 INFO:teuthology.orchestra.run.smithi145.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T10:49:03.709 INFO:teuthology.orchestra.run.smithi145.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T10:49:03.709 INFO:teuthology.orchestra.run.smithi145.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T10:49:03.718 INFO:teuthology.orchestra.run.smithi145.stderr:done 2024-09-11T10:49:03.720 DEBUG:teuthology.orchestra.run.smithi145:> sudo shutdown -r now 2024-09-11T10:49:32.105 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T10:49:32.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T10:49:32.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:49:33.724 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-11T10:49:33.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T10:49:33.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:49:50.653 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-11T10:49:52.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-11T10:49:59.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T10:49:59.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:50:01.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T10:50:01.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:50:02.717 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-11T10:50:04.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-11T10:50:14.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T10:50:14.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:50:16.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T10:50:16.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:50:34.685 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-09-11T10:50:46.788 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-11T10:50:47.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T10:50:47.330 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-11T10:50:47.330 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-11T10:50:47.377 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-119-generic 2024-09-11T10:50:47.377 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T10:50:47.377 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T10:50:47.378 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T10:50:48.379 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T10:50:48.379 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T10:50:48.450 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-09-11T10:50:48.479 DEBUG:teuthology.parallel:result is None 2024-09-11T10:50:49.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T10:50:49.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:50:50.040 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-11T10:50:50.848 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T10:50:50.848 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.15.0-119-generic"... 2024-09-11T10:50:50.848 DEBUG:teuthology.orchestra.run.smithi145:> uname -r 2024-09-11T10:50:50.894 INFO:teuthology.orchestra.run.smithi145.stdout:5.15.0-119-generic 2024-09-11T10:50:50.894 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T10:50:50.894 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T10:50:50.894 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T10:50:51.895 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-11T10:50:51.895 DEBUG:teuthology.orchestra.run.smithi145:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T10:50:52.000 INFO:teuthology.orchestra.run.smithi145.stdout:ttyS1 2024-09-11T10:50:52.020 DEBUG:teuthology.parallel:result is None 2024-09-11T10:50:52.020 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T10:50:52.029 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T10:50:52.029 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T10:50:52.031 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T10:50:52.037 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T10:50:52.042 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T10:50:52.051 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T10:50:52.052 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T10:50:52.078 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T10:50:52.162 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T10:50:52.167 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T10:50:52.168 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T10:50:52.170 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T10:50:52.190 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T10:50:52.194 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T10:50:52.200 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T10:50:52.202 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T10:50:52.203 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T10:50:52.210 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T10:50:52.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T10:50:52.246 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T10:50:52.276 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T10:50:52.285 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T10:50:52.286 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T10:50:52.323 DEBUG:teuthology.orchestra.run.smithi145:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T10:50:52.329 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T10:50:52.374 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T10:50:52.421 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T10:50:52.421 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T10:50:52.490 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T10:50:52.496 DEBUG:teuthology.orchestra.run.smithi145:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T10:50:52.543 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T10:50:52.543 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T10:50:52.607 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-11T10:50:52.610 DEBUG:teuthology.orchestra.run.smithi145:> sudo service rsyslog restart 2024-09-11T10:50:52.689 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T10:50:52.697 INFO:teuthology.task.internal:Starting timer... 2024-09-11T10:50:52.697 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T10:50:52.708 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T10:50:52.717 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2024-09-11T10:50:52.717 DEBUG:teuthology.task.selinux:Excluding smithi145: OS 'ubuntu' does not support SELinux 2024-09-11T10:50:52.717 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T10:50:52.717 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-11T10:50:52.717 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T10:50:52.717 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T10:50:52.724 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T10:50:52.727 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T10:50:52.859 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T10:50:52.870 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T10:50:52.871 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi102.front.sepia.ceph.com,smithi145.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T10:58:20.845 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi102.front.sepia.ceph.com'), Remote(name='ubuntu@smithi145.front.sepia.ceph.com')] 2024-09-11T10:58:20.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T10:58:20.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:58:20.930 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-11T10:58:21.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-11T10:58:21.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T10:58:21.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T10:58:21.093 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-09-11T10:58:21.174 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-09-11T10:58:21.175 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T10:58:21.187 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T10:58:21.187 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T10:58:21.188 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T10:58:21.191 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T10:58:21.191 DEBUG:teuthology.orchestra.run.smithi145:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T10:58:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-11T10:58:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Command line: ntpd -gq 2024-09-11T10:58:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: ---------------------------------------------------- 2024-09-11T10:58:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: ntp-4 is maintained by Network Time Foundation, 2024-09-11T10:58:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-11T10:58:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: corporation. Support and training for ntp-4 are 2024-09-11T10:58:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: available at https://www.nwtime.org/support 2024-09-11T10:58:21.216 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: ---------------------------------------------------- 2024-09-11T10:58:21.217 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: proto: precision = 0.046 usec (-24) 2024-09-11T10:58:21.217 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: basedate set to 2022-02-04 2024-09-11T10:58:21.217 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: gps base set to 2022-02-06 (week 2196) 2024-09-11T10:58:21.218 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T10:58:21.218 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T10:58:21.218 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: restrict ::: KOD does nothing without LIMITED. 2024-09-11T10:58:21.218 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-11T10:58:21.219 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Listen and drop on 0 v6wildcard [::]:123 2024-09-11T10:58:21.219 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-11T10:58:21.219 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Listen normally on 2 lo 127.0.0.1:123 2024-09-11T10:58:21.219 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2024-09-11T10:58:21.219 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Listen normally on 4 lo [::1]:123 2024-09-11T10:58:21.220 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2024-09-11T10:58:21.220 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:21 ntpd[18431]: Listening on routing socket on fd #22 for interface updates 2024-09-11T10:58:21.247 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-11T10:58:21.247 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Command line: ntpd -gq 2024-09-11T10:58:21.247 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: ---------------------------------------------------- 2024-09-11T10:58:21.247 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: ntp-4 is maintained by Network Time Foundation, 2024-09-11T10:58:21.247 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-11T10:58:21.247 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: corporation. Support and training for ntp-4 are 2024-09-11T10:58:21.247 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: available at https://www.nwtime.org/support 2024-09-11T10:58:21.247 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: ---------------------------------------------------- 2024-09-11T10:58:21.248 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: proto: precision = 0.045 usec (-24) 2024-09-11T10:58:21.248 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: basedate set to 2022-02-04 2024-09-11T10:58:21.248 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: gps base set to 2022-02-06 (week 2196) 2024-09-11T10:58:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T10:58:21.249 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T10:58:21.249 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: restrict ::: KOD does nothing without LIMITED. 2024-09-11T10:58:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-11T10:58:21.250 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Listen and drop on 0 v6wildcard [::]:123 2024-09-11T10:58:21.250 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-11T10:58:21.250 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Listen normally on 2 lo 127.0.0.1:123 2024-09-11T10:58:21.250 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Listen normally on 3 enp3s0f1 172.21.15.145:123 2024-09-11T10:58:21.251 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Listen normally on 4 lo [::1]:123 2024-09-11T10:58:21.251 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7791%5]:123 2024-09-11T10:58:21.251 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:21 ntpd[18464]: Listening on routing socket on fd #22 for interface updates 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:22.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:22.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:22 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:24.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:24.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:24 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:24.247 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:24 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:24.247 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:24 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:25.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:25.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:25.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:25.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:25.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:25 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:26.219 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:26 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:26.247 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:26 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.247 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:26 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.247 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:26 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:26.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:26 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:26.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:26 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:26.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:26 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:27.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:27.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:27 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:28.217 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:28.217 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:28.217 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:28.217 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:28.217 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:28.217 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:28.217 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:28.217 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:28.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:28.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:28.218 INFO:teuthology.orchestra.run.smithi102.stdout:11 Sep 10:58:28 ntpd[18431]: ntpd: time slew -0.003118 s 2024-09-11T10:58:28.218 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew -0.003118s 2024-09-11T10:58:28.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-11T10:58:28.218 INFO:teuthology.orchestra.run.smithi102.stderr:11 Sep 10:58:28 ntpd[18431]: can't open /var/log/ntpstats/loopstats.20240911: Permission denied 2024-09-11T10:58:28.247 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:28 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:28 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:28 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:28 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:28 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:28.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:28 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:28.273 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T10:58:28.273 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-09-11T10:58:28.273 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T10:58:28.273 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T10:58:28.273 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T10:58:28.274 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:29.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:29.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:29.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:29.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:29 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:30.247 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:30 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:30.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:30 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:30.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:30 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:30.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:30 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:30.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:30 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:30.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:30 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:31.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:31.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:31.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:31.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:31.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T10:58:31.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T10:58:31.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T10:58:31.248 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T10:58:31.249 INFO:teuthology.orchestra.run.smithi145.stdout:11 Sep 10:58:31 ntpd[18464]: ntpd: time slew -0.001804 s 2024-09-11T10:58:31.249 INFO:teuthology.orchestra.run.smithi145.stdout:ntpd: time slew -0.001804s 2024-09-11T10:58:31.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-11T10:58:31.249 INFO:teuthology.orchestra.run.smithi145.stderr:11 Sep 10:58:31 ntpd[18464]: can't open /var/log/ntpstats/loopstats.20240911: Permission denied 2024-09-11T10:58:31.297 INFO:teuthology.orchestra.run.smithi145.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T10:58:31.298 INFO:teuthology.orchestra.run.smithi145.stdout:============================================================================== 2024-09-11T10:58:31.298 INFO:teuthology.orchestra.run.smithi145.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T10:58:31.298 INFO:teuthology.orchestra.run.smithi145.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T10:58:31.298 INFO:teuthology.orchestra.run.smithi145.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T10:58:31.298 INFO:teuthology.orchestra.run.smithi145.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T10:58:31.298 INFO:teuthology.run_tasks:Running task install... 2024-09-11T10:58:31.306 DEBUG:teuthology.task.install:project ceph 2024-09-11T10:58:31.307 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T10:58:31.307 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T10:58:31.307 INFO:teuthology.task.install:Using flavor: default 2024-09-11T10:58:31.312 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T10:58:31.313 INFO:teuthology.task.install:extra packages: [] 2024-09-11T10:58:31.313 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2024-09-11T10:58:31.314 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-key list | grep Ceph 2024-09-11T10:58:31.377 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-11T10:58:31.394 INFO:teuthology.orchestra.run.smithi145.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-11T10:58:31.406 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-11T10:58:31.406 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2024-09-11T10:58:31.407 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-11T10:58:31.407 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T10:58:31.421 INFO:teuthology.orchestra.run.smithi145.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-11T10:58:31.421 INFO:teuthology.orchestra.run.smithi145.stdout:uid [ unknown] Ceph.com (release key) 2024-09-11T10:58:31.421 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-11T10:58:31.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T10:58:31.553 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-11T10:58:31.553 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T10:58:31.566 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-11T10:58:31.567 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T10:58:31.662 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T10:58:31.662 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-11T10:58:31.676 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T10:58:31.676 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-11T10:58:31.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-11T10:58:31.691 DEBUG:teuthology.orchestra.run.smithi145:> sudo apt-get update 2024-09-11T10:58:31.849 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T10:58:31.858 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T10:58:31.861 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T10:58:31.870 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T10:58:31.875 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T10:58:31.887 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T10:58:31.904 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-11T10:58:31.916 INFO:teuthology.orchestra.run.smithi145.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-11T10:58:31.926 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-11T10:58:31.937 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-11T10:58:31.948 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-11T10:58:31.959 INFO:teuthology.orchestra.run.smithi145.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-11T10:58:31.969 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-11T10:58:31.975 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T10:58:31.980 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-11T10:58:31.985 INFO:teuthology.orchestra.run.smithi145.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T10:58:31.996 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-11T10:58:32.007 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-11T10:58:32.205 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 29.0 kB in 0s (84.9 kB/s) 2024-09-11T10:58:32.218 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 29.0 kB in 0s (83.6 kB/s) 2024-09-11T10:58:33.214 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T10:58:33.231 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy 2024-09-11T10:58:33.247 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-09-11T10:58:33.264 DEBUG:teuthology.orchestra.run.smithi145:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy 2024-09-11T10:58:33.295 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-11T10:58:33.329 INFO:teuthology.orchestra.run.smithi145.stdout:Reading package lists... 2024-09-11T10:58:33.508 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-11T10:58:33.509 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-11T10:58:33.537 INFO:teuthology.orchestra.run.smithi145.stdout:Building dependency tree... 2024-09-11T10:58:33.538 INFO:teuthology.orchestra.run.smithi145.stdout:Reading state information... 2024-09-11T10:58:33.703 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T10:58:33.703 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T10:58:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T10:58:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T10:58:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T10:58:33.704 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T10:58:33.704 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T10:58:33.705 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-11T10:58:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-11T10:58:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-11T10:58:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T10:58:33.705 INFO:teuthology.orchestra.run.smithi102.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-11T10:58:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-11T10:58:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-11T10:58:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-11T10:58:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-11T10:58:33.706 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-11T10:58:33.707 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet zip 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-11T10:58:33.708 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-09-11T10:58:33.709 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2024-09-11T10:58:33.729 INFO:teuthology.orchestra.run.smithi145.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T10:58:33.729 INFO:teuthology.orchestra.run.smithi145.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T10:58:33.729 INFO:teuthology.orchestra.run.smithi145.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T10:58:33.730 INFO:teuthology.orchestra.run.smithi145.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T10:58:33.730 INFO:teuthology.orchestra.run.smithi145.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T10:58:33.730 INFO:teuthology.orchestra.run.smithi145.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T10:58:33.730 INFO:teuthology.orchestra.run.smithi145.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T10:58:33.731 INFO:teuthology.orchestra.run.smithi145.stdout:The following additional packages will be installed: 2024-09-11T10:58:33.731 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-11T10:58:33.731 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-11T10:58:33.731 INFO:teuthology.orchestra.run.smithi145.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T10:58:33.731 INFO:teuthology.orchestra.run.smithi145.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T10:58:33.733 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: xmlstarlet zip 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout:Suggested packages: 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-11T10:58:33.734 INFO:teuthology.orchestra.run.smithi145.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-11T10:58:33.735 INFO:teuthology.orchestra.run.smithi145.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-11T10:58:33.735 INFO:teuthology.orchestra.run.smithi145.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-11T10:58:33.735 INFO:teuthology.orchestra.run.smithi145.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-11T10:58:33.735 INFO:teuthology.orchestra.run.smithi145.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-11T10:58:33.735 INFO:teuthology.orchestra.run.smithi145.stdout:Recommended packages: 2024-09-11T10:58:33.735 INFO:teuthology.orchestra.run.smithi145.stdout: btrfs-tools 2024-09-11T10:58:33.811 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-11T10:58:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-11T10:58:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-11T10:58:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-11T10:58:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-11T10:58:33.811 INFO:teuthology.orchestra.run.smithi102.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-11T10:58:33.812 INFO:teuthology.orchestra.run.smithi102.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T10:58:33.813 INFO:teuthology.orchestra.run.smithi102.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T10:58:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-11T10:58:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-11T10:58:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-11T10:58:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-11T10:58:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-11T10:58:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-11T10:58:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-11T10:58:33.814 INFO:teuthology.orchestra.run.smithi102.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-11T10:58:33.836 INFO:teuthology.orchestra.run.smithi145.stdout:The following NEW packages will be installed: 2024-09-11T10:58:33.836 INFO:teuthology.orchestra.run.smithi145.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-11T10:58:33.836 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-11T10:58:33.836 INFO:teuthology.orchestra.run.smithi145.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-11T10:58:33.837 INFO:teuthology.orchestra.run.smithi145.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-11T10:58:33.837 INFO:teuthology.orchestra.run.smithi145.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T10:58:33.838 INFO:teuthology.orchestra.run.smithi145.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T10:58:33.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-11T10:58:33.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-11T10:58:33.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-11T10:58:33.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-11T10:58:33.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-11T10:58:33.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-11T10:58:33.839 INFO:teuthology.orchestra.run.smithi145.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-11T10:58:33.839 INFO:teuthology.orchestra.run.smithi145.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-11T10:58:33.871 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-11T10:58:33.871 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 181 MB of archives. 2024-09-11T10:58:33.871 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-11T10:58:33.871 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-11T10:58:33.898 INFO:teuthology.orchestra.run.smithi145.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-11T10:58:33.898 INFO:teuthology.orchestra.run.smithi145.stdout:Need to get 181 MB of archives. 2024-09-11T10:58:33.898 INFO:teuthology.orchestra.run.smithi145.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-11T10:58:33.898 INFO:teuthology.orchestra.run.smithi145.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-11T10:58:33.951 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-11T10:58:33.958 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-11T10:58:33.961 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-11T10:58:33.978 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-11T10:58:33.982 INFO:teuthology.orchestra.run.smithi145.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-11T10:58:33.985 INFO:teuthology.orchestra.run.smithi145.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-11T10:58:33.988 INFO:teuthology.orchestra.run.smithi145.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-11T10:58:34.005 INFO:teuthology.orchestra.run.smithi145.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-11T10:58:34.030 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-11T10:58:34.035 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-11T10:58:34.048 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-11T10:58:34.052 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-11T10:58:34.053 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-11T10:58:34.054 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-11T10:58:34.056 INFO:teuthology.orchestra.run.smithi145.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-11T10:58:34.059 INFO:teuthology.orchestra.run.smithi145.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-11T10:58:34.062 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-11T10:58:34.064 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-11T10:58:34.067 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-11T10:58:34.068 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-11T10:58:34.069 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-11T10:58:34.069 INFO:teuthology.orchestra.run.smithi145.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-11T10:58:34.073 INFO:teuthology.orchestra.run.smithi145.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-11T10:58:34.074 INFO:teuthology.orchestra.run.smithi145.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-11T10:58:34.075 INFO:teuthology.orchestra.run.smithi145.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-11T10:58:34.083 INFO:teuthology.orchestra.run.smithi145.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-11T10:58:34.085 INFO:teuthology.orchestra.run.smithi145.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-11T10:58:34.085 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-11T10:58:34.087 INFO:teuthology.orchestra.run.smithi145.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-11T10:58:34.087 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-11T10:58:34.088 INFO:teuthology.orchestra.run.smithi145.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-11T10:58:34.089 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-11T10:58:34.090 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-11T10:58:34.090 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-11T10:58:34.091 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-11T10:58:34.093 INFO:teuthology.orchestra.run.smithi145.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-11T10:58:34.095 INFO:teuthology.orchestra.run.smithi145.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-11T10:58:34.097 INFO:teuthology.orchestra.run.smithi145.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-11T10:58:34.102 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-11T10:58:34.102 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-11T10:58:34.103 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-11T10:58:34.103 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-11T10:58:34.110 INFO:teuthology.orchestra.run.smithi145.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-11T10:58:34.111 INFO:teuthology.orchestra.run.smithi145.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-11T10:58:34.111 INFO:teuthology.orchestra.run.smithi145.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-11T10:58:34.112 INFO:teuthology.orchestra.run.smithi145.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-11T10:58:34.113 INFO:teuthology.orchestra.run.smithi145.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-11T10:58:34.113 INFO:teuthology.orchestra.run.smithi145.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-11T10:58:34.113 INFO:teuthology.orchestra.run.smithi145.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-11T10:58:34.119 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-11T10:58:34.119 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-11T10:58:34.122 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-11T10:58:34.122 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-11T10:58:34.123 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-11T10:58:34.123 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-11T10:58:34.127 INFO:teuthology.orchestra.run.smithi145.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-11T10:58:34.127 INFO:teuthology.orchestra.run.smithi145.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-11T10:58:34.128 INFO:teuthology.orchestra.run.smithi145.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-11T10:58:34.136 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-11T10:58:34.136 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-11T10:58:34.137 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-11T10:58:34.138 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-11T10:58:34.143 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-11T10:58:34.144 INFO:teuthology.orchestra.run.smithi145.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-11T10:58:34.145 INFO:teuthology.orchestra.run.smithi145.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-11T10:58:34.145 INFO:teuthology.orchestra.run.smithi145.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-11T10:58:34.146 INFO:teuthology.orchestra.run.smithi145.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-11T10:58:34.147 INFO:teuthology.orchestra.run.smithi145.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-11T10:58:34.147 INFO:teuthology.orchestra.run.smithi145.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-11T10:58:34.148 INFO:teuthology.orchestra.run.smithi145.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-11T10:58:34.152 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-11T10:58:34.153 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-11T10:58:34.158 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-11T10:58:34.159 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-11T10:58:34.159 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-11T10:58:34.160 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-11T10:58:34.161 INFO:teuthology.orchestra.run.smithi145.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-11T10:58:34.162 INFO:teuthology.orchestra.run.smithi145.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-11T10:58:34.162 INFO:teuthology.orchestra.run.smithi145.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-11T10:58:34.169 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-11T10:58:34.171 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-11T10:58:34.172 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-11T10:58:34.174 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-11T10:58:34.178 INFO:teuthology.orchestra.run.smithi145.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-11T10:58:34.178 INFO:teuthology.orchestra.run.smithi145.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-11T10:58:34.179 INFO:teuthology.orchestra.run.smithi145.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-11T10:58:34.180 INFO:teuthology.orchestra.run.smithi145.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-11T10:58:34.181 INFO:teuthology.orchestra.run.smithi145.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-11T10:58:34.183 INFO:teuthology.orchestra.run.smithi145.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-11T10:58:34.184 INFO:teuthology.orchestra.run.smithi145.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-11T10:58:34.186 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-11T10:58:34.189 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-11T10:58:34.190 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-11T10:58:34.191 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-11T10:58:34.194 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-11T10:58:34.197 INFO:teuthology.orchestra.run.smithi145.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-11T10:58:34.198 INFO:teuthology.orchestra.run.smithi145.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-11T10:58:34.200 INFO:teuthology.orchestra.run.smithi145.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-11T10:58:34.201 INFO:teuthology.orchestra.run.smithi145.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-11T10:58:34.207 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-11T10:58:34.216 INFO:teuthology.orchestra.run.smithi145.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-11T10:58:34.217 INFO:teuthology.orchestra.run.smithi145.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-11T10:58:34.220 INFO:teuthology.orchestra.run.smithi145.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-11T10:58:34.240 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-11T10:58:34.248 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-11T10:58:34.249 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-11T10:58:34.250 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-11T10:58:34.250 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-11T10:58:34.251 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-11T10:58:34.251 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-11T10:58:34.252 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-11T10:58:34.253 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-11T10:58:34.254 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-11T10:58:34.275 INFO:teuthology.orchestra.run.smithi145.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-11T10:58:34.276 INFO:teuthology.orchestra.run.smithi145.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-11T10:58:34.277 INFO:teuthology.orchestra.run.smithi145.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-11T10:58:34.278 INFO:teuthology.orchestra.run.smithi145.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-11T10:58:34.279 INFO:teuthology.orchestra.run.smithi145.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-11T10:58:34.296 INFO:teuthology.orchestra.run.smithi145.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-11T10:58:34.298 INFO:teuthology.orchestra.run.smithi145.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-11T10:58:34.299 INFO:teuthology.orchestra.run.smithi145.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-11T10:58:34.307 INFO:teuthology.orchestra.run.smithi145.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-11T10:58:34.313 INFO:teuthology.orchestra.run.smithi145.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-11T10:58:34.314 INFO:teuthology.orchestra.run.smithi145.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-11T10:58:34.314 INFO:teuthology.orchestra.run.smithi145.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-11T10:58:34.315 INFO:teuthology.orchestra.run.smithi145.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-11T10:58:34.315 INFO:teuthology.orchestra.run.smithi145.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-11T10:58:34.316 INFO:teuthology.orchestra.run.smithi145.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-11T10:58:34.322 INFO:teuthology.orchestra.run.smithi145.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-11T10:58:34.325 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-11T10:58:34.325 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-11T10:58:34.327 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-11T10:58:34.327 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-11T10:58:34.329 INFO:teuthology.orchestra.run.smithi145.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-11T10:58:34.330 INFO:teuthology.orchestra.run.smithi145.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-11T10:58:34.330 INFO:teuthology.orchestra.run.smithi145.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-11T10:58:34.331 INFO:teuthology.orchestra.run.smithi145.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-11T10:58:34.334 INFO:teuthology.orchestra.run.smithi145.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-11T10:58:34.334 INFO:teuthology.orchestra.run.smithi145.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-11T10:58:34.336 INFO:teuthology.orchestra.run.smithi145.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-11T10:58:34.343 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-11T10:58:34.343 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-11T10:58:34.344 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-11T10:58:34.344 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-11T10:58:34.345 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-11T10:58:34.346 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-11T10:58:34.346 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-11T10:58:34.347 INFO:teuthology.orchestra.run.smithi145.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-11T10:58:34.348 INFO:teuthology.orchestra.run.smithi145.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-11T10:58:34.349 INFO:teuthology.orchestra.run.smithi145.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-11T10:58:34.353 INFO:teuthology.orchestra.run.smithi145.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-11T10:58:34.355 INFO:teuthology.orchestra.run.smithi145.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-11T10:58:34.356 INFO:teuthology.orchestra.run.smithi145.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-11T10:58:34.356 INFO:teuthology.orchestra.run.smithi145.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-11T10:58:34.361 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-11T10:58:34.363 INFO:teuthology.orchestra.run.smithi145.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-11T10:58:34.364 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-11T10:58:34.365 INFO:teuthology.orchestra.run.smithi145.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-11T10:58:34.366 INFO:teuthology.orchestra.run.smithi145.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-11T10:58:34.369 INFO:teuthology.orchestra.run.smithi145.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-11T10:58:34.378 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-11T10:58:34.379 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-11T10:58:34.380 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-11T10:58:34.382 INFO:teuthology.orchestra.run.smithi145.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-11T10:58:34.383 INFO:teuthology.orchestra.run.smithi145.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-11T10:58:34.383 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-11T10:58:34.384 INFO:teuthology.orchestra.run.smithi145.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-11T10:58:34.385 INFO:teuthology.orchestra.run.smithi145.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-11T10:58:34.386 INFO:teuthology.orchestra.run.smithi145.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-11T10:58:34.386 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-11T10:58:34.386 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-11T10:58:34.387 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-11T10:58:34.391 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-11T10:58:34.392 INFO:teuthology.orchestra.run.smithi145.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-11T10:58:34.392 INFO:teuthology.orchestra.run.smithi145.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-11T10:58:34.395 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-11T10:58:34.398 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-11T10:58:34.399 INFO:teuthology.orchestra.run.smithi145.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-11T10:58:34.401 INFO:teuthology.orchestra.run.smithi145.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-11T10:58:34.402 INFO:teuthology.orchestra.run.smithi145.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-11T10:58:34.412 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-11T10:58:34.414 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-11T10:58:34.414 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-11T10:58:34.415 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-11T10:58:34.415 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-11T10:58:34.422 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-11T10:58:34.422 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-11T10:58:34.422 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-11T10:58:34.429 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-11T10:58:34.430 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-11T10:58:34.480 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-11T10:58:34.497 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-11T10:58:34.515 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-11T10:58:34.575 INFO:teuthology.orchestra.run.smithi145.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-11T10:58:34.577 INFO:teuthology.orchestra.run.smithi145.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-11T10:58:34.615 INFO:teuthology.orchestra.run.smithi145.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-11T10:58:35.455 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-11T10:58:35.533 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-11T10:58:35.544 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-11T10:58:35.546 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-11T10:58:35.571 INFO:teuthology.orchestra.run.smithi102.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-11T10:58:35.574 INFO:teuthology.orchestra.run.smithi145.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-11T10:58:35.663 INFO:teuthology.orchestra.run.smithi145.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-11T10:58:35.672 INFO:teuthology.orchestra.run.smithi145.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-11T10:58:35.673 INFO:teuthology.orchestra.run.smithi145.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-11T10:58:35.723 INFO:teuthology.orchestra.run.smithi145.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-11T10:58:35.781 INFO:teuthology.orchestra.run.smithi102.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-11T10:58:35.925 INFO:teuthology.orchestra.run.smithi145.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-11T10:58:36.635 INFO:teuthology.orchestra.run.smithi102.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-11T10:58:36.636 INFO:teuthology.orchestra.run.smithi102.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-11T10:58:36.652 INFO:teuthology.orchestra.run.smithi102.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-11T10:58:36.694 INFO:teuthology.orchestra.run.smithi102.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-11T10:58:36.704 INFO:teuthology.orchestra.run.smithi102.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-11T10:58:36.706 INFO:teuthology.orchestra.run.smithi102.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-11T10:58:36.725 INFO:teuthology.orchestra.run.smithi145.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-11T10:58:36.725 INFO:teuthology.orchestra.run.smithi145.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-11T10:58:36.741 INFO:teuthology.orchestra.run.smithi145.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-11T10:58:36.749 INFO:teuthology.orchestra.run.smithi102.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-11T10:58:36.782 INFO:teuthology.orchestra.run.smithi145.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-11T10:58:36.802 INFO:teuthology.orchestra.run.smithi145.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-11T10:58:36.805 INFO:teuthology.orchestra.run.smithi145.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-11T10:58:36.871 INFO:teuthology.orchestra.run.smithi145.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-11T10:58:37.044 INFO:teuthology.orchestra.run.smithi102.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-11T10:58:37.044 INFO:teuthology.orchestra.run.smithi102.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-11T10:58:37.153 INFO:teuthology.orchestra.run.smithi145.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-11T10:58:37.153 INFO:teuthology.orchestra.run.smithi145.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-11T10:58:39.073 INFO:teuthology.orchestra.run.smithi145.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-11T10:58:39.076 INFO:teuthology.orchestra.run.smithi145.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-11T10:58:39.077 INFO:teuthology.orchestra.run.smithi145.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-11T10:58:39.122 INFO:teuthology.orchestra.run.smithi102.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-11T10:58:39.208 INFO:teuthology.orchestra.run.smithi102.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-11T10:58:39.209 INFO:teuthology.orchestra.run.smithi102.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-11T10:58:39.324 INFO:teuthology.orchestra.run.smithi145.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-11T10:58:39.492 INFO:teuthology.orchestra.run.smithi102.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-11T10:58:39.856 INFO:teuthology.orchestra.run.smithi145.stdout:Fetched 181 MB in 5s (33.0 MB/s) 2024-09-11T10:58:40.021 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-11T10:58:40.057 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 181 MB in 6s (31.9 MB/s) 2024-09-11T10:58:40.122 INFO:teuthology.orchestra.run.smithi145.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-11T10:58:40.128 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-11T10:58:40.187 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-11T10:58:40.211 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T10:58:40.285 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-11T10:58:40.290 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-11T10:58:40.360 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T10:58:40.548 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-11T10:58:40.574 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-11T10:58:40.614 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T10:58:40.656 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-11T10:58:40.681 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-11T10:58:40.722 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T10:58:40.959 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-11T10:58:40.986 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-11T10:58:41.026 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T10:58:41.033 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-11T10:58:41.060 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-11T10:58:41.100 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T10:58:41.480 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-11T10:58:41.506 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T10:58:41.537 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-11T10:58:41.554 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:58:41.563 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T10:58:41.648 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:58:41.941 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-11T10:58:41.967 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T10:58:41.999 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:58:42.048 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-11T10:58:42.075 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T10:58:42.115 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:58:42.344 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-11T10:58:42.370 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T10:58:42.410 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:58:42.459 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-11T10:58:42.486 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T10:58:42.526 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:58:42.789 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-11T10:58:42.815 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-11T10:58:42.855 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T10:58:42.879 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-11T10:58:42.905 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-11T10:58:42.954 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T10:58:43.166 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librados2. 2024-09-11T10:58:43.193 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../007-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:43.233 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:43.240 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librados2. 2024-09-11T10:58:43.266 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:43.298 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:43.652 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librbd1. 2024-09-11T10:58:43.679 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../008-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:43.719 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:43.768 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librbd1. 2024-09-11T10:58:43.794 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:43.835 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:44.147 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libcephfs2. 2024-09-11T10:58:44.173 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:44.213 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:44.279 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2024-09-11T10:58:44.305 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:44.346 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:44.623 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2024-09-11T10:58:44.638 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:44.681 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:44.882 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rados. 2024-09-11T10:58:44.909 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../010-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:44.949 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:44.951 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-11T10:58:44.977 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:58:45.017 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:45.269 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-11T10:58:45.286 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2024-09-11T10:58:45.295 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:58:45.313 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:45.326 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:45.353 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:45.538 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cephfs. 2024-09-11T10:58:45.564 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:45.604 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:45.664 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-11T10:58:45.690 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:58:45.730 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:45.907 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-11T10:58:45.934 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:58:45.973 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:46.059 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-11T10:58:46.085 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-11T10:58:46.125 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T10:58:46.293 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-11T10:58:46.320 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-11T10:58:46.359 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T10:58:46.389 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2024-09-11T10:58:46.401 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-11T10:58:46.436 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-11T10:58:46.663 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-prettytable. 2024-09-11T10:58:46.689 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2024-09-11T10:58:46.689 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-11T10:58:46.704 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:46.729 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-11T10:58:46.747 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:46.965 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rbd. 2024-09-11T10:58:46.992 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:47.032 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:47.100 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-11T10:58:47.127 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-11T10:58:47.167 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T10:58:47.376 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-11T10:58:47.403 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-11T10:58:47.436 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-11T10:58:47.443 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T10:58:47.451 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-11T10:58:47.486 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T10:58:47.737 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-11T10:58:47.764 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-11T10:58:47.765 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-11T10:58:47.791 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-11T10:58:47.804 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T10:58:47.830 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T10:58:48.098 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-11T10:58:48.114 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-11T10:58:48.148 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T10:58:48.150 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua5.1. 2024-09-11T10:58:48.177 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-11T10:58:48.217 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-11T10:58:48.436 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package lua5.1. 2024-09-11T10:58:48.462 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-11T10:58:48.501 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-11T10:58:48.537 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-any. 2024-09-11T10:58:48.563 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-11T10:58:48.603 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-11T10:58:48.797 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package zip. 2024-09-11T10:58:48.812 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-11T10:58:48.838 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package lua-any. 2024-09-11T10:58:48.848 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking zip (3.0-12build2) ... 2024-09-11T10:58:48.865 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-11T10:58:48.905 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-11T10:58:49.151 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package unzip. 2024-09-11T10:58:49.174 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package zip. 2024-09-11T10:58:49.177 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-11T10:58:49.189 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-11T10:58:49.217 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-11T10:58:49.232 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking zip (3.0-12build2) ... 2024-09-11T10:58:49.610 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package unzip. 2024-09-11T10:58:49.637 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-11T10:58:49.685 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-11T10:58:49.855 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package luarocks. 2024-09-11T10:58:49.881 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-11T10:58:49.921 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-11T10:58:50.214 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package luarocks. 2024-09-11T10:58:50.241 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-11T10:58:50.279 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2024-09-11T10:58:50.281 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-11T10:58:50.305 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:50.345 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:50.655 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package librgw2. 2024-09-11T10:58:50.682 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../025-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:50.722 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:50.831 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2024-09-11T10:58:50.846 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:50.889 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:51.209 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-11T10:58:51.235 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-11T10:58:51.275 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T10:58:51.282 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rgw. 2024-09-11T10:58:51.298 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:51.341 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:51.595 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2024-09-11T10:58:51.621 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:51.661 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:51.685 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-11T10:58:51.712 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-11T10:58:51.752 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T10:58:51.998 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2024-09-11T10:58:52.024 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:52.030 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libradosstriper1. 2024-09-11T10:58:52.056 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:52.057 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:52.088 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:52.542 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-common. 2024-09-11T10:58:52.569 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../029-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:52.616 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:53.437 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2024-09-11T10:58:53.463 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:53.512 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:54.022 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-base. 2024-09-11T10:58:54.048 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../030-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:58:54.091 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-11T10:58:54.097 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:58:54.117 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-11T10:58:54.158 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-11T10:58:54.444 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cheroot. 2024-09-11T10:58:54.470 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-11T10:58:54.510 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T10:58:54.676 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-11T10:58:54.702 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-11T10:58:54.742 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-11T10:58:54.788 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-11T10:58:54.804 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-11T10:58:54.838 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-11T10:58:55.175 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-11T10:58:55.187 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cheroot. 2024-09-11T10:58:55.206 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-11T10:58:55.213 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-11T10:58:55.241 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-11T10:58:55.255 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T10:58:55.544 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-11T10:58:55.565 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-11T10:58:55.571 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-11T10:58:55.591 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-11T10:58:55.610 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-11T10:58:55.631 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-11T10:58:55.871 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempora. 2024-09-11T10:58:55.886 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-11T10:58:55.921 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-11T10:58:55.942 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-11T10:58:55.969 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-11T10:58:56.009 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-11T10:58:56.166 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-portend. 2024-09-11T10:58:56.192 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-11T10:58:56.233 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-11T10:58:56.287 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-11T10:58:56.313 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-11T10:58:56.353 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-11T10:58:56.536 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-11T10:58:56.562 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-11T10:58:56.602 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-11T10:58:56.623 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-tempora. 2024-09-11T10:58:56.650 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-11T10:58:56.689 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-11T10:58:56.905 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-11T10:58:56.931 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-11T10:58:56.971 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-11T10:58:57.001 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-portend. 2024-09-11T10:58:57.027 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-11T10:58:57.067 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-11T10:58:57.309 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-natsort. 2024-09-11T10:58:57.335 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-11T10:58:57.370 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-11T10:58:57.375 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-11T10:58:57.397 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-11T10:58:57.437 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-11T10:58:57.686 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2024-09-11T10:58:57.698 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-11T10:58:57.713 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-11T10:58:57.725 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-11T10:58:57.753 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-11T10:58:57.756 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-11T10:58:58.056 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-11T10:58:58.082 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-11T10:58:58.093 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-natsort. 2024-09-11T10:58:58.120 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-11T10:58:58.122 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-11T10:58:58.159 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-11T10:58:58.375 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2024-09-11T10:58:58.390 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-11T10:58:58.433 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T10:58:58.480 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-logutils. 2024-09-11T10:58:58.506 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-11T10:58:58.546 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-11T10:58:58.770 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-11T10:58:58.796 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-11T10:58:58.798 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-11T10:58:58.814 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-11T10:58:58.837 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-11T10:58:58.848 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-11T10:58:59.139 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-11T10:58:59.151 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-mako. 2024-09-11T10:58:59.166 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-11T10:58:59.178 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-11T10:58:59.206 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-11T10:58:59.218 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T10:58:59.467 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2024-09-11T10:58:59.494 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-11T10:58:59.533 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T10:58:59.571 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-11T10:58:59.598 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-11T10:58:59.638 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-11T10:58:59.853 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2024-09-11T10:58:59.880 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-11T10:58:59.923 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T10:58:59.941 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-11T10:58:59.968 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-11T10:59:00.007 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-11T10:59:00.214 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2024-09-11T10:59:00.241 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-11T10:59:00.281 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T10:59:00.435 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-webob. 2024-09-11T10:59:00.462 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-11T10:59:00.493 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T10:59:00.584 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2024-09-11T10:59:00.610 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-11T10:59:00.650 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T10:59:00.822 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-waitress. 2024-09-11T10:59:00.848 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-11T10:59:00.891 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T10:59:00.979 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-11T10:59:01.006 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-11T10:59:01.037 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T10:59:01.157 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-tempita. 2024-09-11T10:59:01.173 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-11T10:59:01.216 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T10:59:01.331 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-11T10:59:01.358 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-11T10:59:01.398 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-11T10:59:01.519 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-paste. 2024-09-11T10:59:01.545 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-11T10:59:01.585 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T10:59:01.709 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2024-09-11T10:59:01.736 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-11T10:59:01.776 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-11T10:59:01.897 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-11T10:59:01.912 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-11T10:59:01.947 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T10:59:02.106 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2024-09-11T10:59:02.133 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-11T10:59:02.179 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T10:59:02.275 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-11T10:59:02.301 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-11T10:59:02.341 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-11T10:59:02.541 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-certifi. 2024-09-11T10:59:02.568 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-11T10:59:02.608 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-11T10:59:02.653 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-webtest. 2024-09-11T10:59:02.679 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-11T10:59:02.719 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-11T10:59:02.894 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-idna. 2024-09-11T10:59:02.910 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-11T10:59:02.944 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T10:59:03.039 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pecan. 2024-09-11T10:59:03.065 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-11T10:59:03.122 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T10:59:03.247 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-urllib3. 2024-09-11T10:59:03.273 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-11T10:59:03.313 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T10:59:03.485 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-certifi. 2024-09-11T10:59:03.512 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-11T10:59:03.552 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-11T10:59:03.642 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests. 2024-09-11T10:59:03.668 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-11T10:59:03.708 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T10:59:03.854 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-idna. 2024-09-11T10:59:03.870 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-11T10:59:03.913 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T10:59:04.003 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-11T10:59:04.030 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-11T10:59:04.069 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T10:59:04.207 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-urllib3. 2024-09-11T10:59:04.234 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-11T10:59:04.274 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T10:59:04.373 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-11T10:59:04.399 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:04.439 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:04.569 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-requests. 2024-09-11T10:59:04.595 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-11T10:59:04.635 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T10:59:04.827 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-11T10:59:04.854 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:04.894 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:04.955 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-11T10:59:04.982 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-11T10:59:05.021 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T10:59:05.299 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-11T10:59:05.315 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:05.333 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-11T10:59:05.357 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:05.361 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-11T10:59:05.413 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-11T10:59:05.641 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2024-09-11T10:59:05.656 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-11T10:59:05.716 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-11T10:59:05.771 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-11T10:59:05.797 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:05.837 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:06.061 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2024-09-11T10:59:06.087 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:06.127 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:06.149 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-11T10:59:06.175 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-11T10:59:06.215 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-11T10:59:06.518 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-openssl. 2024-09-11T10:59:06.538 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2024-09-11T10:59:06.544 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-11T10:59:06.566 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:06.584 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-11T10:59:06.605 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:06.971 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr. 2024-09-11T10:59:06.997 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:07.046 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:07.217 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2024-09-11T10:59:07.244 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:07.283 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:08.287 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2024-09-11T10:59:08.313 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:08.316 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mon. 2024-09-11T10:59:08.342 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:08.353 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:08.382 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:08.681 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2024-09-11T10:59:08.708 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:08.747 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:08.986 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-osd. 2024-09-11T10:59:09.012 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:09.052 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:09.117 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2024-09-11T10:59:09.144 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:09.184 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:09.562 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2024-09-11T10:59:09.588 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:09.628 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:09.889 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-11T10:59:09.904 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-11T10:59:09.947 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-11T10:59:10.114 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph. 2024-09-11T10:59:10.129 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../066-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:10.164 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:10.259 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-11T10:59:10.285 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T10:59:10.325 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T10:59:10.458 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-fuse. 2024-09-11T10:59:10.485 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:10.524 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:11.086 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mds. 2024-09-11T10:59:11.113 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:11.152 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:11.330 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-babel. 2024-09-11T10:59:11.346 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T10:59:11.380 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T10:59:11.581 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package cephadm. 2024-09-11T10:59:11.607 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../069-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:11.647 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:11.691 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2024-09-11T10:59:11.718 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-11T10:59:11.757 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T10:59:11.958 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-11T10:59:11.985 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-11T10:59:12.025 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-11T10:59:12.111 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-11T10:59:12.138 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:12.177 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:12.336 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-11T10:59:12.351 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T10:59:12.394 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T10:59:12.531 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-11T10:59:12.558 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-11T10:59:12.597 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-11T10:59:12.900 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2024-09-11T10:59:12.927 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-11T10:59:12.966 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T10:59:13.312 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-11T10:59:13.338 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:13.378 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:13.491 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-babel. 2024-09-11T10:59:13.518 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T10:59:13.557 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T10:59:13.852 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-jinja2. 2024-09-11T10:59:13.880 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-11T10:59:13.910 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T10:59:14.230 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-11T10:59:14.257 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:14.297 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:14.584 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-11T10:59:14.600 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-11T10:59:14.610 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-11T10:59:14.627 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-11T10:59:14.650 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-11T10:59:14.666 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T10:59:14.953 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-routes. 2024-09-11T10:59:14.979 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-11T10:59:15.019 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T10:59:15.128 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2024-09-11T10:59:15.155 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-11T10:59:15.194 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T10:59:15.366 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-11T10:59:15.393 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:15.432 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:15.506 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-11T10:59:15.533 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-11T10:59:15.564 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-11T10:59:16.017 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2024-09-11T10:59:16.045 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-11T10:59:16.083 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T10:59:16.671 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-11T10:59:16.686 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-11T10:59:16.720 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T10:59:16.851 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-11T10:59:16.878 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:16.996 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:17.216 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-joblib. 2024-09-11T10:59:17.243 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-11T10:59:17.282 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T10:59:17.678 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-11T10:59:17.705 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-11T10:59:17.744 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-11T10:59:17.941 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2024-09-11T10:59:17.968 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-11T10:59:18.007 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-11T10:59:18.030 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-sklearn. 2024-09-11T10:59:18.057 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-11T10:59:18.088 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T10:59:18.311 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-11T10:59:18.338 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-11T10:59:18.377 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-11T10:59:18.706 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-11T10:59:18.733 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-11T10:59:18.772 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T10:59:18.780 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-11T10:59:18.807 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:18.941 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2024-09-11T10:59:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-11T10:59:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-11T10:59:19.471 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2024-09-11T10:59:19.498 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-11T10:59:19.537 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-11T10:59:19.861 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-cachetools. 2024-09-11T10:59:19.865 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-11T10:59:19.888 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-11T10:59:19.893 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-11T10:59:19.927 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-11T10:59:19.932 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T10:59:20.230 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-11T10:59:20.235 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2024-09-11T10:59:20.257 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-11T10:59:20.262 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-11T10:59:20.296 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-11T10:59:20.301 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-11T10:59:20.613 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-11T10:59:20.641 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-11T10:59:20.642 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-11T10:59:20.669 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-11T10:59:20.679 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T10:59:20.708 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T10:59:21.117 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-rsa. 2024-09-11T10:59:21.145 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-11T10:59:21.270 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-11T10:59:21.294 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-11T10:59:21.322 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:21.360 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:21.557 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-google-auth. 2024-09-11T10:59:21.584 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-11T10:59:21.623 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-11T10:59:21.688 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-11T10:59:21.715 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-11T10:59:21.754 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T10:59:21.943 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-11T10:59:21.970 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-11T10:59:22.010 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T10:59:22.083 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-11T10:59:22.110 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T10:59:22.149 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T10:59:22.329 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-websocket. 2024-09-11T10:59:22.356 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-11T10:59:22.368 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2024-09-11T10:59:22.384 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T10:59:22.395 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-11T10:59:22.418 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-11T10:59:22.671 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2024-09-11T10:59:22.687 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-11T10:59:22.724 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-11T10:59:22.729 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-11T10:59:22.751 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-11T10:59:22.791 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T10:59:23.016 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2024-09-11T10:59:23.032 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-11T10:59:23.074 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-11T10:59:23.395 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2024-09-11T10:59:23.411 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:23.438 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-11T10:59:23.445 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:23.466 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:23.504 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:23.782 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-11T10:59:23.809 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-11T10:59:23.848 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T10:59:24.193 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-11T10:59:24.220 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T10:59:24.260 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T10:59:24.529 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package jq. 2024-09-11T10:59:24.556 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T10:59:24.612 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-11T10:59:24.874 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package socat. 2024-09-11T10:59:24.901 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-11T10:59:24.932 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-11T10:59:25.210 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package xmlstarlet. 2024-09-11T10:59:25.226 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-11T10:59:25.268 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-11T10:59:25.616 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-volume. 2024-09-11T10:59:25.644 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:25.768 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:25.809 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-test. 2024-09-11T10:59:25.836 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../097-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:25.880 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:26.286 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-11T10:59:26.314 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:26.353 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:26.639 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-11T10:59:26.667 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-11T10:59:26.705 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T10:59:27.010 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-11T10:59:27.038 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-11T10:59:27.068 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-11T10:59:27.464 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2024-09-11T10:59:27.492 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-11T10:59:27.547 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T10:59:27.952 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package pkg-config. 2024-09-11T10:59:27.980 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-11T10:59:28.019 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T10:59:28.235 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package ceph-volume. 2024-09-11T10:59:28.262 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T10:59:28.280 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-11T10:59:28.296 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-11T10:59:28.301 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:28.330 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-11T10:59:28.605 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-11T10:59:28.621 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:28.663 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:28.758 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-11T10:59:28.786 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-11T10:59:28.825 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-11T10:59:28.950 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-11T10:59:28.977 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-11T10:59:29.008 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T10:59:29.094 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2024-09-11T10:59:29.122 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-11T10:59:29.152 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-11T10:59:29.312 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-11T10:59:29.340 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-11T10:59:29.379 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-11T10:59:29.464 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2024-09-11T10:59:29.492 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-11T10:59:29.531 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-11T10:59:29.758 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package nvme-cli. 2024-09-11T10:59:29.786 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-11T10:59:29.824 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T10:59:29.842 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2024-09-11T10:59:29.869 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-11T10:59:29.908 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-11T10:59:30.229 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package pkg-config. 2024-09-11T10:59:30.253 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2024-09-11T10:59:30.257 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-11T10:59:30.281 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-11T10:59:30.295 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T10:59:30.328 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-11T10:59:30.549 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-11T10:59:30.566 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-11T10:59:30.599 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-11T10:59:30.631 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pygments. 2024-09-11T10:59:30.659 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-11T10:59:30.698 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T10:59:30.977 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-11T10:59:31.005 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-11T10:59:31.035 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-11T10:59:31.185 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-11T10:59:31.213 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-11T10:59:31.252 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-11T10:59:31.313 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pastescript. 2024-09-11T10:59:31.341 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-11T10:59:31.379 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-11T10:59:31.588 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-toml. 2024-09-11T10:59:31.616 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-11T10:59:31.654 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-11T10:59:31.957 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2024-09-11T10:59:31.966 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pluggy. 2024-09-11T10:59:31.984 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-11T10:59:31.993 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-11T10:59:32.023 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T10:59:32.032 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-11T10:59:32.310 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-psutil. 2024-09-11T10:59:32.338 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-11T10:59:32.368 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-11T10:59:32.377 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2024-09-11T10:59:32.405 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-11T10:59:32.443 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-11T10:59:32.696 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-py. 2024-09-11T10:59:32.713 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-11T10:59:32.724 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-11T10:59:32.744 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-11T10:59:32.763 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-11T10:59:32.779 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-11T10:59:33.058 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pygments. 2024-09-11T10:59:33.086 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-11T10:59:33.116 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T10:59:33.492 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2024-09-11T10:59:33.503 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-11T10:59:33.519 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../116-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:33.527 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-11T10:59:33.558 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:33.570 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-11T10:59:33.914 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-toml. 2024-09-11T10:59:33.942 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-11T10:59:33.980 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-11T10:59:34.284 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-pytest. 2024-09-11T10:59:34.311 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-11T10:59:34.350 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T10:59:34.378 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2024-09-11T10:59:34.406 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:34.436 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:34.695 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package python3-simplejson. 2024-09-11T10:59:34.723 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-11T10:59:34.741 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-11T10:59:34.762 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-11T10:59:34.992 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T10:59:35.022 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-11T10:59:35.038 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-11T10:59:35.081 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-11T10:59:35.118 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T10:59:35.391 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-11T10:59:35.740 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-11T10:59:35.818 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package radosgw. 2024-09-11T10:59:35.846 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../116-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:35.885 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:36.181 INFO:teuthology.orchestra.run.smithi102.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-11T10:59:36.253 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:36.671 INFO:teuthology.orchestra.run.smithi145.stdout:Selecting previously unselected package rbd-fuse. 2024-09-11T10:59:36.687 INFO:teuthology.orchestra.run.smithi145.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T10:59:36.703 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2024-09-11T10:59:36.729 INFO:teuthology.orchestra.run.smithi145.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:36.851 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T10:59:37.050 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-11T10:59:37.127 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-11T10:59:37.284 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T10:59:37.378 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-11T10:59:37.410 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T10:59:37.496 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-11T10:59:37.674 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-11T10:59:37.731 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-11T10:59:37.982 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T10:59:38.001 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-11T10:59:38.108 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-11T10:59:38.410 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T10:59:38.455 INFO:teuthology.orchestra.run.smithi145.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-11T10:59:38.520 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:38.770 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-11T10:59:39.013 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-11T10:59:39.029 INFO:teuthology.orchestra.run.smithi145.stdout:Adding system user cephadm....done 2024-09-11T10:59:39.185 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T10:59:39.256 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-11T10:59:39.461 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-11T10:59:39.515 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-11T10:59:39.712 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-11T10:59:39.766 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-11T10:59:39.813 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-11T10:59:40.026 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-11T10:59:40.048 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-11T10:59:40.277 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:40.290 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T10:59:40.417 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-11T10:59:40.636 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T10:59:40.718 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T10:59:40.737 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T10:59:40.838 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T10:59:40.964 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-11T10:59:41.087 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-11T10:59:41.216 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-11T10:59:41.347 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-11T10:59:41.623 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-11T10:59:41.769 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-11T10:59:41.858 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-11T10:59:41.947 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-11T10:59:42.011 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T10:59:42.117 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-11T10:59:42.136 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-11T10:59:42.385 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-11T10:59:42.479 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T10:59:42.580 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-11T10:59:42.653 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:42.840 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T10:59:42.996 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T10:59:43.099 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-11T10:59:43.122 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T10:59:43.231 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T10:59:43.332 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-11T10:59:43.401 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up zip (3.0-12build2) ... 2024-09-11T10:59:43.527 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T10:59:43.575 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-11T10:59:43.951 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-11T10:59:43.981 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-11T10:59:44.045 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T10:59:44.171 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-11T10:59:44.212 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T10:59:44.455 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T10:59:44.530 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T10:59:44.573 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-11T10:59:44.665 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-11T10:59:44.698 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T10:59:44.932 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T10:59:44.992 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-11T10:59:45.209 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-11T10:59:45.384 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-11T10:59:45.518 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up zip (3.0-12build2) ... 2024-09-11T10:59:45.644 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T10:59:45.749 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T10:59:46.028 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T10:59:46.321 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T10:59:46.321 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T10:59:46.605 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T10:59:46.677 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-11T10:59:46.732 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-11T10:59:46.858 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T10:59:46.924 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-11T10:59:47.050 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:47.360 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T10:59:47.450 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-11T10:59:47.686 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T10:59:47.843 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-11T10:59:48.111 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T10:59:48.487 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T10:59:48.780 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T10:59:48.917 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T10:59:49.115 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-11T10:59:49.185 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:59:49.319 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-11T10:59:49.358 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-11T10:59:49.484 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:49.570 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T10:59:49.680 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-11T10:59:49.794 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T10:59:49.806 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T10:59:50.107 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-11T10:59:50.128 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T10:59:50.367 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-11T10:59:50.626 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:59:50.752 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-11T10:59:51.062 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-11T10:59:51.313 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-11T10:59:51.367 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T10:59:51.556 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-11T10:59:51.627 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:59:51.761 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-11T10:59:51.807 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-11T10:59:52.029 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T10:59:52.075 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-11T10:59:52.155 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-11T10:59:52.264 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T10:59:52.342 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T10:59:52.468 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-11T10:59:52.541 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-11T10:59:52.753 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T10:59:52.809 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-11T10:59:52.854 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T10:59:53.068 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:59:53.147 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T10:59:53.219 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-11T10:59:53.448 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-11T10:59:53.562 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-11T10:59:53.707 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T10:59:53.813 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-11T10:59:53.833 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-11T10:59:53.959 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T10:59:54.048 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-11T10:59:54.073 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-11T10:59:54.307 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-11T10:59:54.319 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T10:59:54.429 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T10:59:54.566 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-11T10:59:54.797 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-11T10:59:54.834 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T10:59:54.960 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-11T10:59:55.065 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-11T10:59:55.191 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-11T10:59:55.245 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T10:59:55.371 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T10:59:55.450 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:59:55.576 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T10:59:55.664 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T10:59:55.902 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T10:59:55.949 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-11T10:59:56.187 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T10:59:56.199 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T10:59:56.334 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-11T10:59:56.446 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-11T10:59:56.485 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T10:59:56.556 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-11T10:59:56.591 INFO:teuthology.orchestra.run.smithi145.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-11T10:59:56.823 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-11T10:59:56.861 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T10:59:56.987 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T10:59:57.108 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T10:59:57.389 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-11T10:59:57.453 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-11T10:59:57.640 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-11T10:59:57.758 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-11T10:59:57.830 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-11T10:59:58.017 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T10:59:58.106 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T10:59:58.168 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T10:59:58.450 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T10:59:58.511 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T10:59:58.577 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:58.703 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:58.804 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-11T10:59:58.845 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T10:59:59.115 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:59.121 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-11T10:59:59.241 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:59.256 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-11T10:59:59.367 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-11T10:59:59.524 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-11T10:59:59.660 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:59.786 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T10:59:59.800 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T10:59:59.887 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:00.112 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T11:00:00.112 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T11:00:00.153 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-11T11:00:00.530 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-11T11:00:00.589 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:00.715 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:00.815 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T11:00:00.841 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:00.967 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T11:00:01.150 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T11:00:01.293 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:01.419 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:01.545 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-11T11:00:01.867 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:01.993 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.119 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-11T11:00:02.120 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.232 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.358 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.404 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.484 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.530 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.610 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.656 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:02.878 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T11:00:02.878 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T11:00:03.128 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2024-09-11T11:00:03.391 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:03.488 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2024-09-11T11:00:03.517 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:03.643 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:03.648 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2024-09-11T11:00:03.666 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-11T11:00:03.769 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T11:00:03.800 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-11T11:00:04.111 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-11T11:00:04.603 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:04.721 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:05.014 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:05.157 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:05.174 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T11:00:05.174 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T11:00:05.325 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:05.476 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:05.627 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:05.648 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:06.001 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-11T11:00:06.171 INFO:teuthology.orchestra.run.smithi145.stdout:Adding group ceph....done 2024-09-11T11:00:06.483 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:06.547 INFO:teuthology.orchestra.run.smithi145.stdout:Adding system user ceph....done 2024-09-11T11:00:06.707 INFO:teuthology.orchestra.run.smithi145.stdout:Setting system user ceph properties....done 2024-09-11T11:00:06.715 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T11:00:06.715 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T11:00:06.725 INFO:teuthology.orchestra.run.smithi145.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-11T11:00:06.863 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-11T11:00:07.201 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:07.211 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-11T11:00:07.419 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T11:00:07.420 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T11:00:07.662 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:07.789 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:07.894 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:08.152 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T11:00:08.152 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T11:00:08.264 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T11:00:08.265 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T11:00:08.629 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:08.730 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:08.757 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:08.882 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:09.094 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T11:00:09.095 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T11:00:09.145 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-11T11:00:09.533 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:09.626 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:09.675 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:09.801 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:09.859 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T11:00:09.859 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T11:00:09.936 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:10.297 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T11:00:10.369 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:10.389 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T11:00:10.591 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T11:00:10.591 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T11:00:10.642 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T11:00:11.079 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:11.377 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T11:00:11.377 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T11:00:11.660 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T11:00:11.855 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:11.973 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:12.125 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:12.310 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T11:00:12.316 DEBUG:teuthology.parallel:result is None 2024-09-11T11:00:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T11:00:12.352 INFO:teuthology.orchestra.run.smithi145.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T11:00:12.834 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:13.020 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:13.129 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:13.255 INFO:teuthology.orchestra.run.smithi145.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T11:00:13.634 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T11:00:13.751 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T11:00:13.904 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T11:00:14.980 INFO:teuthology.orchestra.run.smithi145.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T11:00:15.637 INFO:teuthology.orchestra.run.smithi145.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T11:00:15.642 DEBUG:teuthology.parallel:result is None 2024-09-11T11:00:15.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T11:00:15.797 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2024-09-11T11:00:15.816 INFO:teuthology.orchestra.run.smithi102.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-11T11:00:15.817 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T11:00:15.817 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-11T11:00:15.818 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T11:00:15.959 DEBUG:teuthology.orchestra.run.smithi145:> dpkg-query -W -f '${Version}' ceph 2024-09-11T11:00:15.979 INFO:teuthology.orchestra.run.smithi145.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-11T11:00:15.979 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T11:00:15.979 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-11T11:00:15.981 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T11:00:15.981 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:15.981 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T11:00:15.995 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:15.996 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T11:00:16.034 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T11:00:16.034 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:16.034 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T11:00:16.050 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T11:00:16.106 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:16.106 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T11:00:16.120 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T11:00:16.174 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T11:00:16.174 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:16.174 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T11:00:16.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T11:00:16.241 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:16.241 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T11:00:16.253 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T11:00:16.305 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T11:00:16.306 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:16.306 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T11:00:16.319 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T11:00:16.373 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:16.373 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T11:00:16.386 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T11:00:16.446 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T11:00:16.518 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T11:00:16.518 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-09-11T11:00:16.520 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 777 /var/log/ceph 2024-09-11T11:00:16.533 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T11:00:16.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T11:00:16.575 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T11:00:16.587 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T11:00:16.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T11:00:16.662 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T11:00:16.720 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T11:00:16.720 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T11:00:16.720 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900804', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'rgw': {'ec-data-pool': False, 'frontend': 'beast'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 5147, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae', 'targets': {'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGOdUeXwjJ1S0M0Zvvf+wQQNBdLWd7QbuGYQQQwuW1pflBihqWrMRRKR1Bb/nahlC8Mqc5zzhy/kVvLUzuk6TBo=', 'smithi145.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAk7Li4Cf4XJ3dwOWSReYhDTUohL/pgots4iDyIIBO30HZ57T+jY2dHwNzNl0fgBtqwtLtKBibyQxMnQCd7SHu0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_21:40:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T11:00:16.721 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T11:00:16.724 DEBUG:teuthology.orchestra.run.smithi145:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T11:00:16.731 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T11:00:16.773 DEBUG:teuthology.orchestra.run.smithi145:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T11:00:16.788 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:16.788 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T11:00:16.830 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T11:00:16.830 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-11T11:00:16.878 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T11:00:16.878 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T11:00:16.879 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 890 Links: 1 2024-09-11T11:00:16.879 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T11:00:16.879 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-11 10:54:49.106422072 +0000 2024-09-11T11:00:16.879 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-11 10:54:48.842466334 +0000 2024-09-11T11:00:16.879 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-11 10:54:48.842466334 +0000 2024-09-11T11:00:16.879 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-11T11:00:16.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T11:00:16.932 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-11T11:00:16.933 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-11T11:00:16.933 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000452896 s, 1.1 MB/s 2024-09-11T11:00:16.934 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T11:00:16.983 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-11T11:00:17.029 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T11:00:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T11:00:17.030 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-09-11T11:00:17.030 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T11:00:17.030 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-11 10:54:49.582344041 +0000 2024-09-11T11:00:17.030 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-11 10:54:49.334384696 +0000 2024-09-11T11:00:17.030 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-11 10:54:49.334384696 +0000 2024-09-11T11:00:17.030 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-11T11:00:17.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T11:00:17.084 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-11T11:00:17.084 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-11T11:00:17.085 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000408683 s, 1.3 MB/s 2024-09-11T11:00:17.086 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T11:00:17.135 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-11T11:00:17.182 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T11:00:17.182 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T11:00:17.182 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-11T11:00:17.182 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T11:00:17.182 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-11 10:54:50.054266873 +0000 2024-09-11T11:00:17.182 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-11 10:54:49.806307320 +0000 2024-09-11T11:00:17.182 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-11 10:54:49.806307320 +0000 2024-09-11T11:00:17.182 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-11T11:00:17.182 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T11:00:17.236 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-11T11:00:17.236 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-11T11:00:17.236 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000368536 s, 1.4 MB/s 2024-09-11T11:00:17.237 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T11:00:17.291 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-11T11:00:17.338 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T11:00:17.338 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T11:00:17.338 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 944 Links: 1 2024-09-11T11:00:17.338 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T11:00:17.339 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-11 10:54:50.550187546 +0000 2024-09-11T11:00:17.339 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-11 10:54:50.290229129 +0000 2024-09-11T11:00:17.339 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-11 10:54:50.290229129 +0000 2024-09-11T11:00:17.339 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: - 2024-09-11T11:00:17.339 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T11:00:17.391 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-11T11:00:17.392 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-11T11:00:17.392 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000289776 s, 1.8 MB/s 2024-09-11T11:00:17.393 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T11:00:17.443 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-11T11:00:17.444 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:17.444 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T11:00:17.449 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T11:00:17.450 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_1 2024-09-11T11:00:17.499 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T11:00:17.499 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T11:00:17.499 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-11T11:00:17.499 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T11:00:17.499 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-11 10:54:51.171815303 +0000 2024-09-11T11:00:17.499 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-11 10:54:50.907817662 +0000 2024-09-11T11:00:17.499 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-11 10:54:50.907817662 +0000 2024-09-11T11:00:17.499 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-09-11T11:00:17.500 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T11:00:17.553 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-11T11:00:17.553 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-11T11:00:17.554 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000390197 s, 1.3 MB/s 2024-09-11T11:00:17.555 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T11:00:17.606 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_2 2024-09-11T11:00:17.655 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T11:00:17.655 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T11:00:17.655 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-09-11T11:00:17.655 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T11:00:17.655 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-11 10:54:51.399813267 +0000 2024-09-11T11:00:17.655 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-11 10:54:51.395813303 +0000 2024-09-11T11:00:17.655 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-11 10:54:51.395813303 +0000 2024-09-11T11:00:17.655 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-09-11T11:00:17.656 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T11:00:17.709 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-11T11:00:17.709 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-11T11:00:17.709 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.00039981 s, 1.3 MB/s 2024-09-11T11:00:17.710 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T11:00:17.760 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_3 2024-09-11T11:00:17.810 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T11:00:17.810 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T11:00:17.810 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-11T11:00:17.811 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T11:00:17.811 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-11 10:54:52.219805942 +0000 2024-09-11T11:00:17.811 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-11 10:54:51.939808444 +0000 2024-09-11T11:00:17.811 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-11 10:54:51.939808444 +0000 2024-09-11T11:00:17.811 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-09-11T11:00:17.811 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T11:00:17.869 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-11T11:00:17.870 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-11T11:00:17.870 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000441984 s, 1.2 MB/s 2024-09-11T11:00:17.871 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T11:00:17.920 DEBUG:teuthology.orchestra.run.smithi145:> stat /dev/vg_nvme/lv_4 2024-09-11T11:00:17.971 INFO:teuthology.orchestra.run.smithi145.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T11:00:17.972 INFO:teuthology.orchestra.run.smithi145.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T11:00:17.972 INFO:teuthology.orchestra.run.smithi145.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-11T11:00:17.972 INFO:teuthology.orchestra.run.smithi145.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T11:00:17.972 INFO:teuthology.orchestra.run.smithi145.stdout:Access: 2024-09-11 10:54:52.667801942 +0000 2024-09-11T11:00:17.972 INFO:teuthology.orchestra.run.smithi145.stdout:Modify: 2024-09-11 10:54:52.423804121 +0000 2024-09-11T11:00:17.972 INFO:teuthology.orchestra.run.smithi145.stdout:Change: 2024-09-11 10:54:52.423804121 +0000 2024-09-11T11:00:17.972 INFO:teuthology.orchestra.run.smithi145.stdout: Birth: - 2024-09-11T11:00:17.973 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T11:00:18.025 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records in 2024-09-11T11:00:18.025 INFO:teuthology.orchestra.run.smithi145.stderr:1+0 records out 2024-09-11T11:00:18.025 INFO:teuthology.orchestra.run.smithi145.stderr:512 bytes copied, 0.000393474 s, 1.3 MB/s 2024-09-11T11:00:18.027 DEBUG:teuthology.orchestra.run.smithi145:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T11:00:18.076 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-11T11:00:18.076 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-11T11:00:18.076 INFO:tasks.ceph:Generating config... 2024-09-11T11:00:18.077 INFO:tasks.ceph:[client] debug ms = 1 2024-09-11T11:00:18.077 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-11T11:00:18.078 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-11T11:00:18.078 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-11T11:00:18.078 INFO:tasks.ceph:[client] setuser = ceph 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T11:00:18.078 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T11:00:18.079 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T11:00:18.079 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T11:00:18.079 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T11:00:18.079 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T11:00:18.079 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T11:00:18.079 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T11:00:18.079 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T11:00:18.079 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T11:00:18.079 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T11:00:18.079 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T11:00:18.079 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T11:00:18.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T11:00:18.115 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T11:00:18.124 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T11:00:18.200 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T11:00:18.253 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.102')] 2024-09-11T11:00:18.254 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.102'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-11T11:00:18.254 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:18.255 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T11:00:18.302 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.102 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:18.380 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:00:18.381 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:00:18.381 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:18.381 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: generated fsid 2f203b3f-97d8-4a3b-bc37-33833403bb89 2024-09-11T11:00:18.381 INFO:teuthology.orchestra.run.smithi102.stdout:setting min_mon_release = quincy 2024-09-11T11:00:18.381 INFO:teuthology.orchestra.run.smithi102.stdout:epoch 0 2024-09-11T11:00:18.381 INFO:teuthology.orchestra.run.smithi102.stdout:fsid 2f203b3f-97d8-4a3b-bc37-33833403bb89 2024-09-11T11:00:18.381 INFO:teuthology.orchestra.run.smithi102.stdout:last_changed 2024-09-11T11:00:18.382093+0000 2024-09-11T11:00:18.382 INFO:teuthology.orchestra.run.smithi102.stdout:created 2024-09-11T11:00:18.382093+0000 2024-09-11T11:00:18.382 INFO:teuthology.orchestra.run.smithi102.stdout:min_mon_release 17 (quincy) 2024-09-11T11:00:18.382 INFO:teuthology.orchestra.run.smithi102.stdout:election_strategy: 1 2024-09-11T11:00:18.382 INFO:teuthology.orchestra.run.smithi102.stdout:0: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.a 2024-09-11T11:00:18.382 INFO:teuthology.orchestra.run.smithi102.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-11T11:00:18.384 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T11:00:18.430 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2f203b3f-97d8-4a3b-bc37-33833403bb89... 2024-09-11T11:00:18.431 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T11:00:18.475 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T11:00:18.503 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-11T11:00:18.503 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-11T11:00:18.503 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T11:00:18.503 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-11T11:00:18.503 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-11T11:00:18.504 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-11T11:00:18.505 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = 172.21.15.102 2024-09-11T11:00:18.506 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = 2f203b3f-97d8-4a3b-bc37-33833403bb89 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-11T11:00:18.507 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-11T11:00:18.508 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: debug objclass = 20 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = bitmap 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-11T11:00:18.509 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-11T11:00:18.510 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.511 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-11T11:00:18.512 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: rgw gc obj min wait = 15 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: debug rgw = 20 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: setgroup = ceph 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout: setuser = ceph 2024-09-11T11:00:18.513 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout:[global] 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: chdir = "" 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: auth supported = cephx 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: filestore xattr use omap = true 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: mon clock drift allowed = 1.000 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: osd crush chooseleaf type = 0 2024-09-11T11:00:18.514 INFO:teuthology.orchestra.run.smithi145.stdout: auth debug = true 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on old message = true 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: ms die on bug = true 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: mon pg warn max object skew = 0 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default size = 2 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.515 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow primary affinity = true 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd allow pg remap = true 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on legacy crush tunables = false 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on crush straw calc version zero = false 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on no sortbitwise = false 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on osd down out interval zero = false 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon warn on too few osds = false 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: mon_allow_pool_size_one = true 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: osd default data pool replay window = 5 2024-09-11T11:00:18.516 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: mon allow pool delete = true 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: mon cluster log file level = debug 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: debug asserts on shutdown = true 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: mon health detail to clog = false 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: mon host = 172.21.15.102 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: fsid = 2f203b3f-97d8-4a3b-bc37-33833403bb89 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout:[osd] 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: osd journal size = 100 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub load threshold = 5.0 2024-09-11T11:00:18.517 INFO:teuthology.orchestra.run.smithi145.stdout: osd scrub max interval = 600 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd mclock profile = high_recovery_ops 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd recover clone overlap = true 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd recovery max chunk = 1048576 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug shutdown = true 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug op order = true 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug verify stray on activate = true 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug trim objects = true 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd open classes on start = true 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug pg log writeout = true 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: osd deep scrub update digest min age = 30 2024-09-11T11:00:18.518 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: osd map max advance = 10 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: journal zero on create = true 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: filestore ondisk finisher threads = 3 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: filestore apply finisher threads = 3 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: bdev debug aio = true 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: osd debug misdirected ops = true 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: debug objclass = 20 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: bdev async discard = True 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: bdev enable discard = True 2024-09-11T11:00:18.519 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore allocator = bitmap 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore block size = 96636764160 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: bluestore fsck on mount = True 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluefs = 1/20 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: debug bluestore = 1/20 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: debug osd = 20 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: debug rocksdb = 4/10 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd full ratio = 0.9 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd nearfull ratio = 0.8 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: osd failsafe full ratio = 0.95 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: osd objectstore = bluestore 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout:[mgr] 2024-09-11T11:00:18.520 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: debug mgr = 20 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: mgr/telemetry/nag = false 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout:[mon] 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: debug mon = 20 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: debug paxos = 20 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: debug auth = 20 2024-09-11T11:00:18.521 INFO:teuthology.orchestra.run.smithi145.stdout: mon data avail warn = 5 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: mon mgr mkfs grace = 240 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min pgs per osd = 4 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd reporter subtree level = osd 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: mon osd prime pg temp = true 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: mon reweight min bytes per osd = 10 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T11:00:18.522 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: # 1m isn't quite enough 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: mon_down_mkfs_grace = 2m 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: mon_warn_on_filestore_osds = false 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout:[client] 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: rgw cache enabled = true 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable ops log = true 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: rgw enable usage log = true 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: debug ms = 1 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: rgw gc obj min wait = 15 2024-09-11T11:00:18.523 INFO:teuthology.orchestra.run.smithi145.stdout: debug rgw = 20 2024-09-11T11:00:18.524 INFO:teuthology.orchestra.run.smithi145.stdout: setgroup = ceph 2024-09-11T11:00:18.524 INFO:teuthology.orchestra.run.smithi145.stdout: setuser = ceph 2024-09-11T11:00:18.524 INFO:teuthology.orchestra.run.smithi145.stdout:[mon.a] 2024-09-11T11:00:18.525 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T11:00:18.525 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T11:00:18.617 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T11:00:18.618 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:18.618 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T11:00:18.623 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:18.623 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T11:00:18.669 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-09-11T11:00:18.670 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:18.670 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T11:00:18.670 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T11:00:18.733 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:18.733 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:18.782 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T11:00:18.782 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:18.782 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T11:00:18.782 DEBUG:teuthology.orchestra.run.smithi145:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T11:00:18.806 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:18.806 DEBUG:teuthology.orchestra.run.smithi145:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:18.855 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T11:00:18.855 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T11:00:18.855 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T11:00:18.946 INFO:teuthology.orchestra.run.smithi145.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T11:00:18.958 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T11:00:18.959 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T11:00:18.959 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T11:00:18.992 INFO:teuthology.orchestra.run.smithi145.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T11:00:19.003 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T11:00:19.003 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi145.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-11T11:00:19.003 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T11:00:19.018 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-11T11:00:19.018 INFO:tasks.ceph:role: osd.0 2024-09-11T11:00:19.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-11T11:00:19.018 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T11:00:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T11:00:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T11:00:19.570 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-11T11:00:19.571 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-11T11:00:19.571 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T11:00:19.732 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T11:00:19.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T11:00:19.743 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T11:00:19.744 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:19.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:19.846+0000 7fdce70b77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T11:00:19.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:19.850+0000 7fdce70b77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T11:00:19.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:19.850+0000 7fdce70b77c0 -1 bdev(0x56337a38f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T11:00:19.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:19.850+0000 7fdce70b77c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T11:00:23.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T11:00:23.265 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T11:00:23.279 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-11T11:00:23.280 INFO:tasks.ceph:role: osd.1 2024-09-11T11:00:23.280 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T11:00:23.280 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T11:00:23.342 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T11:00:23.342 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T11:00:23.342 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T11:00:23.342 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T11:00:23.343 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T11:00:23.343 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-11T11:00:23.343 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T11:00:23.343 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T11:00:23.343 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T11:00:23.343 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T11:00:23.816 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-11T11:00:23.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-11T11:00:23.818 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-11T11:00:23.968 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T11:00:23.979 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T11:00:23.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T11:00:23.980 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T11:00:24.034 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-11T11:00:24.034 INFO:tasks.ceph:role: osd.2 2024-09-11T11:00:24.034 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T11:00:24.034 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T11:00:24.098 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T11:00:24.098 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T11:00:24.098 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T11:00:24.098 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T11:00:24.098 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T11:00:24.099 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-11T11:00:24.099 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T11:00:24.099 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T11:00:24.099 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T11:00:24.099 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T11:00:24.526 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-11T11:00:24.528 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-11T11:00:24.529 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-11T11:00:24.591 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T11:00:24.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T11:00:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T11:00:24.645 DEBUG:teuthology.orchestra.run.smithi145:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T11:00:24.698 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-11T11:00:24.698 INFO:tasks.ceph:role: osd.3 2024-09-11T11:00:24.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T11:00:24.699 DEBUG:teuthology.orchestra.run.smithi145:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T11:00:24.762 INFO:teuthology.orchestra.run.smithi145.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T11:00:24.762 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T11:00:24.762 INFO:teuthology.orchestra.run.smithi145.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T11:00:24.762 INFO:teuthology.orchestra.run.smithi145.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T11:00:24.762 INFO:teuthology.orchestra.run.smithi145.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T11:00:24.762 INFO:teuthology.orchestra.run.smithi145.stdout: = sunit=0 swidth=0 blks 2024-09-11T11:00:24.763 INFO:teuthology.orchestra.run.smithi145.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T11:00:24.763 INFO:teuthology.orchestra.run.smithi145.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T11:00:24.763 INFO:teuthology.orchestra.run.smithi145.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T11:00:24.763 INFO:teuthology.orchestra.run.smithi145.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T11:00:25.213 INFO:teuthology.orchestra.run.smithi145.stdout:Discarding blocks...Done. 2024-09-11T11:00:25.215 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi145.front.sepia.ceph.com -o noatime 2024-09-11T11:00:25.216 DEBUG:teuthology.orchestra.run.smithi145:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-11T11:00:25.317 DEBUG:teuthology.orchestra.run.smithi145:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T11:00:25.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T11:00:25.328 INFO:teuthology.orchestra.run.smithi145.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T11:00:25.328 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:25.433+0000 7f5ff39ac7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T11:00:25.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:25.437+0000 7f5ff39ac7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T11:00:25.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:25.437+0000 7f5ff39ac7c0 -1 bdev(0x5633a8bf5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T11:00:25.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:25.437+0000 7f5ff39ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T11:00:28.612 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T11:00:28.626 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:28.705+0000 7fa3aa4027c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T11:00:28.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:28.705+0000 7fa3aa4027c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T11:00:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:28.705+0000 7fa3aa4027c0 -1 bdev(0x55714c5cb800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T11:00:28.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:28.705+0000 7fa3aa4027c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T11:00:31.885 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T11:00:31.939 DEBUG:teuthology.orchestra.run.smithi145:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:32.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:32.025+0000 7f4668abb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T11:00:32.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:32.029+0000 7f4668abb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T11:00:32.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:32.029+0000 7f4668abb7c0 -1 bdev(0x5633bf06d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T11:00:32.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:32.029+0000 7f4668abb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T11:00:35.153 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T11:00:35.210 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T11:00:35.210 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:35.211 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T11:00:35.226 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:35.226 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T11:00:35.270 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:35.270 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T11:00:35.325 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:35.325 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T11:00:35.381 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:35.382 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T11:00:35.437 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:35.437 DEBUG:teuthology.orchestra.run.smithi145:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T11:00:35.482 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T11:00:35.482 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T11:00:35.494 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBDeOFmvGXAMhAAgXmF/xWYs1epEhT5iTa/LA== 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBCeOFmVgN/OBAAocFHDiux6XuV3QD2SmHKLw== 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBJeOFm87kOGhAAkIVjJYWRjNH90sV4/MNKjg== 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBMeOFm4XVCKhAAiR2NfJ+UejAxNlOzzK3iZQ== 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBQeOFmvRHbARAA5xMASC7MtxniOjmE2Z0Rgw== 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-09-11T11:00:35.495 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBCeOFmAFg+OxAAPVM012DcmBIgGiqN9OL0ag== 2024-09-11T11:00:35.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T11:00:35.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T11:00:35.628 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T11:00:35.707 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T11:00:35.796 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T11:00:35.875 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T11:00:35.959 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T11:00:35.959 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T11:00:36.012 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T11:00:36.103 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T11:00:36.113 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T11:00:36.161 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T11:00:36.162 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T11:00:36.162 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T11:00:36.207 INFO:tasks.ceph.mon.a:Started 2024-09-11T11:00:36.207 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T11:00:36.207 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T11:00:36.207 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T11:00:36.210 INFO:tasks.ceph.mgr.x:Started 2024-09-11T11:00:36.210 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T11:00:36.210 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T11:00:36.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a94b92640 1 Processor -- start 2024-09-11T11:00:36.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a94b92640 1 -- start start 2024-09-11T11:00:36.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a94b92640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 0x7f1a90130cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:36.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a94b92640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a90070ac0 con 0x7f1a9006e410 2024-09-11T11:00:36.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a94b92640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1a9006fd70 con 0x7f1a9006ef00 2024-09-11T11:00:36.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a8e59c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1a9006e410 0x7f1a9006e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:33760/0 (socket says 172.21.15.102:33760) 2024-09-11T11:00:36.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a8e59c640 1 -- 172.21.15.102:0/2595950247 learned_addr learned my addr 172.21.15.102:0/2595950247 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:36.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a87fff640 1 --2- 172.21.15.102:0/2595950247 >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 0x7f1a90130cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:36.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a87fff640 1 -- 172.21.15.102:0/2595950247 >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 msgr2=0x7f1a90130cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-11T11:00:36.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a87fff640 1 -- 172.21.15.102:0/2595950247 >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 msgr2=0x7f1a90130cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-11T11:00:36.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a87fff640 1 --2- 172.21.15.102:0/2595950247 >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 0x7f1a90130cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-11T11:00:36.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.330+0000 7f1a87fff640 1 --2- 172.21.15.102:0/2595950247 >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 0x7f1a90130cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-11T11:00:36.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399615165 0 0) 0x7f1a90070ac0 con 0x7f1a9006e410 2024-09-11T11:00:36.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a7c005740 con 0x7f1a9006e410 2024-09-11T11:00:36.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3888176435 0 0) 0x7f1a7c005740 con 0x7f1a9006e410 2024-09-11T11:00:36.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 msgr2=0x7f1a90130cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T11:00:36.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 --2- 172.21.15.102:0/2595950247 >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 0x7f1a90130cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:36.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a90072640 con 0x7f1a9006e410 2024-09-11T11:00:36.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 <== mon.0 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 3619516820 0 0) 0x7f1a800015b0 con 0x7f1a9006e410 2024-09-11T11:00:36.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 >> v1:172.21.15.102:6789/0 conn(0x7f1a9006e410 legacy=0x7f1a9006e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:36.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 --2- 172.21.15.102:0/2595950247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a7c005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:36.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c0066a0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8e59c640 1 --2- 172.21.15.102:0/2595950247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a7c005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:36.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.338+0000 7f1a8e59c640 1 -- 172.21.15.102:0/2595950247 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c005740 con 0x7f1a7c005bd0 2024-09-11T11:00:36.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.350+0000 7f1a8e59c640 1 --2- 172.21.15.102:0/2595950247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a7c005fd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c110 tx=0x7f1a8001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f907b18c6c1809b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:36.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.350+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a80007cb0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.350+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a800a9070 con 0x7f1a7c005bd0 2024-09-11T11:00:36.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.350+0000 7f1a8dd9b640 1 -- 172.21.15.102:0/2595950247 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a80005ba0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- 172.21.15.102:0/2595950247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 msgr2=0x7f1a7c005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 --2- 172.21.15.102:0/2595950247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a7c005fd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c110 tx=0x7f1a8001ccc0 comp rx=0 tx=0).stop 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- 172.21.15.102:0/2595950247 shutdown_connections 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 --2- 172.21.15.102:0/2595950247 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a7c005fd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 --2- 172.21.15.102:0/2595950247 >> v2:172.21.15.102:3300/0 conn(0x7f1a9006ef00 0x7f1a90130cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- 172.21.15.102:0/2595950247 >> 172.21.15.102:0/2595950247 conn(0x7f1a9009aa70 msgr2=0x7f1a9009ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- 172.21.15.102:0/2595950247 shutdown_connections 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- 172.21.15.102:0/2595950247 wait complete. 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 Processor -- start 2024-09-11T11:00:36.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- start start 2024-09-11T11:00:36.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a90094230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:36.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1a9006c7f0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a8e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a90094230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:36.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a8e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a90094230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46400/0 (socket says 172.21.15.102:46400) 2024-09-11T11:00:36.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a8e59c640 1 -- 172.21.15.102:0/1116466286 learned_addr learned my addr 172.21.15.102:0/1116466286 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:36.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a8e59c640 1 -- 172.21.15.102:0/1116466286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a90130da0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a8e59c640 1 --2- 172.21.15.102:0/1116466286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a90094230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c110 tx=0x7f1a7c007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a86ffd640 1 -- 172.21.15.102:0/1116466286 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a80005e50 con 0x7f1a7c005bd0 2024-09-11T11:00:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a86ffd640 1 -- 172.21.15.102:0/1116466286 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a80001440 con 0x7f1a7c005bd0 2024-09-11T11:00:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a90130fd0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a86ffd640 1 -- 172.21.15.102:0/1116466286 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a80007050 con 0x7f1a7c005bd0 2024-09-11T11:00:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a90096ee0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a86ffd640 1 -- 172.21.15.102:0/1116466286 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a80007580 con 0x7f1a7c005bd0 2024-09-11T11:00:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a86ffd640 1 -- 172.21.15.102:0/1116466286 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1a800ae9c0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.354+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a90096870 con 0x7f1a7c005bd0 2024-09-11T11:00:36.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.370+0000 7f1a86ffd640 1 -- 172.21.15.102:0/1116466286 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1a800d82d0 con 0x7f1a7c005bd0 2024-09-11T11:00:36.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.434+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1a9006f990 con 0x7f1a7c005bd0 2024-09-11T11:00:36.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.434+0000 7f1a86ffd640 1 -- 172.21.15.102:0/1116466286 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1a800c6070 con 0x7f1a7c005bd0 2024-09-11T11:00:36.441 INFO:teuthology.orchestra.run.smithi102.stderr:adjusted tunables profile to default 2024-09-11T11:00:36.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.438+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 msgr2=0x7f1a90094230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:36.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.438+0000 7f1a94b92640 1 --2- 172.21.15.102:0/1116466286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a90094230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c110 tx=0x7f1a7c007a50 comp rx=0 tx=0).stop 2024-09-11T11:00:36.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.438+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 shutdown_connections 2024-09-11T11:00:36.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.438+0000 7f1a94b92640 1 --2- 172.21.15.102:0/1116466286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1a7c005bd0 0x7f1a90094230 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:36.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.438+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 >> 172.21.15.102:0/1116466286 conn(0x7f1a9009aa70 msgr2=0x7f1a9008d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:36.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.438+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 shutdown_connections 2024-09-11T11:00:36.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:36.438+0000 7f1a94b92640 1 -- 172.21.15.102:0/1116466286 wait complete. 2024-09-11T11:00:36.458 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T11:00:36.458 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T11:00:36.459 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-11T11:00:36.459 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T11:00:36.469 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:36.469 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T11:00:36.483 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:36.483 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T11:00:36.537 DEBUG:teuthology.orchestra.run.smithi145:> set -ex 2024-09-11T11:00:36.537 DEBUG:teuthology.orchestra.run.smithi145:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T11:00:36.571 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:36.569+0000 7fcd7db53180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T11:00:36.582 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new c9cea281-6c68-455d-84fe-43662e932c43 0 2024-09-11T11:00:36.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.745+0000 7f88d1a71640 1 Processor -- start 2024-09-11T11:00:36.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.745+0000 7f88d1a71640 1 -- start start 2024-09-11T11:00:36.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.745+0000 7f88d1a71640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f88cc117900 0x7f88cc119cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:36.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.745+0000 7f88d1a71640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88cc11a350 con 0x7f88cc114c00 2024-09-11T11:00:36.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.745+0000 7f88d1a71640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f88cc11b550 con 0x7f88cc117900 2024-09-11T11:00:36.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.749+0000 7f88c2ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f88cc117900 0x7f88cc119cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:36.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.749+0000 7f88c2ffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f88cc117900 0x7f88cc119cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:33422/0 (socket says 172.21.15.145:33422) 2024-09-11T11:00:36.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.749+0000 7f88c2ffd640 1 -- 172.21.15.145:0/3835533479 learned_addr learned my addr 172.21.15.145:0/3835533479 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:00:36.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.749+0000 7f88c2ffd640 1 -- 172.21.15.145:0/3835533479 >> v1:172.21.15.102:6789/0 conn(0x7f88cc114c00 legacy=0x7f88cc114fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:36.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.749+0000 7f88c2ffd640 1 -- 172.21.15.145:0/3835533479 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc11b700 con 0x7f88cc117900 2024-09-11T11:00:36.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.749+0000 7f88c2ffd640 1 --2- 172.21.15.145:0/3835533479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc117900 0x7f88cc119cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88b40097f0 tx=0x7f88b401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6650f86f02f331 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:36.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88caffd640 1 -- 172.21.15.145:0/3835533479 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88b40ab580 con 0x7f88cc117900 2024-09-11T11:00:36.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88caffd640 1 -- 172.21.15.145:0/3835533479 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b40b0070 con 0x7f88cc117900 2024-09-11T11:00:36.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88caffd640 1 -- 172.21.15.145:0/3835533479 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88b40ab870 con 0x7f88cc117900 2024-09-11T11:00:36.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- 172.21.15.145:0/3835533479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc117900 msgr2=0x7f88cc119cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:36.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 --2- 172.21.15.145:0/3835533479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc117900 0x7f88cc119cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88b40097f0 tx=0x7f88b401c430 comp rx=0 tx=0).stop 2024-09-11T11:00:36.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- 172.21.15.145:0/3835533479 shutdown_connections 2024-09-11T11:00:36.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 --2- 172.21.15.145:0/3835533479 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc117900 0x7f88cc119cf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:36.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- 172.21.15.145:0/3835533479 >> 172.21.15.145:0/3835533479 conn(0x7f88cc06fff0 msgr2=0x7f88cc072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:36.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- 172.21.15.145:0/3835533479 shutdown_connections 2024-09-11T11:00:36.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- 172.21.15.145:0/3835533479 wait complete. 2024-09-11T11:00:36.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 Processor -- start 2024-09-11T11:00:36.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- start start 2024-09-11T11:00:36.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc114c00 0x7f88cc117f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:36.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc11b210 con 0x7f88cc114c00 2024-09-11T11:00:36.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88cb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc114c00 0x7f88cc117f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:36.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88cb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc114c00 0x7f88cc117f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:33428/0 (socket says 172.21.15.145:33428) 2024-09-11T11:00:36.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88cb7fe640 1 -- 172.21.15.145:0/1312450099 learned_addr learned my addr 172.21.15.145:0/1312450099 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:00:36.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88cb7fe640 1 -- 172.21.15.145:0/1312450099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc118480 con 0x7f88cc114c00 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88cb7fe640 1 --2- 172.21.15.145:0/1312450099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc114c00 0x7f88cc117f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00c3a0 tx=0x7f88bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88c8ff9640 1 -- 172.21.15.145:0/1312450099 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88bc005150 con 0x7f88cc114c00 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88cc118710 con 0x7f88cc114c00 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88c8ff9640 1 -- 172.21.15.145:0/1312450099 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88bc0052f0 con 0x7f88cc114c00 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88c8ff9640 1 -- 172.21.15.145:0/1312450099 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88bc0067e0 con 0x7f88cc114c00 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88cc118bd0 con 0x7f88cc114c00 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88c8ff9640 1 -- 172.21.15.145:0/1312450099 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f88bc019020 con 0x7f88cc114c00 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.753+0000 7f88c8ff9640 1 -- 172.21.15.145:0/1312450099 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f88bc003b30 con 0x7f88cc114c00 2024-09-11T11:00:36.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.757+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88cc114fe0 con 0x7f88cc114c00 2024-09-11T11:00:36.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.761+0000 7f88c8ff9640 1 -- 172.21.15.145:0/1312450099 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f88bc003600 con 0x7f88cc114c00 2024-09-11T11:00:36.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.829+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c9cea281-6c68-455d-84fe-43662e932c43", "id": 0} v 0) -- 0x7f88cc112d00 con 0x7f88cc114c00 2024-09-11T11:00:36.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.833+0000 7f88c8ff9640 1 -- 172.21.15.145:0/1312450099 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9cea281-6c68-455d-84fe-43662e932c43", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f88bc007090 con 0x7f88cc114c00 2024-09-11T11:00:36.835 INFO:teuthology.orchestra.run.smithi145.stdout:0 2024-09-11T11:00:36.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.833+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc114c00 msgr2=0x7f88cc117f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:36.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.833+0000 7f88d1a71640 1 --2- 172.21.15.145:0/1312450099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc114c00 0x7f88cc117f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88bc00c3a0 tx=0x7f88bc00c860 comp rx=0 tx=0).stop 2024-09-11T11:00:36.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.833+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 shutdown_connections 2024-09-11T11:00:36.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.833+0000 7f88d1a71640 1 --2- 172.21.15.145:0/1312450099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f88cc114c00 0x7f88cc117f40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:36.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.833+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 >> 172.21.15.145:0/1312450099 conn(0x7f88cc06fff0 msgr2=0x7f88cc06c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:36.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.833+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 shutdown_connections 2024-09-11T11:00:36.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.833+0000 7f88d1a71640 1 -- 172.21.15.145:0/1312450099 wait complete. 2024-09-11T11:00:36.851 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new cde5215c-172e-4c43-9180-9619ea7bfc29 1 2024-09-11T11:00:36.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e6c723640 1 Processor -- start 2024-09-11T11:00:36.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e6c723640 1 -- start start 2024-09-11T11:00:36.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e6c723640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2e6410ed90 0x7f2e6410f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:36.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e6c723640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e64074280 con 0x7f2e6410f6b0 2024-09-11T11:00:36.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e6c723640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2e6410fbf0 con 0x7f2e6410ed90 2024-09-11T11:00:36.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e6a4bf640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2e6410ed90 0x7f2e6410f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:36.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e69cbe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2e6410f6b0 0x7f2e6411a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:35496/0 (socket says 172.21.15.145:35496) 2024-09-11T11:00:36.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e69cbe640 1 -- 172.21.15.145:0/2226554646 learned_addr learned my addr 172.21.15.145:0/2226554646 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:00:36.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e6a4bf640 1 -- 172.21.15.145:0/2226554646 >> v1:172.21.15.102:6789/0 conn(0x7f2e6410f6b0 legacy=0x7f2e6411a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:36.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.961+0000 7f2e6a4bf640 1 -- 172.21.15.145:0/2226554646 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6411c840 con 0x7f2e6410ed90 2024-09-11T11:00:36.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6a4bf640 1 --2- 172.21.15.145:0/2226554646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410f170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009740 tx=0x7f2e6001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de04e7a4affaecc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:36.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e694bd640 1 -- 172.21.15.145:0/2226554646 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600b1070 con 0x7f2e6410ed90 2024-09-11T11:00:36.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e694bd640 1 -- 172.21.15.145:0/2226554646 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e600ac520 con 0x7f2e6410ed90 2024-09-11T11:00:36.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e694bd640 1 -- 172.21.15.145:0/2226554646 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600ac820 con 0x7f2e6410ed90 2024-09-11T11:00:36.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 -- 172.21.15.145:0/2226554646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 msgr2=0x7f2e6410f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:36.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 --2- 172.21.15.145:0/2226554646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410f170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2e60009740 tx=0x7f2e6001c370 comp rx=0 tx=0).stop 2024-09-11T11:00:36.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 -- 172.21.15.145:0/2226554646 shutdown_connections 2024-09-11T11:00:36.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 --2- 172.21.15.145:0/2226554646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410f170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:36.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 -- 172.21.15.145:0/2226554646 >> 172.21.15.145:0/2226554646 conn(0x7f2e6406f840 msgr2=0x7f2e64071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:36.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 -- 172.21.15.145:0/2226554646 shutdown_connections 2024-09-11T11:00:36.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 -- 172.21.15.145:0/2226554646 wait complete. 2024-09-11T11:00:36.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 Processor -- start 2024-09-11T11:00:36.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.965+0000 7f2e6c723640 1 -- start start 2024-09-11T11:00:36.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6c723640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:36.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6c723640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2e6411c500 con 0x7f2e6410ed90 2024-09-11T11:00:36.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6a4bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:36.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6a4bf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:33440/0 (socket says 172.21.15.145:33440) 2024-09-11T11:00:36.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6a4bf640 1 -- 172.21.15.145:0/2977359155 learned_addr learned my addr 172.21.15.145:0/2977359155 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:00:36.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6a4bf640 1 -- 172.21.15.145:0/2977359155 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e641104b0 con 0x7f2e6410ed90 2024-09-11T11:00:36.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6a4bf640 1 --2- 172.21.15.145:0/2977359155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410ff70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e600af040 tx=0x7f2e6001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:36.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e56ffd640 1 -- 172.21.15.145:0/2977359155 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600b1050 con 0x7f2e6410ed90 2024-09-11T11:00:36.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e641106e0 con 0x7f2e6410ed90 2024-09-11T11:00:36.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e56ffd640 1 -- 172.21.15.145:0/2977359155 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e600b2040 con 0x7f2e6410ed90 2024-09-11T11:00:36.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e56ffd640 1 -- 172.21.15.145:0/2977359155 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2e600aba00 con 0x7f2e6410ed90 2024-09-11T11:00:36.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e64110b40 con 0x7f2e6410ed90 2024-09-11T11:00:36.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e56ffd640 1 -- 172.21.15.145:0/2977359155 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2e600bf030 con 0x7f2e6410ed90 2024-09-11T11:00:36.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e56ffd640 1 -- 172.21.15.145:0/2977359155 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f2e600bd070 con 0x7f2e6410ed90 2024-09-11T11:00:36.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.969+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e6410f170 con 0x7f2e6410ed90 2024-09-11T11:00:36.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:36.977+0000 7f2e56ffd640 1 -- 172.21.15.145:0/2977359155 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2e600c6020 con 0x7f2e6410ed90 2024-09-11T11:00:37.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.045+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cde5215c-172e-4c43-9180-9619ea7bfc29", "id": 1} v 0) -- 0x7f2e64110e80 con 0x7f2e6410ed90 2024-09-11T11:00:37.048 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:37.045+0000 7fcd7db53180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T11:00:37.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.049+0000 7f2e56ffd640 1 -- 172.21.15.145:0/2977359155 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cde5215c-172e-4c43-9180-9619ea7bfc29", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f2e64110e80 con 0x7f2e6410ed90 2024-09-11T11:00:37.052 INFO:teuthology.orchestra.run.smithi145.stdout:1 2024-09-11T11:00:37.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.049+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 msgr2=0x7f2e6410ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.049+0000 7f2e6c723640 1 --2- 172.21.15.145:0/2977359155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410ff70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2e600af040 tx=0x7f2e6001abb0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.049+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 shutdown_connections 2024-09-11T11:00:37.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.049+0000 7f2e6c723640 1 --2- 172.21.15.145:0/2977359155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2e6410ed90 0x7f2e6410ff70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.049+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 >> 172.21.15.145:0/2977359155 conn(0x7f2e6406f840 msgr2=0x7f2e64117890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:37.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.049+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 shutdown_connections 2024-09-11T11:00:37.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.049+0000 7f2e6c723640 1 -- 172.21.15.145:0/2977359155 wait complete. 2024-09-11T11:00:37.069 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 1d00ec9b-54e3-4e8f-9c74-1deeb015da2d 2 2024-09-11T11:00:37.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb291808640 1 Processor -- start 2024-09-11T11:00:37.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb291808640 1 -- start start 2024-09-11T11:00:37.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb291808640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb28c06cce0 0x7fb28c11d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:37.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb291808640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28c06d200 con 0x7fb28c110b60 2024-09-11T11:00:37.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb291808640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb28c11e960 con 0x7fb28c06cce0 2024-09-11T11:00:37.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb28a7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb28c06cce0 0x7fb28c11d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:37.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb28affd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb28c110b60 0x7fb28c06c4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:35512/0 (socket says 172.21.15.145:35512) 2024-09-11T11:00:37.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb28affd640 1 -- 172.21.15.145:0/3309098376 learned_addr learned my addr 172.21.15.145:0/3309098376 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:00:37.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb28a7fc640 1 -- 172.21.15.145:0/3309098376 >> v1:172.21.15.102:6789/0 conn(0x7fb28c110b60 legacy=0x7fb28c06c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.173+0000 7fb28a7fc640 1 -- 172.21.15.145:0/3309098376 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c11eae0 con 0x7fb28c06cce0 2024-09-11T11:00:37.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb28a7fc640 1 --2- 172.21.15.145:0/3309098376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c11d410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb280009740 tx=0x7fb28001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fae2232840b10b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:37.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb289ffb640 1 -- 172.21.15.145:0/3309098376 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800b1070 con 0x7fb28c06cce0 2024-09-11T11:00:37.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb289ffb640 1 -- 172.21.15.145:0/3309098376 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2800ac520 con 0x7fb28c06cce0 2024-09-11T11:00:37.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb289ffb640 1 -- 172.21.15.145:0/3309098376 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2800ac820 con 0x7fb28c06cce0 2024-09-11T11:00:37.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb291808640 1 -- 172.21.15.145:0/3309098376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 msgr2=0x7fb28c11d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb291808640 1 --2- 172.21.15.145:0/3309098376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c11d410 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb280009740 tx=0x7fb28001c370 comp rx=0 tx=0).stop 2024-09-11T11:00:37.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb291808640 1 -- 172.21.15.145:0/3309098376 shutdown_connections 2024-09-11T11:00:37.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb291808640 1 --2- 172.21.15.145:0/3309098376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c11d410 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb291808640 1 -- 172.21.15.145:0/3309098376 >> 172.21.15.145:0/3309098376 conn(0x7fb28c06fff0 msgr2=0x7fb28c072410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:37.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb291808640 1 -- 172.21.15.145:0/3309098376 shutdown_connections 2024-09-11T11:00:37.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.177+0000 7fb291808640 1 -- 172.21.15.145:0/3309098376 wait complete. 2024-09-11T11:00:37.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb291808640 1 Processor -- start 2024-09-11T11:00:37.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb291808640 1 -- start start 2024-09-11T11:00:37.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb291808640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c1aef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:37.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb291808640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb28c11e5c0 con 0x7fb28c06cce0 2024-09-11T11:00:37.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb28affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c1aef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:37.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb28affd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c1aef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:33448/0 (socket says 172.21.15.145:33448) 2024-09-11T11:00:37.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb28affd640 1 -- 172.21.15.145:0/1133224180 learned_addr learned my addr 172.21.15.145:0/1133224180 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:00:37.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb28affd640 1 -- 172.21.15.145:0/1133224180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28c1af4f0 con 0x7fb28c06cce0 2024-09-11T11:00:37.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb28affd640 1 --2- 172.21.15.145:0/1133224180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c1aef20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00c480 tx=0x7fb27c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:37.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb273fff640 1 -- 172.21.15.145:0/1133224180 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb27c017070 con 0x7fb28c06cce0 2024-09-11T11:00:37.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28c1af780 con 0x7fb28c06cce0 2024-09-11T11:00:37.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28c1a9190 con 0x7fb28c06cce0 2024-09-11T11:00:37.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb273fff640 1 -- 172.21.15.145:0/1133224180 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c005c20 con 0x7fb28c06cce0 2024-09-11T11:00:37.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb273fff640 1 -- 172.21.15.145:0/1133224180 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb27c007070 con 0x7fb28c06cce0 2024-09-11T11:00:37.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb273fff640 1 -- 172.21.15.145:0/1133224180 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb27c01a070 con 0x7fb28c06cce0 2024-09-11T11:00:37.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb273fff640 1 -- 172.21.15.145:0/1133224180 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb27c01cc60 con 0x7fb28c06cce0 2024-09-11T11:00:37.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.181+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26c005090 con 0x7fb28c06cce0 2024-09-11T11:00:37.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.189+0000 7fb273fff640 1 -- 172.21.15.145:0/1133224180 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb27c007370 con 0x7fb28c06cce0 2024-09-11T11:00:37.230 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:37.229+0000 7fcd7db53180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T11:00:37.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.253+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1d00ec9b-54e3-4e8f-9c74-1deeb015da2d", "id": 2} v 0) -- 0x7fb26c005680 con 0x7fb28c06cce0 2024-09-11T11:00:37.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.257+0000 7fb273fff640 1 -- 172.21.15.145:0/1133224180 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d00ec9b-54e3-4e8f-9c74-1deeb015da2d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb27c0076e0 con 0x7fb28c06cce0 2024-09-11T11:00:37.258 INFO:teuthology.orchestra.run.smithi145.stdout:2 2024-09-11T11:00:37.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.257+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 msgr2=0x7fb28c1aef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.257+0000 7fb291808640 1 --2- 172.21.15.145:0/1133224180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c1aef20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00c480 tx=0x7fb27c00c940 comp rx=0 tx=0).stop 2024-09-11T11:00:37.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.257+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 shutdown_connections 2024-09-11T11:00:37.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.257+0000 7fb291808640 1 --2- 172.21.15.145:0/1133224180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28c06cce0 0x7fb28c1aef20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.257+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 >> 172.21.15.145:0/1133224180 conn(0x7fb28c06fff0 msgr2=0x7fb28c11ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:37.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.257+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 shutdown_connections 2024-09-11T11:00:37.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.257+0000 7fb291808640 1 -- 172.21.15.145:0/1133224180 wait complete. 2024-09-11T11:00:37.274 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph --cluster ceph osd new 8c84c992-dc47-43d3-9cfb-f83d4052d9a0 3 2024-09-11T11:00:37.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f829c37b640 1 Processor -- start 2024-09-11T11:00:37.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f829c37b640 1 -- start start 2024-09-11T11:00:37.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f829c37b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8294118a50 0x7f829411ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:37.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f829c37b640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829411b410 con 0x7f8294115df0 2024-09-11T11:00:37.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f829c37b640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f829411c5f0 con 0x7f8294118a50 2024-09-11T11:00:37.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f8299916640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8294118a50 0x7f829411ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:37.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f829a117640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8294115df0 0x7f82941161d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:35516/0 (socket says 172.21.15.145:35516) 2024-09-11T11:00:37.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f829a117640 1 -- 172.21.15.145:0/1814489022 learned_addr learned my addr 172.21.15.145:0/1814489022 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:00:37.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f8299115640 1 -- 172.21.15.145:0/1814489022 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085384136 0 0) 0x7f829411b410 con 0x7f8294115df0 2024-09-11T11:00:37.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f8299115640 1 -- 172.21.15.145:0/1814489022 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8280003530 con 0x7f8294115df0 2024-09-11T11:00:37.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f8299916640 1 -- 172.21.15.145:0/1814489022 >> v1:172.21.15.102:6789/0 conn(0x7f8294115df0 legacy=0x7f82941161d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.381+0000 7f8299916640 1 -- 172.21.15.145:0/1814489022 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829411c7a0 con 0x7f8294118a50 2024-09-11T11:00:37.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f8299916640 1 --2- 172.21.15.145:0/1814489022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294118a50 0x7f829411ae40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8284009740 tx=0x7f828401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557f655de7b3c578 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:37.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f8299115640 1 -- 172.21.15.145:0/1814489022 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82840b1070 con 0x7f8294118a50 2024-09-11T11:00:37.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f8299115640 1 -- 172.21.15.145:0/1814489022 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82840ac520 con 0x7f8294118a50 2024-09-11T11:00:37.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f8299115640 1 -- 172.21.15.145:0/1814489022 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82840ac800 con 0x7f8294118a50 2024-09-11T11:00:37.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 -- 172.21.15.145:0/1814489022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294118a50 msgr2=0x7f829411ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 --2- 172.21.15.145:0/1814489022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294118a50 0x7f829411ae40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8284009740 tx=0x7f828401c370 comp rx=0 tx=0).stop 2024-09-11T11:00:37.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 -- 172.21.15.145:0/1814489022 shutdown_connections 2024-09-11T11:00:37.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 --2- 172.21.15.145:0/1814489022 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294118a50 0x7f829411ae40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 -- 172.21.15.145:0/1814489022 >> 172.21.15.145:0/1814489022 conn(0x7f8294071310 msgr2=0x7f8294073730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:37.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 -- 172.21.15.145:0/1814489022 shutdown_connections 2024-09-11T11:00:37.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 -- 172.21.15.145:0/1814489022 wait complete. 2024-09-11T11:00:37.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 Processor -- start 2024-09-11T11:00:37.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 -- start start 2024-09-11T11:00:37.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294115df0 0x7f829406d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:37.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.385+0000 7f829c37b640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f829411c310 con 0x7f8294115df0 2024-09-11T11:00:37.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f829a117640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294115df0 0x7f829406d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:37.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f829a117640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294115df0 0x7f829406d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:33464/0 (socket says 172.21.15.145:33464) 2024-09-11T11:00:37.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f829a117640 1 -- 172.21.15.145:0/3862085014 learned_addr learned my addr 172.21.15.145:0/3862085014 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:00:37.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f829a117640 1 -- 172.21.15.145:0/3862085014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829406dc00 con 0x7f8294115df0 2024-09-11T11:00:37.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f829a117640 1 --2- 172.21.15.145:0/3862085014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294115df0 0x7f829406d6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f829000c3d0 tx=0x7f829000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:37.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f828affd640 1 -- 172.21.15.145:0/3862085014 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8290017070 con 0x7f8294115df0 2024-09-11T11:00:37.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829406de90 con 0x7f8294115df0 2024-09-11T11:00:37.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f828affd640 1 -- 172.21.15.145:0/3862085014 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8290005ce0 con 0x7f8294115df0 2024-09-11T11:00:37.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f828affd640 1 -- 172.21.15.145:0/3862085014 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82900070d0 con 0x7f8294115df0 2024-09-11T11:00:37.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f829406e350 con 0x7f8294115df0 2024-09-11T11:00:37.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f828affd640 1 -- 172.21.15.145:0/3862085014 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f829001a070 con 0x7f8294115df0 2024-09-11T11:00:37.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f828affd640 1 -- 172.21.15.145:0/3862085014 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8290007270 con 0x7f8294115df0 2024-09-11T11:00:37.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.389+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82941161d0 con 0x7f8294115df0 2024-09-11T11:00:37.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.397+0000 7f828affd640 1 -- 172.21.15.145:0/3862085014 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f8290021070 con 0x7f8294115df0 2024-09-11T11:00:37.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.465+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8c84c992-dc47-43d3-9cfb-f83d4052d9a0", "id": 3} v 0) -- 0x7f8294118a50 con 0x7f8294115df0 2024-09-11T11:00:37.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.465+0000 7f828affd640 1 -- 172.21.15.145:0/3862085014 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8c84c992-dc47-43d3-9cfb-f83d4052d9a0", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8290007620 con 0x7f8294115df0 2024-09-11T11:00:37.469 INFO:teuthology.orchestra.run.smithi145.stdout:3 2024-09-11T11:00:37.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.469+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294115df0 msgr2=0x7f829406d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.469+0000 7f829c37b640 1 --2- 172.21.15.145:0/3862085014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294115df0 0x7f829406d6c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f829000c3d0 tx=0x7f829000c890 comp rx=0 tx=0).stop 2024-09-11T11:00:37.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.469+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 shutdown_connections 2024-09-11T11:00:37.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.469+0000 7f829c37b640 1 --2- 172.21.15.145:0/3862085014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8294115df0 0x7f829406d6c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.469+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 >> 172.21.15.145:0/3862085014 conn(0x7f8294071310 msgr2=0x7f829410ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:37.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.469+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 shutdown_connections 2024-09-11T11:00:37.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:00:37.469+0000 7f829c37b640 1 -- 172.21.15.145:0/3862085014 wait complete. 2024-09-11T11:00:37.486 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T11:00:37.486 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T11:00:37.489 INFO:tasks.ceph.osd.0:Started 2024-09-11T11:00:37.489 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T11:00:37.489 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T11:00:37.491 INFO:tasks.ceph.osd.1:Started 2024-09-11T11:00:37.491 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T11:00:37.492 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T11:00:37.494 INFO:tasks.ceph.osd.2:Started 2024-09-11T11:00:37.494 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T11:00:37.494 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T11:00:37.496 INFO:tasks.ceph.osd.3:Started 2024-09-11T11:00:37.496 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726c54e640 1 Processor -- start 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726c54e640 1 -- start start 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726c54e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f726412e760 0x7f726412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726c54e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72640984f0 con 0x7f726412f1c0 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726c54e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7264098dc0 con 0x7f726412e760 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726a2ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f726412e760 0x7f726412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726a2ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f726412e760 0x7f726412ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46410/0 (socket says 172.21.15.102:46410) 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f7269ae9640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f726412f1c0 0x7f726412b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:33780/0 (socket says 172.21.15.102:33780) 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726a2ea640 1 -- 172.21.15.102:0/3485196002 learned_addr learned my addr 172.21.15.102:0/3485196002 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:37.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726a2ea640 1 -- 172.21.15.102:0/3485196002 >> v1:172.21.15.102:6789/0 conn(0x7f726412f1c0 legacy=0x7f726412b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.614+0000 7f726a2ea640 1 -- 172.21.15.102:0/3485196002 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f726412f5a0 con 0x7f726412e760 2024-09-11T11:00:37.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726a2ea640 1 --2- 172.21.15.102:0/3485196002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726412ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72600097f0 tx=0x7f726001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3157b53026a128 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:37.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f72692e8640 1 -- 172.21.15.102:0/3485196002 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72600b0070 con 0x7f726412e760 2024-09-11T11:00:37.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f72692e8640 1 -- 172.21.15.102:0/3485196002 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72600ab530 con 0x7f726412e760 2024-09-11T11:00:37.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f72692e8640 1 -- 172.21.15.102:0/3485196002 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72600ab830 con 0x7f726412e760 2024-09-11T11:00:37.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- 172.21.15.102:0/3485196002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 msgr2=0x7f726412ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 --2- 172.21.15.102:0/3485196002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726412ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f72600097f0 tx=0x7f726001c4c0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- 172.21.15.102:0/3485196002 shutdown_connections 2024-09-11T11:00:37.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 --2- 172.21.15.102:0/3485196002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726412ec80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- 172.21.15.102:0/3485196002 >> 172.21.15.102:0/3485196002 conn(0x7f72640a10a0 msgr2=0x7f72640a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:37.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- 172.21.15.102:0/3485196002 shutdown_connections 2024-09-11T11:00:37.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- 172.21.15.102:0/3485196002 wait complete. 2024-09-11T11:00:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 Processor -- start 2024-09-11T11:00:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- start start 2024-09-11T11:00:37.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726409c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7264136e30 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726a2ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726409c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726a2ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726409c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46414/0 (socket says 172.21.15.102:46414) 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726a2ea640 1 -- 172.21.15.102:0/1438753574 learned_addr learned my addr 172.21.15.102:0/1438753574 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726a2ea640 1 -- 172.21.15.102:0/1438753574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7264130510 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726a2ea640 1 --2- 172.21.15.102:0/1438753574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726409c920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f726001a0f0 tx=0x7f726001ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f725affd640 1 -- 172.21.15.102:0/1438753574 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72600ba020 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f725affd640 1 -- 172.21.15.102:0/1438753574 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72600b6420 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7264130c10 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f725affd640 1 -- 172.21.15.102:0/1438753574 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72600b0040 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f726409ce60 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.618+0000 7f725affd640 1 -- 172.21.15.102:0/1438753574 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72600bd020 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.622+0000 7f725affd640 1 -- 172.21.15.102:0/1438753574 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f72600bfd70 con 0x7f726412e760 2024-09-11T11:00:37.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.622+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726409e3a0 con 0x7f726412e760 2024-09-11T11:00:37.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.622+0000 7f725affd640 1 -- 172.21.15.102:0/1438753574 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f72600c4030 con 0x7f726412e760 2024-09-11T11:00:37.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f726412ec80 con 0x7f726412e760 2024-09-11T11:00:37.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f725affd640 1 -- 172.21.15.102:0/1438753574 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f72600160b0 con 0x7f726412e760 2024-09-11T11:00:37.686 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:37.687 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":6,"fsid":"2f203b3f-97d8-4a3b-bc37-33833403bb89","created":"2024-09-11T11:00:36.331917+0000","modified":"2024-09-11T11:00:37.468939+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T11:00:37.468939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c9cea281-6c68-455d-84fe-43662e932c43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cde5215c-172e-4c43-9180-9619ea7bfc29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1d00ec9b-54e3-4e8f-9c74-1deeb015da2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8c84c992-dc47-43d3-9cfb-f83d4052d9a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T11:00:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 msgr2=0x7f726409c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f726c54e640 1 --2- 172.21.15.102:0/1438753574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726409c920 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f726001a0f0 tx=0x7f726001ad00 comp rx=0 tx=0).stop 2024-09-11T11:00:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 shutdown_connections 2024-09-11T11:00:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f726c54e640 1 --2- 172.21.15.102:0/1438753574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f726412e760 0x7f726409c920 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 >> 172.21.15.102:0/1438753574 conn(0x7f72640a10a0 msgr2=0x7f7264095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 shutdown_connections 2024-09-11T11:00:37.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:37.682+0000 7f726c54e640 1 -- 172.21.15.102:0/1438753574 wait complete. 2024-09-11T11:00:37.704 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T11:00:37.705 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T11:00:37.795 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:37.793+0000 7fcd7db53180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T11:00:37.848 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:37.845+0000 7fcd7db53180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T11:00:37.901 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:37.897+0000 7fcd7db53180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T11:00:37.977 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:37.973+0000 7fcd7db53180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T11:00:38.029 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:38.025+0000 7fcd7db53180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T11:00:38.104 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:38.101+0000 7fcd7db53180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T11:00:38.108 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T11:00:38.157 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:38.153+0000 7fcd7db53180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T11:00:38.229 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.222+0000 7fddfc099640 1 Processor -- start 2024-09-11T11:00:38.229 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.222+0000 7fddfc099640 1 -- start start 2024-09-11T11:00:38.229 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.222+0000 7fddfc099640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fddf412a6a0 0x7fddf412aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:38.229 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.222+0000 7fddfc099640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf4098be0 con 0x7fddf4096ff0 2024-09-11T11:00:38.229 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.222+0000 7fddfc099640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fddf412a2e0 con 0x7fddf412a6a0 2024-09-11T11:00:38.229 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.222+0000 7fddf9e35640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fddf412a6a0 0x7fddf412aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:38.229 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.222+0000 7fddf9634640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fddf4096ff0 0x7fddf4129260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:33786/0 (socket says 172.21.15.102:33786) 2024-09-11T11:00:38.229 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.222+0000 7fddf9634640 1 -- 172.21.15.102:0/2492655258 learned_addr learned my addr 172.21.15.102:0/2492655258 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:38.230 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.226+0000 7fddf9e35640 1 -- 172.21.15.102:0/2492655258 >> v1:172.21.15.102:6789/0 conn(0x7fddf4096ff0 legacy=0x7fddf4129260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:38.230 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.226+0000 7fddf9e35640 1 -- 172.21.15.102:0/2492655258 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf4096560 con 0x7fddf412a6a0 2024-09-11T11:00:38.232 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.226+0000 7fddf9e35640 1 --2- 172.21.15.102:0/2492655258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf412a6a0 0x7fddf412aa80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009740 tx=0x7fdde801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ac879b4d458666 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:38.232 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.226+0000 7fddf8e33640 1 -- 172.21.15.102:0/2492655258 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde80b0070 con 0x7fddf412a6a0 2024-09-11T11:00:38.232 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.226+0000 7fddf8e33640 1 -- 172.21.15.102:0/2492655258 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde80ab530 con 0x7fddf412a6a0 2024-09-11T11:00:38.232 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.226+0000 7fddf8e33640 1 -- 172.21.15.102:0/2492655258 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde80a4e60 con 0x7fddf412a6a0 2024-09-11T11:00:38.233 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- 172.21.15.102:0/2492655258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf412a6a0 msgr2=0x7fddf412aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:38.233 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 --2- 172.21.15.102:0/2492655258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf412a6a0 0x7fddf412aa80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009740 tx=0x7fdde801c3a0 comp rx=0 tx=0).stop 2024-09-11T11:00:38.233 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- 172.21.15.102:0/2492655258 shutdown_connections 2024-09-11T11:00:38.233 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 --2- 172.21.15.102:0/2492655258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf412a6a0 0x7fddf412aa80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:38.234 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- 172.21.15.102:0/2492655258 >> 172.21.15.102:0/2492655258 conn(0x7fddf4099c40 msgr2=0x7fddf409a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:38.234 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- 172.21.15.102:0/2492655258 shutdown_connections 2024-09-11T11:00:38.234 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- 172.21.15.102:0/2492655258 wait complete. 2024-09-11T11:00:38.234 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 Processor -- start 2024-09-11T11:00:38.234 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- start start 2024-09-11T11:00:38.235 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf4096ff0 0x7fddf4127b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:38.235 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fddf4133b20 con 0x7fddf4096ff0 2024-09-11T11:00:38.235 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf9e35640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf4096ff0 0x7fddf4127b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:38.235 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf9e35640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf4096ff0 0x7fddf4127b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:46438/0 (socket says 172.21.15.102:46438) 2024-09-11T11:00:38.235 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf9e35640 1 -- 172.21.15.102:0/2834275528 learned_addr learned my addr 172.21.15.102:0/2834275528 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:38.235 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf9e35640 1 -- 172.21.15.102:0/2834275528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf4126df0 con 0x7fddf4096ff0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf9e35640 1 --2- 172.21.15.102:0/2834275528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf4096ff0 0x7fddf4127b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdde801a030 tx=0x7fdde801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf27fc640 1 -- 172.21.15.102:0/2834275528 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde80b0050 con 0x7fddf4096ff0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf27fc640 1 -- 172.21.15.102:0/2834275528 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde80b1040 con 0x7fddf4096ff0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf41263f0 con 0x7fddf4096ff0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf27fc640 1 -- 172.21.15.102:0/2834275528 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdde80b5610 con 0x7fddf4096ff0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf4128230 con 0x7fddf4096ff0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf27fc640 1 -- 172.21.15.102:0/2834275528 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdde80be030 con 0x7fddf4096ff0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddf27fc640 1 -- 172.21.15.102:0/2834275528 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fdde80bc070 con 0x7fddf4096ff0 2024-09-11T11:00:38.237 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.230+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf4126bc0 con 0x7fddf4096ff0 2024-09-11T11:00:38.238 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.234+0000 7fddf27fc640 1 -- 172.21.15.102:0/2834275528 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fdde80c5020 con 0x7fddf4096ff0 2024-09-11T11:00:38.297 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddf41278f0 con 0x7fddf4096ff0 2024-09-11T11:00:38.298 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddf27fc640 1 -- 172.21.15.102:0/2834275528 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7fdde8015ff0 con 0x7fddf4096ff0 2024-09-11T11:00:38.298 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-11T11:00:38.298 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":6,"fsid":"2f203b3f-97d8-4a3b-bc37-33833403bb89","created":"2024-09-11T11:00:36.331917+0000","modified":"2024-09-11T11:00:37.468939+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T11:00:37.468939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c9cea281-6c68-455d-84fe-43662e932c43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cde5215c-172e-4c43-9180-9619ea7bfc29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1d00ec9b-54e3-4e8f-9c74-1deeb015da2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8c84c992-dc47-43d3-9cfb-f83d4052d9a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T11:00:38.299 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf4096ff0 msgr2=0x7fddf4127b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:38.299 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddfc099640 1 --2- 172.21.15.102:0/2834275528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf4096ff0 0x7fddf4127b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdde801a030 tx=0x7fdde801ac40 comp rx=0 tx=0).stop 2024-09-11T11:00:38.299 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 shutdown_connections 2024-09-11T11:00:38.299 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddfc099640 1 --2- 172.21.15.102:0/2834275528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fddf4096ff0 0x7fddf4127b20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:38.299 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 >> 172.21.15.102:0/2834275528 conn(0x7fddf4099c40 msgr2=0x7fddf409b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:38.299 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 shutdown_connections 2024-09-11T11:00:38.299 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:38.294+0000 7fddfc099640 1 -- 172.21.15.102:0/2834275528 wait complete. 2024-09-11T11:00:38.307 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:38.305+0000 7fcd7db53180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T11:00:38.314 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-11T11:00:38.368 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:38.365+0000 7fcd7db53180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T11:00:39.000 INFO:tasks.ceph.mgr.x.smithi145.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T11:00:39.000 INFO:tasks.ceph.mgr.x.smithi145.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T11:00:39.000 INFO:tasks.ceph.mgr.x.smithi145.stderr: from numpy import show_config as show_numpy_config 2024-09-11T11:00:39.060 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:39.057+0000 7fcd7db53180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T11:00:39.079 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-11T11:00:39.074+0000 7f6694c937c0 -1 Falling back to public interface 2024-09-11T11:00:39.160 INFO:tasks.ceph.osd.3.smithi145.stderr:2024-09-11T11:00:39.157+0000 7fa710e647c0 -1 Falling back to public interface 2024-09-11T11:00:39.204 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:39.201+0000 7fcd7db53180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T11:00:39.387 INFO:tasks.ceph.osd.1.smithi145.stderr:2024-09-11T11:00:39.385+0000 7f7c989c57c0 -1 Falling back to public interface 2024-09-11T11:00:39.387 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:39.385+0000 7fcd7db53180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T11:00:39.453 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:39.449+0000 7fcd7db53180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T11:00:39.587 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:39.585+0000 7fcd7db53180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T11:00:39.603 INFO:tasks.ceph.osd.2.smithi145.stderr:2024-09-11T11:00:39.601+0000 7f6dc00a07c0 -1 Falling back to public interface 2024-09-11T11:00:40.226 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:40.221+0000 7fcd7db53180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T11:00:40.300 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:40.297+0000 7fcd7db53180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T11:00:40.484 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:40.481+0000 7fcd7db53180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T11:00:40.555 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:40.553+0000 7fcd7db53180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T11:00:40.843 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:40.841+0000 7fcd7db53180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T11:00:40.905 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:40.901+0000 7fcd7db53180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T11:00:41.936 INFO:tasks.ceph.mgr.x.smithi145.stderr:2024-09-11T11:00:41.933+0000 7fcd24788640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-11T11:00:43.612 INFO:tasks.ceph.osd.1.smithi145.stderr:2024-09-11T11:00:43.609+0000 7f7c989c57c0 -1 osd.1 0 log_to_monitors true 2024-09-11T11:00:43.640 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-11T11:00:43.634+0000 7f6694c937c0 -1 osd.0 0 log_to_monitors true 2024-09-11T11:00:43.919 INFO:tasks.ceph.osd.3.smithi145.stderr:2024-09-11T11:00:43.917+0000 7fa710e647c0 -1 osd.3 0 log_to_monitors true 2024-09-11T11:00:44.342 INFO:tasks.ceph.osd.2.smithi145.stderr:2024-09-11T11:00:44.341+0000 7f6dc00a07c0 -1 osd.2 0 log_to_monitors true 2024-09-11T11:00:44.718 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T11:00:44.842 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3f0206e640 1 Processor -- start 2024-09-11T11:00:44.842 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3f0206e640 1 -- start start 2024-09-11T11:00:44.842 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3f0206e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3efc093470 0x7f3efc093850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:44.842 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3f0206e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3efc096130 con 0x7f3efc128f50 2024-09-11T11:00:44.843 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3f0206e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3efc096760 con 0x7f3efc093470 2024-09-11T11:00:44.843 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3efaffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3efc128f50 0x7f3efc1293c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36932/0 (socket says 172.21.15.102:36932) 2024-09-11T11:00:44.843 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3efb7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3efc093470 0x7f3efc093850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:44.843 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3efaffd640 1 -- 172.21.15.102:0/217443331 learned_addr learned my addr 172.21.15.102:0/217443331 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:44.843 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3efa7fc640 1 -- 172.21.15.102:0/217443331 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031459305 0 0) 0x7f3efc096130 con 0x7f3efc128f50 2024-09-11T11:00:44.843 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3efa7fc640 1 -- 172.21.15.102:0/217443331 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee4003530 con 0x7f3efc128f50 2024-09-11T11:00:44.844 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3efb7fe640 1 -- 172.21.15.102:0/217443331 >> v1:172.21.15.102:6789/0 conn(0x7f3efc128f50 legacy=0x7f3efc1293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:44.844 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.838+0000 7f3efb7fe640 1 -- 172.21.15.102:0/217443331 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc098be0 con 0x7f3efc093470 2024-09-11T11:00:44.845 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efb7fe640 1 --2- 172.21.15.102:0/217443331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc093850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009770 tx=0x7f3ef001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ad7057a2a24c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:44.845 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efa7fc640 1 -- 172.21.15.102:0/217443331 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef00b0070 con 0x7f3efc093470 2024-09-11T11:00:44.845 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efa7fc640 1 -- 172.21.15.102:0/217443331 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef00ab530 con 0x7f3efc093470 2024-09-11T11:00:44.845 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efa7fc640 1 -- 172.21.15.102:0/217443331 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef00ab830 con 0x7f3efc093470 2024-09-11T11:00:44.846 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- 172.21.15.102:0/217443331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 msgr2=0x7f3efc093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:44.846 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 --2- 172.21.15.102:0/217443331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc093850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0009770 tx=0x7f3ef001c370 comp rx=0 tx=0).stop 2024-09-11T11:00:44.846 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- 172.21.15.102:0/217443331 shutdown_connections 2024-09-11T11:00:44.846 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 --2- 172.21.15.102:0/217443331 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc093850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:44.847 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- 172.21.15.102:0/217443331 >> 172.21.15.102:0/217443331 conn(0x7f3efc099c40 msgr2=0x7f3efc09a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:44.847 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- 172.21.15.102:0/217443331 shutdown_connections 2024-09-11T11:00:44.847 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- 172.21.15.102:0/217443331 wait complete. 2024-09-11T11:00:44.848 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 Processor -- start 2024-09-11T11:00:44.848 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- start start 2024-09-11T11:00:44.848 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc128440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:44.848 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc135160 con 0x7f3efc093470 2024-09-11T11:00:44.848 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc128440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:44.848 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efb7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc128440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35482/0 (socket says 172.21.15.102:35482) 2024-09-11T11:00:44.849 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efb7fe640 1 -- 172.21.15.102:0/3486145581 learned_addr learned my addr 172.21.15.102:0/3486145581 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:44.849 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efb7fe640 1 -- 172.21.15.102:0/3486145581 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc1320a0 con 0x7f3efc093470 2024-09-11T11:00:44.849 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3efb7fe640 1 --2- 172.21.15.102:0/3486145581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc128440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0019fa0 tx=0x7f3ef001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:44.849 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3ee3fff640 1 -- 172.21.15.102:0/3486145581 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef00b0050 con 0x7f3efc093470 2024-09-11T11:00:44.849 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3ee3fff640 1 -- 172.21.15.102:0/3486145581 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ef00b1040 con 0x7f3efc093470 2024-09-11T11:00:44.849 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3efc06e4c0 con 0x7f3efc093470 2024-09-11T11:00:44.849 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3ee3fff640 1 -- 172.21.15.102:0/3486145581 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ef00b5740 con 0x7f3efc093470 2024-09-11T11:00:44.849 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.842+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3efc128980 con 0x7f3efc093470 2024-09-11T11:00:44.850 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.846+0000 7f3ee3fff640 1 -- 172.21.15.102:0/3486145581 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f3ef00be030 con 0x7f3efc093470 2024-09-11T11:00:44.850 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.846+0000 7f3ee3fff640 1 --2- 172.21.15.102:0/3486145581 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3ee8035d20 0x7f3ee80381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:44.850 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.846+0000 7f3ee3fff640 1 -- 172.21.15.102:0/3486145581 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1318+0+0 (secure 0 0 0) 0x7f3ef00bc070 con 0x7f3efc093470 2024-09-11T11:00:44.850 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.846+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3efc131e30 con 0x7f3efc093470 2024-09-11T11:00:44.850 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.846+0000 7f3efaffd640 1 --2- 172.21.15.102:0/3486145581 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3ee8035d20 0x7f3ee80381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:44.851 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.846+0000 7f3efaffd640 1 --2- 172.21.15.102:0/3486145581 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3ee8035d20 0x7f3ee80381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3eec007fd0 tx=0x7f3eec007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:44.854 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:44.850+0000 7f3ee3fff640 1 -- 172.21.15.102:0/3486145581 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3ef00c5020 con 0x7f3efc093470 2024-09-11T11:00:45.019 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.014+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3efc093850 con 0x7f3efc093470 2024-09-11T11:00:45.019 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.014+0000 7f3ee3fff640 1 -- 172.21.15.102:0/3486145581 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+4153 (secure 0 0 0) 0x7f3ef0015ff0 con 0x7f3efc093470 2024-09-11T11:00:45.020 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-11T11:00:45.020 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":8,"fsid":"2f203b3f-97d8-4a3b-bc37-33833403bb89","created":"2024-09-11T11:00:36.331917+0000","modified":"2024-09-11T11:00:44.988060+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T11:00:37.468939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c9cea281-6c68-455d-84fe-43662e932c43","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cde5215c-172e-4c43-9180-9619ea7bfc29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1d00ec9b-54e3-4e8f-9c74-1deeb015da2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8c84c992-dc47-43d3-9cfb-f83d4052d9a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T11:00:45.022 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3ee8035d20 msgr2=0x7f3ee80381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:45.022 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 --2- 172.21.15.102:0/3486145581 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3ee8035d20 0x7f3ee80381e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3eec007fd0 tx=0x7f3eec007980 comp rx=0 tx=0).stop 2024-09-11T11:00:45.022 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 msgr2=0x7f3efc128440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:45.022 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 --2- 172.21.15.102:0/3486145581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc128440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0019fa0 tx=0x7f3ef001abb0 comp rx=0 tx=0).stop 2024-09-11T11:00:45.022 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 shutdown_connections 2024-09-11T11:00:45.022 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 --2- 172.21.15.102:0/3486145581 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3ee8035d20 0x7f3ee80381e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:45.022 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 --2- 172.21.15.102:0/3486145581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3efc093470 0x7f3efc128440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:45.022 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 >> 172.21.15.102:0/3486145581 conn(0x7f3efc099c40 msgr2=0x7f3efc12ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:45.023 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 shutdown_connections 2024-09-11T11:00:45.023 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:45.018+0000 7f3f0206e640 1 -- 172.21.15.102:0/3486145581 wait complete. 2024-09-11T11:00:45.041 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-11T11:00:45.901 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-11T11:00:45.894+0000 7f669144e640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T11:00:45.922 INFO:tasks.ceph.osd.0.smithi102.stderr:2024-09-11T11:00:45.918+0000 7f6688a60640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T11:00:46.413 INFO:tasks.ceph.osd.1.smithi145.stderr:2024-09-11T11:00:46.409+0000 7f7c95180640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T11:00:46.414 INFO:tasks.ceph.osd.3.smithi145.stderr:2024-09-11T11:00:46.413+0000 7fa70c5ea640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T11:00:46.456 INFO:tasks.ceph.osd.1.smithi145.stderr:2024-09-11T11:00:46.453+0000 7f7c8c792640 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T11:00:46.459 INFO:tasks.ceph.osd.3.smithi145.stderr:2024-09-11T11:00:46.457+0000 7fa704c31640 -1 osd.3 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T11:00:47.020 INFO:tasks.ceph.osd.2.smithi145.stderr:2024-09-11T11:00:47.017+0000 7f6dbb826640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T11:00:47.059 INFO:tasks.ceph.osd.2.smithi145.stderr:2024-09-11T11:00:47.057+0000 7f6db3e6d640 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T11:00:51.444 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T11:00:51.571 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40c5f16640 1 Processor -- start 2024-09-11T11:00:51.571 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40c5f16640 1 -- start start 2024-09-11T11:00:51.571 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40c5f16640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f40c0093470 0x7f40c0093850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40c5f16640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c0096130 con 0x7f40c0128f50 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40c5f16640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f40c0096760 con 0x7f40c0093470 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40bf7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f40c0093470 0x7f40c0093850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40beffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f40c0128f50 0x7f40c01293c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36946/0 (socket says 172.21.15.102:36946) 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40beffd640 1 -- 172.21.15.102:0/1859155618 learned_addr learned my addr 172.21.15.102:0/1859155618 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40be7fc640 1 -- 172.21.15.102:0/1859155618 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 48012163 0 0) 0x7f40c0096130 con 0x7f40c0128f50 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40be7fc640 1 -- 172.21.15.102:0/1859155618 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a8003530 con 0x7f40c0128f50 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40bf7fe640 1 -- 172.21.15.102:0/1859155618 >> v1:172.21.15.102:6789/0 conn(0x7f40c0128f50 legacy=0x7f40c01293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:51.572 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.566+0000 7f40bf7fe640 1 -- 172.21.15.102:0/1859155618 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c0098be0 con 0x7f40c0093470 2024-09-11T11:00:51.573 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40bf7fe640 1 --2- 172.21.15.102:0/1859155618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0093850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009770 tx=0x7f40b801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd38c296be17758 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:51.573 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40be7fc640 1 -- 172.21.15.102:0/1859155618 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b80b0070 con 0x7f40c0093470 2024-09-11T11:00:51.574 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40be7fc640 1 -- 172.21.15.102:0/1859155618 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b80ab530 con 0x7f40c0093470 2024-09-11T11:00:51.574 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40be7fc640 1 -- 172.21.15.102:0/1859155618 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b80ab830 con 0x7f40c0093470 2024-09-11T11:00:51.575 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- 172.21.15.102:0/1859155618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 msgr2=0x7f40c0093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:51.575 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 --2- 172.21.15.102:0/1859155618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0093850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f40b8009770 tx=0x7f40b801c370 comp rx=0 tx=0).stop 2024-09-11T11:00:51.575 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- 172.21.15.102:0/1859155618 shutdown_connections 2024-09-11T11:00:51.575 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 --2- 172.21.15.102:0/1859155618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0093850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:51.575 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- 172.21.15.102:0/1859155618 >> 172.21.15.102:0/1859155618 conn(0x7f40c0099c40 msgr2=0x7f40c009a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:51.575 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- 172.21.15.102:0/1859155618 shutdown_connections 2024-09-11T11:00:51.575 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- 172.21.15.102:0/1859155618 wait complete. 2024-09-11T11:00:51.577 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 Processor -- start 2024-09-11T11:00:51.577 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- start start 2024-09-11T11:00:51.577 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0122060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:51.577 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f40c0135160 con 0x7f40c0093470 2024-09-11T11:00:51.577 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40bf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0122060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:51.577 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40bf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0122060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35504/0 (socket says 172.21.15.102:35504) 2024-09-11T11:00:51.578 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40bf7fe640 1 -- 172.21.15.102:0/2611263205 learned_addr learned my addr 172.21.15.102:0/2611263205 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:51.578 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40bf7fe640 1 -- 172.21.15.102:0/2611263205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c0123800 con 0x7f40c0093470 2024-09-11T11:00:51.578 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40bf7fe640 1 --2- 172.21.15.102:0/2611263205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0122060 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40b8019fa0 tx=0x7f40b801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:51.578 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40a7fff640 1 -- 172.21.15.102:0/2611263205 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b80b0050 con 0x7f40c0093470 2024-09-11T11:00:51.578 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40a7fff640 1 -- 172.21.15.102:0/2611263205 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b80b1040 con 0x7f40c0093470 2024-09-11T11:00:51.578 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c0124470 con 0x7f40c0093470 2024-09-11T11:00:51.578 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40a7fff640 1 -- 172.21.15.102:0/2611263205 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40b80b5740 con 0x7f40c0093470 2024-09-11T11:00:51.578 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.570+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c01225a0 con 0x7f40c0093470 2024-09-11T11:00:51.579 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.574+0000 7f40a7fff640 1 -- 172.21.15.102:0/2611263205 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f40b80be030 con 0x7f40c0093470 2024-09-11T11:00:51.579 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.574+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c0124b00 con 0x7f40c0093470 2024-09-11T11:00:51.579 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.574+0000 7f40a7fff640 1 --2- 172.21.15.102:0/2611263205 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40ac035d20 0x7f40ac0381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:51.579 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.574+0000 7f40a7fff640 1 -- 172.21.15.102:0/2611263205 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f40b80bc070 con 0x7f40c0093470 2024-09-11T11:00:51.579 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.574+0000 7f40beffd640 1 --2- 172.21.15.102:0/2611263205 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40ac035d20 0x7f40ac0381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:51.579 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.574+0000 7f40beffd640 1 --2- 172.21.15.102:0/2611263205 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40ac035d20 0x7f40ac0381e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f40b4007fd0 tx=0x7f40b4007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:51.583 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.578+0000 7f40a7fff640 1 -- 172.21.15.102:0/2611263205 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f40b80c5020 con 0x7f40c0093470 2024-09-11T11:00:51.749 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40c0093850 con 0x7f40c0093470 2024-09-11T11:00:51.750 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40a7fff640 1 -- 172.21.15.102:0/2611263205 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8002 (secure 0 0 0) 0x7f40b8015ff0 con 0x7f40c0093470 2024-09-11T11:00:51.750 INFO:teuthology.misc.health.smithi102.stdout: 2024-09-11T11:00:51.750 INFO:teuthology.misc.health.smithi102.stdout:{"epoch":14,"fsid":"2f203b3f-97d8-4a3b-bc37-33833403bb89","created":"2024-09-11T11:00:36.331917+0000","modified":"2024-09-11T11:00:51.455269+0000","last_up_change":"2024-09-11T11:00:47.426191+0000","last_in_change":"2024-09-11T11:00:37.468939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T11:00:49.009964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9cea281-6c68-455d-84fe-43662e932c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6801","nonce":3035634142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6803","nonce":3035634142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6807","nonce":3035634142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6805","nonce":3035634142}]},"public_addr":"172.21.15.102:6801/3035634142","cluster_addr":"172.21.15.102:6803/3035634142","heartbeat_back_addr":"172.21.15.102:6807/3035634142","heartbeat_front_addr":"172.21.15.102:6805/3035634142","state":["exists","up"]},{"osd":1,"uuid":"cde5215c-172e-4c43-9180-9619ea7bfc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6809","nonce":1879781812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6811","nonce":1879781812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6815","nonce":1879781812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6813","nonce":1879781812}]},"public_addr":"172.21.15.145:6809/1879781812","cluster_addr":"172.21.15.145:6811/1879781812","heartbeat_back_addr":"172.21.15.145:6815/1879781812","heartbeat_front_addr":"172.21.15.145:6813/1879781812","state":["exists","up"]},{"osd":2,"uuid":"1d00ec9b-54e3-4e8f-9c74-1deeb015da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6817","nonce":446921044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6819","nonce":446921044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6823","nonce":446921044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6821","nonce":446921044}]},"public_addr":"172.21.15.145:6817/446921044","cluster_addr":"172.21.15.145:6819/446921044","heartbeat_back_addr":"172.21.15.145:6823/446921044","heartbeat_front_addr":"172.21.15.145:6821/446921044","state":["exists","up"]},{"osd":3,"uuid":"8c84c992-dc47-43d3-9cfb-f83d4052d9a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6801","nonce":493661776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6803","nonce":493661776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6807","nonce":493661776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6805","nonce":493661776}]},"public_addr":"172.21.15.145:6801/493661776","cluster_addr":"172.21.15.145:6803/493661776","heartbeat_back_addr":"172.21.15.145:6807/493661776","heartbeat_front_addr":"172.21.15.145:6805/493661776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.674297+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.654148+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:45.317003+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.920650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T11:00:51.753 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40ac035d20 msgr2=0x7f40ac0381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:51.753 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 --2- 172.21.15.102:0/2611263205 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40ac035d20 0x7f40ac0381e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f40b4007fd0 tx=0x7f40b4007980 comp rx=0 tx=0).stop 2024-09-11T11:00:51.753 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 msgr2=0x7f40c0122060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:51.753 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 --2- 172.21.15.102:0/2611263205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0122060 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f40b8019fa0 tx=0x7f40b801abb0 comp rx=0 tx=0).stop 2024-09-11T11:00:51.753 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 shutdown_connections 2024-09-11T11:00:51.753 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 --2- 172.21.15.102:0/2611263205 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40ac035d20 0x7f40ac0381e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:51.754 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 --2- 172.21.15.102:0/2611263205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40c0093470 0x7f40c0122060 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:51.754 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.746+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 >> 172.21.15.102:0/2611263205 conn(0x7f40c0099c40 msgr2=0x7f40c01308d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:51.754 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.750+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 shutdown_connections 2024-09-11T11:00:51.754 INFO:teuthology.misc.health.smithi102.stderr:2024-09-11T11:00:51.750+0000 7f40c5f16640 1 -- 172.21.15.102:0/2611263205 wait complete. 2024-09-11T11:00:51.769 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-11T11:00:51.769 INFO:tasks.ceph:Creating RBD pool 2024-09-11T11:00:51.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T11:00:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8eae297640 1 Processor -- start 2024-09-11T11:00:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8eae297640 1 -- start start 2024-09-11T11:00:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8eae297640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8ea81283a0 0x7f8ea8128780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8eae297640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ea8127f00 con 0x7f8ea80702c0 2024-09-11T11:00:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8eae297640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8ea8073360 con 0x7f8ea81283a0 2024-09-11T11:00:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea7fff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8ea81283a0 0x7f8ea8128780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea77fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8ea80702c0 0x7f8ea812b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:36954/0 (socket says 172.21.15.102:36954) 2024-09-11T11:00:51.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea77fe640 1 -- 172.21.15.102:0/4070742976 learned_addr learned my addr 172.21.15.102:0/4070742976 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:51.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea7fff640 1 -- 172.21.15.102:0/4070742976 >> v1:172.21.15.102:6789/0 conn(0x7f8ea80702c0 legacy=0x7f8ea812b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:51.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea7fff640 1 -- 172.21.15.102:0/4070742976 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea81281a0 con 0x7f8ea81283a0 2024-09-11T11:00:51.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea7fff640 1 --2- 172.21.15.102:0/4070742976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea81283a0 0x7f8ea8128780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009740 tx=0x7f8e9801c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5849bfb5450ccd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:51.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea6ffd640 1 -- 172.21.15.102:0/4070742976 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e980b0070 con 0x7f8ea81283a0 2024-09-11T11:00:51.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea6ffd640 1 -- 172.21.15.102:0/4070742976 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e980ab530 con 0x7f8ea81283a0 2024-09-11T11:00:51.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.890+0000 7f8ea6ffd640 1 -- 172.21.15.102:0/4070742976 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e980ab830 con 0x7f8ea81283a0 2024-09-11T11:00:51.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- 172.21.15.102:0/4070742976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea81283a0 msgr2=0x7f8ea8128780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 --2- 172.21.15.102:0/4070742976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea81283a0 0x7f8ea8128780 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e98009740 tx=0x7f8e9801c2e0 comp rx=0 tx=0).stop 2024-09-11T11:00:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- 172.21.15.102:0/4070742976 shutdown_connections 2024-09-11T11:00:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 --2- 172.21.15.102:0/4070742976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea81283a0 0x7f8ea8128780 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- 172.21.15.102:0/4070742976 >> 172.21.15.102:0/4070742976 conn(0x7f8ea809a8a0 msgr2=0x7f8ea809acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- 172.21.15.102:0/4070742976 shutdown_connections 2024-09-11T11:00:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- 172.21.15.102:0/4070742976 wait complete. 2024-09-11T11:00:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 Processor -- start 2024-09-11T11:00:51.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- start start 2024-09-11T11:00:51.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea80702c0 0x7f8ea812c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:51.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea81339a0 con 0x7f8ea80702c0 2024-09-11T11:00:51.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea80702c0 0x7f8ea812c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea7fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea80702c0 0x7f8ea812c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35532/0 (socket says 172.21.15.102:35532) 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea7fff640 1 -- 172.21.15.102:0/2178056242 learned_addr learned my addr 172.21.15.102:0/2178056242 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea7fff640 1 -- 172.21.15.102:0/2178056242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea806e230 con 0x7f8ea80702c0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea7fff640 1 --2- 172.21.15.102:0/2178056242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea80702c0 0x7f8ea812c9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e980ae040 tx=0x7f8e98019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea4ff9640 1 -- 172.21.15.102:0/2178056242 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e980b8020 con 0x7f8ea80702c0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea4ff9640 1 -- 172.21.15.102:0/2178056242 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e980b4410 con 0x7f8ea80702c0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea812efb0 con 0x7f8ea80702c0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea4ff9640 1 -- 172.21.15.102:0/2178056242 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e980b0040 con 0x7f8ea80702c0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea806d970 con 0x7f8ea80702c0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea4ff9640 1 -- 172.21.15.102:0/2178056242 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f8e980bb020 con 0x7f8ea80702c0 2024-09-11T11:00:51.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea4ff9640 1 --2- 172.21.15.102:0/2178056242 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e94035d20 0x7f8e940381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:51.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea806dc00 con 0x7f8ea80702c0 2024-09-11T11:00:51.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea4ff9640 1 -- 172.21.15.102:0/2178056242 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3129+0+0 (secure 0 0 0) 0x7f8e980e2130 con 0x7f8ea80702c0 2024-09-11T11:00:51.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.894+0000 7f8ea77fe640 1 --2- 172.21.15.102:0/2178056242 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e94035d20 0x7f8e940381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:51.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.898+0000 7f8ea77fe640 1 --2- 172.21.15.102:0/2178056242 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e94035d20 0x7f8e940381e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c001610 tx=0x7f8e9c007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:51.902+0000 7f8ea4ff9640 1 -- 172.21.15.102:0/2178056242 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e980c2030 con 0x7f8ea80702c0 2024-09-11T11:00:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.062+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f8ea812ed40 con 0x7f8ea80702c0 2024-09-11T11:00:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.850+0000 7f8ea4ff9640 1 -- 172.21.15.102:0/2178056242 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f8e98015ff0 con 0x7f8ea80702c0 2024-09-11T11:00:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'rbd' created 2024-09-11T11:00:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e94035d20 msgr2=0x7f8e940381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 --2- 172.21.15.102:0/2178056242 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e94035d20 0x7f8e940381e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c001610 tx=0x7f8e9c007ad0 comp rx=0 tx=0).stop 2024-09-11T11:00:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea80702c0 msgr2=0x7f8ea812c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 --2- 172.21.15.102:0/2178056242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea80702c0 0x7f8ea812c9d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8e980ae040 tx=0x7f8e98019080 comp rx=0 tx=0).stop 2024-09-11T11:00:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 shutdown_connections 2024-09-11T11:00:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 --2- 172.21.15.102:0/2178056242 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e94035d20 0x7f8e940381e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 --2- 172.21.15.102:0/2178056242 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8ea80702c0 0x7f8ea812c9d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 >> 172.21.15.102:0/2178056242 conn(0x7f8ea809a8a0 msgr2=0x7f8ea8097d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 shutdown_connections 2024-09-11T11:00:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.854+0000 7f8eae297640 1 -- 172.21.15.102:0/2178056242 wait complete. 2024-09-11T11:00:52.884 DEBUG:teuthology.orchestra.run.smithi102:> rbd --cluster ceph pool init rbd 2024-09-11T11:00:52.933 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:00:52.934 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:00:52.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f85fdf80 1 Processor -- start 2024-09-11T11:00:52.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f85fdf80 1 -- start start 2024-09-11T11:00:52.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f85fdf80 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562ce5b73ca0 0x562ce5b784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:52.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f85fdf80 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x562ce5965ea0 con 0x562ce5b731b0 2024-09-11T11:00:52.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f85fdf80 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x562ce595ae20 con 0x562ce5b73ca0 2024-09-11T11:00:52.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f7111640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x562ce5b731b0 0x562ce5b73590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53476/0 (socket says 172.21.15.102:53476) 2024-09-11T11:00:52.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f7111640 1 -- 172.21.15.102:0/138624511 learned_addr learned my addr 172.21.15.102:0/138624511 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:52.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f6910640 1 --2- 172.21.15.102:0/138624511 >> v2:172.21.15.102:3300/0 conn(0x562ce5b73ca0 0x562ce5b784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:52.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f6910640 1 -- 172.21.15.102:0/138624511 >> v1:172.21.15.102:6789/0 conn(0x562ce5b731b0 legacy=0x562ce5b73590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:52.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.930+0000 7f33f6910640 1 -- 172.21.15.102:0/138624511 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce594c180 con 0x562ce5b73ca0 2024-09-11T11:00:52.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f6910640 1 --2- 172.21.15.102:0/138624511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b73ca0 0x562ce5b784d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00a480 tx=0x7f33ec01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78497b9a5f7f8dca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:52.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f610f640 1 -- 172.21.15.102:0/138624511 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec0af070 con 0x562ce5b73ca0 2024-09-11T11:00:52.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f610f640 1 -- 172.21.15.102:0/138624511 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec0aa530 con 0x562ce5b73ca0 2024-09-11T11:00:52.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f610f640 1 -- 172.21.15.102:0/138624511 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33ec0aa830 con 0x562ce5b73ca0 2024-09-11T11:00:52.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 -- 172.21.15.102:0/138624511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b73ca0 msgr2=0x562ce5b784d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:52.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/138624511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b73ca0 0x562ce5b784d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00a480 tx=0x7f33ec01b280 comp rx=0 tx=0).stop 2024-09-11T11:00:52.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 -- 172.21.15.102:0/138624511 shutdown_connections 2024-09-11T11:00:52.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/138624511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b73ca0 0x562ce5b784d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:52.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 -- 172.21.15.102:0/138624511 >> 172.21.15.102:0/138624511 conn(0x562ce5ae5e90 msgr2=0x562ce5ae22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:52.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 -- 172.21.15.102:0/138624511 shutdown_connections 2024-09-11T11:00:52.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 -- 172.21.15.102:0/138624511 wait complete. 2024-09-11T11:00:52.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 Processor -- start 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 -- start start 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b731b0 0x562ce5b5f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.934+0000 7f33f85fdf80 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562ce59b1800 con 0x562ce5b731b0 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f7111640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b731b0 0x562ce5b5f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f7111640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b731b0 0x562ce5b5f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35610/0 (socket says 172.21.15.102:35610) 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f7111640 1 -- 172.21.15.102:0/2642082691 learned_addr learned my addr 172.21.15.102:0/2642082691 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f7111640 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ce5936990 con 0x562ce5b731b0 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f7111640 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b731b0 0x562ce5b5f390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33e800bd40 tx=0x7f33e8009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e800e5b0 con 0x562ce5b731b0 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33e800e750 con 0x562ce5b731b0 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562ce5b61210 con 0x562ce5b731b0 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33e800eab0 con 0x562ce5b731b0 2024-09-11T11:00:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ce5b5f8d0 con 0x562ce5b731b0 2024-09-11T11:00:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 4) ==== 43997+0+0 (secure 0 0 0) 0x7f33e800ec50 con 0x562ce5b731b0 2024-09-11T11:00:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33e77fe640 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f33dc034610 0x7f33dc036ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3471+0+0 (secure 0 0 0) 0x7f33e8005050 con 0x562ce5b731b0 2024-09-11T11:00:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x562ce5b5fd10 con 0x562ce5b731b0 2024-09-11T11:00:52.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f6910640 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f33dc034610 0x7f33dc036ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:52.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:52.938+0000 7f33f6910640 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f33dc034610 0x7f33dc036ad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00a480 tx=0x7f33ec0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:53.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.850+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x7f33e8012020 con 0x562ce5b731b0 2024-09-11T11:00:53.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.854+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33ec0aa530 con 0x562ce5b731b0 2024-09-11T11:00:53.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.858+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f33e801c020 con 0x562ce5b731b0 2024-09-11T11:00:53.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.858+0000 7f33f590e640 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=16}) -- 0x7f33d4002af0 con 0x562ce5b731b0 2024-09-11T11:00:53.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.862+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 8 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f33e801e300 con 0x562ce5b731b0 2024-09-11T11:00:53.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.866+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 9 ==== osd_map(16..16 src has 1..16) ==== 650+0+0 (secure 0 0 0) 0x7f33e803c3d0 con 0x562ce5b731b0 2024-09-11T11:00:53.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.866+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562ce5b73ca0 0x562ce5b89be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:53.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.866+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x562ce5b8a120 con 0x562ce5b73ca0 2024-09-11T11:00:53.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.866+0000 7f33f8373640 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562ce5b73ca0 0x562ce5b89be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:53.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.866+0000 7f33f8373640 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562ce5b73ca0 0x562ce5b89be0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:53.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.870+0000 7f33f8373640 1 -- 172.21.15.102:0/2642082691 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f33f000a4d0 con 0x562ce5b73ca0 2024-09-11T11:00:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.874+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x562ce5bdb450 con 0x562ce5b73ca0 2024-09-11T11:00:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.874+0000 7f33f8373640 1 -- 172.21.15.102:0/2642082691 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33f000a4d0 con 0x562ce5b73ca0 2024-09-11T11:00:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.874+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x562ce5bda560 con 0x562ce5b73ca0 2024-09-11T11:00:53.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.874+0000 7f33f8373640 1 -- 172.21.15.102:0/2642082691 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f33f000a4d0 con 0x562ce5b73ca0 2024-09-11T11:00:53.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:53.874+0000 7f33f510d640 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f33d8001f10 con 0x562ce5b731b0 2024-09-11T11:00:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:54.866+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7f33e8015310 con 0x562ce5b731b0 2024-09-11T11:00:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:54.866+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f33dc03a2a0 con 0x562ce5b731b0 2024-09-11T11:00:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:54.866+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 11 ==== osd_map(17..17 src has 1..17) ==== 626+0+0 (secure 0 0 0) 0x7f33e804aa50 con 0x562ce5b731b0 2024-09-11T11:00:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:54.866+0000 7f33f590e640 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f33d4005690 con 0x562ce5b73ca0 2024-09-11T11:00:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:54.874+0000 7f33f8373640 1 -- 172.21.15.102:0/2642082691 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f33f000a4d0 con 0x562ce5b73ca0 2024-09-11T11:00:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:54.874+0000 7f33f510d640 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f33d8003360 con 0x562ce5b731b0 2024-09-11T11:00:55.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.870+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7f33e8045380 con 0x562ce5b731b0 2024-09-11T11:00:55.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.870+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7f33dc03a2a0 con 0x562ce5b731b0 2024-09-11T11:00:55.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.870+0000 7f33e77fe640 1 -- 172.21.15.102:0/2642082691 <== mon.0 v2:172.21.15.102:3300/0 13 ==== osd_map(18..18 src has 1..18) ==== 654+0+0 (secure 0 0 0) 0x7f33e800dc80 con 0x562ce5b731b0 2024-09-11T11:00:55.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.870+0000 7f33f590e640 1 -- 172.21.15.102:0/2642082691 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f33d4005a30 con 0x562ce5b73ca0 2024-09-11T11:00:55.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f8373640 1 -- 172.21.15.102:0/2642082691 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f33f000a4d0 con 0x562ce5b73ca0 2024-09-11T11:00:55.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562ce5b73ca0 msgr2=0x562ce5b89be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:55.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562ce5b73ca0 0x562ce5b89be0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f33dc034610 msgr2=0x7f33dc036ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f33dc034610 0x7f33dc036ad0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00a480 tx=0x7f33ec0a5000 comp rx=0 tx=0).stop 2024-09-11T11:00:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b731b0 msgr2=0x562ce5b5f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b731b0 0x562ce5b5f390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33e800bd40 tx=0x7f33e8009650 comp rx=0 tx=0).stop 2024-09-11T11:00:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 shutdown_connections 2024-09-11T11:00:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562ce5b73ca0 0x562ce5b89be0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f33dc034610 0x7f33dc036ad0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:55.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.878+0000 7f33f85fdf80 1 --2- 172.21.15.102:0/2642082691 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562ce5b731b0 0x562ce5b5f390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:55.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.882+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 >> 172.21.15.102:0/2642082691 conn(0x562ce5ae5e90 msgr2=0x562ce5ae01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:55.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.882+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 shutdown_connections 2024-09-11T11:00:55.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:55.882+0000 7f33f85fdf80 1 -- 172.21.15.102:0/2642082691 wait complete. 2024-09-11T11:00:55.892 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T11:00:55.893 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T11:00:55.893 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T11:00:55.893 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T11:00:55.893 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T11:00:56.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb353a640 1 Processor -- start 2024-09-11T11:00:56.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb353a640 1 -- start start 2024-09-11T11:00:56.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb353a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7effac06ece0 0x7effac130e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb353a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac06f750 con 0x7effac06e1f0 2024-09-11T11:00:56.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb353a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7effac070c10 con 0x7effac06ece0 2024-09-11T11:00:56.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb12d6640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7effac06e1f0 0x7effac06e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53478/0 (socket says 172.21.15.102:53478) 2024-09-11T11:00:56.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb12d6640 1 -- 172.21.15.102:0/927286669 learned_addr learned my addr 172.21.15.102:0/927286669 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:56.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb0ad5640 1 --2- 172.21.15.102:0/927286669 >> v2:172.21.15.102:3300/0 conn(0x7effac06ece0 0x7effac130e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effa3fff640 1 -- 172.21.15.102:0/927286669 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700018326 0 0) 0x7effac06f750 con 0x7effac06e1f0 2024-09-11T11:00:56.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effa3fff640 1 -- 172.21.15.102:0/927286669 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff98003530 con 0x7effac06e1f0 2024-09-11T11:00:56.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb0ad5640 1 -- 172.21.15.102:0/927286669 >> v1:172.21.15.102:6789/0 conn(0x7effac06e1f0 legacy=0x7effac06e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effa3fff640 1 -- 172.21.15.102:0/927286669 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 577624189 0 0) 0x7eff98003530 con 0x7effac06e1f0 2024-09-11T11:00:56.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb0ad5640 1 -- 172.21.15.102:0/927286669 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac0703f0 con 0x7effac06ece0 2024-09-11T11:00:56.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.018+0000 7effb0ad5640 1 --2- 172.21.15.102:0/927286669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06ece0 0x7effac130e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009740 tx=0x7eff9c01c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b1ad4c6f0b8ec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effa3fff640 1 -- 172.21.15.102:0/927286669 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff9c0b0070 con 0x7effac06ece0 2024-09-11T11:00:56.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effa3fff640 1 -- 172.21.15.102:0/927286669 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff9c0ab400 con 0x7effac06ece0 2024-09-11T11:00:56.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effa3fff640 1 -- 172.21.15.102:0/927286669 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa80015b0 con 0x7effac06ece0 2024-09-11T11:00:56.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- 172.21.15.102:0/927286669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06ece0 msgr2=0x7effac130e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 --2- 172.21.15.102:0/927286669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06ece0 0x7effac130e50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009740 tx=0x7eff9c01c290 comp rx=0 tx=0).stop 2024-09-11T11:00:56.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- 172.21.15.102:0/927286669 shutdown_connections 2024-09-11T11:00:56.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 --2- 172.21.15.102:0/927286669 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06ece0 0x7effac130e50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- 172.21.15.102:0/927286669 >> 172.21.15.102:0/927286669 conn(0x7effac099a50 msgr2=0x7effac0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- 172.21.15.102:0/927286669 shutdown_connections 2024-09-11T11:00:56.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- 172.21.15.102:0/927286669 wait complete. 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 Processor -- start 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- start start 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06e1f0 0x7effac127fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7effac133d30 con 0x7effac06e1f0 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb12d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06e1f0 0x7effac127fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb12d6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06e1f0 0x7effac127fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35636/0 (socket says 172.21.15.102:35636) 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb12d6640 1 -- 172.21.15.102:0/2436539074 learned_addr learned my addr 172.21.15.102:0/2436539074 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb12d6640 1 -- 172.21.15.102:0/2436539074 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac0726e0 con 0x7effac06e1f0 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb12d6640 1 --2- 172.21.15.102:0/2436539074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06e1f0 0x7effac127fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7effa800c6b0 tx=0x7effa800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effa1ffb640 1 -- 172.21.15.102:0/2436539074 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa8017070 con 0x7effac06e1f0 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effa1ffb640 1 -- 172.21.15.102:0/2436539074 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effa80058e0 con 0x7effac06e1f0 2024-09-11T11:00:56.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac12c0f0 con 0x7effac06e1f0 2024-09-11T11:00:56.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effa1ffb640 1 -- 172.21.15.102:0/2436539074 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effa8005c00 con 0x7effac06e1f0 2024-09-11T11:00:56.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac12adb0 con 0x7effac06e1f0 2024-09-11T11:00:56.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effac06e5d0 con 0x7effac06e1f0 2024-09-11T11:00:56.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effa1ffb640 1 -- 172.21.15.102:0/2436539074 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7effa801a070 con 0x7effac06e1f0 2024-09-11T11:00:56.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.022+0000 7effa1ffb640 1 --2- 172.21.15.102:0/2436539074 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff90035db0 0x7eff90038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.026+0000 7effa1ffb640 1 -- 172.21.15.102:0/2436539074 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7effa8047ad0 con 0x7effac06e1f0 2024-09-11T11:00:56.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.026+0000 7effb0ad5640 1 --2- 172.21.15.102:0/2436539074 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff90035db0 0x7eff90038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.026+0000 7effb0ad5640 1 --2- 172.21.15.102:0/2436539074 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff90035db0 0x7eff90038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0ad000 tx=0x7eff9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.030+0000 7effa1ffb640 1 -- 172.21.15.102:0/2436539074 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7effa8005da0 con 0x7effac06e1f0 2024-09-11T11:00:56.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.226+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7effac073790 con 0x7effac06e1f0 2024-09-11T11:00:56.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.226+0000 7effa1ffb640 1 -- 172.21.15.102:0/2436539074 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+84174 (secure 0 0 0) 0x7effa8007590 con 0x7effac06e1f0 2024-09-11T11:00:56.233 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:56.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff90035db0 msgr2=0x7eff90038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 --2- 172.21.15.102:0/2436539074 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff90035db0 0x7eff90038270 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff9c0ad000 tx=0x7eff9c008040 comp rx=0 tx=0).stop 2024-09-11T11:00:56.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06e1f0 msgr2=0x7effac127fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 --2- 172.21.15.102:0/2436539074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06e1f0 0x7effac127fc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7effa800c6b0 tx=0x7effa800cb70 comp rx=0 tx=0).stop 2024-09-11T11:00:56.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 shutdown_connections 2024-09-11T11:00:56.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 --2- 172.21.15.102:0/2436539074 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff90035db0 0x7eff90038270 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 --2- 172.21.15.102:0/2436539074 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7effac06e1f0 0x7effac127fc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 >> 172.21.15.102:0/2436539074 conn(0x7effac099a50 msgr2=0x7effac06d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 shutdown_connections 2024-09-11T11:00:56.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.230+0000 7effb353a640 1 -- 172.21.15.102:0/2436539074 wait complete. 2024-09-11T11:00:56.251 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6824","nonce":53826467},{"type":"v1","addr":"172.21.15.145:6825","nonce":53826467}]},"active_addr":"172.21.15.145:6825/53826467","active_change":"2024-09-11T11:00:40.924896+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":2785436244}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":692434368}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":3464521677}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.145:0","nonce":2421423650}]}]} 2024-09-11T11:00:56.253 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T11:00:56.253 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T11:00:56.253 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T11:00:56.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e25998640 1 Processor -- start 2024-09-11T11:00:56.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e25998640 1 -- start start 2024-09-11T11:00:56.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e25998640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8e2012f390 0x7f8e20133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e25998640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e200984f0 con 0x7f8e2012e760 2024-09-11T11:00:56.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e25998640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8e20098dc0 con 0x7f8e2012f390 2024-09-11T11:00:56.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e1e7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8e2012f390 0x7f8e20133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e1effd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8e2012e760 0x7f8e2012ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53484/0 (socket says 172.21.15.102:53484) 2024-09-11T11:00:56.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e1effd640 1 -- 172.21.15.102:0/2249137200 learned_addr learned my addr 172.21.15.102:0/2249137200 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:56.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e1e7fc640 1 -- 172.21.15.102:0/2249137200 >> v1:172.21.15.102:6789/0 conn(0x7f8e2012e760 legacy=0x7f8e2012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e1e7fc640 1 -- 172.21.15.102:0/2249137200 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e200981a0 con 0x7f8e2012f390 2024-09-11T11:00:56.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.362+0000 7f8e1dffb640 1 -- 172.21.15.102:0/2249137200 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159593781 0 0) 0x7f8e200984f0 con 0x7f8e2012e760 2024-09-11T11:00:56.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1e7fc640 1 --2- 172.21.15.102:0/2249137200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012f390 0x7f8e20133a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009740 tx=0x7f8e0801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f2ad81baf01835 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1dffb640 1 -- 172.21.15.102:0/2249137200 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e080b1070 con 0x7f8e2012f390 2024-09-11T11:00:56.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1dffb640 1 -- 172.21.15.102:0/2249137200 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e080ac570 con 0x7f8e2012f390 2024-09-11T11:00:56.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1dffb640 1 -- 172.21.15.102:0/2249137200 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e080ac870 con 0x7f8e2012f390 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- 172.21.15.102:0/2249137200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012f390 msgr2=0x7f8e20133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 --2- 172.21.15.102:0/2249137200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012f390 0x7f8e20133a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009740 tx=0x7f8e0801c400 comp rx=0 tx=0).stop 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- 172.21.15.102:0/2249137200 shutdown_connections 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 --2- 172.21.15.102:0/2249137200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012f390 0x7f8e20133a80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- 172.21.15.102:0/2249137200 >> 172.21.15.102:0/2249137200 conn(0x7f8e200a10a0 msgr2=0x7f8e200a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- 172.21.15.102:0/2249137200 shutdown_connections 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- 172.21.15.102:0/2249137200 wait complete. 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 Processor -- start 2024-09-11T11:00:56.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- start start 2024-09-11T11:00:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012e760 0x7f8e2012fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8e20136b70 con 0x7f8e2012e760 2024-09-11T11:00:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012e760 0x7f8e2012fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1effd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012e760 0x7f8e2012fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35656/0 (socket says 172.21.15.102:35656) 2024-09-11T11:00:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1effd640 1 -- 172.21.15.102:0/286051174 learned_addr learned my addr 172.21.15.102:0/286051174 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1effd640 1 -- 172.21.15.102:0/286051174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e20131f30 con 0x7f8e2012e760 2024-09-11T11:00:56.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e1effd640 1 --2- 172.21.15.102:0/286051174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012e760 0x7f8e2012fae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c840 tx=0x7f8e1800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e17fff640 1 -- 172.21.15.102:0/286051174 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e18018070 con 0x7f8e2012e760 2024-09-11T11:00:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e17fff640 1 -- 172.21.15.102:0/286051174 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1800a660 con 0x7f8e2012e760 2024-09-11T11:00:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e17fff640 1 -- 172.21.15.102:0/286051174 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8e1800a850 con 0x7f8e2012e760 2024-09-11T11:00:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e201323f0 con 0x7f8e2012e760 2024-09-11T11:00:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.366+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e20130020 con 0x7f8e2012e760 2024-09-11T11:00:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.370+0000 7f8e17fff640 1 -- 172.21.15.102:0/286051174 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8e1801b070 con 0x7f8e2012e760 2024-09-11T11:00:56.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.370+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e20132a20 con 0x7f8e2012e760 2024-09-11T11:00:56.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.370+0000 7f8e17fff640 1 --2- 172.21.15.102:0/286051174 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e00035db0 0x7f8e00038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.370+0000 7f8e17fff640 1 -- 172.21.15.102:0/286051174 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f8e18047dc0 con 0x7f8e2012e760 2024-09-11T11:00:56.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.370+0000 7f8e1e7fc640 1 --2- 172.21.15.102:0/286051174 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e00035db0 0x7f8e00038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.370+0000 7f8e1e7fc640 1 --2- 172.21.15.102:0/286051174 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e00035db0 0x7f8e00038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e080ae000 tx=0x7f8e08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.374+0000 7f8e17fff640 1 -- 172.21.15.102:0/286051174 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e18011360 con 0x7f8e2012e760 2024-09-11T11:00:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e2012ec80 con 0x7f8e2012e760 2024-09-11T11:00:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e17fff640 1 -- 172.21.15.102:0/286051174 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9901 (secure 0 0 0) 0x7f8e1801cda0 con 0x7f8e2012e760 2024-09-11T11:00:56.543 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:56.543 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":18,"fsid":"2f203b3f-97d8-4a3b-bc37-33833403bb89","created":"2024-09-11T11:00:36.331917+0000","modified":"2024-09-11T11:00:55.869253+0000","last_up_change":"2024-09-11T11:00:47.426191+0000","last_in_change":"2024-09-11T11:00:37.468939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T11:00:49.009964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T11:00:52.107760+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9cea281-6c68-455d-84fe-43662e932c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6801","nonce":3035634142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6803","nonce":3035634142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6807","nonce":3035634142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6805","nonce":3035634142}]},"public_addr":"172.21.15.102:6801/3035634142","cluster_addr":"172.21.15.102:6803/3035634142","heartbeat_back_addr":"172.21.15.102:6807/3035634142","heartbeat_front_addr":"172.21.15.102:6805/3035634142","state":["exists","up"]},{"osd":1,"uuid":"cde5215c-172e-4c43-9180-9619ea7bfc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6809","nonce":1879781812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6811","nonce":1879781812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6815","nonce":1879781812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6813","nonce":1879781812}]},"public_addr":"172.21.15.145:6809/1879781812","cluster_addr":"172.21.15.145:6811/1879781812","heartbeat_back_addr":"172.21.15.145:6815/1879781812","heartbeat_front_addr":"172.21.15.145:6813/1879781812","state":["exists","up"]},{"osd":2,"uuid":"1d00ec9b-54e3-4e8f-9c74-1deeb015da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6817","nonce":446921044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6819","nonce":446921044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6823","nonce":446921044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6821","nonce":446921044}]},"public_addr":"172.21.15.145:6817/446921044","cluster_addr":"172.21.15.145:6819/446921044","heartbeat_back_addr":"172.21.15.145:6823/446921044","heartbeat_front_addr":"172.21.15.145:6821/446921044","state":["exists","up"]},{"osd":3,"uuid":"8c84c992-dc47-43d3-9cfb-f83d4052d9a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6801","nonce":493661776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6803","nonce":493661776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6807","nonce":493661776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6805","nonce":493661776}]},"public_addr":"172.21.15.145:6801/493661776","cluster_addr":"172.21.15.145:6803/493661776","heartbeat_back_addr":"172.21.15.145:6807/493661776","heartbeat_front_addr":"172.21.15.145:6805/493661776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.674297+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.654148+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:45.317003+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.920650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T11:00:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e00035db0 msgr2=0x7f8e00038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e25998640 1 --2- 172.21.15.102:0/286051174 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e00035db0 0x7f8e00038270 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e080ae000 tx=0x7f8e08008040 comp rx=0 tx=0).stop 2024-09-11T11:00:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012e760 msgr2=0x7f8e2012fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e25998640 1 --2- 172.21.15.102:0/286051174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012e760 0x7f8e2012fae0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800c840 tx=0x7f8e1800cd00 comp rx=0 tx=0).stop 2024-09-11T11:00:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 shutdown_connections 2024-09-11T11:00:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e25998640 1 --2- 172.21.15.102:0/286051174 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e00035db0 0x7f8e00038270 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.538+0000 7f8e25998640 1 --2- 172.21.15.102:0/286051174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2012e760 0x7f8e2012fae0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.542+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 >> 172.21.15.102:0/286051174 conn(0x7f8e200a10a0 msgr2=0x7f8e20128080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.542+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 shutdown_connections 2024-09-11T11:00:56.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.542+0000 7f8e25998640 1 -- 172.21.15.102:0/286051174 wait complete. 2024-09-11T11:00:56.560 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T11:00:56.561 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T11:00:56.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.662+0000 7fe83c3f9640 1 Processor -- start 2024-09-11T11:00:56.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.662+0000 7fe83c3f9640 1 -- start start 2024-09-11T11:00:56.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.662+0000 7fe83c3f9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe83412cd50 0x7fe83412d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.662+0000 7fe83c3f9640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe83409e860 con 0x7fe834071c60 2024-09-11T11:00:56.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83c3f9640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe83412d670 con 0x7fe83412cd50 2024-09-11T11:00:56.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83a195640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe83412cd50 0x7fe83412d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe839994640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe834071c60 0x7fe83406f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53500/0 (socket says 172.21.15.102:53500) 2024-09-11T11:00:56.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe839994640 1 -- 172.21.15.102:0/1254345140 learned_addr learned my addr 172.21.15.102:0/1254345140 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:56.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe839193640 1 -- 172.21.15.102:0/1254345140 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754439609 0 0) 0x7fe83409e860 con 0x7fe834071c60 2024-09-11T11:00:56.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe839193640 1 -- 172.21.15.102:0/1254345140 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe820003530 con 0x7fe834071c60 2024-09-11T11:00:56.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83a195640 1 -- 172.21.15.102:0/1254345140 >> v1:172.21.15.102:6789/0 conn(0x7fe834071c60 legacy=0x7fe83406f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83a195640 1 -- 172.21.15.102:0/1254345140 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83412d820 con 0x7fe83412cd50 2024-09-11T11:00:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83a195640 1 --2- 172.21.15.102:0/1254345140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe83412cd50 0x7fe83412d130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe830009740 tx=0x7fe83001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1ac7631dc5ecc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe839193640 1 -- 172.21.15.102:0/1254345140 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8300ab550 con 0x7fe83412cd50 2024-09-11T11:00:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe839193640 1 -- 172.21.15.102:0/1254345140 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8300b0070 con 0x7fe83412cd50 2024-09-11T11:00:56.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe839193640 1 -- 172.21.15.102:0/1254345140 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8300ab820 con 0x7fe83412cd50 2024-09-11T11:00:56.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83c3f9640 1 -- 172.21.15.102:0/1254345140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe83412cd50 msgr2=0x7fe83412d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83c3f9640 1 --2- 172.21.15.102:0/1254345140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe83412cd50 0x7fe83412d130 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe830009740 tx=0x7fe83001c400 comp rx=0 tx=0).stop 2024-09-11T11:00:56.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83c3f9640 1 -- 172.21.15.102:0/1254345140 shutdown_connections 2024-09-11T11:00:56.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83c3f9640 1 --2- 172.21.15.102:0/1254345140 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe83412cd50 0x7fe83412d130 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83c3f9640 1 -- 172.21.15.102:0/1254345140 >> 172.21.15.102:0/1254345140 conn(0x7fe83409cd30 msgr2=0x7fe83409d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83c3f9640 1 -- 172.21.15.102:0/1254345140 shutdown_connections 2024-09-11T11:00:56.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.666+0000 7fe83c3f9640 1 -- 172.21.15.102:0/1254345140 wait complete. 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83c3f9640 1 Processor -- start 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83c3f9640 1 -- start start 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83c3f9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe834071c60 0x7fe834098680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83c3f9640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe834070b10 con 0x7fe834071c60 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83a195640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe834071c60 0x7fe834098680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83a195640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe834071c60 0x7fe834098680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35680/0 (socket says 172.21.15.102:35680) 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83a195640 1 -- 172.21.15.102:0/3008364600 learned_addr learned my addr 172.21.15.102:0/3008364600 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83a195640 1 -- 172.21.15.102:0/3008364600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83406f180 con 0x7fe834071c60 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83a195640 1 --2- 172.21.15.102:0/3008364600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe834071c60 0x7fe834098680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe83001aab0 tx=0x7fe8300191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe82affd640 1 -- 172.21.15.102:0/3008364600 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe830003b20 con 0x7fe834071c60 2024-09-11T11:00:56.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe82affd640 1 -- 172.21.15.102:0/3008364600 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe830003ce0 con 0x7fe834071c60 2024-09-11T11:00:56.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe83412a2c0 con 0x7fe834071c60 2024-09-11T11:00:56.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe82affd640 1 -- 172.21.15.102:0/3008364600 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8300ab420 con 0x7fe834071c60 2024-09-11T11:00:56.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe834098d90 con 0x7fe834071c60 2024-09-11T11:00:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe82affd640 1 -- 172.21.15.102:0/3008364600 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe8300c3060 con 0x7fe834071c60 2024-09-11T11:00:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe834129e00 con 0x7fe834071c60 2024-09-11T11:00:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe82affd640 1 --2- 172.21.15.102:0/3008364600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe818035db0 0x7fe818038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe82affd640 1 -- 172.21.15.102:0/3008364600 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe8300e2b10 con 0x7fe834071c60 2024-09-11T11:00:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe839994640 1 --2- 172.21.15.102:0/3008364600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe818035db0 0x7fe818038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.670+0000 7fe839994640 1 --2- 172.21.15.102:0/3008364600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe818035db0 0x7fe818038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe824000f70 tx=0x7fe8240010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.674+0000 7fe82affd640 1 -- 172.21.15.102:0/3008364600 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe830015ff0 con 0x7fe834071c60 2024-09-11T11:00:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.834+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe834070e10 con 0x7fe834071c60 2024-09-11T11:00:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.834+0000 7fe82affd640 1 -- 172.21.15.102:0/3008364600 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+9901 (secure 0 0 0) 0x7fe8300bb560 con 0x7fe834071c60 2024-09-11T11:00:56.839 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:00:56.839 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":18,"fsid":"2f203b3f-97d8-4a3b-bc37-33833403bb89","created":"2024-09-11T11:00:36.331917+0000","modified":"2024-09-11T11:00:55.869253+0000","last_up_change":"2024-09-11T11:00:47.426191+0000","last_in_change":"2024-09-11T11:00:37.468939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T11:00:49.009964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T11:00:52.107760+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9cea281-6c68-455d-84fe-43662e932c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6801","nonce":3035634142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6803","nonce":3035634142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6807","nonce":3035634142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6805","nonce":3035634142}]},"public_addr":"172.21.15.102:6801/3035634142","cluster_addr":"172.21.15.102:6803/3035634142","heartbeat_back_addr":"172.21.15.102:6807/3035634142","heartbeat_front_addr":"172.21.15.102:6805/3035634142","state":["exists","up"]},{"osd":1,"uuid":"cde5215c-172e-4c43-9180-9619ea7bfc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6809","nonce":1879781812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6811","nonce":1879781812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6815","nonce":1879781812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6813","nonce":1879781812}]},"public_addr":"172.21.15.145:6809/1879781812","cluster_addr":"172.21.15.145:6811/1879781812","heartbeat_back_addr":"172.21.15.145:6815/1879781812","heartbeat_front_addr":"172.21.15.145:6813/1879781812","state":["exists","up"]},{"osd":2,"uuid":"1d00ec9b-54e3-4e8f-9c74-1deeb015da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6817","nonce":446921044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6819","nonce":446921044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6823","nonce":446921044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6821","nonce":446921044}]},"public_addr":"172.21.15.145:6817/446921044","cluster_addr":"172.21.15.145:6819/446921044","heartbeat_back_addr":"172.21.15.145:6823/446921044","heartbeat_front_addr":"172.21.15.145:6821/446921044","state":["exists","up"]},{"osd":3,"uuid":"8c84c992-dc47-43d3-9cfb-f83d4052d9a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6801","nonce":493661776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6803","nonce":493661776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6807","nonce":493661776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6805","nonce":493661776}]},"public_addr":"172.21.15.145:6801/493661776","cluster_addr":"172.21.15.145:6803/493661776","heartbeat_back_addr":"172.21.15.145:6807/493661776","heartbeat_front_addr":"172.21.15.145:6805/493661776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.674297+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.654148+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:45.317003+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.920650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T11:00:56.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe818035db0 msgr2=0x7fe818038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 --2- 172.21.15.102:0/3008364600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe818035db0 0x7fe818038270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe824000f70 tx=0x7fe8240010b0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe834071c60 msgr2=0x7fe834098680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 --2- 172.21.15.102:0/3008364600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe834071c60 0x7fe834098680 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe83001aab0 tx=0x7fe8300191a0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 shutdown_connections 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 --2- 172.21.15.102:0/3008364600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe818035db0 0x7fe818038270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 --2- 172.21.15.102:0/3008364600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe834071c60 0x7fe834098680 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 >> 172.21.15.102:0/3008364600 conn(0x7fe83409cd30 msgr2=0x7fe834099600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 shutdown_connections 2024-09-11T11:00:56.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.838+0000 7fe83c3f9640 1 -- 172.21.15.102:0/3008364600 wait complete. 2024-09-11T11:00:56.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T11:00:56.857 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T11:00:56.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T11:00:56.858 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T11:00:56.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14f7c6640 1 Processor -- start 2024-09-11T11:00:56.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14f7c6640 1 -- start start 2024-09-11T11:00:56.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f9a02b4c640 1 Processor -- start 2024-09-11T11:00:56.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f9a02b4c640 1 -- start start 2024-09-11T11:00:56.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f9a34640 1 Processor -- start 2024-09-11T11:00:56.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f9a34640 1 -- start start 2024-09-11T11:00:56.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14f7c6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe148070870 0x7fe148131dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14f7c6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe14809e860 con 0x7fe14812cd50 2024-09-11T11:00:56.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14f7c6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe14812d840 con 0x7fe148070870 2024-09-11T11:00:56.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14cd61640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe148070870 0x7fe148131dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14d562640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe14812cd50 0x7fe14812d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53506/0 (socket says 172.21.15.102:53506) 2024-09-11T11:00:56.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14d562640 1 -- 172.21.15.102:0/3362129512 learned_addr learned my addr 172.21.15.102:0/3362129512 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:56.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f9a34640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe6f406bce0 0x7fe6f412c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f9a02b4c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f99fc1319b0 0x7f99fc133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f9a34640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6f406c5d0 con 0x7fe6f412ceb0 2024-09-11T11:00:56.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f9a34640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe6f4073920 con 0x7fe6f406bce0 2024-09-11T11:00:56.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14cd61640 1 -- 172.21.15.102:0/3362129512 >> v1:172.21.15.102:6789/0 conn(0x7fe14812cd50 legacy=0x7fe14812d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe14cd61640 1 -- 172.21.15.102:0/3362129512 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe148071c60 con 0x7fe148070870 2024-09-11T11:00:56.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f9a02b4c640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99fc09aa70 con 0x7f99fc12b7d0 2024-09-11T11:00:56.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f9a02b4c640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f99fc09e090 con 0x7f99fc1319b0 2024-09-11T11:00:56.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f9a008e8640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f99fc12b7d0 0x7f99fc12bbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53516/0 (socket says 172.21.15.102:53516) 2024-09-11T11:00:56.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f9a008e8640 1 -- 172.21.15.102:0/1713177750 learned_addr learned my addr 172.21.15.102:0/1713177750 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:56.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f99fbfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f99fc1319b0 0x7f99fc133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f27fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe6f412ceb0 0x7fe6f4070350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53520/0 (socket says 172.21.15.102:53520) 2024-09-11T11:00:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f27fc640 1 -- 172.21.15.102:0/1032017186 learned_addr learned my addr 172.21.15.102:0/1032017186 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f2ffd640 1 --2- 172.21.15.102:0/1032017186 >> v2:172.21.15.102:3300/0 conn(0x7fe6f406bce0 0x7fe6f412c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54d60f5640 1 Processor -- start 2024-09-11T11:00:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f99fb7fe640 1 -- 172.21.15.102:0/1713177750 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140213945 0 0) 0x7f99fc09aa70 con 0x7f99fc12b7d0 2024-09-11T11:00:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f99fb7fe640 1 -- 172.21.15.102:0/1713177750 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99ec003530 con 0x7f99fc12b7d0 2024-09-11T11:00:56.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54d60f5640 1 -- start start 2024-09-11T11:00:56.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f99fb7fe640 1 -- 172.21.15.102:0/1713177750 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3964132188 0 0) 0x7f99ec003530 con 0x7f99fc12b7d0 2024-09-11T11:00:56.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f99fbfff640 1 -- 172.21.15.102:0/1713177750 >> v1:172.21.15.102:6789/0 conn(0x7f99fc12b7d0 legacy=0x7f99fc12bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f99fbfff640 1 -- 172.21.15.102:0/1713177750 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc075250 con 0x7f99fc1319b0 2024-09-11T11:00:56.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f2ffd640 1 -- 172.21.15.102:0/1032017186 >> v1:172.21.15.102:6789/0 conn(0x7fe6f412ceb0 legacy=0x7fe6f4070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7fe6f2ffd640 1 -- 172.21.15.102:0/1032017186 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f412c520 con 0x7fe6f406bce0 2024-09-11T11:00:56.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54d60f5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f54d0091630 0x7f54d0091a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54d60f5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54d0092da0 con 0x7f54d0091f50 2024-09-11T11:00:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54d60f5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f54d0093fc0 con 0x7f54d0091630 2024-09-11T11:00:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54cf7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f54d0091630 0x7f54d0091a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54cf7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f54d0091630 0x7f54d0091a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35718/0 (socket says 172.21.15.102:35718) 2024-09-11T11:00:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54cf7fe640 1 -- 172.21.15.102:0/759328608 learned_addr learned my addr 172.21.15.102:0/759328608 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54cf7fe640 1 -- 172.21.15.102:0/759328608 >> v1:172.21.15.102:6789/0 conn(0x7f54d0091f50 legacy=0x7f54d012f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T11:00:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.962+0000 7f54cf7fe640 1 -- 172.21.15.102:0/759328608 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d0092a80 con 0x7f54d0091630 2024-09-11T11:00:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f2ffd640 1 --2- 172.21.15.102:0/1032017186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f406bce0 0x7fe6f412c970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009770 tx=0x7fe6e401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad72ad3fd1e931e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14cd61640 1 --2- 172.21.15.102:0/3362129512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe148070870 0x7fe148131dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe138009740 tx=0x7fe13801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dedf7a9ccaa0d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f1ffb640 1 -- 172.21.15.102:0/1032017186 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6e40b1070 con 0x7fe6f406bce0 2024-09-11T11:00:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f1ffb640 1 -- 172.21.15.102:0/1032017186 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e40ac520 con 0x7fe6f406bce0 2024-09-11T11:00:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f1ffb640 1 -- 172.21.15.102:0/1032017186 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6e40ac820 con 0x7fe6f406bce0 2024-09-11T11:00:56.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe13ffff640 1 -- 172.21.15.102:0/3362129512 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1380ab550 con 0x7fe148070870 2024-09-11T11:00:56.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe13ffff640 1 -- 172.21.15.102:0/3362129512 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1380b0070 con 0x7fe148070870 2024-09-11T11:00:56.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe13ffff640 1 -- 172.21.15.102:0/3362129512 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe1380ab840 con 0x7fe148070870 2024-09-11T11:00:56.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54cf7fe640 1 --2- 172.21.15.102:0/759328608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0091a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009e50 tx=0x7f54c001da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d963b6b85d56aa4f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54ce7fc640 1 -- 172.21.15.102:0/759328608 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c0009200 con 0x7f54d0091630 2024-09-11T11:00:56.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54ce7fc640 1 -- 172.21.15.102:0/759328608 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c00a6740 con 0x7f54d0091630 2024-09-11T11:00:56.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54ce7fc640 1 -- 172.21.15.102:0/759328608 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c00a6a40 con 0x7f54d0091630 2024-09-11T11:00:56.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f99fbfff640 1 --2- 172.21.15.102:0/1713177750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc1319b0 0x7f99fc133da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009740 tx=0x7f99e801c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1868fe044856157e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f99fb7fe640 1 -- 172.21.15.102:0/1713177750 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99e80b0070 con 0x7f99fc1319b0 2024-09-11T11:00:56.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f99fb7fe640 1 -- 172.21.15.102:0/1713177750 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99e80ab400 con 0x7f99fc1319b0 2024-09-11T11:00:56.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f99fb7fe640 1 -- 172.21.15.102:0/1713177750 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99f00015b0 con 0x7f99fc1319b0 2024-09-11T11:00:56.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1032017186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f406bce0 msgr2=0x7fe6f412c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 --2- 172.21.15.102:0/1032017186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f406bce0 0x7fe6f412c970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009770 tx=0x7fe6e401c370 comp rx=0 tx=0).stop 2024-09-11T11:00:56.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1032017186 shutdown_connections 2024-09-11T11:00:56.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 --2- 172.21.15.102:0/1032017186 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f406bce0 0x7fe6f412c970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1032017186 >> 172.21.15.102:0/1032017186 conn(0x7fe6f409a6f0 msgr2=0x7fe6f409ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 -- 172.21.15.102:0/3362129512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe148070870 msgr2=0x7fe148131dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 --2- 172.21.15.102:0/3362129512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe148070870 0x7fe148131dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe138009740 tx=0x7fe13801c400 comp rx=0 tx=0).stop 2024-09-11T11:00:56.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1032017186 shutdown_connections 2024-09-11T11:00:56.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1032017186 wait complete. 2024-09-11T11:00:56.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 -- 172.21.15.102:0/3362129512 shutdown_connections 2024-09-11T11:00:56.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 --2- 172.21.15.102:0/3362129512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe148070870 0x7fe148131dc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 -- 172.21.15.102:0/3362129512 >> 172.21.15.102:0/3362129512 conn(0x7fe14809cd30 msgr2=0x7fe14809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 Processor -- start 2024-09-11T11:00:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 -- 172.21.15.102:0/759328608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 msgr2=0x7f54d0091a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 --2- 172.21.15.102:0/759328608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0091a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009e50 tx=0x7f54c001da50 comp rx=0 tx=0).stop 2024-09-11T11:00:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 -- 172.21.15.102:0/759328608 shutdown_connections 2024-09-11T11:00:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 --2- 172.21.15.102:0/759328608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0091a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 -- 172.21.15.102:0/759328608 >> 172.21.15.102:0/759328608 conn(0x7f54d009d4c0 msgr2=0x7f54d009d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 -- 172.21.15.102:0/759328608 shutdown_connections 2024-09-11T11:00:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 -- 172.21.15.102:0/759328608 wait complete. 2024-09-11T11:00:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 -- 172.21.15.102:0/3362129512 shutdown_connections 2024-09-11T11:00:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 -- 172.21.15.102:0/3362129512 wait complete. 2024-09-11T11:00:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 Processor -- start 2024-09-11T11:00:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1713177750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc1319b0 msgr2=0x7f99fc133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 --2- 172.21.15.102:0/1713177750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc1319b0 0x7f99fc133da0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009740 tx=0x7f99e801c290 comp rx=0 tx=0).stop 2024-09-11T11:00:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1713177750 shutdown_connections 2024-09-11T11:00:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 --2- 172.21.15.102:0/1713177750 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc1319b0 0x7f99fc133da0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1713177750 >> 172.21.15.102:0/1713177750 conn(0x7f99fc09d830 msgr2=0x7f99fc099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1713177750 shutdown_connections 2024-09-11T11:00:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1713177750 wait complete. 2024-09-11T11:00:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 -- start start 2024-09-11T11:00:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 -- start start 2024-09-11T11:00:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 Processor -- start 2024-09-11T11:00:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe14812cd50 0x7fe14806d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe148134d30 con 0x7fe14812cd50 2024-09-11T11:00:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 -- start start 2024-09-11T11:00:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f412ceb0 0x7fe6f412d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f9a34640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe6f406e500 con 0x7fe6f412ceb0 2024-09-11T11:00:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f412ceb0 0x7fe6f412d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14d562640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe14812cd50 0x7fe14806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14d562640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe14812cd50 0x7fe14806d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35730/0 (socket says 172.21.15.102:35730) 2024-09-11T11:00:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14d562640 1 -- 172.21.15.102:0/2118583631 learned_addr learned my addr 172.21.15.102:0/2118583631 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f412ceb0 0x7fe6f412d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35742/0 (socket says 172.21.15.102:35742) 2024-09-11T11:00:56.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f2ffd640 1 -- 172.21.15.102:0/1776250070 learned_addr learned my addr 172.21.15.102:0/1776250070 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:56.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 Processor -- start 2024-09-11T11:00:56.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14d562640 1 -- 172.21.15.102:0/2118583631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe148072cd0 con 0x7fe14812cd50 2024-09-11T11:00:56.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f2ffd640 1 -- 172.21.15.102:0/1776250070 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6f4130110 con 0x7fe6f412ceb0 2024-09-11T11:00:56.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0070910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54d60f5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f54d0132cf0 con 0x7f54d0091630 2024-09-11T11:00:56.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14d562640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe14812cd50 0x7fe14806d170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c480 tx=0x7fe14400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54cf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0070910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54cf7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0070910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35754/0 (socket says 172.21.15.102:35754) 2024-09-11T11:00:56.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f54cf7fe640 1 -- 172.21.15.102:0/3649215080 learned_addr learned my addr 172.21.15.102:0/3649215080 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:56.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe6f2ffd640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f412ceb0 0x7fe6f412d500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40af040 tx=0x7fe6e4019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe144017070 con 0x7fe14812cd50 2024-09-11T11:00:56.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe144005c20 con 0x7fe14812cd50 2024-09-11T11:00:56.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14806e6f0 con 0x7fe14812cd50 2024-09-11T11:00:56.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.966+0000 7f9a02b4c640 1 -- start start 2024-09-11T11:00:56.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14808b0b0 con 0x7fe14812cd50 2024-09-11T11:00:56.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe144007070 con 0x7fe14812cd50 2024-09-11T11:00:56.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a02b4c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc12b7d0 0x7f99fc12f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a02b4c640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc136c80 con 0x7f99fc12b7d0 2024-09-11T11:00:56.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6e40b9070 con 0x7fe6f412ceb0 2024-09-11T11:00:56.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6e40b5600 con 0x7fe6f412ceb0 2024-09-11T11:00:56.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6e40b1040 con 0x7fe6f412ceb0 2024-09-11T11:00:56.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6f41303d0 con 0x7fe6f412ceb0 2024-09-11T11:00:56.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6f41322f0 con 0x7fe6f412ceb0 2024-09-11T11:00:56.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54cf7fe640 1 -- 172.21.15.102:0/3649215080 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d0126900 con 0x7f54d0091630 2024-09-11T11:00:56.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54cf7fe640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0070910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54c001b680 tx=0x7f54c001c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c00bc030 con 0x7f54d0091630 2024-09-11T11:00:56.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d00734b0 con 0x7f54d0091630 2024-09-11T11:00:56.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d0071020 con 0x7f54d0091630 2024-09-11T11:00:56.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe128000f90 con 0x7fe14812cd50 2024-09-11T11:00:56.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c0007a60 con 0x7f54d0091630 2024-09-11T11:00:56.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54c0007d80 con 0x7f54d0091630 2024-09-11T11:00:56.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe14401a070 con 0x7fe14812cd50 2024-09-11T11:00:56.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe13dffb640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe12c035db0 0x7fe12c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe144047990 con 0x7fe14812cd50 2024-09-11T11:00:56.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe6e40bc070 con 0x7fe6f412ceb0 2024-09-11T11:00:56.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a008e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc12b7d0 0x7f99fc12f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a008e8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc12b7d0 0x7f99fc12f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35758/0 (socket says 172.21.15.102:35758) 2024-09-11T11:00:56.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a008e8640 1 -- 172.21.15.102:0/1072230252 learned_addr learned my addr 172.21.15.102:0/1072230252 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:56.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe6f4126c70 con 0x7fe6f412ceb0 2024-09-11T11:00:56.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe13dffb640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe12c03b530 0x7fe12c03d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe144013e50 con 0x7fe12c03b530 2024-09-11T11:00:56.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe14404c2a0 con 0x7fe14812cd50 2024-09-11T11:00:56.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54b0000f90 con 0x7f54d0091630 2024-09-11T11:00:56.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe6e0035e50 0x7fe6e0038310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe14cd61640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe12c035db0 0x7fe12c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fe6e40e2690 con 0x7fe6f412ceb0 2024-09-11T11:00:56.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7fe6e003b5d0 0x7fe6e003da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6e40ac520 con 0x7fe6e003b5d0 2024-09-11T11:00:56.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a008e8640 1 -- 172.21.15.102:0/1072230252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc08b850 con 0x7f99fc12b7d0 2024-09-11T11:00:56.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f54c00bf070 con 0x7f54d0091630 2024-09-11T11:00:56.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a008e8640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc12b7d0 0x7f99fc12f660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c6b0 tx=0x7f99f000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6f37fe640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7fe6e003b5d0 0x7fe6e003da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54bc035e00 0x7f54bc0382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe14dd63640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe12c03b530 0x7fe12c03d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f54c00bd070 con 0x7f54d0091630 2024-09-11T11:00:56.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f54bc03b580 0x7f54bc03da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:56.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54c00020c0 con 0x7f54bc03b580 2024-09-11T11:00:56.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6f27fc640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe6e0035e50 0x7fe6e0038310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6f37fe640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7fe6e003b5d0 0x7fe6e003da50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fe6e40ab390 con 0x7fe6f412ceb0 2024-09-11T11:00:56.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f54c00ea050 con 0x7f54d0091630 2024-09-11T11:00:56.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54ceffd640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54bc035e00 0x7f54bc0382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54cffff640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f54bc03b580 0x7f54bc03da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:56.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe14cd61640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe12c035db0 0x7fe12c038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe1380af000 tx=0x7fe1380a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe14dd63640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe12c03b530 0x7fe12c03d9b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99f0017070 con 0x7f99fc12b7d0 2024-09-11T11:00:56.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99f00058e0 con 0x7f99fc12b7d0 2024-09-11T11:00:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f99f0005c00 con 0x7f99fc12b7d0 2024-09-11T11:00:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99fc12ad90 con 0x7f99fc12b7d0 2024-09-11T11:00:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99fc12fba0 con 0x7f99fc12b7d0 2024-09-11T11:00:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6f27fc640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe6e0035e50 0x7fe6e0038310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8001610 tx=0x7fe6e8007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe6e40ac520 con 0x7fe6e003b5d0 2024-09-11T11:00:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99fc1310d0 con 0x7f99fc12b7d0 2024-09-11T11:00:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54ceffd640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54bc035e00 0x7f54bc0382c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54c4003d20 tx=0x7f54c4007a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f99f001a070 con 0x7f99fc12b7d0 2024-09-11T11:00:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.970+0000 7f54cffff640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f54bc03b580 0x7f54bc03da00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f99f97fa640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f99e0035e00 0x7f99e00382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f99f0047ab0 con 0x7f99fc12b7d0 2024-09-11T11:00:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f99f97fa640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f99e003b580 0x7f99e003da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99e003e0d0 con 0x7f99e003b580 2024-09-11T11:00:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f99f004c220 con 0x7f99fc12b7d0 2024-09-11T11:00:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f99fbfff640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f99e0035e00 0x7f99e00382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f9a010e9640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f99e003b580 0x7f99e003da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f9a010e9640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f99e003b580 0x7f99e003da00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f99fbfff640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f99e0035e00 0x7f99e00382c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f99e80ad000 tx=0x7f99e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54c00020c0 con 0x7f54bc03b580 2024-09-11T11:00:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe144013e50 con 0x7fe12c03b530 2024-09-11T11:00:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.974+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99e003e0d0 con 0x7f99e003b580 2024-09-11T11:00:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe6f412e6f0 con 0x7fe6e003b5d0 2024-09-11T11:00:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6dbfff640 1 -- 172.21.15.102:0/1776250070 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe6ec00adb0 con 0x7fe6e003b5d0 2024-09-11T11:00:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7fe6e003b5d0 msgr2=0x7fe6e003da50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7fe6e003b5d0 0x7fe6e003da50 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe6e0035e50 msgr2=0x7fe6e0038310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe6e0035e50 0x7fe6e0038310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe6e8001610 tx=0x7fe6e8007ad0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f412ceb0 msgr2=0x7fe6f412d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f412ceb0 0x7fe6f412d500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40af040 tx=0x7fe6e4019110 comp rx=0 tx=0).stop 2024-09-11T11:00:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 shutdown_connections 2024-09-11T11:00:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7fe6e003b5d0 0x7fe6e003da50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe6e0035e50 0x7fe6e0038310 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 --2- 172.21.15.102:0/1776250070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe6f412ceb0 0x7fe6f412d500 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 >> 172.21.15.102:0/1776250070 conn(0x7fe6f409a6f0 msgr2=0x7fe6f406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 shutdown_connections 2024-09-11T11:00:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.986+0000 7fe6f9a34640 1 -- 172.21.15.102:0/1776250070 wait complete. 2024-09-11T11:00:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54b0002c80 con 0x7f54bc03b580 2024-09-11T11:00:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe128002c80 con 0x7fe12c03b530 2024-09-11T11:00:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54b7fff640 1 -- 172.21.15.102:0/3649215080 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f54b0002c80 con 0x7f54bc03b580 2024-09-11T11:00:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99fc12bbb0 con 0x7f99e003b580 2024-09-11T11:00:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe13dffb640 1 -- 172.21.15.102:0/2118583631 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe128002c80 con 0x7fe12c03b530 2024-09-11T11:00:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe12c03b530 msgr2=0x7fe12c03d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe12c03b530 0x7fe12c03d9b0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f54bc03b580 msgr2=0x7f54bc03da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f54bc03b580 0x7f54bc03da00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe12c035db0 msgr2=0x7fe12c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe12c035db0 0x7fe12c038270 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe1380af000 tx=0x7fe1380a7000 comp rx=0 tx=0).stop 2024-09-11T11:00:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe14812cd50 msgr2=0x7fe14806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe14812cd50 0x7fe14806d170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe14400c480 tx=0x7fe14400c940 comp rx=0 tx=0).stop 2024-09-11T11:00:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54bc035e00 msgr2=0x7f54bc0382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54bc035e00 0x7f54bc0382c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f54c4003d20 tx=0x7f54c4007a60 comp rx=0 tx=0).stop 2024-09-11T11:00:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 msgr2=0x7f54d0070910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0070910 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54c001b680 tx=0x7f54c001c290 comp rx=0 tx=0).stop 2024-09-11T11:00:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 shutdown_connections 2024-09-11T11:00:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe12c03b530 0x7fe12c03d9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe12c035db0 0x7fe12c038270 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 --2- 172.21.15.102:0/2118583631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe14812cd50 0x7fe14806d170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 >> 172.21.15.102:0/2118583631 conn(0x7fe14809cd30 msgr2=0x7fe148099c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f99f97fa640 1 -- 172.21.15.102:0/1072230252 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f99fc12bbb0 con 0x7f99e003b580 2024-09-11T11:00:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 shutdown_connections 2024-09-11T11:00:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f54bc03b580 0x7f54bc03da00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54bc035e00 0x7f54bc0382c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 --2- 172.21.15.102:0/3649215080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54d0091630 0x7f54d0070910 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 >> 172.21.15.102:0/3649215080 conn(0x7f54d009d4c0 msgr2=0x7f54d008f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 shutdown_connections 2024-09-11T11:00:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 shutdown_connections 2024-09-11T11:00:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7fe14f7c6640 1 -- 172.21.15.102:0/2118583631 wait complete. 2024-09-11T11:00:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f54d60f5640 1 -- 172.21.15.102:0/3649215080 wait complete. 2024-09-11T11:00:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f99e003b580 msgr2=0x7f99e003da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f99e003b580 0x7f99e003da00 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f99e0035e00 msgr2=0x7f99e00382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f99e0035e00 0x7f99e00382c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f99e80ad000 tx=0x7f99e8008040 comp rx=0 tx=0).stop 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc12b7d0 msgr2=0x7f99fc12f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc12b7d0 0x7f99fc12f660 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c6b0 tx=0x7f99f000cb70 comp rx=0 tx=0).stop 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 shutdown_connections 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f99e003b580 0x7f99e003da00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f99e0035e00 0x7f99e00382c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 --2- 172.21.15.102:0/1072230252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f99fc12b7d0 0x7f99fc12f660 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 >> 172.21.15.102:0/1072230252 conn(0x7f99fc09d830 msgr2=0x7f99fc096740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 shutdown_connections 2024-09-11T11:00:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:56.990+0000 7f9a02b4c640 1 -- 172.21.15.102:0/1072230252 wait complete. 2024-09-11T11:00:57.015 INFO:teuthology.orchestra.run.smithi102.stdout:42949672965 2024-09-11T11:00:57.015 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T11:00:57.017 INFO:teuthology.orchestra.run.smithi102.stdout:42949672964 2024-09-11T11:00:57.017 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T11:00:57.019 INFO:teuthology.orchestra.run.smithi102.stdout:38654705668 2024-09-11T11:00:57.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T11:00:57.022 INFO:teuthology.orchestra.run.smithi102.stdout:42949672964 2024-09-11T11:00:57.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T11:00:57.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f9655c08640 1 Processor -- start 2024-09-11T11:00:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f9655c08640 1 -- start start 2024-09-11T11:00:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f9655c08640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f965012ed70 0x7f965012f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f9655c08640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965006f8a0 con 0x7f965012f690 2024-09-11T11:00:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f9655c08640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f965006eac0 con 0x7f965012ed70 2024-09-11T11:00:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964f7fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f965012ed70 0x7f965012f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964effd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f965012f690 0x7f965006d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53538/0 (socket says 172.21.15.102:53538) 2024-09-11T11:00:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964effd640 1 -- 172.21.15.102:0/4248672019 learned_addr learned my addr 172.21.15.102:0/4248672019 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964f7fe640 1 -- 172.21.15.102:0/4248672019 >> v1:172.21.15.102:6789/0 conn(0x7f965012f690 legacy=0x7f965006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964f7fe640 1 -- 172.21.15.102:0/4248672019 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965006fbb0 con 0x7f965012ed70 2024-09-11T11:00:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964e7fc640 1 -- 172.21.15.102:0/4248672019 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 916333743 0 0) 0x7f965006f8a0 con 0x7f965012f690 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb4ca06640 1 Processor -- start 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb4ca06640 1 -- start start 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb4ca06640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb481319b0 0x7fcb48133da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb4ca06640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4809aa70 con 0x7fcb4812b7d0 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb4ca06640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4809e090 con 0x7fcb481319b0 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb45d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb481319b0 0x7fcb48133da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb45d9b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcb481319b0 0x7fcb48133da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35776/0 (socket says 172.21.15.102:35776) 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb45d9b640 1 -- 172.21.15.102:0/1978624054 learned_addr learned my addr 172.21.15.102:0/1978624054 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb4659c640 1 --1- 172.21.15.102:0/1978624054 >> v1:172.21.15.102:6789/0 conn(0x7fcb4812b7d0 0x7fcb4812bbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53540/0 (socket says 172.21.15.102:53540) 2024-09-11T11:00:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb45d9b640 1 -- 172.21.15.102:0/1978624054 >> v1:172.21.15.102:6789/0 conn(0x7fcb4812b7d0 legacy=0x7fcb4812bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7fcb45d9b640 1 -- 172.21.15.102:0/1978624054 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48075250 con 0x7fcb481319b0 2024-09-11T11:00:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964f7fe640 1 --2- 172.21.15.102:0/4248672019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f965012f150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9640009740 tx=0x7f964001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc71e11ebf55921 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964e7fc640 1 -- 172.21.15.102:0/4248672019 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96400b1070 con 0x7f965012ed70 2024-09-11T11:00:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964e7fc640 1 -- 172.21.15.102:0/4248672019 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96400ac570 con 0x7f965012ed70 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.118+0000 7f964e7fc640 1 -- 172.21.15.102:0/4248672019 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96400ac870 con 0x7f965012ed70 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- 172.21.15.102:0/4248672019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 msgr2=0x7f965012f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 --2- 172.21.15.102:0/4248672019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f965012f150 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9640009740 tx=0x7f964001c400 comp rx=0 tx=0).stop 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- 172.21.15.102:0/4248672019 shutdown_connections 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 --2- 172.21.15.102:0/4248672019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f965012f150 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- 172.21.15.102:0/4248672019 >> 172.21.15.102:0/4248672019 conn(0x7f965009cd30 msgr2=0x7f965009d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- 172.21.15.102:0/4248672019 shutdown_connections 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- 172.21.15.102:0/4248672019 wait complete. 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 Processor -- start 2024-09-11T11:00:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- start start 2024-09-11T11:00:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb45d9b640 1 --2- 172.21.15.102:0/1978624054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb481319b0 0x7fcb48133da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0097f0 tx=0x7fcb3c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763370b87d8ec052 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4559a640 1 -- 172.21.15.102:0/1978624054 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c0b0070 con 0x7fcb481319b0 2024-09-11T11:00:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4559a640 1 -- 172.21.15.102:0/1978624054 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0ab530 con 0x7fcb481319b0 2024-09-11T11:00:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4559a640 1 -- 172.21.15.102:0/1978624054 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c0ab830 con 0x7fcb481319b0 2024-09-11T11:00:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f9650092210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f965006e420 con 0x7f965012ed70 2024-09-11T11:00:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f964f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f9650092210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f964f7fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f9650092210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35788/0 (socket says 172.21.15.102:35788) 2024-09-11T11:00:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f964f7fe640 1 -- 172.21.15.102:0/1659306408 learned_addr learned my addr 172.21.15.102:0/1659306408 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4ca06640 1 -- 172.21.15.102:0/1978624054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb481319b0 msgr2=0x7fcb48133da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4ca06640 1 --2- 172.21.15.102:0/1978624054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb481319b0 0x7fcb48133da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0097f0 tx=0x7fcb3c01c430 comp rx=0 tx=0).stop 2024-09-11T11:00:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4ca06640 1 -- 172.21.15.102:0/1978624054 shutdown_connections 2024-09-11T11:00:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4ca06640 1 --2- 172.21.15.102:0/1978624054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb481319b0 0x7fcb48133da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f964f7fe640 1 -- 172.21.15.102:0/1659306408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9650095110 con 0x7f965012ed70 2024-09-11T11:00:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4ca06640 1 -- 172.21.15.102:0/1978624054 >> 172.21.15.102:0/1978624054 conn(0x7fcb4809d830 msgr2=0x7fcb48099d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4ca06640 1 -- 172.21.15.102:0/1978624054 shutdown_connections 2024-09-11T11:00:57.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7fcb4ca06640 1 -- 172.21.15.102:0/1978624054 wait complete. 2024-09-11T11:00:57.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f964f7fe640 1 --2- 172.21.15.102:0/1659306408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f9650092210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96400af040 tx=0x7f964001ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9637fff640 1 -- 172.21.15.102:0/1659306408 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96400b1050 con 0x7f965012ed70 2024-09-11T11:00:57.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9637fff640 1 -- 172.21.15.102:0/1659306408 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96400b2040 con 0x7f965012ed70 2024-09-11T11:00:57.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9650094970 con 0x7f965012ed70 2024-09-11T11:00:57.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9637fff640 1 -- 172.21.15.102:0/1659306408 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96400aab20 con 0x7f965012ed70 2024-09-11T11:00:57.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.122+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9650092750 con 0x7f965012ed70 2024-09-11T11:00:57.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965012f150 con 0x7f965012ed70 2024-09-11T11:00:57.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4ca06640 1 Processor -- start 2024-09-11T11:00:57.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4ca06640 1 -- start start 2024-09-11T11:00:57.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7f9637fff640 1 -- 172.21.15.102:0/1659306408 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f96400bf030 con 0x7f965012ed70 2024-09-11T11:00:57.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7f9637fff640 1 --2- 172.21.15.102:0/1659306408 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f963c035db0 0x7f963c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7f9637fff640 1 -- 172.21.15.102:0/1659306408 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f96400bd070 con 0x7f965012ed70 2024-09-11T11:00:57.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4ca06640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4812b7d0 0x7fcb4812f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7f964effd640 1 --2- 172.21.15.102:0/1659306408 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f963c035db0 0x7f963c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4ca06640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb48136c80 con 0x7fcb4812b7d0 2024-09-11T11:00:57.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4812b7d0 0x7fcb4812f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4659c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4812b7d0 0x7fcb4812f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35804/0 (socket says 172.21.15.102:35804) 2024-09-11T11:00:57.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4659c640 1 -- 172.21.15.102:0/2774293098 learned_addr learned my addr 172.21.15.102:0/2774293098 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:57.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4659c640 1 -- 172.21.15.102:0/2774293098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4806e1a0 con 0x7fcb4812b7d0 2024-09-11T11:00:57.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7fcb4659c640 1 --2- 172.21.15.102:0/2774293098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4812b7d0 0x7fcb4812f7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800c410 tx=0x7fcb3800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.126+0000 7f964effd640 1 --2- 172.21.15.102:0/1659306408 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f963c035db0 0x7f963c038270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9644007fd0 tx=0x7f9644007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb36ffd640 1 -- 172.21.15.102:0/2774293098 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb38007410 con 0x7fcb4812b7d0 2024-09-11T11:00:57.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb36ffd640 1 -- 172.21.15.102:0/2774293098 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380075b0 con 0x7fcb4812b7d0 2024-09-11T11:00:57.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb36ffd640 1 -- 172.21.15.102:0/2774293098 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb38004920 con 0x7fcb4812b7d0 2024-09-11T11:00:57.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4806dd60 con 0x7fcb4812b7d0 2024-09-11T11:00:57.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7f9637fff640 1 -- 172.21.15.102:0/1659306408 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96400c6060 con 0x7f965012ed70 2024-09-11T11:00:57.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4812fef0 con 0x7fcb4812b7d0 2024-09-11T11:00:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb36ffd640 1 -- 172.21.15.102:0/2774293098 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb3801a020 con 0x7fcb4812b7d0 2024-09-11T11:00:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb36ffd640 1 --2- 172.21.15.102:0/2774293098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fcb28035e00 0x7fcb280382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb36ffd640 1 -- 172.21.15.102:0/2774293098 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fcb38047f30 con 0x7fcb4812b7d0 2024-09-11T11:00:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.134+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4806e510 con 0x7fcb4812b7d0 2024-09-11T11:00:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.138+0000 7fcb45d9b640 1 --2- 172.21.15.102:0/2774293098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fcb28035e00 0x7fcb280382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.138+0000 7fcb45d9b640 1 --2- 172.21.15.102:0/2774293098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fcb28035e00 0x7fcb280382c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0ad000 tx=0x7fcb3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.138+0000 7fcb36ffd640 1 -- 172.21.15.102:0/2774293098 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcb38046dc0 con 0x7fcb4812b7d0 2024-09-11T11:00:57.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.166+0000 7f81c955d640 1 Processor -- start 2024-09-11T11:00:57.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.166+0000 7f81c955d640 1 -- start start 2024-09-11T11:00:57.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c955d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f81c412f390 0x7f81c4133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c955d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81c40984f0 con 0x7f81c412e760 2024-09-11T11:00:57.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c955d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f81c4098dc0 con 0x7f81c412f390 2024-09-11T11:00:57.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c27fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f81c412f390 0x7f81c4133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c27fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f81c412f390 0x7f81c4133a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35810/0 (socket says 172.21.15.102:35810) 2024-09-11T11:00:57.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c27fc640 1 -- 172.21.15.102:0/3843694376 learned_addr learned my addr 172.21.15.102:0/3843694376 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:57.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c27fc640 1 -- 172.21.15.102:0/3843694376 >> v1:172.21.15.102:6789/0 conn(0x7f81c412e760 legacy=0x7f81c412ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c27fc640 1 -- 172.21.15.102:0/3843694376 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c40981a0 con 0x7f81c412f390 2024-09-11T11:00:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c1ffb640 1 -- 172.21.15.102:0/3843694376 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3174303939 0 0) 0x7f81c40984f0 con 0x7f81c412e760 2024-09-11T11:00:57.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c27fc640 1 --2- 172.21.15.102:0/3843694376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412f390 0x7f81c4133a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81b80097f0 tx=0x7f81b801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84f8f5f7d601a5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c1ffb640 1 -- 172.21.15.102:0/3843694376 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b80b1070 con 0x7f81c412f390 2024-09-11T11:00:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c1ffb640 1 -- 172.21.15.102:0/3843694376 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b80ac560 con 0x7f81c412f390 2024-09-11T11:00:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.170+0000 7f81c1ffb640 1 -- 172.21.15.102:0/3843694376 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b80a8050 con 0x7f81c412f390 2024-09-11T11:00:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- 172.21.15.102:0/3843694376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412f390 msgr2=0x7f81c4133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 --2- 172.21.15.102:0/3843694376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412f390 0x7f81c4133a80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81b80097f0 tx=0x7f81b801c4c0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- 172.21.15.102:0/3843694376 shutdown_connections 2024-09-11T11:00:57.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 --2- 172.21.15.102:0/3843694376 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412f390 0x7f81c4133a80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- 172.21.15.102:0/3843694376 >> 172.21.15.102:0/3843694376 conn(0x7f81c40a10a0 msgr2=0x7f81c40a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- 172.21.15.102:0/3843694376 shutdown_connections 2024-09-11T11:00:57.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- 172.21.15.102:0/3843694376 wait complete. 2024-09-11T11:00:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 Processor -- start 2024-09-11T11:00:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- start start 2024-09-11T11:00:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412e760 0x7f81c412fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81c4136b70 con 0x7f81c412e760 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412e760 0x7f81c412fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c2ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412e760 0x7f81c412fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35822/0 (socket says 172.21.15.102:35822) 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c2ffd640 1 -- 172.21.15.102:0/2378295061 learned_addr learned my addr 172.21.15.102:0/2378295061 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c2ffd640 1 -- 172.21.15.102:0/2378295061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81c4131f30 con 0x7f81c412e760 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c2ffd640 1 --2- 172.21.15.102:0/2378295061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412e760 0x7f81c412fae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81b400c400 tx=0x7f81b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81ab7fe640 1 -- 172.21.15.102:0/2378295061 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b4017070 con 0x7f81c412e760 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81ab7fe640 1 -- 172.21.15.102:0/2378295061 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81b4003600 con 0x7f81c412e760 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81c41323f0 con 0x7f81c412e760 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81ab7fe640 1 -- 172.21.15.102:0/2378295061 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81b40039a0 con 0x7f81c412e760 2024-09-11T11:00:57.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81c4130020 con 0x7f81c412e760 2024-09-11T11:00:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c4132a20 con 0x7f81c412e760 2024-09-11T11:00:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.174+0000 7f81ab7fe640 1 -- 172.21.15.102:0/2378295061 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f81b401a070 con 0x7f81c412e760 2024-09-11T11:00:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.178+0000 7f81ab7fe640 1 --2- 172.21.15.102:0/2378295061 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f81b0035e00 0x7f81b00382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.178+0000 7f81ab7fe640 1 -- 172.21.15.102:0/2378295061 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f81b4047b30 con 0x7f81c412e760 2024-09-11T11:00:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.178+0000 7f81c27fc640 1 --2- 172.21.15.102:0/2378295061 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f81b0035e00 0x7f81b00382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.178+0000 7f81c27fc640 1 --2- 172.21.15.102:0/2378295061 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f81b0035e00 0x7f81b00382c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f81b80ae000 tx=0x7f81b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.182+0000 7f81ab7fe640 1 -- 172.21.15.102:0/2378295061 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f81b4019e10 con 0x7f81c412e760 2024-09-11T11:00:57.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f2962edc640 1 Processor -- start 2024-09-11T11:00:57.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f2962edc640 1 -- start start 2024-09-11T11:00:57.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f2962edc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f295c12d120 0x7f295c131730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f2962edc640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0716f0 con 0x7f295c12c410 2024-09-11T11:00:57.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f2962edc640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f295c12c7f0 con 0x7f295c12d120 2024-09-11T11:00:57.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f2960c78640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f295c12c410 0x7f295c12ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53562/0 (socket says 172.21.15.102:53562) 2024-09-11T11:00:57.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f295bfff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f295c12d120 0x7f295c131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f2960c78640 1 -- 172.21.15.102:0/1756163031 learned_addr learned my addr 172.21.15.102:0/1756163031 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:57.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f295bfff640 1 -- 172.21.15.102:0/1756163031 >> v1:172.21.15.102:6789/0 conn(0x7f295c12c410 legacy=0x7f295c12ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f295b7fe640 1 -- 172.21.15.102:0/1756163031 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670444850 0 0) 0x7f295c0716f0 con 0x7f295c12c410 2024-09-11T11:00:57.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.186+0000 7f295bfff640 1 -- 172.21.15.102:0/1756163031 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c070b20 con 0x7f295c12d120 2024-09-11T11:00:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f295bfff640 1 --2- 172.21.15.102:0/1756163031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12d120 0x7f295c131730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2948009740 tx=0x7f294801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f04f08cde8df3f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f295b7fe640 1 -- 172.21.15.102:0/1756163031 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29480b0070 con 0x7f295c12d120 2024-09-11T11:00:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f295b7fe640 1 -- 172.21.15.102:0/1756163031 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29480ab530 con 0x7f295c12d120 2024-09-11T11:00:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f295b7fe640 1 -- 172.21.15.102:0/1756163031 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29480ab830 con 0x7f295c12d120 2024-09-11T11:00:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 -- 172.21.15.102:0/1756163031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12d120 msgr2=0x7f295c131730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 --2- 172.21.15.102:0/1756163031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12d120 0x7f295c131730 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2948009740 tx=0x7f294801c390 comp rx=0 tx=0).stop 2024-09-11T11:00:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 -- 172.21.15.102:0/1756163031 shutdown_connections 2024-09-11T11:00:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 --2- 172.21.15.102:0/1756163031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12d120 0x7f295c131730 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 -- 172.21.15.102:0/1756163031 >> 172.21.15.102:0/1756163031 conn(0x7f295c09ef10 msgr2=0x7f295c09f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 -- 172.21.15.102:0/1756163031 shutdown_connections 2024-09-11T11:00:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 -- 172.21.15.102:0/1756163031 wait complete. 2024-09-11T11:00:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 Processor -- start 2024-09-11T11:00:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 -- start start 2024-09-11T11:00:57.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12c410 0x7f295c12e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2962edc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f295c1346a0 con 0x7f295c12c410 2024-09-11T11:00:57.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2960c78640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12c410 0x7f295c12e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2960c78640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12c410 0x7f295c12e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35838/0 (socket says 172.21.15.102:35838) 2024-09-11T11:00:57.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.190+0000 7f2960c78640 1 -- 172.21.15.102:0/616943313 learned_addr learned my addr 172.21.15.102:0/616943313 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:57.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f2960c78640 1 -- 172.21.15.102:0/616943313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c126c00 con 0x7f295c12c410 2024-09-11T11:00:57.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f2960c78640 1 --2- 172.21.15.102:0/616943313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12c410 0x7f295c12e6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f295000c420 tx=0x7f295000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f29597fa640 1 -- 172.21.15.102:0/616943313 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2950018070 con 0x7f295c12c410 2024-09-11T11:00:57.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f29597fa640 1 -- 172.21.15.102:0/616943313 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29500074d0 con 0x7f295c12c410 2024-09-11T11:00:57.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f2962edc640 1 -- 172.21.15.102:0/616943313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295c131020 con 0x7f295c12c410 2024-09-11T11:00:57.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f29597fa640 1 -- 172.21.15.102:0/616943313 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2950004960 con 0x7f295c12c410 2024-09-11T11:00:57.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f2962edc640 1 -- 172.21.15.102:0/616943313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295c12edf0 con 0x7f295c12c410 2024-09-11T11:00:57.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f29597fa640 1 -- 172.21.15.102:0/616943313 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f295001b070 con 0x7f295c12c410 2024-09-11T11:00:57.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f29597fa640 1 --2- 172.21.15.102:0/616943313 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2940035db0 0x7f2940038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:57.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f2946ffd640 1 -- 172.21.15.102:0/616943313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2934005090 con 0x7f295c12c410 2024-09-11T11:00:57.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f29597fa640 1 -- 172.21.15.102:0/616943313 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f2950047a40 con 0x7f295c12c410 2024-09-11T11:00:57.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f295bfff640 1 --2- 172.21.15.102:0/616943313 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2940035db0 0x7f2940038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:57.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.194+0000 7f295bfff640 1 --2- 172.21.15.102:0/616943313 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2940035db0 0x7f2940038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29480ad000 tx=0x7f29480a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:57.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.198+0000 7f29597fa640 1 -- 172.21.15.102:0/616943313 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f295c126c00 con 0x7f295c12c410 2024-09-11T11:00:57.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.298+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9650093d00 con 0x7f965012ed70 2024-09-11T11:00:57.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.298+0000 7f9637fff640 1 -- 172.21.15.102:0/1659306408 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9640015ff0 con 0x7f965012ed70 2024-09-11T11:00:57.305 INFO:teuthology.orchestra.run.smithi102.stdout:42949672964 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f963c035db0 msgr2=0x7f963c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 --2- 172.21.15.102:0/1659306408 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f963c035db0 0x7f963c038270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9644007fd0 tx=0x7f9644007980 comp rx=0 tx=0).stop 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 msgr2=0x7f9650092210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 --2- 172.21.15.102:0/1659306408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f9650092210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f96400af040 tx=0x7f964001ac40 comp rx=0 tx=0).stop 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 shutdown_connections 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 --2- 172.21.15.102:0/1659306408 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f963c035db0 0x7f963c038270 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9644007fd0 tx=0x7f9644007980 comp rx=0 tx=0).stop 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 --2- 172.21.15.102:0/1659306408 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f965012ed70 0x7f9650092210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 >> 172.21.15.102:0/1659306408 conn(0x7f965009cd30 msgr2=0x7f9650099430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 shutdown_connections 2024-09-11T11:00:57.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.302+0000 7f9655c08640 1 -- 172.21.15.102:0/1659306408 wait complete. 2024-09-11T11:00:57.322 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-11T11:00:57.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcb4812bbb0 con 0x7fcb4812b7d0 2024-09-11T11:00:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb36ffd640 1 -- 172.21.15.102:0/2774293098 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcb3801b990 con 0x7fcb4812b7d0 2024-09-11T11:00:57.323 INFO:teuthology.orchestra.run.smithi102.stdout:42949672963 2024-09-11T11:00:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fcb28035e00 msgr2=0x7fcb280382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 --2- 172.21.15.102:0/2774293098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fcb28035e00 0x7fcb280382c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0ad000 tx=0x7fcb3c008040 comp rx=0 tx=0).stop 2024-09-11T11:00:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4812b7d0 msgr2=0x7fcb4812f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 --2- 172.21.15.102:0/2774293098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4812b7d0 0x7fcb4812f7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800c410 tx=0x7fcb3800c8d0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 shutdown_connections 2024-09-11T11:00:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 --2- 172.21.15.102:0/2774293098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fcb28035e00 0x7fcb280382c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 --2- 172.21.15.102:0/2774293098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4812b7d0 0x7fcb4812f7e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 >> 172.21.15.102:0/2774293098 conn(0x7fcb4809d830 msgr2=0x7fcb48097c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 shutdown_connections 2024-09-11T11:00:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.318+0000 7fcb4ca06640 1 -- 172.21.15.102:0/2774293098 wait complete. 2024-09-11T11:00:57.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2024-09-11T11:00:57.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.342+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f81c412ec80 con 0x7f81c412e760 2024-09-11T11:00:57.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.342+0000 7f81ab7fe640 1 -- 172.21.15.102:0/2378295061 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f81b4010920 con 0x7f81c412e760 2024-09-11T11:00:57.348 INFO:teuthology.orchestra.run.smithi102.stdout:42949672963 2024-09-11T11:00:57.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f81b0035e00 msgr2=0x7f81b00382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 --2- 172.21.15.102:0/2378295061 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f81b0035e00 0x7f81b00382c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f81b80ae000 tx=0x7f81b8008040 comp rx=0 tx=0).stop 2024-09-11T11:00:57.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412e760 msgr2=0x7f81c412fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 --2- 172.21.15.102:0/2378295061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412e760 0x7f81c412fae0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81b400c400 tx=0x7f81b400c8c0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 shutdown_connections 2024-09-11T11:00:57.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 --2- 172.21.15.102:0/2378295061 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f81b0035e00 0x7f81b00382c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 --2- 172.21.15.102:0/2378295061 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81c412e760 0x7f81c412fae0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 >> 172.21.15.102:0/2378295061 conn(0x7f81c40a10a0 msgr2=0x7f81c4128080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 shutdown_connections 2024-09-11T11:00:57.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.346+0000 7f81c955d640 1 -- 172.21.15.102:0/2378295061 wait complete. 2024-09-11T11:00:57.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.358+0000 7f2946ffd640 1 -- 172.21.15.102:0/616943313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2934005380 con 0x7f295c12c410 2024-09-11T11:00:57.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.358+0000 7f29597fa640 1 -- 172.21.15.102:0/616943313 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29500119b0 con 0x7f295c12c410 2024-09-11T11:00:57.363 INFO:teuthology.orchestra.run.smithi102.stdout:38654705666 2024-09-11T11:00:57.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.2 2024-09-11T11:00:57.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 -- 172.21.15.102:0/616943313 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2940035db0 msgr2=0x7f2940038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 --2- 172.21.15.102:0/616943313 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2940035db0 0x7f2940038270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29480ad000 tx=0x7f29480a6000 comp rx=0 tx=0).stop 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 -- 172.21.15.102:0/616943313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12c410 msgr2=0x7f295c12e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 --2- 172.21.15.102:0/616943313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12c410 0x7f295c12e6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f295000c420 tx=0x7f295000c8e0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 -- 172.21.15.102:0/616943313 shutdown_connections 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 --2- 172.21.15.102:0/616943313 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2940035db0 0x7f2940038270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 --2- 172.21.15.102:0/616943313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f295c12c410 0x7f295c12e6e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 -- 172.21.15.102:0/616943313 >> 172.21.15.102:0/616943313 conn(0x7f295c09ef10 msgr2=0x7f295c123bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 -- 172.21.15.102:0/616943313 shutdown_connections 2024-09-11T11:00:57.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:57.362+0000 7f2946ffd640 1 -- 172.21.15.102:0/616943313 wait complete. 2024-09-11T11:00:57.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705666 for osd.0 2024-09-11T11:00:58.323 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T11:00:58.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T11:00:58.366 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T11:00:58.380 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T11:00:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0b1633640 1 Processor -- start 2024-09-11T11:00:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0b1633640 1 -- start start 2024-09-11T11:00:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0b1633640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc0ac071860 0x7fc0ac1318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0b1633640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ac06c6b0 con 0x7fc0ac070d70 2024-09-11T11:00:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0b1633640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc0ac06c8d0 con 0x7fc0ac071860 2024-09-11T11:00:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0aa7fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc0ac071860 0x7fc0ac1318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0aaffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc0ac070d70 0x7fc0ac071150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53572/0 (socket says 172.21.15.102:53572) 2024-09-11T11:00:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0aaffd640 1 -- 172.21.15.102:0/1799586323 learned_addr learned my addr 172.21.15.102:0/1799586323 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0aa7fc640 1 -- 172.21.15.102:0/1799586323 >> v1:172.21.15.102:6789/0 conn(0x7fc0ac070d70 legacy=0x7fc0ac071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.446+0000 7fc0aa7fc640 1 -- 172.21.15.102:0/1799586323 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ac06be20 con 0x7fc0ac071860 2024-09-11T11:00:58.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0aa7fc640 1 --2- 172.21.15.102:0/1799586323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac071860 0x7fc0ac1318d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009740 tx=0x7fc0a001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfd73b8897eb172 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0a9ffb640 1 -- 172.21.15.102:0/1799586323 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00b1070 con 0x7fc0ac071860 2024-09-11T11:00:58.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0a9ffb640 1 -- 172.21.15.102:0/1799586323 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a00ac520 con 0x7fc0ac071860 2024-09-11T11:00:58.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0a9ffb640 1 -- 172.21.15.102:0/1799586323 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0a00ac820 con 0x7fc0ac071860 2024-09-11T11:00:58.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- 172.21.15.102:0/1799586323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac071860 msgr2=0x7fc0ac1318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 --2- 172.21.15.102:0/1799586323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac071860 0x7fc0ac1318d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009740 tx=0x7fc0a001c330 comp rx=0 tx=0).stop 2024-09-11T11:00:58.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- 172.21.15.102:0/1799586323 shutdown_connections 2024-09-11T11:00:58.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 --2- 172.21.15.102:0/1799586323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac071860 0x7fc0ac1318d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- 172.21.15.102:0/1799586323 >> 172.21.15.102:0/1799586323 conn(0x7fc0ac09ac70 msgr2=0x7fc0ac06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:58.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- 172.21.15.102:0/1799586323 shutdown_connections 2024-09-11T11:00:58.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- 172.21.15.102:0/1799586323 wait complete. 2024-09-11T11:00:58.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 Processor -- start 2024-09-11T11:00:58.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- start start 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac070d70 0x7fc0ac06e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ac1349c0 con 0x7fc0ac070d70 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac070d70 0x7fc0ac06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0aaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac070d70 0x7fc0ac06e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35858/0 (socket says 172.21.15.102:35858) 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0aaffd640 1 -- 172.21.15.102:0/1781800739 learned_addr learned my addr 172.21.15.102:0/1781800739 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0aaffd640 1 -- 172.21.15.102:0/1781800739 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ac08c780 con 0x7fc0ac070d70 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0aaffd640 1 --2- 172.21.15.102:0/1781800739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac070d70 0x7fc0ac06e440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00c480 tx=0x7fc09c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0937fe640 1 -- 172.21.15.102:0/1781800739 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc09c017070 con 0x7fc0ac070d70 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0937fe640 1 -- 172.21.15.102:0/1781800739 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09c005c20 con 0x7fc0ac070d70 2024-09-11T11:00:58.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ac08c450 con 0x7fc0ac070d70 2024-09-11T11:00:58.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0937fe640 1 -- 172.21.15.102:0/1781800739 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc09c007070 con 0x7fc0ac070d70 2024-09-11T11:00:58.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.450+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ac08b610 con 0x7fc0ac070d70 2024-09-11T11:00:58.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.454+0000 7fc0937fe640 1 -- 172.21.15.102:0/1781800739 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc09c01a070 con 0x7fc0ac070d70 2024-09-11T11:00:58.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.454+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0ac071150 con 0x7fc0ac070d70 2024-09-11T11:00:58.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.454+0000 7fc0937fe640 1 --2- 172.21.15.102:0/1781800739 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc098035db0 0x7fc098038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.454+0000 7fc0937fe640 1 -- 172.21.15.102:0/1781800739 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc09c047990 con 0x7fc0ac070d70 2024-09-11T11:00:58.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.454+0000 7fc0aa7fc640 1 --2- 172.21.15.102:0/1781800739 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc098035db0 0x7fc098038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.454+0000 7fc0aa7fc640 1 --2- 172.21.15.102:0/1781800739 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc098035db0 0x7fc098038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00ae000 tx=0x7fc0a00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.458+0000 7fc0937fe640 1 -- 172.21.15.102:0/1781800739 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc0ac08c780 con 0x7fc0ac070d70 2024-09-11T11:00:58.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f89c36640 1 Processor -- start 2024-09-11T11:00:58.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f4ee2d18640 1 Processor -- start 2024-09-11T11:00:58.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f89c36640 1 -- start start 2024-09-11T11:00:58.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f4ee2d18640 1 -- start start 2024-09-11T11:00:58.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f89c36640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8f8412e760 0x7f8f8412ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f89c36640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f840984f0 con 0x7f8f8412f1c0 2024-09-11T11:00:58.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f89c36640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8f84098dc0 con 0x7f8f8412e760 2024-09-11T11:00:58.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f4ee2d18640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4edc06f860 0x7f4edc130cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f4ee2d18640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4edc070ac0 con 0x7f4edc071be0 2024-09-11T11:00:58.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f4ee2d18640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4edc070c90 con 0x7f4edc06f860 2024-09-11T11:00:58.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f837fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8f8412e760 0x7f8f8412ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f82ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f8f8412f1c0 0x7f8f8412b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53578/0 (socket says 172.21.15.102:53578) 2024-09-11T11:00:58.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f82ffd640 1 -- 172.21.15.102:0/2395119534 learned_addr learned my addr 172.21.15.102:0/2395119534 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:58.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f4ee0ab4640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4edc071be0 0x7f4edc071fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53588/0 (socket says 172.21.15.102:53588) 2024-09-11T11:00:58.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f4ee0ab4640 1 -- 172.21.15.102:0/2931078438 learned_addr learned my addr 172.21.15.102:0/2931078438 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:58.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f4edbfff640 1 --2- 172.21.15.102:0/2931078438 >> v2:172.21.15.102:3300/0 conn(0x7f4edc06f860 0x7f4edc130cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f837fe640 1 -- 172.21.15.102:0/2395119534 >> v1:172.21.15.102:6789/0 conn(0x7f8f8412f1c0 legacy=0x7f8f8412b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.478+0000 7f8f837fe640 1 -- 172.21.15.102:0/2395119534 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8412f5a0 con 0x7f8f8412e760 2024-09-11T11:00:58.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4edb7fe640 1 -- 172.21.15.102:0/2931078438 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508911084 0 0) 0x7f4edc070ac0 con 0x7f4edc071be0 2024-09-11T11:00:58.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4edb7fe640 1 -- 172.21.15.102:0/2931078438 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ecc005740 con 0x7f4edc071be0 2024-09-11T11:00:58.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4edbfff640 1 -- 172.21.15.102:0/2931078438 >> v1:172.21.15.102:6789/0 conn(0x7f4edc071be0 legacy=0x7f4edc071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4edbfff640 1 -- 172.21.15.102:0/2931078438 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc0726d0 con 0x7f4edc06f860 2024-09-11T11:00:58.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f837fe640 1 --2- 172.21.15.102:0/2395119534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8412ec80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009740 tx=0x7f8f7401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66896ae5f59f44d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4edbfff640 1 --2- 172.21.15.102:0/2931078438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc06f860 0x7f4edc130cf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009740 tx=0x7f4ec801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65649fe8ccebe2f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f827fc640 1 -- 172.21.15.102:0/2395119534 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f740b0070 con 0x7f8f8412e760 2024-09-11T11:00:58.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f827fc640 1 -- 172.21.15.102:0/2395119534 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f740ab530 con 0x7f8f8412e760 2024-09-11T11:00:58.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f827fc640 1 -- 172.21.15.102:0/2395119534 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f740ab830 con 0x7f8f8412e760 2024-09-11T11:00:58.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4edb7fe640 1 -- 172.21.15.102:0/2931078438 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec80b1070 con 0x7f4edc06f860 2024-09-11T11:00:58.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4edb7fe640 1 -- 172.21.15.102:0/2931078438 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ec80ac570 con 0x7f4edc06f860 2024-09-11T11:00:58.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4edb7fe640 1 -- 172.21.15.102:0/2931078438 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ec80ac870 con 0x7f4edc06f860 2024-09-11T11:00:58.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f89c36640 1 -- 172.21.15.102:0/2395119534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 msgr2=0x7f8f8412ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f89c36640 1 --2- 172.21.15.102:0/2395119534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8412ec80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f74009740 tx=0x7f8f7401c400 comp rx=0 tx=0).stop 2024-09-11T11:00:58.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2931078438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc06f860 msgr2=0x7f4edc130cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4ee2d18640 1 --2- 172.21.15.102:0/2931078438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc06f860 0x7f4edc130cf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8009740 tx=0x7f4ec801c400 comp rx=0 tx=0).stop 2024-09-11T11:00:58.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f89c36640 1 -- 172.21.15.102:0/2395119534 shutdown_connections 2024-09-11T11:00:58.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f89c36640 1 --2- 172.21.15.102:0/2395119534 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8412ec80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f89c36640 1 -- 172.21.15.102:0/2395119534 >> 172.21.15.102:0/2395119534 conn(0x7f8f840a10a0 msgr2=0x7f8f840a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:58.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2931078438 shutdown_connections 2024-09-11T11:00:58.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4ee2d18640 1 --2- 172.21.15.102:0/2931078438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc06f860 0x7f4edc130cf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2931078438 >> 172.21.15.102:0/2931078438 conn(0x7f4edc09ac70 msgr2=0x7f4edc06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:58.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f89c36640 1 -- 172.21.15.102:0/2395119534 shutdown_connections 2024-09-11T11:00:58.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f8f89c36640 1 -- 172.21.15.102:0/2395119534 wait complete. 2024-09-11T11:00:58.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2931078438 shutdown_connections 2024-09-11T11:00:58.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.482+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2931078438 wait complete. 2024-09-11T11:00:58.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee2d18640 1 Processor -- start 2024-09-11T11:00:58.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f89c36640 1 Processor -- start 2024-09-11T11:00:58.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee2d18640 1 -- start start 2024-09-11T11:00:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f89c36640 1 -- start start 2024-09-11T11:00:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f89c36640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8409c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f89c36640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8f84136e30 con 0x7f8f8412e760 2024-09-11T11:00:58.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee2d18640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc071be0 0x7f4edc094a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f837fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8409c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f837fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8409c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35900/0 (socket says 172.21.15.102:35900) 2024-09-11T11:00:58.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f837fe640 1 -- 172.21.15.102:0/1920818010 learned_addr learned my addr 172.21.15.102:0/1920818010 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:58.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee0ab4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc071be0 0x7f4edc094a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee0ab4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc071be0 0x7f4edc094a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35908/0 (socket says 172.21.15.102:35908) 2024-09-11T11:00:58.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee0ab4640 1 -- 172.21.15.102:0/2699577554 learned_addr learned my addr 172.21.15.102:0/2699577554 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:58.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4edc06c7f0 con 0x7f4edc071be0 2024-09-11T11:00:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f837fe640 1 -- 172.21.15.102:0/1920818010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f84130510 con 0x7f8f8412e760 2024-09-11T11:00:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee0ab4640 1 -- 172.21.15.102:0/2699577554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4edc122c30 con 0x7f4edc071be0 2024-09-11T11:00:58.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f837fe640 1 --2- 172.21.15.102:0/1920818010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8409c920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f7401a030 tx=0x7f8f7401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee0ab4640 1 --2- 172.21.15.102:0/2699577554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc071be0 0x7f4edc094a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c450 tx=0x7f4ed000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ed97fa640 1 -- 172.21.15.102:0/2699577554 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ed0017070 con 0x7f4edc071be0 2024-09-11T11:00:58.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f6bfff640 1 -- 172.21.15.102:0/1920818010 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f740b0050 con 0x7f8f8412e760 2024-09-11T11:00:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ed97fa640 1 -- 172.21.15.102:0/2699577554 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ed0005c20 con 0x7f4edc071be0 2024-09-11T11:00:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4edc096ba0 con 0x7f4edc071be0 2024-09-11T11:00:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f6bfff640 1 -- 172.21.15.102:0/1920818010 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f740b1040 con 0x7f8f8412e760 2024-09-11T11:00:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f6bfff640 1 -- 172.21.15.102:0/1920818010 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f740b5740 con 0x7f8f8412e760 2024-09-11T11:00:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f89c36640 1 -- 172.21.15.102:0/1920818010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f84130c10 con 0x7f8f8412e760 2024-09-11T11:00:58.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f89c36640 1 -- 172.21.15.102:0/1920818010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8409ce60 con 0x7f8f8412e760 2024-09-11T11:00:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ed97fa640 1 -- 172.21.15.102:0/2699577554 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ed0007070 con 0x7f4edc071be0 2024-09-11T11:00:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4edc122fe0 con 0x7f4edc071be0 2024-09-11T11:00:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f6bfff640 1 -- 172.21.15.102:0/1920818010 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8f740be030 con 0x7f8f8412e760 2024-09-11T11:00:58.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f6bfff640 1 --2- 172.21.15.102:0/1920818010 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8f70035db0 0x7f8f70038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f6bfff640 1 -- 172.21.15.102:0/1920818010 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f8f740bc070 con 0x7f8f8412e760 2024-09-11T11:00:58.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f69ffb640 1 -- 172.21.15.102:0/1920818010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f5c005090 con 0x7f8f8412e760 2024-09-11T11:00:58.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ed97fa640 1 -- 172.21.15.102:0/2699577554 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4ed001a070 con 0x7f4edc071be0 2024-09-11T11:00:58.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ed97fa640 1 --2- 172.21.15.102:0/2699577554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ec0035e00 0x7f4ec00382c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f4ed97fa640 1 -- 172.21.15.102:0/2699577554 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f4ed0047a20 con 0x7f4edc071be0 2024-09-11T11:00:58.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.486+0000 7f8f82ffd640 1 --2- 172.21.15.102:0/1920818010 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8f70035db0 0x7f8f70038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.490+0000 7f4edbfff640 1 --2- 172.21.15.102:0/2699577554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ec0035e00 0x7f4ec00382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.490+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ebc005090 con 0x7f4edc071be0 2024-09-11T11:00:58.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.490+0000 7f4edbfff640 1 --2- 172.21.15.102:0/2699577554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ec0035e00 0x7f4ec00382c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80ae000 tx=0x7f4ec80a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.490+0000 7f8f82ffd640 1 --2- 172.21.15.102:0/1920818010 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8f70035db0 0x7f8f70038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8f78005890 tx=0x7f8f78007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.494+0000 7f8f6bfff640 1 -- 172.21.15.102:0/1920818010 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f740c5020 con 0x7f8f8412e760 2024-09-11T11:00:58.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.498+0000 7f4ed97fa640 1 -- 172.21.15.102:0/2699577554 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4edc122c30 con 0x7f4edc071be0 2024-09-11T11:00:58.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e09027640 1 Processor -- start 2024-09-11T11:00:58.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e09027640 1 -- start start 2024-09-11T11:00:58.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e09027640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e04097010 0x7f4e041316e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e09027640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e04098420 con 0x7f4e04096520 2024-09-11T11:00:58.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e09027640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4e040989e0 con 0x7f4e04097010 2024-09-11T11:00:58.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e0259c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4e04097010 0x7f4e041316e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e02d9d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4e04096520 0x7f4e04096900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53594/0 (socket says 172.21.15.102:53594) 2024-09-11T11:00:58.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e02d9d640 1 -- 172.21.15.102:0/251156446 learned_addr learned my addr 172.21.15.102:0/251156446 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:58.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e0259c640 1 -- 172.21.15.102:0/251156446 >> v1:172.21.15.102:6789/0 conn(0x7f4e04096520 legacy=0x7f4e04096900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.546+0000 7f4e0259c640 1 -- 172.21.15.102:0/251156446 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e04097a80 con 0x7f4e04097010 2024-09-11T11:00:58.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e0259c640 1 --2- 172.21.15.102:0/251156446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04097010 0x7f4e041316e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009740 tx=0x7f4df801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8c18b1c723ae5e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e01d9b640 1 -- 172.21.15.102:0/251156446 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df80b0070 con 0x7f4e04097010 2024-09-11T11:00:58.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e01d9b640 1 -- 172.21.15.102:0/251156446 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df80ab530 con 0x7f4e04097010 2024-09-11T11:00:58.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e01d9b640 1 -- 172.21.15.102:0/251156446 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df80ab830 con 0x7f4e04097010 2024-09-11T11:00:58.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 -- 172.21.15.102:0/251156446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04097010 msgr2=0x7f4e041316e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 --2- 172.21.15.102:0/251156446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04097010 0x7f4e041316e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4df8009740 tx=0x7f4df801c370 comp rx=0 tx=0).stop 2024-09-11T11:00:58.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 -- 172.21.15.102:0/251156446 shutdown_connections 2024-09-11T11:00:58.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 --2- 172.21.15.102:0/251156446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04097010 0x7f4e041316e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 -- 172.21.15.102:0/251156446 >> 172.21.15.102:0/251156446 conn(0x7f4e0409f010 msgr2=0x7f4e0409f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:58.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 -- 172.21.15.102:0/251156446 shutdown_connections 2024-09-11T11:00:58.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 -- 172.21.15.102:0/251156446 wait complete. 2024-09-11T11:00:58.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 Processor -- start 2024-09-11T11:00:58.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 -- start start 2024-09-11T11:00:58.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04096520 0x7f4e041c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.550+0000 7f4e09027640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4e04134650 con 0x7f4e04096520 2024-09-11T11:00:58.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e02d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04096520 0x7f4e041c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e02d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04096520 0x7f4e041c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35936/0 (socket says 172.21.15.102:35936) 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e02d9d640 1 -- 172.21.15.102:0/3747651553 learned_addr learned my addr 172.21.15.102:0/3747651553 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e02d9d640 1 -- 172.21.15.102:0/3747651553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0406ffd0 con 0x7f4e04096520 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e02d9d640 1 --2- 172.21.15.102:0/3747651553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04096520 0x7f4e041c6650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4df400c380 tx=0x7f4df400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4deb7fe640 1 -- 172.21.15.102:0/3747651553 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df4017070 con 0x7f4e04096520 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4deb7fe640 1 -- 172.21.15.102:0/3747651553 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df4005c20 con 0x7f4e04096520 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e09027640 1 -- 172.21.15.102:0/3747651553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e04071870 con 0x7f4e04096520 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4deb7fe640 1 -- 172.21.15.102:0/3747651553 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df40070d0 con 0x7f4e04096520 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e09027640 1 -- 172.21.15.102:0/3747651553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e041c5fa0 con 0x7f4e04096520 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4de97fa640 1 -- 172.21.15.102:0/3747651553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ddc005090 con 0x7f4e04096520 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4deb7fe640 1 -- 172.21.15.102:0/3747651553 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4df401a070 con 0x7f4e04096520 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4deb7fe640 1 --2- 172.21.15.102:0/3747651553 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4df0035db0 0x7f4df0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:58.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4deb7fe640 1 -- 172.21.15.102:0/3747651553 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f4df4047980 con 0x7f4e04096520 2024-09-11T11:00:58.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e0259c640 1 --2- 172.21.15.102:0/3747651553 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4df0035db0 0x7f4df0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:58.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.554+0000 7f4e0259c640 1 --2- 172.21.15.102:0/3747651553 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4df0035db0 0x7f4df0038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4df80ad000 tx=0x7f4df80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:58.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.562+0000 7f4deb7fe640 1 -- 172.21.15.102:0/3747651553 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4df4007270 con 0x7f4e04096520 2024-09-11T11:00:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.654+0000 7f8f69ffb640 1 -- 172.21.15.102:0/1920818010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f8f5c005380 con 0x7f8f8412e760 2024-09-11T11:00:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.654+0000 7f8f6bfff640 1 -- 172.21.15.102:0/1920818010 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8f74015ff0 con 0x7f8f8412e760 2024-09-11T11:00:58.661 INFO:teuthology.orchestra.run.smithi102.stdout:42949672963 2024-09-11T11:00:58.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 -- 172.21.15.102:0/1920818010 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8f70035db0 msgr2=0x7f8f70038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 --2- 172.21.15.102:0/1920818010 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8f70035db0 0x7f8f70038270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8f78005890 tx=0x7f8f78007a90 comp rx=0 tx=0).stop 2024-09-11T11:00:58.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 -- 172.21.15.102:0/1920818010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 msgr2=0x7f8f8409c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 --2- 172.21.15.102:0/1920818010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8409c920 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8f7401a030 tx=0x7f8f7401ac40 comp rx=0 tx=0).stop 2024-09-11T11:00:58.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 -- 172.21.15.102:0/1920818010 shutdown_connections 2024-09-11T11:00:58.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 --2- 172.21.15.102:0/1920818010 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8f70035db0 0x7f8f70038270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 --2- 172.21.15.102:0/1920818010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f8412e760 0x7f8f8409c920 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 -- 172.21.15.102:0/1920818010 >> 172.21.15.102:0/1920818010 conn(0x7f8f840a10a0 msgr2=0x7f8f84095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:58.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 -- 172.21.15.102:0/1920818010 shutdown_connections 2024-09-11T11:00:58.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.658+0000 7f8f69ffb640 1 -- 172.21.15.102:0/1920818010 wait complete. 2024-09-11T11:00:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.662+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc0ac09b490 con 0x7fc0ac070d70 2024-09-11T11:00:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.662+0000 7fc0937fe640 1 -- 172.21.15.102:0/1781800739 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc09c007210 con 0x7fc0ac070d70 2024-09-11T11:00:58.667 INFO:teuthology.orchestra.run.smithi102.stdout:42949672964 2024-09-11T11:00:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.662+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f4ebc005380 con 0x7f4edc071be0 2024-09-11T11:00:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.662+0000 7f4ed97fa640 1 -- 172.21.15.102:0/2699577554 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4ed0012400 con 0x7f4edc071be0 2024-09-11T11:00:58.668 INFO:teuthology.orchestra.run.smithi102.stdout:42949672963 2024-09-11T11:00:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ec0035e00 msgr2=0x7f4ec00382c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 --2- 172.21.15.102:0/2699577554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ec0035e00 0x7f4ec00382c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4ec80ae000 tx=0x7f4ec80a6070 comp rx=0 tx=0).stop 2024-09-11T11:00:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc071be0 msgr2=0x7f4edc094a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 --2- 172.21.15.102:0/2699577554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc071be0 0x7f4edc094a90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000c450 tx=0x7f4ed000c910 comp rx=0 tx=0).stop 2024-09-11T11:00:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 shutdown_connections 2024-09-11T11:00:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 --2- 172.21.15.102:0/2699577554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ec0035e00 0x7f4ec00382c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 --2- 172.21.15.102:0/2699577554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4edc071be0 0x7f4edc094a90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 >> 172.21.15.102:0/2699577554 conn(0x7f4edc09ac70 msgr2=0x7f4edc08d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 shutdown_connections 2024-09-11T11:00:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7f4ee2d18640 1 -- 172.21.15.102:0/2699577554 wait complete. 2024-09-11T11:00:58.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc098035db0 msgr2=0x7fc098038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 --2- 172.21.15.102:0/1781800739 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc098035db0 0x7fc098038270 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00ae000 tx=0x7fc0a00a7000 comp rx=0 tx=0).stop 2024-09-11T11:00:58.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac070d70 msgr2=0x7fc0ac06e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 --2- 172.21.15.102:0/1781800739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac070d70 0x7fc0ac06e440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00c480 tx=0x7fc09c00c940 comp rx=0 tx=0).stop 2024-09-11T11:00:58.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 shutdown_connections 2024-09-11T11:00:58.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 --2- 172.21.15.102:0/1781800739 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc098035db0 0x7fc098038270 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 --2- 172.21.15.102:0/1781800739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc0ac070d70 0x7fc0ac06e440 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 >> 172.21.15.102:0/1781800739 conn(0x7fc0ac09ac70 msgr2=0x7fc0ac098d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:58.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 shutdown_connections 2024-09-11T11:00:58.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.666+0000 7fc0b1633640 1 -- 172.21.15.102:0/1781800739 wait complete. 2024-09-11T11:00:58.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.2 2024-09-11T11:00:58.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672963 for osd.3 2024-09-11T11:00:58.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-09-11T11:00:58.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 -- 172.21.15.102:0/3747651553 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4ddc005380 con 0x7f4e04096520 2024-09-11T11:00:58.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4deb7fe640 1 -- 172.21.15.102:0/3747651553 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4df401b3b0 con 0x7f4e04096520 2024-09-11T11:00:58.739 INFO:teuthology.orchestra.run.smithi102.stdout:38654705667 2024-09-11T11:00:58.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 -- 172.21.15.102:0/3747651553 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4df0035db0 msgr2=0x7f4df0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 --2- 172.21.15.102:0/3747651553 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4df0035db0 0x7f4df0038270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4df80ad000 tx=0x7f4df80a6000 comp rx=0 tx=0).stop 2024-09-11T11:00:58.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 -- 172.21.15.102:0/3747651553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04096520 msgr2=0x7f4e041c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:58.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 --2- 172.21.15.102:0/3747651553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04096520 0x7f4e041c6650 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4df400c380 tx=0x7f4df400c840 comp rx=0 tx=0).stop 2024-09-11T11:00:58.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 -- 172.21.15.102:0/3747651553 shutdown_connections 2024-09-11T11:00:58.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 --2- 172.21.15.102:0/3747651553 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4df0035db0 0x7f4df0038270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 --2- 172.21.15.102:0/3747651553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4e04096520 0x7f4e041c6650 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:58.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 -- 172.21.15.102:0/3747651553 >> 172.21.15.102:0/3747651553 conn(0x7f4e0409f010 msgr2=0x7f4e04123cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:58.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 -- 172.21.15.102:0/3747651553 shutdown_connections 2024-09-11T11:00:58.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:58.734+0000 7f4de97fa640 1 -- 172.21.15.102:0/3747651553 wait complete. 2024-09-11T11:00:58.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-09-11T11:00:59.682 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T11:00:59.688 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T11:00:59.696 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T11:00:59.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T11:00:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.802+0000 7feb49cf6640 1 Processor -- start 2024-09-11T11:00:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.802+0000 7feb49cf6640 1 -- start start 2024-09-11T11:00:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb49cf6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feb4406bc50 0x7feb4412ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb49cf6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb44097c50 con 0x7feb4412f2c0 2024-09-11T11:00:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb49cf6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feb440500e0 con 0x7feb4406bc50 2024-09-11T11:00:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb437fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feb4406bc50 0x7feb4412ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb42ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7feb4412f2c0 0x7feb44096400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53608/0 (socket says 172.21.15.102:53608) 2024-09-11T11:00:59.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb42ffd640 1 -- 172.21.15.102:0/1522871078 learned_addr learned my addr 172.21.15.102:0/1522871078 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb427fc640 1 -- 172.21.15.102:0/1522871078 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441664031 0 0) 0x7feb44097c50 con 0x7feb4412f2c0 2024-09-11T11:00:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb427fc640 1 -- 172.21.15.102:0/1522871078 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb2c003530 con 0x7feb4412f2c0 2024-09-11T11:00:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb437fe640 1 -- 172.21.15.102:0/1522871078 >> v1:172.21.15.102:6789/0 conn(0x7feb4412f2c0 legacy=0x7feb44096400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.806+0000 7feb437fe640 1 -- 172.21.15.102:0/1522871078 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4406c440 con 0x7feb4406bc50 2024-09-11T11:00:59.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb437fe640 1 --2- 172.21.15.102:0/1522871078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4412ed80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb34009740 tx=0x7feb3401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb13aa68c3e61c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb427fc640 1 -- 172.21.15.102:0/1522871078 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb340b1070 con 0x7feb4406bc50 2024-09-11T11:00:59.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb427fc640 1 -- 172.21.15.102:0/1522871078 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb340ac570 con 0x7feb4406bc50 2024-09-11T11:00:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb427fc640 1 -- 172.21.15.102:0/1522871078 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb340ac850 con 0x7feb4406bc50 2024-09-11T11:00:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- 172.21.15.102:0/1522871078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 msgr2=0x7feb4412ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 --2- 172.21.15.102:0/1522871078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4412ed80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb34009740 tx=0x7feb3401c400 comp rx=0 tx=0).stop 2024-09-11T11:00:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- 172.21.15.102:0/1522871078 shutdown_connections 2024-09-11T11:00:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 --2- 172.21.15.102:0/1522871078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4412ed80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- 172.21.15.102:0/1522871078 >> 172.21.15.102:0/1522871078 conn(0x7feb4409ab00 msgr2=0x7feb4409af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- 172.21.15.102:0/1522871078 shutdown_connections 2024-09-11T11:00:59.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- 172.21.15.102:0/1522871078 wait complete. 2024-09-11T11:00:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 Processor -- start 2024-09-11T11:00:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- start start 2024-09-11T11:00:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4406de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb441371f0 con 0x7feb4406bc50 2024-09-11T11:00:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb437fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4406de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35966/0 (socket says 172.21.15.102:35966) 2024-09-11T11:00:59.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb437fe640 1 -- 172.21.15.102:0/616052101 learned_addr learned my addr 172.21.15.102:0/616052101 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:59.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb437fe640 1 -- 172.21.15.102:0/616052101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb4406f970 con 0x7feb4406bc50 2024-09-11T11:00:59.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb437fe640 1 --2- 172.21.15.102:0/616052101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4406de70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feb340af040 tx=0x7feb3401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb2bfff640 1 -- 172.21.15.102:0/616052101 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb340b1050 con 0x7feb4406bc50 2024-09-11T11:00:59.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb2bfff640 1 -- 172.21.15.102:0/616052101 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb340b2040 con 0x7feb4406bc50 2024-09-11T11:00:59.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb2bfff640 1 -- 172.21.15.102:0/616052101 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb340aa9b0 con 0x7feb4406bc50 2024-09-11T11:00:59.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- 172.21.15.102:0/616052101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb440943f0 con 0x7feb4406bc50 2024-09-11T11:00:59.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.810+0000 7feb49cf6640 1 -- 172.21.15.102:0/616052101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb440705e0 con 0x7feb4406bc50 2024-09-11T11:00:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.814+0000 7feb29ffb640 1 -- 172.21.15.102:0/616052101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb1c005090 con 0x7feb4406bc50 2024-09-11T11:00:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.814+0000 7feb2bfff640 1 -- 172.21.15.102:0/616052101 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feb340bf030 con 0x7feb4406bc50 2024-09-11T11:00:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.814+0000 7feb2bfff640 1 --2- 172.21.15.102:0/616052101 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7feb30035db0 0x7feb30038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.814+0000 7feb2bfff640 1 -- 172.21.15.102:0/616052101 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7feb340bd070 con 0x7feb4406bc50 2024-09-11T11:00:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.814+0000 7feb42ffd640 1 --2- 172.21.15.102:0/616052101 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7feb30035db0 0x7feb30038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.814+0000 7feb42ffd640 1 --2- 172.21.15.102:0/616052101 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7feb30035db0 0x7feb30038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb38000f70 tx=0x7feb380010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.822+0000 7feb2bfff640 1 -- 172.21.15.102:0/616052101 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb340c6020 con 0x7feb4406bc50 2024-09-11T11:00:59.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.838+0000 7f55f179f640 1 Processor -- start 2024-09-11T11:00:59.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.838+0000 7f55f179f640 1 -- start start 2024-09-11T11:00:59.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55f179f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f55ec093250 0x7f55ec093630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55f179f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55ec094c50 con 0x7f55ec093b70 2024-09-11T11:00:59.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55f179f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f55ec0753d0 con 0x7f55ec093250 2024-09-11T11:00:59.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55ea7fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f55ec093b70 0x7f55ec128250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53612/0 (socket says 172.21.15.102:53612) 2024-09-11T11:00:59.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55eaffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f55ec093250 0x7f55ec093630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55ea7fc640 1 -- 172.21.15.102:0/3067989605 learned_addr learned my addr 172.21.15.102:0/3067989605 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:59.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55eaffd640 1 -- 172.21.15.102:0/3067989605 >> v1:172.21.15.102:6789/0 conn(0x7f55ec093b70 legacy=0x7f55ec128250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55eaffd640 1 -- 172.21.15.102:0/3067989605 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ec093fa0 con 0x7f55ec093250 2024-09-11T11:00:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55eaffd640 1 --2- 172.21.15.102:0/3067989605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec093630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009740 tx=0x7f55dc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b2d651c760624a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.842+0000 7f55e9ffb640 1 -- 172.21.15.102:0/3067989605 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55dc0b0070 con 0x7f55ec093250 2024-09-11T11:00:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55e9ffb640 1 -- 172.21.15.102:0/3067989605 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55dc0ab530 con 0x7f55ec093250 2024-09-11T11:00:59.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55e9ffb640 1 -- 172.21.15.102:0/3067989605 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55dc0ab830 con 0x7f55ec093250 2024-09-11T11:00:59.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- 172.21.15.102:0/3067989605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 msgr2=0x7f55ec093630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 --2- 172.21.15.102:0/3067989605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec093630 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009740 tx=0x7f55dc01c370 comp rx=0 tx=0).stop 2024-09-11T11:00:59.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- 172.21.15.102:0/3067989605 shutdown_connections 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 --2- 172.21.15.102:0/3067989605 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec093630 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- 172.21.15.102:0/3067989605 >> 172.21.15.102:0/3067989605 conn(0x7f55ec09d730 msgr2=0x7f55ec099c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- 172.21.15.102:0/3067989605 shutdown_connections 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- 172.21.15.102:0/3067989605 wait complete. 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 Processor -- start 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- start start 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec08f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec133bc0 con 0x7f55ec093250 2024-09-11T11:00:59.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55eaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec08f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55eaffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec08f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:35990/0 (socket says 172.21.15.102:35990) 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55eaffd640 1 -- 172.21.15.102:0/3147839685 learned_addr learned my addr 172.21.15.102:0/3147839685 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55eaffd640 1 -- 172.21.15.102:0/3147839685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ec06f380 con 0x7f55ec093250 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55eaffd640 1 --2- 172.21.15.102:0/3147839685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec08f850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55dc019fa0 tx=0x7f55dc01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55d37fe640 1 -- 172.21.15.102:0/3147839685 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55dc0b0050 con 0x7f55ec093250 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55d37fe640 1 -- 172.21.15.102:0/3147839685 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55dc0b1040 con 0x7f55ec093250 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ec073220 con 0x7f55ec093250 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55d37fe640 1 -- 172.21.15.102:0/3147839685 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55dc0b5760 con 0x7f55ec093250 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.846+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ec06ecf0 con 0x7f55ec093250 2024-09-11T11:00:59.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.850+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ec06dae0 con 0x7f55ec093250 2024-09-11T11:00:59.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.850+0000 7f55d37fe640 1 -- 172.21.15.102:0/3147839685 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f55dc0be030 con 0x7f55ec093250 2024-09-11T11:00:59.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.850+0000 7f55d37fe640 1 --2- 172.21.15.102:0/3147839685 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f55d8035db0 0x7f55d8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.850+0000 7f55d37fe640 1 -- 172.21.15.102:0/3147839685 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f55dc0bc070 con 0x7f55ec093250 2024-09-11T11:00:59.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.850+0000 7f55ea7fc640 1 --2- 172.21.15.102:0/3147839685 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f55d8035db0 0x7f55d8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.850+0000 7f55ea7fc640 1 --2- 172.21.15.102:0/3147839685 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f55d8035db0 0x7f55d8038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55e0001610 tx=0x7f55e0007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f55d37fe640 1 -- 172.21.15.102:0/3147839685 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f55dc0c5060 con 0x7f55ec093250 2024-09-11T11:00:59.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f644e025640 1 Processor -- start 2024-09-11T11:00:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f644e025640 1 -- start start 2024-09-11T11:00:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f644e025640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f644812e760 0x7f644812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f644e025640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64480984f0 con 0x7f644812f1c0 2024-09-11T11:00:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f644e025640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6448098dc0 con 0x7f644812e760 2024-09-11T11:00:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f64477fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f644812e760 0x7f644812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f6446ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f644812f1c0 0x7f644812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53624/0 (socket says 172.21.15.102:53624) 2024-09-11T11:00:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.854+0000 7f6446ffd640 1 -- 172.21.15.102:0/3050468235 learned_addr learned my addr 172.21.15.102:0/3050468235 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:59.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f64467fc640 1 -- 172.21.15.102:0/3050468235 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624236388 0 0) 0x7f64480984f0 con 0x7f644812f1c0 2024-09-11T11:00:59.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f64467fc640 1 -- 172.21.15.102:0/3050468235 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6430003530 con 0x7f644812f1c0 2024-09-11T11:00:59.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f64477fe640 1 -- 172.21.15.102:0/3050468235 >> v1:172.21.15.102:6789/0 conn(0x7f644812f1c0 legacy=0x7f644812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f64477fe640 1 -- 172.21.15.102:0/3050468235 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644812f5a0 con 0x7f644812e760 2024-09-11T11:00:59.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f64477fe640 1 --2- 172.21.15.102:0/3050468235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f644812ec80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6438009740 tx=0x7f643801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48820b2a014f091d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f64467fc640 1 -- 172.21.15.102:0/3050468235 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64380b0070 con 0x7f644812e760 2024-09-11T11:00:59.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f64467fc640 1 -- 172.21.15.102:0/3050468235 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64380ab400 con 0x7f644812e760 2024-09-11T11:00:59.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f64467fc640 1 -- 172.21.15.102:0/3050468235 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f643c0015b0 con 0x7f644812e760 2024-09-11T11:00:59.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f644e025640 1 -- 172.21.15.102:0/3050468235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 msgr2=0x7f644812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f644e025640 1 --2- 172.21.15.102:0/3050468235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f644812ec80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6438009740 tx=0x7f643801c260 comp rx=0 tx=0).stop 2024-09-11T11:00:59.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f644e025640 1 -- 172.21.15.102:0/3050468235 shutdown_connections 2024-09-11T11:00:59.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f644e025640 1 --2- 172.21.15.102:0/3050468235 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f644812ec80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:59.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f644e025640 1 -- 172.21.15.102:0/3050468235 >> 172.21.15.102:0/3050468235 conn(0x7f64480a10a0 msgr2=0x7f64480a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:59.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f644e025640 1 -- 172.21.15.102:0/3050468235 shutdown_connections 2024-09-11T11:00:59.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.858+0000 7f644e025640 1 -- 172.21.15.102:0/3050468235 wait complete. 2024-09-11T11:00:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f644e025640 1 Processor -- start 2024-09-11T11:00:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f644e025640 1 -- start start 2024-09-11T11:00:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f644e025640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f64480972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f644e025640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6448136e30 con 0x7f644812e760 2024-09-11T11:00:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f64477fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f64480972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f64477fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f64480972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36008/0 (socket says 172.21.15.102:36008) 2024-09-11T11:00:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f64477fe640 1 -- 172.21.15.102:0/614337888 learned_addr learned my addr 172.21.15.102:0/614337888 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:59.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f64477fe640 1 -- 172.21.15.102:0/614337888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6448128f50 con 0x7f644812e760 2024-09-11T11:00:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f64477fe640 1 --2- 172.21.15.102:0/614337888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f64480972f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6438019e90 tx=0x7f643801aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f642ffff640 1 -- 172.21.15.102:0/614337888 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64380b0050 con 0x7f644812e760 2024-09-11T11:00:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f642ffff640 1 -- 172.21.15.102:0/614337888 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64380b1040 con 0x7f644812e760 2024-09-11T11:00:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f644e025640 1 -- 172.21.15.102:0/614337888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6448134130 con 0x7f644812e760 2024-09-11T11:00:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f642ffff640 1 -- 172.21.15.102:0/614337888 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64380b75a0 con 0x7f644812e760 2024-09-11T11:00:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f644e025640 1 -- 172.21.15.102:0/614337888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6448097830 con 0x7f644812e760 2024-09-11T11:00:59.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f642dffb640 1 -- 172.21.15.102:0/614337888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6420005090 con 0x7f644812e760 2024-09-11T11:00:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f642ffff640 1 -- 172.21.15.102:0/614337888 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f64380be030 con 0x7f644812e760 2024-09-11T11:00:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f642ffff640 1 --2- 172.21.15.102:0/614337888 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6434035db0 0x7f6434038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f642ffff640 1 -- 172.21.15.102:0/614337888 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f64380bc070 con 0x7f644812e760 2024-09-11T11:00:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.862+0000 7f6446ffd640 1 --2- 172.21.15.102:0/614337888 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6434035db0 0x7f6434038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.866+0000 7f6446ffd640 1 --2- 172.21.15.102:0/614337888 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6434035db0 0x7f6434038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f643c0011f0 tx=0x7f643c000fa0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.866+0000 7f642ffff640 1 -- 172.21.15.102:0/614337888 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f64380e2e20 con 0x7f644812e760 2024-09-11T11:00:59.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.890+0000 7fc4c36d5640 1 Processor -- start 2024-09-11T11:00:59.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.890+0000 7fc4c36d5640 1 -- start start 2024-09-11T11:00:59.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.890+0000 7fc4c36d5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4bc12e760 0x7fc4bc12ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.890+0000 7fc4c36d5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4bc0984f0 con 0x7fc4bc12f1c0 2024-09-11T11:00:59.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.890+0000 7fc4c36d5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc4bc098dc0 con 0x7fc4bc12e760 2024-09-11T11:00:59.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.890+0000 7fc4c1471640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4bc12e760 0x7fc4bc12ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.894+0000 7fc4c0c70640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc4bc12f1c0 0x7fc4bc12b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53640/0 (socket says 172.21.15.102:53640) 2024-09-11T11:00:59.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.894+0000 7fc4c0c70640 1 -- 172.21.15.102:0/181453345 learned_addr learned my addr 172.21.15.102:0/181453345 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:00:59.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.894+0000 7fc4c1471640 1 -- 172.21.15.102:0/181453345 >> v1:172.21.15.102:6789/0 conn(0x7fc4bc12f1c0 legacy=0x7fc4bc12b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.894+0000 7fc4c1471640 1 -- 172.21.15.102:0/181453345 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc12f5a0 con 0x7fc4bc12e760 2024-09-11T11:00:59.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.894+0000 7fc4c1471640 1 --2- 172.21.15.102:0/181453345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc12ec80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009740 tx=0x7fc4b801c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90fc24d36fbd3fe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.894+0000 7fc4b3fff640 1 -- 172.21.15.102:0/181453345 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4b80b0070 con 0x7fc4bc12e760 2024-09-11T11:00:59.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.894+0000 7fc4b3fff640 1 -- 172.21.15.102:0/181453345 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b80ab530 con 0x7fc4bc12e760 2024-09-11T11:00:59.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.894+0000 7fc4b3fff640 1 -- 172.21.15.102:0/181453345 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4b80ab830 con 0x7fc4bc12e760 2024-09-11T11:00:59.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- 172.21.15.102:0/181453345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 msgr2=0x7fc4bc12ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 --2- 172.21.15.102:0/181453345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc12ec80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8009740 tx=0x7fc4b801c290 comp rx=0 tx=0).stop 2024-09-11T11:00:59.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- 172.21.15.102:0/181453345 shutdown_connections 2024-09-11T11:00:59.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 --2- 172.21.15.102:0/181453345 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc12ec80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:59.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- 172.21.15.102:0/181453345 >> 172.21.15.102:0/181453345 conn(0x7fc4bc0a10a0 msgr2=0x7fc4bc0a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:59.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- 172.21.15.102:0/181453345 shutdown_connections 2024-09-11T11:00:59.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- 172.21.15.102:0/181453345 wait complete. 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 Processor -- start 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- start start 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc1c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc06eef0 con 0x7fc4bc12e760 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c1471640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc1c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c1471640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc1c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36034/0 (socket says 172.21.15.102:36034) 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c1471640 1 -- 172.21.15.102:0/3127780298 learned_addr learned my addr 172.21.15.102:0/3127780298 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c1471640 1 -- 172.21.15.102:0/3127780298 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc08d890 con 0x7fc4bc12e760 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c1471640 1 --2- 172.21.15.102:0/3127780298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc1c3630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80ae040 tx=0x7fc4b801aad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4b1ffb640 1 -- 172.21.15.102:0/3127780298 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4b80b0050 con 0x7fc4bc12e760 2024-09-11T11:00:59.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4b1ffb640 1 -- 172.21.15.102:0/3127780298 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b80b1040 con 0x7fc4bc12e760 2024-09-11T11:00:59.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4b1ffb640 1 -- 172.21.15.102:0/3127780298 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4b80aab40 con 0x7fc4bc12e760 2024-09-11T11:00:59.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- 172.21.15.102:0/3127780298 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc08e060 con 0x7fc4bc12e760 2024-09-11T11:00:59.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.898+0000 7fc4c36d5640 1 -- 172.21.15.102:0/3127780298 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc1c3b70 con 0x7fc4bc12e760 2024-09-11T11:00:59.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.902+0000 7fc49f7fe640 1 -- 172.21.15.102:0/3127780298 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc498005090 con 0x7fc4bc12e760 2024-09-11T11:00:59.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.902+0000 7fc4b1ffb640 1 -- 172.21.15.102:0/3127780298 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4b80be030 con 0x7fc4bc12e760 2024-09-11T11:00:59.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.902+0000 7fc4b1ffb640 1 --2- 172.21.15.102:0/3127780298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc4a0035db0 0x7fc4a0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:00:59.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.902+0000 7fc4b1ffb640 1 -- 172.21.15.102:0/3127780298 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7fc4b80bc070 con 0x7fc4bc12e760 2024-09-11T11:00:59.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.906+0000 7fc4b1ffb640 1 -- 172.21.15.102:0/3127780298 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4b80c5020 con 0x7fc4bc12e760 2024-09-11T11:00:59.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.906+0000 7fc4c0c70640 1 --2- 172.21.15.102:0/3127780298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc4a0035db0 0x7fc4a0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:00:59.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.906+0000 7fc4c0c70640 1 --2- 172.21.15.102:0/3127780298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc4a0035db0 0x7fc4a0038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00e1f0 tx=0x7fc4ac001c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:00:59.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.986+0000 7feb29ffb640 1 -- 172.21.15.102:0/616052101 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7feb1c005380 con 0x7feb4406bc50 2024-09-11T11:00:59.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.986+0000 7feb2bfff640 1 -- 172.21.15.102:0/616052101 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb34015ff0 con 0x7feb4406bc50 2024-09-11T11:00:59.992 INFO:teuthology.orchestra.run.smithi102.stdout:42949672965 2024-09-11T11:00:59.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 -- 172.21.15.102:0/616052101 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7feb30035db0 msgr2=0x7feb30038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 --2- 172.21.15.102:0/616052101 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7feb30035db0 0x7feb30038270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb38000f70 tx=0x7feb380010b0 comp rx=0 tx=0).stop 2024-09-11T11:00:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 -- 172.21.15.102:0/616052101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 msgr2=0x7feb4406de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:00:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 --2- 172.21.15.102:0/616052101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4406de70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feb340af040 tx=0x7feb3401ac40 comp rx=0 tx=0).stop 2024-09-11T11:00:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 -- 172.21.15.102:0/616052101 shutdown_connections 2024-09-11T11:00:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 --2- 172.21.15.102:0/616052101 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7feb30035db0 0x7feb30038270 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 --2- 172.21.15.102:0/616052101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb4406bc50 0x7feb4406de70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:00:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 -- 172.21.15.102:0/616052101 >> 172.21.15.102:0/616052101 conn(0x7feb4409ab00 msgr2=0x7feb441335f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:00:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 -- 172.21.15.102:0/616052101 shutdown_connections 2024-09-11T11:00:59.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:00:59.990+0000 7feb29ffb640 1 -- 172.21.15.102:0/616052101 wait complete. 2024-09-11T11:01:00.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672965 for osd.2 2024-09-11T11:01:00.014 DEBUG:teuthology.parallel:result is None 2024-09-11T11:01:00.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.030+0000 7f642dffb640 1 -- 172.21.15.102:0/614337888 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6420005650 con 0x7f644812e760 2024-09-11T11:01:00.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.030+0000 7f642ffff640 1 -- 172.21.15.102:0/614337888 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f64380c5060 con 0x7f644812e760 2024-09-11T11:01:00.036 INFO:teuthology.orchestra.run.smithi102.stdout:42949672965 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 -- 172.21.15.102:0/614337888 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6434035db0 msgr2=0x7f6434038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 --2- 172.21.15.102:0/614337888 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6434035db0 0x7f6434038270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f643c0011f0 tx=0x7f643c000fa0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 -- 172.21.15.102:0/614337888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 msgr2=0x7f64480972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 --2- 172.21.15.102:0/614337888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f64480972f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6438019e90 tx=0x7f643801aaa0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 -- 172.21.15.102:0/614337888 shutdown_connections 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 --2- 172.21.15.102:0/614337888 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6434035db0 0x7f6434038270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 --2- 172.21.15.102:0/614337888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f644812e760 0x7f64480972f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 -- 172.21.15.102:0/614337888 >> 172.21.15.102:0/614337888 conn(0x7f64480a10a0 msgr2=0x7f6448125d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 -- 172.21.15.102:0/614337888 shutdown_connections 2024-09-11T11:01:00.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.034+0000 7f642dffb640 1 -- 172.21.15.102:0/614337888 wait complete. 2024-09-11T11:01:00.053 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672964 got 42949672965 for osd.3 2024-09-11T11:01:00.053 DEBUG:teuthology.parallel:result is None 2024-09-11T11:01:00.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.066+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f55ec093630 con 0x7f55ec093250 2024-09-11T11:01:00.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.066+0000 7f55d37fe640 1 -- 172.21.15.102:0/3147839685 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f55ec06f380 con 0x7f55ec093250 2024-09-11T11:01:00.071 INFO:teuthology.orchestra.run.smithi102.stdout:42949672966 2024-09-11T11:01:00.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.066+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f55d8035db0 msgr2=0x7f55d8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.066+0000 7f55f179f640 1 --2- 172.21.15.102:0/3147839685 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f55d8035db0 0x7f55d8038270 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55e0001610 tx=0x7f55e0007ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.066+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 msgr2=0x7f55ec08f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.066+0000 7f55f179f640 1 --2- 172.21.15.102:0/3147839685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec08f850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f55dc019fa0 tx=0x7f55dc01abb0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.070+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 shutdown_connections 2024-09-11T11:01:00.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.070+0000 7f55f179f640 1 --2- 172.21.15.102:0/3147839685 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f55d8035db0 0x7f55d8038270 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.070+0000 7f55f179f640 1 --2- 172.21.15.102:0/3147839685 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f55ec093250 0x7f55ec08f850 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.070+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 >> 172.21.15.102:0/3147839685 conn(0x7f55ec09d730 msgr2=0x7f55ec095c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:00.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.070+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 shutdown_connections 2024-09-11T11:01:00.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.070+0000 7f55f179f640 1 -- 172.21.15.102:0/3147839685 wait complete. 2024-09-11T11:01:00.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672966 for osd.1 2024-09-11T11:01:00.088 DEBUG:teuthology.parallel:result is None 2024-09-11T11:01:00.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 -- 172.21.15.102:0/3127780298 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc498005380 con 0x7fc4bc12e760 2024-09-11T11:01:00.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc4b1ffb640 1 -- 172.21.15.102:0/3127780298 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc4b8015f10 con 0x7fc4bc12e760 2024-09-11T11:01:00.103 INFO:teuthology.orchestra.run.smithi102.stdout:38654705668 2024-09-11T11:01:00.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 -- 172.21.15.102:0/3127780298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc4a0035db0 msgr2=0x7fc4a0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 --2- 172.21.15.102:0/3127780298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc4a0035db0 0x7fc4a0038270 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac00e1f0 tx=0x7fc4ac001c80 comp rx=0 tx=0).stop 2024-09-11T11:01:00.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 -- 172.21.15.102:0/3127780298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 msgr2=0x7fc4bc1c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 --2- 172.21.15.102:0/3127780298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc1c3630 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80ae040 tx=0x7fc4b801aad0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 -- 172.21.15.102:0/3127780298 shutdown_connections 2024-09-11T11:01:00.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 --2- 172.21.15.102:0/3127780298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc4a0035db0 0x7fc4a0038270 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 --2- 172.21.15.102:0/3127780298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4bc12e760 0x7fc4bc1c3630 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 -- 172.21.15.102:0/3127780298 >> 172.21.15.102:0/3127780298 conn(0x7fc4bc0a10a0 msgr2=0x7fc4bc09a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:00.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 -- 172.21.15.102:0/3127780298 shutdown_connections 2024-09-11T11:01:00.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.098+0000 7fc49f7fe640 1 -- 172.21.15.102:0/3127780298 wait complete. 2024-09-11T11:01:00.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-09-11T11:01:00.119 DEBUG:teuthology.parallel:result is None 2024-09-11T11:01:00.119 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T11:01:00.119 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:01:00.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53c543f640 1 Processor -- start 2024-09-11T11:01:00.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53c543f640 1 -- start start 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53c543f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53c012e760 0x7f53c012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53c543f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c00984f0 con 0x7f53c012f1c0 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53c543f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f53c0098dc0 con 0x7f53c012e760 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53beffd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f53c012e760 0x7f53c012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53be7fc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f53c012f1c0 0x7f53c012b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53644/0 (socket says 172.21.15.102:53644) 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53be7fc640 1 -- 172.21.15.102:0/3538357523 learned_addr learned my addr 172.21.15.102:0/3538357523 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53bdffb640 1 -- 172.21.15.102:0/3538357523 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773672444 0 0) 0x7f53c00984f0 con 0x7f53c012f1c0 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53bdffb640 1 -- 172.21.15.102:0/3538357523 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53a8003530 con 0x7f53c012f1c0 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53beffd640 1 -- 172.21.15.102:0/3538357523 >> v1:172.21.15.102:6789/0 conn(0x7f53c012f1c0 legacy=0x7f53c012b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.266+0000 7f53beffd640 1 -- 172.21.15.102:0/3538357523 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c012f5a0 con 0x7f53c012e760 2024-09-11T11:01:00.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53beffd640 1 --2- 172.21.15.102:0/3538357523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c012ec80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009740 tx=0x7f53b001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb93f6396fc86d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53bdffb640 1 -- 172.21.15.102:0/3538357523 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b00b0070 con 0x7f53c012e760 2024-09-11T11:01:00.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53bdffb640 1 -- 172.21.15.102:0/3538357523 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b00ab530 con 0x7f53c012e760 2024-09-11T11:01:00.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53bdffb640 1 -- 172.21.15.102:0/3538357523 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b00ab830 con 0x7f53c012e760 2024-09-11T11:01:00.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- 172.21.15.102:0/3538357523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 msgr2=0x7f53c012ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 --2- 172.21.15.102:0/3538357523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c012ec80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009740 tx=0x7f53b001c3c0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- 172.21.15.102:0/3538357523 shutdown_connections 2024-09-11T11:01:00.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 --2- 172.21.15.102:0/3538357523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c012ec80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- 172.21.15.102:0/3538357523 >> 172.21.15.102:0/3538357523 conn(0x7f53c00a10a0 msgr2=0x7f53c00a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:00.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- 172.21.15.102:0/3538357523 shutdown_connections 2024-09-11T11:01:00.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- 172.21.15.102:0/3538357523 wait complete. 2024-09-11T11:01:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 Processor -- start 2024-09-11T11:01:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- start start 2024-09-11T11:01:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c01309e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f53c0136e30 con 0x7f53c012e760 2024-09-11T11:01:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53beffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c01309e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53beffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c01309e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36052/0 (socket says 172.21.15.102:36052) 2024-09-11T11:01:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53beffd640 1 -- 172.21.15.102:0/2020392835 learned_addr learned my addr 172.21.15.102:0/2020392835 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:01:00.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53beffd640 1 -- 172.21.15.102:0/2020392835 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c0132f70 con 0x7f53c012e760 2024-09-11T11:01:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53beffd640 1 --2- 172.21.15.102:0/2020392835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c01309e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f53b0019ff0 tx=0x7f53b001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53a77fe640 1 -- 172.21.15.102:0/2020392835 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b00b0050 con 0x7f53c012e760 2024-09-11T11:01:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53a77fe640 1 -- 172.21.15.102:0/2020392835 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b00b1040 con 0x7f53c012e760 2024-09-11T11:01:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c0133430 con 0x7f53c012e760 2024-09-11T11:01:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53a77fe640 1 -- 172.21.15.102:0/2020392835 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53b00b7580 con 0x7f53c012e760 2024-09-11T11:01:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.270+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c0130f20 con 0x7f53c012e760 2024-09-11T11:01:00.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.274+0000 7f53a77fe640 1 -- 172.21.15.102:0/2020392835 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f53b00be030 con 0x7f53c012e760 2024-09-11T11:01:00.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.274+0000 7f53a77fe640 1 --2- 172.21.15.102:0/2020392835 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53ac035db0 0x7f53ac038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.274+0000 7f53a77fe640 1 -- 172.21.15.102:0/2020392835 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f53b00bc070 con 0x7f53c012e760 2024-09-11T11:01:00.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.274+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c0132300 con 0x7f53c012e760 2024-09-11T11:01:00.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.274+0000 7f53be7fc640 1 --2- 172.21.15.102:0/2020392835 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53ac035db0 0x7f53ac038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.274+0000 7f53be7fc640 1 --2- 172.21.15.102:0/2020392835 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53ac035db0 0x7f53ac038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53b4005890 tx=0x7f53b40079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.278+0000 7f53a77fe640 1 -- 172.21.15.102:0/2020392835 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f53b00c5020 con 0x7f53c012e760 2024-09-11T11:01:00.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.422+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53c012ec80 con 0x7f53ac035db0 2024-09-11T11:01:00.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.426+0000 7f53a77fe640 1 -- 172.21.15.102:0/2020392835 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32212 (secure 0 0 0) 0x7f53c012ec80 con 0x7f53ac035db0 2024-09-11T11:01:00.432 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:01:00.432 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:01:00.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53ac035db0 msgr2=0x7f53ac038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 --2- 172.21.15.102:0/2020392835 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53ac035db0 0x7f53ac038270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53b4005890 tx=0x7f53b40079a0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 msgr2=0x7f53c01309e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 --2- 172.21.15.102:0/2020392835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c01309e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f53b0019ff0 tx=0x7f53b001ac00 comp rx=0 tx=0).stop 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 shutdown_connections 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 --2- 172.21.15.102:0/2020392835 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53ac035db0 0x7f53ac038270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 --2- 172.21.15.102:0/2020392835 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f53c012e760 0x7f53c01309e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 >> 172.21.15.102:0/2020392835 conn(0x7f53c00a10a0 msgr2=0x7f53c012c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 shutdown_connections 2024-09-11T11:01:00.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.430+0000 7f53c543f640 1 -- 172.21.15.102:0/2020392835 wait complete. 2024-09-11T11:01:00.450 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-11T11:00:58.935374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114056,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373304,"statfs":{"total":386547056640,"available":386430263296,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.075555"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.884159+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:00:55.884159+0000","last_peered":"2024-09-11T11:00:55.884159+0000","last_clean":"2024-09-11T11:00:55.884159+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:00:55.884159+0000","last_undegraded":"2024-09-11T11:00:55.884159+0000","last_fullsized":"2024-09-11T11:00:55.884159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:52:42.400043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.878899+0000","last_change":"2024-09-11T11:00:55.878899+0000","last_active":"2024-09-11T11:00:55.878899+0000","last_peered":"2024-09-11T11:00:55.878899+0000","last_clean":"2024-09-11T11:00:55.878899+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:00:55.878899+0000","last_undegraded":"2024-09-11T11:00:55.878899+0000","last_fullsized":"2024-09-11T11:00:55.878899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:24.156776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.883708+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:00:55.883708+0000","last_peered":"2024-09-11T11:00:55.883708+0000","last_clean":"2024-09-11T11:00:55.883708+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:00:55.883708+0000","last_undegraded":"2024-09-11T11:00:55.883708+0000","last_fullsized":"2024-09-11T11:00:55.883708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.878837+0000","last_change":"2024-09-11T11:00:55.878837+0000","last_active":"2024-09-11T11:00:55.878837+0000","last_peered":"2024-09-11T11:00:55.878837+0000","last_clean":"2024-09-11T11:00:55.878837+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:00:55.878837+0000","last_undegraded":"2024-09-11T11:00:55.878837+0000","last_fullsized":"2024-09-11T11:00:55.878837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.885219+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:00:55.885219+0000","last_peered":"2024-09-11T11:00:55.885219+0000","last_clean":"2024-09-11T11:00:55.885219+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:00:55.885219+0000","last_undegraded":"2024-09-11T11:00:55.885219+0000","last_fullsized":"2024-09-11T11:00:55.885219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:00.420708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:56.126982+0000","last_change":"2024-09-11T11:00:56.127438+0000","last_active":"2024-09-11T11:00:56.126982+0000","last_peered":"2024-09-11T11:00:56.126982+0000","last_clean":"2024-09-11T11:00:56.126982+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:00:56.126982+0000","last_undegraded":"2024-09-11T11:00:56.126982+0000","last_fullsized":"2024-09-11T11:00:56.126982+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:21.503625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.882458+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:00:55.882458+0000","last_peered":"2024-09-11T11:00:55.882458+0000","last_clean":"2024-09-11T11:00:55.882458+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:00:55.882458+0000","last_undegraded":"2024-09-11T11:00:55.882458+0000","last_fullsized":"2024-09-11T11:00:55.882458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:31:53.046144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.884398+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:00:55.884398+0000","last_peered":"2024-09-11T11:00:55.884398+0000","last_clean":"2024-09-11T11:00:55.884398+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:00:55.884398+0000","last_undegraded":"2024-09-11T11:00:55.884398+0000","last_fullsized":"2024-09-11T11:00:55.884398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:29.398076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.877967+0000","last_change":"2024-09-11T11:00:51.371382+0000","last_active":"2024-09-11T11:00:55.877967+0000","last_peered":"2024-09-11T11:00:55.877967+0000","last_clean":"2024-09-11T11:00:55.877967+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:00:55.877967+0000","last_undegraded":"2024-09-11T11:00:55.877967+0000","last_fullsized":"2024-09-11T11:00:55.877967+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_clean_scrub_stamp":"2024-09-11T11:00:49.442581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:56.798705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":155648,"data_stored":50912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":641299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:01:00.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:01:00.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.558+0000 7f6d57678640 1 Processor -- start 2024-09-11T11:01:00.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 -- start start 2024-09-11T11:01:00.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6d5006f340 0x7f6d50133f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5006fa70 con 0x7f6d5006e850 2024-09-11T11:01:00.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5006c360 con 0x7f6d5006f340 2024-09-11T11:01:00.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d55414640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6d5006e850 0x7f6d5006ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53648/0 (socket says 172.21.15.102:53648) 2024-09-11T11:01:00.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d55414640 1 -- 172.21.15.102:0/4043687257 learned_addr learned my addr 172.21.15.102:0/4043687257 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:01:00.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d54c13640 1 --2- 172.21.15.102:0/4043687257 >> v2:172.21.15.102:3300/0 conn(0x7f6d5006f340 0x7f6d50133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d47fff640 1 -- 172.21.15.102:0/4043687257 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552535867 0 0) 0x7f6d5006fa70 con 0x7f6d5006e850 2024-09-11T11:01:00.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d47fff640 1 -- 172.21.15.102:0/4043687257 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d3c003530 con 0x7f6d5006e850 2024-09-11T11:01:00.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d54c13640 1 -- 172.21.15.102:0/4043687257 >> v1:172.21.15.102:6789/0 conn(0x7f6d5006e850 legacy=0x7f6d5006ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d47fff640 1 -- 172.21.15.102:0/4043687257 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1125043801 0 0) 0x7f6d3c003530 con 0x7f6d5006e850 2024-09-11T11:01:00.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d54c13640 1 -- 172.21.15.102:0/4043687257 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5006beb0 con 0x7f6d5006f340 2024-09-11T11:01:00.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d54c13640 1 --2- 172.21.15.102:0/4043687257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006f340 0x7f6d50133f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009740 tx=0x7f6d4001c290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c5ab9219f1f920 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d47fff640 1 -- 172.21.15.102:0/4043687257 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d400b0070 con 0x7f6d5006f340 2024-09-11T11:01:00.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d47fff640 1 -- 172.21.15.102:0/4043687257 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d400ab400 con 0x7f6d5006f340 2024-09-11T11:01:00.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d47fff640 1 -- 172.21.15.102:0/4043687257 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c0015b0 con 0x7f6d5006f340 2024-09-11T11:01:00.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 -- 172.21.15.102:0/4043687257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006f340 msgr2=0x7f6d50133f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 --2- 172.21.15.102:0/4043687257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006f340 0x7f6d50133f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009740 tx=0x7f6d4001c290 comp rx=0 tx=0).stop 2024-09-11T11:01:00.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 -- 172.21.15.102:0/4043687257 shutdown_connections 2024-09-11T11:01:00.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 --2- 172.21.15.102:0/4043687257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006f340 0x7f6d50133f30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.562+0000 7f6d57678640 1 -- 172.21.15.102:0/4043687257 >> 172.21.15.102:0/4043687257 conn(0x7f6d5009ac70 msgr2=0x7f6d5006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:00.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 -- 172.21.15.102:0/4043687257 shutdown_connections 2024-09-11T11:01:00.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 -- 172.21.15.102:0/4043687257 wait complete. 2024-09-11T11:01:00.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 Processor -- start 2024-09-11T11:01:00.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 -- start start 2024-09-11T11:01:00.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006e850 0x7f6d5012ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5009eab0 con 0x7f6d5006e850 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d55414640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006e850 0x7f6d5012ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d55414640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006e850 0x7f6d5012ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36068/0 (socket says 172.21.15.102:36068) 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d55414640 1 -- 172.21.15.102:0/3418257054 learned_addr learned my addr 172.21.15.102:0/3418257054 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d55414640 1 -- 172.21.15.102:0/3418257054 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d50097550 con 0x7f6d5006e850 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d55414640 1 --2- 172.21.15.102:0/3418257054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006e850 0x7f6d5012ef50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00c6b0 tx=0x7f6d4c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d45ffb640 1 -- 172.21.15.102:0/3418257054 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c017070 con 0x7f6d5006e850 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d45ffb640 1 -- 172.21.15.102:0/3418257054 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d4c005a10 con 0x7f6d5006e850 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d500959f0 con 0x7f6d5006e850 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d45ffb640 1 -- 172.21.15.102:0/3418257054 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d4c005db0 con 0x7f6d5006e850 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5012f660 con 0x7f6d5006e850 2024-09-11T11:01:00.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d45ffb640 1 -- 172.21.15.102:0/3418257054 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d4c01a070 con 0x7f6d5006e850 2024-09-11T11:01:00.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d50096940 con 0x7f6d5006e850 2024-09-11T11:01:00.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d45ffb640 1 --2- 172.21.15.102:0/3418257054 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6d34035db0 0x7f6d34038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d45ffb640 1 -- 172.21.15.102:0/3418257054 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f6d4c047c40 con 0x7f6d5006e850 2024-09-11T11:01:00.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.566+0000 7f6d54c13640 1 --2- 172.21.15.102:0/3418257054 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6d34035db0 0x7f6d34038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.570+0000 7f6d54c13640 1 --2- 172.21.15.102:0/3418257054 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6d34035db0 0x7f6d34038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6d400ad000 tx=0x7f6d40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.570+0000 7f6d45ffb640 1 -- 172.21.15.102:0/3418257054 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6d4c01a360 con 0x7f6d5006e850 2024-09-11T11:01:00.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.718+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d50096cd0 con 0x7f6d34035db0 2024-09-11T11:01:00.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d45ffb640 1 -- 172.21.15.102:0/3418257054 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32212 (secure 0 0 0) 0x7f6d400b1040 con 0x7f6d34035db0 2024-09-11T11:01:00.727 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:01:00.727 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6d34035db0 msgr2=0x7f6d34038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 --2- 172.21.15.102:0/3418257054 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6d34035db0 0x7f6d34038270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6d400ad000 tx=0x7f6d40008040 comp rx=0 tx=0).stop 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006e850 msgr2=0x7f6d5012ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 --2- 172.21.15.102:0/3418257054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006e850 0x7f6d5012ef50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00c6b0 tx=0x7f6d4c00cb70 comp rx=0 tx=0).stop 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 shutdown_connections 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 --2- 172.21.15.102:0/3418257054 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6d34035db0 0x7f6d34038270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 --2- 172.21.15.102:0/3418257054 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6d5006e850 0x7f6d5012ef50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 >> 172.21.15.102:0/3418257054 conn(0x7f6d5009ac70 msgr2=0x7f6d50098960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 shutdown_connections 2024-09-11T11:01:00.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.726+0000 7f6d57678640 1 -- 172.21.15.102:0/3418257054 wait complete. 2024-09-11T11:01:00.744 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-11T11:00:58.935374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":114056,"kb_used_data":1776,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373304,"statfs":{"total":386547056640,"available":386430263296,"internally_reserved":0,"allocated":1818624,"data_stored":1384422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.075555"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.884159+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:00:55.884159+0000","last_peered":"2024-09-11T11:00:55.884159+0000","last_clean":"2024-09-11T11:00:55.884159+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:00:55.884159+0000","last_undegraded":"2024-09-11T11:00:55.884159+0000","last_fullsized":"2024-09-11T11:00:55.884159+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:52:42.400043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.878899+0000","last_change":"2024-09-11T11:00:55.878899+0000","last_active":"2024-09-11T11:00:55.878899+0000","last_peered":"2024-09-11T11:00:55.878899+0000","last_clean":"2024-09-11T11:00:55.878899+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:00:55.878899+0000","last_undegraded":"2024-09-11T11:00:55.878899+0000","last_fullsized":"2024-09-11T11:00:55.878899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:24.156776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.883708+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:00:55.883708+0000","last_peered":"2024-09-11T11:00:55.883708+0000","last_clean":"2024-09-11T11:00:55.883708+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:00:55.883708+0000","last_undegraded":"2024-09-11T11:00:55.883708+0000","last_fullsized":"2024-09-11T11:00:55.883708+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.878837+0000","last_change":"2024-09-11T11:00:55.878837+0000","last_active":"2024-09-11T11:00:55.878837+0000","last_peered":"2024-09-11T11:00:55.878837+0000","last_clean":"2024-09-11T11:00:55.878837+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:00:55.878837+0000","last_undegraded":"2024-09-11T11:00:55.878837+0000","last_fullsized":"2024-09-11T11:00:55.878837+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.885219+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:00:55.885219+0000","last_peered":"2024-09-11T11:00:55.885219+0000","last_clean":"2024-09-11T11:00:55.885219+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:00:55.885219+0000","last_undegraded":"2024-09-11T11:00:55.885219+0000","last_fullsized":"2024-09-11T11:00:55.885219+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:00.420708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:56.126982+0000","last_change":"2024-09-11T11:00:56.127438+0000","last_active":"2024-09-11T11:00:56.126982+0000","last_peered":"2024-09-11T11:00:56.126982+0000","last_clean":"2024-09-11T11:00:56.126982+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:00:56.126982+0000","last_undegraded":"2024-09-11T11:00:56.126982+0000","last_fullsized":"2024-09-11T11:00:56.126982+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:21.503625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.882458+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:00:55.882458+0000","last_peered":"2024-09-11T11:00:55.882458+0000","last_clean":"2024-09-11T11:00:55.882458+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:00:55.882458+0000","last_undegraded":"2024-09-11T11:00:55.882458+0000","last_fullsized":"2024-09-11T11:00:55.882458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:31:53.046144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.884398+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:00:55.884398+0000","last_peered":"2024-09-11T11:00:55.884398+0000","last_clean":"2024-09-11T11:00:55.884398+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:00:55.884398+0000","last_undegraded":"2024-09-11T11:00:55.884398+0000","last_fullsized":"2024-09-11T11:00:55.884398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:29.398076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'117","reported_seq":170,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-09-11T11:00:55.877967+0000","last_change":"2024-09-11T11:00:51.371382+0000","last_active":"2024-09-11T11:00:55.877967+0000","last_peered":"2024-09-11T11:00:55.877967+0000","last_clean":"2024-09-11T11:00:55.877967+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:00:55.877967+0000","last_undegraded":"2024-09-11T11:00:55.877967+0000","last_fullsized":"2024-09-11T11:00:55.877967+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_clean_scrub_stamp":"2024-09-11T11:00:49.442581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:56.798705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949672965,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":155648,"data_stored":50912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949672965,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31920,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339920,"statfs":{"total":96636764160,"available":96604078080,"internally_reserved":0,"allocated":749568,"data_stored":641280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":753664,"data_stored":641299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":156,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":159744,"data_stored":50931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:01:00.744 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T11:01:00.745 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T11:01:00.745 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T11:01:00.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd7f57640 1 Processor -- start 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd7f57640 1 -- start start 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd7f57640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9dd012f390 0x7f9dd0133a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd7f57640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd00984f0 con 0x7f9dd012e760 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd7f57640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd0098dc0 con 0x7f9dd012f390 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd5cf3640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9dd012e760 0x7f9dd012ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:53654/0 (socket says 172.21.15.102:53654) 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd5cf3640 1 -- 172.21.15.102:0/2742763752 learned_addr learned my addr 172.21.15.102:0/2742763752 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd54f2640 1 --2- 172.21.15.102:0/2742763752 >> v2:172.21.15.102:3300/0 conn(0x7f9dd012f390 0x7f9dd0133a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd4cf1640 1 -- 172.21.15.102:0/2742763752 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874465952 0 0) 0x7f9dd00984f0 con 0x7f9dd012e760 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd4cf1640 1 -- 172.21.15.102:0/2742763752 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dbc003530 con 0x7f9dd012e760 2024-09-11T11:01:00.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd54f2640 1 -- 172.21.15.102:0/2742763752 >> v1:172.21.15.102:6789/0 conn(0x7f9dd012e760 legacy=0x7f9dd012ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.854+0000 7f9dd54f2640 1 -- 172.21.15.102:0/2742763752 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd00981a0 con 0x7f9dd012f390 2024-09-11T11:01:00.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd54f2640 1 --2- 172.21.15.102:0/2742763752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012f390 0x7f9dd0133a80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009740 tx=0x7f9dc001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a6f83541497fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd4cf1640 1 -- 172.21.15.102:0/2742763752 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00b1070 con 0x7f9dd012f390 2024-09-11T11:01:00.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd4cf1640 1 -- 172.21.15.102:0/2742763752 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dc00ac570 con 0x7f9dd012f390 2024-09-11T11:01:00.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd4cf1640 1 -- 172.21.15.102:0/2742763752 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dc00ac850 con 0x7f9dd012f390 2024-09-11T11:01:00.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- 172.21.15.102:0/2742763752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012f390 msgr2=0x7f9dd0133a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:00.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 --2- 172.21.15.102:0/2742763752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012f390 0x7f9dd0133a80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009740 tx=0x7f9dc001c400 comp rx=0 tx=0).stop 2024-09-11T11:01:00.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- 172.21.15.102:0/2742763752 shutdown_connections 2024-09-11T11:01:00.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 --2- 172.21.15.102:0/2742763752 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012f390 0x7f9dd0133a80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:00.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- 172.21.15.102:0/2742763752 >> 172.21.15.102:0/2742763752 conn(0x7f9dd00a10a0 msgr2=0x7f9dd00a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:00.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- 172.21.15.102:0/2742763752 shutdown_connections 2024-09-11T11:01:00.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- 172.21.15.102:0/2742763752 wait complete. 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 Processor -- start 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- start start 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012e760 0x7f9dd00972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0136b70 con 0x7f9dd012e760 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd5cf3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012e760 0x7f9dd00972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd5cf3640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012e760 0x7f9dd00972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36092/0 (socket says 172.21.15.102:36092) 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd5cf3640 1 -- 172.21.15.102:0/431082388 learned_addr learned my addr 172.21.15.102:0/431082388 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd5cf3640 1 -- 172.21.15.102:0/431082388 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd0131150 con 0x7f9dd012e760 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd5cf3640 1 --2- 172.21.15.102:0/431082388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012e760 0x7f9dd00972f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00c3d0 tx=0x7f9dcc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dc67fc640 1 -- 172.21.15.102:0/431082388 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dcc017070 con 0x7f9dd012e760 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dc67fc640 1 -- 172.21.15.102:0/431082388 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dcc005ce0 con 0x7f9dd012e760 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd0132e30 con 0x7f9dd012e760 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dc67fc640 1 -- 172.21.15.102:0/431082388 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9dcc0070d0 con 0x7f9dd012e760 2024-09-11T11:01:00.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.862+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd0097830 con 0x7f9dd012e760 2024-09-11T11:01:00.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.866+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd012ec80 con 0x7f9dd012e760 2024-09-11T11:01:00.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.866+0000 7f9dc67fc640 1 -- 172.21.15.102:0/431082388 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9dcc01a070 con 0x7f9dd012e760 2024-09-11T11:01:00.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.866+0000 7f9dc67fc640 1 --2- 172.21.15.102:0/431082388 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9db4035db0 0x7f9db4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:00.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.866+0000 7f9dc67fc640 1 -- 172.21.15.102:0/431082388 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7f9dcc047b60 con 0x7f9dd012e760 2024-09-11T11:01:00.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.866+0000 7f9dd54f2640 1 --2- 172.21.15.102:0/431082388 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9db4035db0 0x7f9db4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:00.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.866+0000 7f9dd54f2640 1 --2- 172.21.15.102:0/431082388 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9db4035db0 0x7f9db4038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00ae000 tx=0x7f9dc00a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:00.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:00.870+0000 7f9dc67fc640 1 -- 172.21.15.102:0/431082388 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9dcc019e10 con 0x7f9dd012e760 2024-09-11T11:01:01.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.058+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9dd0131a30 con 0x7f9dd012e760 2024-09-11T11:01:01.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.058+0000 7f9dc67fc640 1 -- 172.21.15.102:0/431082388 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9dcc01b8d0 con 0x7f9dd012e760 2024-09-11T11:01:01.064 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:01:01.064 INFO:teuthology.orchestra.run.smithi102.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T11:01:01.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9db4035db0 msgr2=0x7f9db4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 --2- 172.21.15.102:0/431082388 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9db4035db0 0x7f9db4038270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00ae000 tx=0x7f9dc00a6070 comp rx=0 tx=0).stop 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012e760 msgr2=0x7f9dd00972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 --2- 172.21.15.102:0/431082388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012e760 0x7f9dd00972f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc00c3d0 tx=0x7f9dcc00c890 comp rx=0 tx=0).stop 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 shutdown_connections 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 --2- 172.21.15.102:0/431082388 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9db4035db0 0x7f9db4038270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 --2- 172.21.15.102:0/431082388 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd012e760 0x7f9dd00972f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 >> 172.21.15.102:0/431082388 conn(0x7f9dd00a10a0 msgr2=0x7f9dd0128080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 shutdown_connections 2024-09-11T11:01:01.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:01:01.062+0000 7f9dd7f57640 1 -- 172.21.15.102:0/431082388 wait complete. 2024-09-11T11:01:01.082 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T11:01:01.082 INFO:teuthology.run_tasks:Running task rgw... 2024-09-11T11:01:01.099 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-11T11:01:01.099 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-11T11:01:01.099 INFO:tasks.rgw:Creating data pools 2024-09-11T11:01:01.099 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-11T11:01:01.099 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-11T11:01:01.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff8700ea640 1 Processor -- start 2024-09-11T11:01:01.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff8700ea640 1 -- start start 2024-09-11T11:01:01.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff8700ea640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff86810f880 0x7ff86811b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:01.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff8700ea640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86811b660 con 0x7ff86810ed90 2024-09-11T11:01:01.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff8700ea640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff86811c840 con 0x7ff86810f880 2024-09-11T11:01:01.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff86de86640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff86810ed90 0x7ff86810f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:43180/0 (socket says 172.21.15.145:43180) 2024-09-11T11:01:01.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff86de86640 1 -- 172.21.15.145:0/427946696 learned_addr learned my addr 172.21.15.145:0/427946696 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:01.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff86d685640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff86810f880 0x7ff86811b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:01.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff86ce84640 1 -- 172.21.15.145:0/427946696 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260663034 0 0) 0x7ff86811b660 con 0x7ff86810ed90 2024-09-11T11:01:01.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff86ce84640 1 -- 172.21.15.145:0/427946696 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff854003530 con 0x7ff86810ed90 2024-09-11T11:01:01.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff86d685640 1 -- 172.21.15.145:0/427946696 >> v1:172.21.15.102:6789/0 conn(0x7ff86810ed90 legacy=0x7ff86810f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:01.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.229+0000 7ff86d685640 1 -- 172.21.15.145:0/427946696 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86811c9c0 con 0x7ff86810f880 2024-09-11T11:01:01.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86d685640 1 --2- 172.21.15.145:0/427946696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810f880 0x7ff86811b120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff864009740 tx=0x7ff86401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a97c79a9b05c9cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:01.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86ce84640 1 -- 172.21.15.145:0/427946696 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8640b1070 con 0x7ff86810f880 2024-09-11T11:01:01.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86ce84640 1 -- 172.21.15.145:0/427946696 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8640ac520 con 0x7ff86810f880 2024-09-11T11:01:01.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86ce84640 1 -- 172.21.15.145:0/427946696 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8640ac800 con 0x7ff86810f880 2024-09-11T11:01:01.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 -- 172.21.15.145:0/427946696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810f880 msgr2=0x7ff86811b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:01.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 --2- 172.21.15.145:0/427946696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810f880 0x7ff86811b120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff864009740 tx=0x7ff86401c370 comp rx=0 tx=0).stop 2024-09-11T11:01:01.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 -- 172.21.15.145:0/427946696 shutdown_connections 2024-09-11T11:01:01.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 --2- 172.21.15.145:0/427946696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810f880 0x7ff86811b120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:01.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 -- 172.21.15.145:0/427946696 >> 172.21.15.145:0/427946696 conn(0x7ff86806f390 msgr2=0x7ff8680717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:01.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 -- 172.21.15.145:0/427946696 shutdown_connections 2024-09-11T11:01:01.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 -- 172.21.15.145:0/427946696 wait complete. 2024-09-11T11:01:01.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 Processor -- start 2024-09-11T11:01:01.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 -- start start 2024-09-11T11:01:01.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810ed90 0x7ff8681aed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:01.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff8700ea640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff86811c490 con 0x7ff86810ed90 2024-09-11T11:01:01.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86de86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810ed90 0x7ff8681aed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86de86640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810ed90 0x7ff8681aed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56158/0 (socket says 172.21.15.145:56158) 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86de86640 1 -- 172.21.15.145:0/3440632372 learned_addr learned my addr 172.21.15.145:0/3440632372 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86de86640 1 -- 172.21.15.145:0/3440632372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8681af320 con 0x7ff86810ed90 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.233+0000 7ff86de86640 1 --2- 172.21.15.145:0/3440632372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810ed90 0x7ff8681aed50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c3d0 tx=0x7ff85c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff85a7fc640 1 -- 172.21.15.145:0/3440632372 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff85c017070 con 0x7ff86810ed90 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8681af5b0 con 0x7ff86810ed90 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8681a8fc0 con 0x7ff86810ed90 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff85a7fc640 1 -- 172.21.15.145:0/3440632372 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff85c005ce0 con 0x7ff86810ed90 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff85a7fc640 1 -- 172.21.15.145:0/3440632372 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff85c0070d0 con 0x7ff86810ed90 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff850005090 con 0x7ff86810ed90 2024-09-11T11:01:01.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff85a7fc640 1 -- 172.21.15.145:0/3440632372 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff85c01a070 con 0x7ff86810ed90 2024-09-11T11:01:01.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff85a7fc640 1 --2- 172.21.15.145:0/3440632372 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff84c035d60 0x7ff84c038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:01.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff85a7fc640 1 -- 172.21.15.145:0/3440632372 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3538+0+0 (secure 0 0 0) 0x7ff85c048070 con 0x7ff86810ed90 2024-09-11T11:01:01.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff86d685640 1 --2- 172.21.15.145:0/3440632372 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff84c035d60 0x7ff84c038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:01.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.237+0000 7ff86d685640 1 --2- 172.21.15.145:0/3440632372 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff84c035d60 0x7ff84c038220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8640ae000 tx=0x7ff8640a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:01.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.249+0000 7ff85a7fc640 1 -- 172.21.15.145:0/3440632372 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff85c021020 con 0x7ff86810ed90 2024-09-11T11:01:01.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:01.409+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7ff850005380 con 0x7ff86810ed90 2024-09-11T11:01:02.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.285+0000 7ff85a7fc640 1 -- 172.21.15.145:0/3440632372 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.data' created v20) ==== 167+0+0 (secure 0 0 0) 0x7ff85c019e10 con 0x7ff86810ed90 2024-09-11T11:01:02.289 INFO:teuthology.orchestra.run.smithi145.stderr:pool 'default.rgw.buckets.data' created 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff84c035d60 msgr2=0x7ff84c038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 --2- 172.21.15.145:0/3440632372 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff84c035d60 0x7ff84c038220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8640ae000 tx=0x7ff8640a7000 comp rx=0 tx=0).stop 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810ed90 msgr2=0x7ff8681aed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 --2- 172.21.15.145:0/3440632372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810ed90 0x7ff8681aed50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00c3d0 tx=0x7ff85c00c890 comp rx=0 tx=0).stop 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 shutdown_connections 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 --2- 172.21.15.145:0/3440632372 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff84c035d60 0x7ff84c038220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 --2- 172.21.15.145:0/3440632372 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff86810ed90 0x7ff8681aed50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 >> 172.21.15.145:0/3440632372 conn(0x7ff86806f390 msgr2=0x7ff86810ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 shutdown_connections 2024-09-11T11:01:02.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.289+0000 7ff8700ea640 1 -- 172.21.15.145:0/3440632372 wait complete. 2024-09-11T11:01:02.318 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-11T11:01:02.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fada6d08640 1 Processor -- start 2024-09-11T11:01:02.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fada6d08640 1 -- start start 2024-09-11T11:01:02.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fada6d08640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fada0118a00 0x7fada011adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:02.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fada6d08640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fada011b3c0 con 0x7fada0115d00 2024-09-11T11:01:02.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fada6d08640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fada011c5c0 con 0x7fada0118a00 2024-09-11T11:01:02.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fad9ffff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fada0118a00 0x7fada011adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:02.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fada4aa4640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fada0115d00 0x7fada01160e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:43190/0 (socket says 172.21.15.145:43190) 2024-09-11T11:01:02.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fada4aa4640 1 -- 172.21.15.145:0/1994120793 learned_addr learned my addr 172.21.15.145:0/1994120793 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:02.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fad9ffff640 1 -- 172.21.15.145:0/1994120793 >> v1:172.21.15.102:6789/0 conn(0x7fada0115d00 legacy=0x7fada01160e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:02.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.437+0000 7fad9ffff640 1 -- 172.21.15.145:0/1994120793 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada011c770 con 0x7fada0118a00 2024-09-11T11:01:02.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fad9ffff640 1 --2- 172.21.15.145:0/1994120793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0118a00 0x7fada011adf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad94009740 tx=0x7fad9401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cab283d9f13240c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fad9f7fe640 1 -- 172.21.15.145:0/1994120793 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad940b1070 con 0x7fada0118a00 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fad9f7fe640 1 -- 172.21.15.145:0/1994120793 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad940ac520 con 0x7fada0118a00 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fad9f7fe640 1 -- 172.21.15.145:0/1994120793 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad940ac820 con 0x7fada0118a00 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 -- 172.21.15.145:0/1994120793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0118a00 msgr2=0x7fada011adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 --2- 172.21.15.145:0/1994120793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0118a00 0x7fada011adf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fad94009740 tx=0x7fad9401c370 comp rx=0 tx=0).stop 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 -- 172.21.15.145:0/1994120793 shutdown_connections 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 --2- 172.21.15.145:0/1994120793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0118a00 0x7fada011adf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 -- 172.21.15.145:0/1994120793 >> 172.21.15.145:0/1994120793 conn(0x7fada0071360 msgr2=0x7fada0073780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 -- 172.21.15.145:0/1994120793 shutdown_connections 2024-09-11T11:01:02.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 -- 172.21.15.145:0/1994120793 wait complete. 2024-09-11T11:01:02.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 Processor -- start 2024-09-11T11:01:02.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 -- start start 2024-09-11T11:01:02.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0115d00 0x7fada01acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:02.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.441+0000 7fada6d08640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fada011c2c0 con 0x7fada0115d00 2024-09-11T11:01:02.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fada4aa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0115d00 0x7fada01acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:02.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fada4aa4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0115d00 0x7fada01acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56180/0 (socket says 172.21.15.145:56180) 2024-09-11T11:01:02.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fada4aa4640 1 -- 172.21.15.145:0/1529235249 learned_addr learned my addr 172.21.15.145:0/1529235249 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:02.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fada4aa4640 1 -- 172.21.15.145:0/1529235249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada01ad350 con 0x7fada0115d00 2024-09-11T11:01:02.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fada4aa4640 1 --2- 172.21.15.145:0/1529235249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0115d00 0x7fada01acd80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad9000c480 tx=0x7fad9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:02.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fad9d7fa640 1 -- 172.21.15.145:0/1529235249 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad90017070 con 0x7fada0115d00 2024-09-11T11:01:02.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fad9d7fa640 1 -- 172.21.15.145:0/1529235249 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad90005c20 con 0x7fada0115d00 2024-09-11T11:01:02.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada01ad5e0 con 0x7fada0115d00 2024-09-11T11:01:02.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fad9d7fa640 1 -- 172.21.15.145:0/1529235249 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad90007070 con 0x7fada0115d00 2024-09-11T11:01:02.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada01a6ff0 con 0x7fada0115d00 2024-09-11T11:01:02.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada01160e0 con 0x7fada0115d00 2024-09-11T11:01:02.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fad9d7fa640 1 -- 172.21.15.145:0/1529235249 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fad9001a070 con 0x7fada0115d00 2024-09-11T11:01:02.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fad9d7fa640 1 --2- 172.21.15.145:0/1529235249 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad8c035db0 0x7fad8c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:02.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fad9d7fa640 1 -- 172.21.15.145:0/1529235249 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 3845+0+0 (secure 0 0 0) 0x7fad90047f40 con 0x7fada0115d00 2024-09-11T11:01:02.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fad9ffff640 1 --2- 172.21.15.145:0/1529235249 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad8c035db0 0x7fad8c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:02.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.445+0000 7fad9ffff640 1 --2- 172.21.15.145:0/1529235249 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad8c035db0 0x7fad8c038270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad940ae000 tx=0x7fad94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:02.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.461+0000 7fad9d7fa640 1 -- 172.21.15.145:0/1529235249 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fad90045db0 con 0x7fada0115d00 2024-09-11T11:01:02.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:02.621+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7fada01ad810 con 0x7fada0115d00 2024-09-11T11:01:03.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fad9d7fa640 1 -- 172.21.15.145:0/1529235249 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v21) ==== 185+0+0 (secure 0 0 0) 0x7fad90046130 con 0x7fada0115d00 2024-09-11T11:01:03.295 INFO:teuthology.orchestra.run.smithi145.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-11T11:01:03.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad8c035db0 msgr2=0x7fad8c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:03.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 --2- 172.21.15.145:0/1529235249 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad8c035db0 0x7fad8c038270 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad940ae000 tx=0x7fad94008040 comp rx=0 tx=0).stop 2024-09-11T11:01:03.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0115d00 msgr2=0x7fada01acd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:03.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 --2- 172.21.15.145:0/1529235249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0115d00 0x7fada01acd80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fad9000c480 tx=0x7fad9000c940 comp rx=0 tx=0).stop 2024-09-11T11:01:03.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 shutdown_connections 2024-09-11T11:01:03.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 --2- 172.21.15.145:0/1529235249 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad8c035db0 0x7fad8c038270 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:03.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 --2- 172.21.15.145:0/1529235249 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fada0115d00 0x7fada01acd80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:03.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 >> 172.21.15.145:0/1529235249 conn(0x7fada0071360 msgr2=0x7fada011a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:03.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.293+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 shutdown_connections 2024-09-11T11:01:03.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.297+0000 7fada6d08640 1 -- 172.21.15.145:0/1529235249 wait complete. 2024-09-11T11:01:03.327 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-11T11:01:03.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f392c102640 1 Processor -- start 2024-09-11T11:01:03.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f392c102640 1 -- start start 2024-09-11T11:01:03.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f392c102640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f392410ed90 0x7f392410f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:03.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f392c102640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f392410fb60 con 0x7f392410f6b0 2024-09-11T11:01:03.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f392c102640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f392411c840 con 0x7f392410ed90 2024-09-11T11:01:03.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f392969d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f392410f6b0 0x7f392411a110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:43204/0 (socket says 172.21.15.145:43204) 2024-09-11T11:01:03.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f3929e9e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f392410ed90 0x7f392410f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:03.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f392969d640 1 -- 172.21.15.145:0/953687361 learned_addr learned my addr 172.21.15.145:0/953687361 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:03.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f3929e9e640 1 -- 172.21.15.145:0/953687361 >> v1:172.21.15.102:6789/0 conn(0x7f392410f6b0 legacy=0x7f392411a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:03.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.457+0000 7f3929e9e640 1 -- 172.21.15.145:0/953687361 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392411c9c0 con 0x7f392410ed90 2024-09-11T11:01:03.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3929e9e640 1 --2- 172.21.15.145:0/953687361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410f170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3920009740 tx=0x7f392001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b34e37f2dda73c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:03.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3928e9c640 1 -- 172.21.15.145:0/953687361 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39200b1070 con 0x7f392410ed90 2024-09-11T11:01:03.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3928e9c640 1 -- 172.21.15.145:0/953687361 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39200ac520 con 0x7f392410ed90 2024-09-11T11:01:03.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3928e9c640 1 -- 172.21.15.145:0/953687361 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39200ac820 con 0x7f392410ed90 2024-09-11T11:01:03.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 -- 172.21.15.145:0/953687361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 msgr2=0x7f392410f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:03.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 --2- 172.21.15.145:0/953687361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410f170 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3920009740 tx=0x7f392001c370 comp rx=0 tx=0).stop 2024-09-11T11:01:03.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 -- 172.21.15.145:0/953687361 shutdown_connections 2024-09-11T11:01:03.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 --2- 172.21.15.145:0/953687361 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410f170 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:03.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 -- 172.21.15.145:0/953687361 >> 172.21.15.145:0/953687361 conn(0x7f392406f390 msgr2=0x7f39240717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:03.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 -- 172.21.15.145:0/953687361 shutdown_connections 2024-09-11T11:01:03.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 -- 172.21.15.145:0/953687361 wait complete. 2024-09-11T11:01:03.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 Processor -- start 2024-09-11T11:01:03.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 -- start start 2024-09-11T11:01:03.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f392c102640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f392411c3d0 con 0x7f392410ed90 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3929e9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3929e9e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56198/0 (socket says 172.21.15.145:56198) 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3929e9e640 1 -- 172.21.15.145:0/1988850414 learned_addr learned my addr 172.21.15.145:0/1988850414 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3929e9e640 1 -- 172.21.15.145:0/1988850414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39241104b0 con 0x7f392410ed90 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.461+0000 7f3929e9e640 1 --2- 172.21.15.145:0/1988850414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410ff70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f392001aa20 tx=0x7f392001abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f391a7fc640 1 -- 172.21.15.145:0/1988850414 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39200b1050 con 0x7f392410ed90 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f391a7fc640 1 -- 172.21.15.145:0/1988850414 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39200b2040 con 0x7f392410ed90 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39241106e0 con 0x7f392410ed90 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f391a7fc640 1 -- 172.21.15.145:0/1988850414 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39200abb30 con 0x7f392410ed90 2024-09-11T11:01:03.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3924110bc0 con 0x7f392410ed90 2024-09-11T11:01:03.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f392410f170 con 0x7f392410ed90 2024-09-11T11:01:03.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f391a7fc640 1 -- 172.21.15.145:0/1988850414 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f39200bf030 con 0x7f392410ed90 2024-09-11T11:01:03.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f391a7fc640 1 --2- 172.21.15.145:0/1988850414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3908035d60 0x7f3908038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:03.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f391a7fc640 1 -- 172.21.15.145:0/1988850414 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3856+0+0 (secure 0 0 0) 0x7f39200bd070 con 0x7f392410ed90 2024-09-11T11:01:03.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f392969d640 1 --2- 172.21.15.145:0/1988850414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3908035d60 0x7f3908038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:03.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.465+0000 7f392969d640 1 --2- 172.21.15.145:0/1988850414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3908035d60 0x7f3908038220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3914005890 tx=0x7f3914007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:03.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.477+0000 7f391a7fc640 1 -- 172.21.15.145:0/1988850414 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f39200c6020 con 0x7f392410ed90 2024-09-11T11:01:03.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:03.637+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f392410f6b0 con 0x7f392410ed90 2024-09-11T11:01:04.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.301+0000 7f391a7fc640 1 -- 172.21.15.145:0/1988850414 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v22) ==== 169+0+0 (secure 0 0 0) 0x7f39200a9070 con 0x7f392410ed90 2024-09-11T11:01:04.303 INFO:teuthology.orchestra.run.smithi145.stderr:pool 'default.rgw.buckets.index' created 2024-09-11T11:01:04.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3908035d60 msgr2=0x7f3908038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:04.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 --2- 172.21.15.145:0/1988850414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3908035d60 0x7f3908038220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3914005890 tx=0x7f3914007a90 comp rx=0 tx=0).stop 2024-09-11T11:01:04.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 msgr2=0x7f392410ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:04.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 --2- 172.21.15.145:0/1988850414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410ff70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f392001aa20 tx=0x7f392001abb0 comp rx=0 tx=0).stop 2024-09-11T11:01:04.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 shutdown_connections 2024-09-11T11:01:04.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 --2- 172.21.15.145:0/1988850414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3908035d60 0x7f3908038220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:04.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 --2- 172.21.15.145:0/1988850414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f392410ed90 0x7f392410ff70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:04.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 >> 172.21.15.145:0/1988850414 conn(0x7f392406f390 msgr2=0x7f3924117890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:04.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 shutdown_connections 2024-09-11T11:01:04.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.305+0000 7f392c102640 1 -- 172.21.15.145:0/1988850414 wait complete. 2024-09-11T11:01:04.337 DEBUG:teuthology.orchestra.run.smithi145:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-11T11:01:04.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb28dc61640 1 Processor -- start 2024-09-11T11:01:04.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb28dc61640 1 -- start start 2024-09-11T11:01:04.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb28dc61640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb288110b60 0x7fb28806c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:04.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb28dc61640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28806d030 con 0x7fb28806cb10 2024-09-11T11:01:04.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb28dc61640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb28806d200 con 0x7fb288110b60 2024-09-11T11:01:04.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb2877fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb288110b60 0x7fb28806c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:04.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb2877fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb288110b60 0x7fb28806c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56214/0 (socket says 172.21.15.145:56214) 2024-09-11T11:01:04.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb2877fe640 1 -- 172.21.15.145:0/255381219 learned_addr learned my addr 172.21.15.145:0/255381219 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:04.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb2877fe640 1 -- 172.21.15.145:0/255381219 >> v1:172.21.15.102:6789/0 conn(0x7fb28806cb10 legacy=0x7fb28811c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:04.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.457+0000 7fb2877fe640 1 -- 172.21.15.145:0/255381219 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28811eb30 con 0x7fb288110b60 2024-09-11T11:01:04.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb2877fe640 1 --2- 172.21.15.145:0/255381219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb288110b60 0x7fb28806c4e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2780097f0 tx=0x7fb27801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f247b25db90373d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:04.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb2867fc640 1 -- 172.21.15.145:0/255381219 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2780ab580 con 0x7fb288110b60 2024-09-11T11:01:04.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb2867fc640 1 -- 172.21.15.145:0/255381219 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2780b0070 con 0x7fb288110b60 2024-09-11T11:01:04.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb2867fc640 1 -- 172.21.15.145:0/255381219 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2780ab870 con 0x7fb288110b60 2024-09-11T11:01:04.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 -- 172.21.15.145:0/255381219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb288110b60 msgr2=0x7fb28806c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:04.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 --2- 172.21.15.145:0/255381219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb288110b60 0x7fb28806c4e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2780097f0 tx=0x7fb27801c430 comp rx=0 tx=0).stop 2024-09-11T11:01:04.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 -- 172.21.15.145:0/255381219 shutdown_connections 2024-09-11T11:01:04.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 --2- 172.21.15.145:0/255381219 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb288110b60 0x7fb28806c4e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:04.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 -- 172.21.15.145:0/255381219 >> 172.21.15.145:0/255381219 conn(0x7fb2880700e0 msgr2=0x7fb288072500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:04.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 -- 172.21.15.145:0/255381219 shutdown_connections 2024-09-11T11:01:04.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 -- 172.21.15.145:0/255381219 wait complete. 2024-09-11T11:01:04.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 Processor -- start 2024-09-11T11:01:04.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 -- start start 2024-09-11T11:01:04.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28806cb10 0x7fb2881aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:04.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb28dc61640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb28811e700 con 0x7fb28806cb10 2024-09-11T11:01:04.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb2877fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28806cb10 0x7fb2881aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:04.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb2877fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28806cb10 0x7fb2881aee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56226/0 (socket says 172.21.15.145:56226) 2024-09-11T11:01:04.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb2877fe640 1 -- 172.21.15.145:0/1094035587 learned_addr learned my addr 172.21.15.145:0/1094035587 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:04.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.461+0000 7fb2877fe640 1 -- 172.21.15.145:0/1094035587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2881af430 con 0x7fb28806cb10 2024-09-11T11:01:04.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb2877fe640 1 --2- 172.21.15.145:0/1094035587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28806cb10 0x7fb2881aee60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb27801a060 tx=0x7fb27801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:04.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb26ffff640 1 -- 172.21.15.145:0/1094035587 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2780abe30 con 0x7fb28806cb10 2024-09-11T11:01:04.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2881af660 con 0x7fb28806cb10 2024-09-11T11:01:04.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb26ffff640 1 -- 172.21.15.145:0/1094035587 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2780aa8f0 con 0x7fb28806cb10 2024-09-11T11:01:04.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2881a8f80 con 0x7fb28806cb10 2024-09-11T11:01:04.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb26ffff640 1 -- 172.21.15.145:0/1094035587 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2780aabd0 con 0x7fb28806cb10 2024-09-11T11:01:04.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb28806c560 con 0x7fb28806cb10 2024-09-11T11:01:04.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb26ffff640 1 -- 172.21.15.145:0/1094035587 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb2780aad70 con 0x7fb28806cb10 2024-09-11T11:01:04.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb26ffff640 1 --2- 172.21.15.145:0/1094035587 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb274035d60 0x7fb274038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:04.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb26ffff640 1 -- 172.21.15.145:0/1094035587 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 4220+0+0 (secure 0 0 0) 0x7fb2780e3aa0 con 0x7fb28806cb10 2024-09-11T11:01:04.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb286ffd640 1 --2- 172.21.15.145:0/1094035587 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb274035d60 0x7fb274038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:04.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.465+0000 7fb286ffd640 1 --2- 172.21.15.145:0/1094035587 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb274035d60 0x7fb274038220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000f70 tx=0x7fb27c007a40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:04.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.477+0000 7fb26ffff640 1 -- 172.21.15.145:0/1094035587 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb2780160b0 con 0x7fb28806cb10 2024-09-11T11:01:04.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:04.629+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fb288110b60 con 0x7fb28806cb10 2024-09-11T11:01:05.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.305+0000 7fb26ffff640 1 -- 172.21.15.145:0/1094035587 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v23) ==== 187+0+0 (secure 0 0 0) 0x7fb2780c6550 con 0x7fb28806cb10 2024-09-11T11:01:05.308 INFO:teuthology.orchestra.run.smithi145.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb274035d60 msgr2=0x7fb274038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 --2- 172.21.15.145:0/1094035587 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb274035d60 0x7fb274038220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb27c000f70 tx=0x7fb27c007a40 comp rx=0 tx=0).stop 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28806cb10 msgr2=0x7fb2881aee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 --2- 172.21.15.145:0/1094035587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28806cb10 0x7fb2881aee60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb27801a060 tx=0x7fb27801ac70 comp rx=0 tx=0).stop 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 shutdown_connections 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 --2- 172.21.15.145:0/1094035587 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb274035d60 0x7fb274038220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 --2- 172.21.15.145:0/1094035587 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb28806cb10 0x7fb2881aee60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 >> 172.21.15.145:0/1094035587 conn(0x7fb2880700e0 msgr2=0x7fb28811cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 shutdown_connections 2024-09-11T11:01:05.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:05.309+0000 7fb28dc61640 1 -- 172.21.15.145:0/1094035587 wait complete. 2024-09-11T11:01:05.346 DEBUG:tasks.rgw:Pools created 2024-09-11T11:01:05.346 INFO:tasks.rgw:Starting rgw... 2024-09-11T11:01:05.346 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-11T11:01:05.346 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-11T11:01:05.347 DEBUG:teuthology.orchestra.run.smithi145:> sudo echo -n http://smithi145.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-11T11:01:05.361 INFO:teuthology.orchestra.run.smithi145.stdout:http://smithi145.front.sepia.ceph.com:80 2024-09-11T11:01:05.362 DEBUG:teuthology.orchestra.run.smithi145:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-11T11:01:05.417 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-11T11:01:05.417 DEBUG:teuthology.orchestra.run.smithi145:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-11T11:01:05.463 INFO:tasks.rgw.client.0:Started 2024-09-11T11:01:05.463 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi145.front.sepia.ceph.com:80/ 2024-09-11T11:01:05.463 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-11T11:01:05.498 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-11T11:01:05.498 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-11T11:01:05.498 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-11T11:01:05.498 INFO:teuthology.orchestra.run.smithi145.stderr:curl: (7) Failed to connect to smithi145.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-11T11:01:05.499 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-11T11:01:06.500 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-11T11:01:06.511 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-11T11:01:06.511 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-11T11:01:06.511 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-11T11:01:06.511 INFO:teuthology.orchestra.run.smithi145.stderr:curl: (7) Failed to connect to smithi145.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-11T11:01:06.512 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-11T11:01:08.513 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-11T11:01:08.525 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-11T11:01:08.525 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-11T11:01:08.525 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-11T11:01:08.525 INFO:teuthology.orchestra.run.smithi145.stderr:curl: (7) Failed to connect to smithi145.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-11T11:01:08.526 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-11T11:01:12.527 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-11T11:01:12.538 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-11T11:01:12.538 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-11T11:01:12.539 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-11T11:01:12.539 INFO:teuthology.orchestra.run.smithi145.stderr:curl: (7) Failed to connect to smithi145.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-11T11:01:12.539 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-11T11:01:14.529 INFO:tasks.rgw.client.0.smithi145.stdout:2024-09-11T11:01:14.525+0000 7f9a79158a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-11T11:01:20.540 DEBUG:teuthology.orchestra.run.smithi145:> curl http://smithi145.front.sepia.ceph.com:80/ 2024-09-11T11:01:20.552 INFO:teuthology.orchestra.run.smithi145.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-11T11:01:20.552 INFO:teuthology.orchestra.run.smithi145.stderr: Dload Upload Total Spent Left Speed 2024-09-11T11:01:20.555 INFO:teuthology.orchestra.run.smithi145.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 48433 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-11T11:01:20.556 INFO:teuthology.orchestra.run.smithi145.stdout:anonymous 2024-09-11T11:01:20.557 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-11T11:01:20.639 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-11T11:01:20.639 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-11T11:01:20.639 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-11T11:01:20.639 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-11T11:01:20.675 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:20.675 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:20.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb8ac9980 1 Processor -- start 2024-09-11T11:01:20.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb8ac9980 1 -- start start 2024-09-11T11:01:20.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb8ac9980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562f3a866830 0x562f3a868c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb8ac9980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562f3a6ecae0 con 0x562f3a7d8af0 2024-09-11T11:01:20.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb8ac9980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x562f3a710e30 con 0x562f3a866830 2024-09-11T11:01:20.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb5dd8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562f3a866830 0x562f3a868c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb5dd8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562f3a866830 0x562f3a868c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47932/0 (socket says 172.21.15.145:47932) 2024-09-11T11:01:20.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/809428418 learned_addr learned my addr 172.21.15.145:0/809428418 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.673+0000 7f8bb65d9640 1 --1- 172.21.15.145:0/809428418 >> v1:172.21.15.102:6789/0 conn(0x562f3a7d8af0 0x562f3a865110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48490/0 (socket says 172.21.15.145:48490) 2024-09-11T11:01:20.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/809428418 >> v1:172.21.15.102:6789/0 conn(0x562f3a7d8af0 legacy=0x562f3a865110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/809428418 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3a869190 con 0x562f3a866830 2024-09-11T11:01:20.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/809428418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a866830 0x562f3a868c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000a5c0 tx=0x7f8ba001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c676f851bf78d81f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb55d7640 1 -- 172.21.15.145:0/809428418 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba00af070 con 0x562f3a866830 2024-09-11T11:01:20.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb55d7640 1 -- 172.21.15.145:0/809428418 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba00aa530 con 0x562f3a866830 2024-09-11T11:01:20.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb55d7640 1 -- 172.21.15.145:0/809428418 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba00aa830 con 0x562f3a866830 2024-09-11T11:01:20.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/809428418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a866830 msgr2=0x562f3a868c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/809428418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a866830 0x562f3a868c50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000a5c0 tx=0x7f8ba001b340 comp rx=0 tx=0).stop 2024-09-11T11:01:20.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/809428418 shutdown_connections 2024-09-11T11:01:20.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/809428418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a866830 0x562f3a868c50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/809428418 >> 172.21.15.145:0/809428418 conn(0x562f3a85f050 msgr2=0x562f3a861470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/809428418 shutdown_connections 2024-09-11T11:01:20.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.677+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/809428418 wait complete. 2024-09-11T11:01:20.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.693+0000 7f8bb8ac9980 1 Processor -- start 2024-09-11T11:01:20.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.693+0000 7f8bb8ac9980 1 -- start start 2024-09-11T11:01:20.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.693+0000 7f8bb8ac9980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a9564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.693+0000 7f8bb8ac9980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f3a712200 con 0x562f3a7d8af0 2024-09-11T11:01:20.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a9564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a9564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47944/0 (socket says 172.21.15.145:47944) 2024-09-11T11:01:20.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2890206789 learned_addr learned my addr 172.21.15.145:0/2890206789 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2890206789 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3a956a80 con 0x562f3a7d8af0 2024-09-11T11:01:20.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/2890206789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a9564b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8001690 tx=0x7f8ba8001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476e6958a5d40cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8aa4608640 1 -- 172.21.15.145:0/2890206789 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba8003460 con 0x562f3a7d8af0 2024-09-11T11:01:20.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8aa4608640 1 -- 172.21.15.145:0/2890206789 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba8003600 con 0x562f3a7d8af0 2024-09-11T11:01:20.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8aa4608640 1 -- 172.21.15.145:0/2890206789 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba8003920 con 0x562f3a7d8af0 2024-09-11T11:01:20.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2890206789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 msgr2=0x562f3a9564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2890206789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a9564b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8001690 tx=0x7f8ba8001b50 comp rx=0 tx=0).stop 2024-09-11T11:01:20.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2890206789 shutdown_connections 2024-09-11T11:01:20.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2890206789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a9564b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2890206789 >> 172.21.15.145:0/2890206789 conn(0x562f3a85f050 msgr2=0x562f3a9520e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2890206789 shutdown_connections 2024-09-11T11:01:20.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2890206789 wait complete. 2024-09-11T11:01:20.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 Processor -- start 2024-09-11T11:01:20.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 -- start start 2024-09-11T11:01:20.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a95d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb8ac9980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f3a8749f0 con 0x562f3a7d8af0 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a95d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a95d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47948/0 (socket says 172.21.15.145:47948) 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.697+0000 7f8bb65d9640 1 -- 172.21.15.145:0/3575531642 learned_addr learned my addr 172.21.15.145:0/3575531642 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb65d9640 1 -- 172.21.15.145:0/3575531642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3a95dd40 con 0x562f3a7d8af0 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a95d800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8000f90 tx=0x7f8ba8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8aa2e05640 1 -- 172.21.15.145:0/3575531642 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba8022020 con 0x562f3a7d8af0 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8aa2e05640 1 -- 172.21.15.145:0/3575531642 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba8006840 con 0x562f3a7d8af0 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f3a95dfd0 con 0x562f3a7d8af0 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8aa2e05640 1 -- 172.21.15.145:0/3575531642 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba801e800 con 0x562f3a7d8af0 2024-09-11T11:01:20.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3a960cb0 con 0x562f3a7d8af0 2024-09-11T11:01:20.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8aa2e05640 1 -- 172.21.15.145:0/3575531642 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8ba8025020 con 0x562f3a7d8af0 2024-09-11T11:01:20.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8aa2e05640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a9c034600 0x7f8a9c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8aa2e05640 1 -- 172.21.15.145:0/3575531642 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8ba8049ae0 con 0x562f3a7d8af0 2024-09-11T11:01:20.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a9c034600 0x7f8a9c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a866830 0x562f3a964900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a964e40 con 0x562f3a866830 2024-09-11T11:01:20.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb6dda640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a866830 0x562f3a964900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a9c034600 0x7f8a9c036ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00ac000 tx=0x7f8ba00a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb6dda640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a866830 0x562f3a964900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb6dda640 1 -- 172.21.15.145:0/3575531642 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a866830 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a965c10 0x562f3a968000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a968640 con 0x562f3a965c10 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.701+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a965c10 0x562f3a968000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a965c10 0x562f3a968000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb65d9640 1 -- 172.21.15.145:0/3575531642 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ba801b040 con 0x562f3a965c10 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a969ef0 con 0x562f3a965c10 2024-09-11T11:01:20.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb65d9640 1 -- 172.21.15.145:0/3575531642 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ba801b040 con 0x562f3a965c10 2024-09-11T11:01:20.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a969120 con 0x562f3a965c10 2024-09-11T11:01:20.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb65d9640 1 -- 172.21.15.145:0/3575531642 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ba801b040 con 0x562f3a965c10 2024-09-11T11:01:20.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562f3a96b2a0 0x562f3a96d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a96dbd0 con 0x562f3a96b2a0 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562f3a96b2a0 0x562f3a96d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562f3a96b2a0 0x562f3a96d690 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.705+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/3575531642 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ba00b2040 con 0x562f3a96b2a0 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb8ac9980 1 Processor -- start 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb8ac9980 1 -- start start 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb8ac9980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a97b590 0x562f3a97b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb8ac9980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f3a76b800 con 0x562f3a97b590 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a97b590 0x562f3a97b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a97b590 0x562f3a97b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47950/0 (socket says 172.21.15.145:47950) 2024-09-11T11:01:20.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2228801053 learned_addr learned my addr 172.21.15.145:0/2228801053 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2228801053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3a97bef0 con 0x562f3a97b590 2024-09-11T11:01:20.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/2228801053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a97b590 0x562f3a97b9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8006810 tx=0x7f8ba8010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8a9bfff640 1 -- 172.21.15.145:0/2228801053 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba8041250 con 0x562f3a97b590 2024-09-11T11:01:20.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8a9bfff640 1 -- 172.21.15.145:0/2228801053 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba80413f0 con 0x562f3a97b590 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8a9bfff640 1 -- 172.21.15.145:0/2228801053 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba801eb90 con 0x562f3a97b590 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2228801053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f3a97c180 con 0x562f3a97b590 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2228801053 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3a97ee00 con 0x562f3a97b590 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8a9bfff640 1 -- 172.21.15.145:0/2228801053 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8ba8049440 con 0x562f3a97b590 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8a9bfff640 1 --2- 172.21.15.145:0/2228801053 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a90034650 0x7f8a90036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8a9bfff640 1 -- 172.21.15.145:0/2228801053 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8ba80344c0 con 0x562f3a97b590 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/2228801053 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a90034650 0x7f8a90036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb8ac9980 1 Processor -- start 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.709+0000 7f8bb8ac9980 1 -- start start 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a988260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f3a956da0 con 0x562f3a987e80 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/2228801053 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a90034650 0x7f8a90036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x562f3a961df0 tx=0x7f8ba0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a988260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a988260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47954/0 (socket says 172.21.15.145:47954) 2024-09-11T11:01:20.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 -- 172.21.15.145:0/1585429289 learned_addr learned my addr 172.21.15.145:0/1585429289 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 -- 172.21.15.145:0/1585429289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3a988830 con 0x562f3a987e80 2024-09-11T11:01:20.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/1585429289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a988260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8046df0 tx=0x7f8ba8033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623fa08af58cf48e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8a99ffb640 1 -- 172.21.15.145:0/1585429289 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba8014df0 con 0x562f3a987e80 2024-09-11T11:01:20.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8a99ffb640 1 -- 172.21.15.145:0/1585429289 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba8061070 con 0x562f3a987e80 2024-09-11T11:01:20.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8a99ffb640 1 -- 172.21.15.145:0/1585429289 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba801ed30 con 0x562f3a987e80 2024-09-11T11:01:20.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/1585429289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 msgr2=0x562f3a988260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/1585429289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a988260 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8046df0 tx=0x7f8ba8033d90 comp rx=0 tx=0).stop 2024-09-11T11:01:20.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/1585429289 shutdown_connections 2024-09-11T11:01:20.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/1585429289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a988260 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/1585429289 >> 172.21.15.145:0/1585429289 conn(0x562f3a984260 msgr2=0x562f3a982360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/1585429289 shutdown_connections 2024-09-11T11:01:20.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/1585429289 wait complete. 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 Processor -- start 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 -- start start 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a98f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb8ac9980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562f3a988cd0 con 0x562f3a987e80 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a98f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a98f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47958/0 (socket says 172.21.15.145:47958) 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 learned_addr learned my addr 172.21.15.145:0/2525943773 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3a98f5a0 con 0x562f3a987e80 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.713+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a98f060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ba803e5b0 tx=0x7f8ba8034190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8a87fff640 1 -- 172.21.15.145:0/2525943773 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba8049730 con 0x562f3a987e80 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8a87fff640 1 -- 172.21.15.145:0/2525943773 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba80498d0 con 0x562f3a987e80 2024-09-11T11:01:20.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562f3a98f5a0 con 0x562f3a987e80 2024-09-11T11:01:20.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8a87fff640 1 -- 172.21.15.145:0/2525943773 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba80339b0 con 0x562f3a987e80 2024-09-11T11:01:20.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3a98f5a0 con 0x562f3a987e80 2024-09-11T11:01:20.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8a87fff640 1 -- 172.21.15.145:0/2525943773 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8ba805b070 con 0x562f3a987e80 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8a87fff640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a80034650 0x7f8a80036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8a87fff640 1 -- 172.21.15.145:0/2525943773 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8ba8071af0 con 0x562f3a987e80 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a80034650 0x7f8a80036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a999f70 0x562f3a99c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a99cb60 con 0x562f3a999f70 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb6dda640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a999f70 0x562f3a99c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a80034650 0x7f8a80036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0000c10 tx=0x7f8ba00b8040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb6dda640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a999f70 0x562f3a99c410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 20 realm 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a999460 con 0x562f3a999f70 2024-09-11T11:01:20.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a99d630 con 0x562f3a999f70 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a99e1e0 0x562f3a9a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a0e10 con 0x562f3a99e1e0 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.717+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a99e1e0 0x562f3a9a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a99e1e0 0x562f3a9a06a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb8ac9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:20.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a16b0 con 0x562f3a99e1e0 2024-09-11T11:01:20.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb8ac9980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:20.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb8ac9980 20 searching for the correct realm 2024-09-11T11:01:20.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562f3a9a3420 0x562f3a9a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a9a3420 2024-09-11T11:01:20.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562f3a9a3420 0x562f3a9a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb5dd8640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562f3a9a3420 0x562f3a9a5810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb65d9640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8ba8027020 0x7f8ba804d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x7f8ba8027020 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb6dda640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8ba8027020 0x7f8ba804d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.721+0000 7f8bb6dda640 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8ba8027020 0x7f8ba804d920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a9a3420 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x7f8ba8027020 2024-09-11T11:01:20.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x7f8ba8027020 2024-09-11T11:01:20.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.725+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a9a3420 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a9a3420 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a9a3420 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x7f8ba8027020 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.729+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a999f70 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x7f8ba8027020 2024-09-11T11:01:20.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a9a3420 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x7f8ba8027020 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a9a3420 2024-09-11T11:01:20.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.733+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a5e90 con 0x562f3a99e1e0 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:20.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a2060 con 0x562f3a999f70 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a2480 con 0x562f3a99e1e0 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a28a0 con 0x7f8ba8027020 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 zone default found 2024-09-11T11:01:20.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 4 Realm: () 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 zonegroup default 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x7f8ba8027020 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a8700 con 0x562f3a9a3420 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a8aa0 con 0x562f3a9a3420 2024-09-11T11:01:20.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 started sync module instance, tier type = 2024-09-11T11:01:20.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:20.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.737+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a7b90 con 0x562f3a99e1e0 2024-09-11T11:01:20.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.741+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.741+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94760846655632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a7b90 con 0x562f3a99e1e0 2024-09-11T11:01:20.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.741+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a94f0 con 0x562f3a999f70 2024-09-11T11:01:20.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.741+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.741+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94760846659584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a9420 con 0x562f3a999f70 2024-09-11T11:01:20.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.741+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9aa410 con 0x562f3a99e1e0 2024-09-11T11:01:20.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.741+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94760846655632] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.745+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94760846659584] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.745+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.745+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94760846661856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9aa3d0 con 0x562f3a99e1e0 2024-09-11T11:01:20.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.745+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9aacb0 con 0x7f8ba8027020 2024-09-11T11:01:20.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.749+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.749+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94760846665728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9aa3d0 con 0x7f8ba8027020 2024-09-11T11:01:20.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.749+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9ab770 con 0x562f3a99e1e0 2024-09-11T11:01:20.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.749+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94760846661856] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.749+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94760846665728] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.753+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.753+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94760846666784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9ab730 con 0x562f3a99e1e0 2024-09-11T11:01:20.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.753+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9abb60 con 0x562f3a9a3420 2024-09-11T11:01:20.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.753+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.753+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94760846663424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9ac3b0 con 0x562f3a9a3420 2024-09-11T11:01:20.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.753+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9acdb0 con 0x562f3a9a3420 2024-09-11T11:01:20.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.757+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94760846666784] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.757+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94760846663424] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.757+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.757+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94760846668352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9ad1a0 con 0x562f3a9a3420 2024-09-11T11:01:20.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.757+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9ada30 con 0x7f8ba8027020 2024-09-11T11:01:20.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94760846676384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9ad620 con 0x7f8ba8027020 2024-09-11T11:01:20.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb8ac9980 20 add_watcher() i=0 2024-09-11T11:01:20.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb8ac9980 20 add_watcher() i=1 2024-09-11T11:01:20.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb8ac9980 20 add_watcher() i=2 2024-09-11T11:01:20.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb8ac9980 20 add_watcher() i=3 2024-09-11T11:01:20.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb8ac9980 20 add_watcher() i=4 2024-09-11T11:01:20.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb8ac9980 20 add_watcher() i=5 2024-09-11T11:01:20.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94760846668352] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.761+0000 7f8bb8ac9980 20 add_watcher() i=6 2024-09-11T11:01:20.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.765+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94760846676384] v32'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.765+0000 7f8bb8ac9980 20 add_watcher() i=7 2024-09-11T11:01:20.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.765+0000 7f8bb8ac9980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:20.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.765+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9ac8c0 con 0x562f3a999f70 2024-09-11T11:01:20.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.765+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.765+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94760846674112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9ae3c0 con 0x562f3a999f70 2024-09-11T11:01:20.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94760846674112] v32'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8a6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:20.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb8ac9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:20.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb8ac9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:20.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb8ac9980 5 note: GC not initialized 2024-09-11T11:01:20.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f89e77fe640 20 reqs_thread_entry: start 2024-09-11T11:01:20.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb8ac9980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:20.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb8ac9980 20 Filter name: none 2024-09-11T11:01:20.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f89e57fa640 20 reqs_thread_entry: start 2024-09-11T11:01:20.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9d3bd0 con 0x562f3a9a3420 2024-09-11T11:01:20.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9acdb0 con 0x562f3a99e1e0 2024-09-11T11:01:20.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.769+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a2480 con 0x562f3a999f70 2024-09-11T11:01:20.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x7f8ba8027020 2024-09-11T11:01:20.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a99e1e0 2024-09-11T11:01:20.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a9a3420 2024-09-11T11:01:20.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x7f8ba8027020 2024-09-11T11:01:20.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a99e1e0 2024-09-11T11:01:20.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(72 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a9a3420 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.773+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a9a3420 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x7f8ba8027020 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a9a3420 2024-09-11T11:01:20.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a99e1e0 2024-09-11T11:01:20.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x7f8ba8027020 2024-09-11T11:01:20.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(80 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a99e1e0 2024-09-11T11:01:20.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a9a3420 2024-09-11T11:01:20.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x7f8ba8027020 2024-09-11T11:01:20.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.777+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a9a3420 2024-09-11T11:01:20.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a9a3420 2024-09-11T11:01:20.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x7f8ba8027020 2024-09-11T11:01:20.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a999f70 2024-09-11T11:01:20.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a99e1e0 2024-09-11T11:01:20.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x562f3a9a3420 2024-09-11T11:01:20.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a1c60 con 0x7f8ba8027020 2024-09-11T11:01:20.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.781+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.785+0000 7f8a6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:20.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.785+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94760846674112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9acdb0 con 0x562f3a999f70 2024-09-11T11:01:20.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.785+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94760846674112] v32'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.785+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94760846655632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a2480 con 0x562f3a99e1e0 2024-09-11T11:01:20.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.789+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94760846655632] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.789+0000 7f8bb8ac9980 20 remove_watcher() i=0 2024-09-11T11:01:20.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.789+0000 7f8bb8ac9980 2 removed watcher, disabling cache 2024-09-11T11:01:20.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.789+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94760846659584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9acdb0 con 0x562f3a999f70 2024-09-11T11:01:20.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.789+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94760846659584] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x562f3a999f70 2024-09-11T11:01:20.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.789+0000 7f8bb8ac9980 20 remove_watcher() i=1 2024-09-11T11:01:20.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.789+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94760846661856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9acdb0 con 0x562f3a99e1e0 2024-09-11T11:01:20.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.793+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94760846661856] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.793+0000 7f8bb8ac9980 20 remove_watcher() i=2 2024-09-11T11:01:20.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.793+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94760846665728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9acdb0 con 0x7f8ba8027020 2024-09-11T11:01:20.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.797+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94760846665728] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.797+0000 7f8bb8ac9980 20 remove_watcher() i=3 2024-09-11T11:01:20.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.797+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94760846666784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9acdb0 con 0x562f3a99e1e0 2024-09-11T11:01:20.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.797+0000 7f8bb65d9640 1 -- 172.21.15.145:0/2525943773 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94760846666784] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba8076020 con 0x562f3a99e1e0 2024-09-11T11:01:20.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.797+0000 7f8bb8ac9980 20 remove_watcher() i=4 2024-09-11T11:01:20.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.797+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94760846663424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9acdb0 con 0x562f3a9a3420 2024-09-11T11:01:20.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.801+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94760846663424] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.801+0000 7f8bb8ac9980 20 remove_watcher() i=5 2024-09-11T11:01:20.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.801+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94760846668352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a9000 con 0x562f3a9a3420 2024-09-11T11:01:20.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.801+0000 7f8bb5dd8640 1 -- 172.21.15.145:0/2525943773 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94760846668352] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ba00d7070 con 0x562f3a9a3420 2024-09-11T11:01:20.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.801+0000 7f8bb8ac9980 20 remove_watcher() i=6 2024-09-11T11:01:20.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.801+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94760846676384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562f3a9a9f00 con 0x7f8ba8027020 2024-09-11T11:01:20.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94760846676384] v32'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8bb00083f0 con 0x7f8ba8027020 2024-09-11T11:01:20.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 20 remove_watcher() i=7 2024-09-11T11:01:20.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a99e1e0 msgr2=0x562f3a9a06a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a99e1e0 0x562f3a9a06a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a999f70 msgr2=0x562f3a99c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a999f70 0x562f3a99c410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8ba8027020 msgr2=0x7f8ba804d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8ba8027020 0x7f8ba804d920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562f3a9a3420 msgr2=0x562f3a9a5810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562f3a9a3420 0x562f3a9a5810 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a80034650 msgr2=0x7f8a80036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a80034650 0x7f8a80036b10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0000c10 tx=0x7f8ba00b8040 comp rx=0 tx=0).stop 2024-09-11T11:01:20.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 msgr2=0x562f3a98f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2525943773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a987e80 0x562f3a98f060 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8ba803e5b0 tx=0x7f8ba8034190 comp rx=0 tx=0).stop 2024-09-11T11:01:20.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb6dda640 1 -- 172.21.15.145:0/2525943773 reap_dead start 2024-09-11T11:01:20.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 shutdown_connections 2024-09-11T11:01:20.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 >> 172.21.15.145:0/2525943773 conn(0x562f3a984260 msgr2=0x562f3a982330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 shutdown_connections 2024-09-11T11:01:20.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2525943773 wait complete. 2024-09-11T11:01:20.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2228801053 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a90034650 msgr2=0x7f8a90036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2228801053 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a90034650 0x7f8a90036b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x562f3a961df0 tx=0x7f8ba0005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2228801053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a97b590 msgr2=0x562f3a97b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2228801053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a97b590 0x562f3a97b9b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8006810 tx=0x7f8ba8010f90 comp rx=0 tx=0).stop 2024-09-11T11:01:20.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2228801053 shutdown_connections 2024-09-11T11:01:20.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2228801053 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a90034650 0x7f8a90036b10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/2228801053 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a97b590 0x562f3a97b9b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2228801053 >> 172.21.15.145:0/2228801053 conn(0x562f3a9706e0 msgr2=0x562f3a973160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2228801053 shutdown_connections 2024-09-11T11:01:20.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/2228801053 wait complete. 2024-09-11T11:01:20.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a965c10 msgr2=0x562f3a968000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562f3a965c10 0x562f3a968000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a866830 msgr2=0x562f3a964900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562f3a866830 0x562f3a964900 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562f3a96b2a0 msgr2=0x562f3a96d690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562f3a96b2a0 0x562f3a96d690 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a9c034600 msgr2=0x7f8a9c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a9c034600 0x7f8a9c036ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00ac000 tx=0x7f8ba00a5000 comp rx=0 tx=0).stop 2024-09-11T11:01:20.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 msgr2=0x562f3a95d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 --2- 172.21.15.145:0/3575531642 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562f3a7d8af0 0x562f3a95d800 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8000f90 tx=0x7f8ba8001260 comp rx=0 tx=0).stop 2024-09-11T11:01:20.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb6dda640 1 -- 172.21.15.145:0/3575531642 reap_dead start 2024-09-11T11:01:20.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 shutdown_connections 2024-09-11T11:01:20.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 >> 172.21.15.145:0/3575531642 conn(0x562f3a85f050 msgr2=0x562f3a950c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 shutdown_connections 2024-09-11T11:01:20.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.805+0000 7f8bb8ac9980 1 -- 172.21.15.145:0/3575531642 wait complete. 2024-09-11T11:01:20.820 INFO:teuthology.orchestra.run.smithi145.stdout:[] 2024-09-11T11:01:20.821 DEBUG:tasks.util.rgw: json result: [] 2024-09-11T11:01:20.821 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-11T11:01:20.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-11T11:01:20.822 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-11T11:01:20.902 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:20.902 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:20.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff607cf2980 1 Processor -- start 2024-09-11T11:01:20.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff607cf2980 1 -- start start 2024-09-11T11:01:20.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff607cf2980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x561be99758f0 0x561be9977ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff607cf2980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561be97faae0 con 0x561be9971570 2024-09-11T11:01:20.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff607cf2980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x561be981ee30 con 0x561be99758f0 2024-09-11T11:01:20.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff605001640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x561be99758f0 0x561be9977ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff605802640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x561be9971570 0x561be9971950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48500/0 (socket says 172.21.15.145:48500) 2024-09-11T11:01:20.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff605001640 1 --2- 172.21.15.145:0/1610065441 >> v2:172.21.15.102:3300/0 conn(0x561be99758f0 0x561be9977ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47974/0 (socket says 172.21.15.145:47974) 2024-09-11T11:01:20.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff605802640 1 -- 172.21.15.145:0/1610065441 learned_addr learned my addr 172.21.15.145:0/1610065441 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:20.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff605001640 1 -- 172.21.15.145:0/1610065441 >> v1:172.21.15.102:6789/0 conn(0x561be9971570 legacy=0x561be9971950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.901+0000 7ff605001640 1 -- 172.21.15.145:0/1610065441 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be9979230 con 0x561be99758f0 2024-09-11T11:01:20.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff605001640 1 --2- 172.21.15.145:0/1610065441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be99758f0 0x561be9977ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00a480 tx=0x7ff5fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28539ddc7231f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff604800640 1 -- 172.21.15.145:0/1610065441 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5fc0b0070 con 0x561be99758f0 2024-09-11T11:01:20.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff604800640 1 -- 172.21.15.145:0/1610065441 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5fc0ab540 con 0x561be99758f0 2024-09-11T11:01:20.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff604800640 1 -- 172.21.15.145:0/1610065441 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5fc0ab840 con 0x561be99758f0 2024-09-11T11:01:20.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff607cf2980 1 -- 172.21.15.145:0/1610065441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be99758f0 msgr2=0x561be9977ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff607cf2980 1 --2- 172.21.15.145:0/1610065441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be99758f0 0x561be9977ce0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00a480 tx=0x7ff5fc01b280 comp rx=0 tx=0).stop 2024-09-11T11:01:20.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff607cf2980 1 -- 172.21.15.145:0/1610065441 shutdown_connections 2024-09-11T11:01:20.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff607cf2980 1 --2- 172.21.15.145:0/1610065441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be99758f0 0x561be9977ce0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff607cf2980 1 -- 172.21.15.145:0/1610065441 >> 172.21.15.145:0/1610065441 conn(0x561be996d090 msgr2=0x561be996f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff607cf2980 1 -- 172.21.15.145:0/1610065441 shutdown_connections 2024-09-11T11:01:20.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.905+0000 7ff607cf2980 1 -- 172.21.15.145:0/1610065441 wait complete. 2024-09-11T11:01:20.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff607cf2980 1 Processor -- start 2024-09-11T11:01:20.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff607cf2980 1 -- start start 2024-09-11T11:01:20.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff607cf2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be9a5c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff607cf2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561be9820200 con 0x561be9971570 2024-09-11T11:01:20.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be9a5c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be9a5c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47976/0 (socket says 172.21.15.145:47976) 2024-09-11T11:01:20.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff605802640 1 -- 172.21.15.145:0/3701013594 learned_addr learned my addr 172.21.15.145:0/3701013594 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff605802640 1 -- 172.21.15.145:0/3701013594 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be9a5cf40 con 0x561be9971570 2024-09-11T11:01:20.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.921+0000 7ff605802640 1 --2- 172.21.15.145:0/3701013594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be9a5c970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80017b0 tx=0x7ff5f8001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9171e4a852f0b2f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff4f3e07640 1 -- 172.21.15.145:0/3701013594 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8016070 con 0x561be9971570 2024-09-11T11:01:20.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff4f3e07640 1 -- 172.21.15.145:0/3701013594 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8004530 con 0x561be9971570 2024-09-11T11:01:20.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff4f3e07640 1 -- 172.21.15.145:0/3701013594 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8004870 con 0x561be9971570 2024-09-11T11:01:20.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- 172.21.15.145:0/3701013594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 msgr2=0x561be9a5c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3701013594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be9a5c970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80017b0 tx=0x7ff5f8001c70 comp rx=0 tx=0).stop 2024-09-11T11:01:20.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- 172.21.15.145:0/3701013594 shutdown_connections 2024-09-11T11:01:20.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3701013594 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be9a5c970 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- 172.21.15.145:0/3701013594 >> 172.21.15.145:0/3701013594 conn(0x561be996d090 msgr2=0x561be9a585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- 172.21.15.145:0/3701013594 shutdown_connections 2024-09-11T11:01:20.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- 172.21.15.145:0/3701013594 wait complete. 2024-09-11T11:01:20.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 Processor -- start 2024-09-11T11:01:20.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- start start 2024-09-11T11:01:20.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be98e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561be9978d30 con 0x561be9971570 2024-09-11T11:01:20.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be98e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be98e73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47980/0 (socket says 172.21.15.145:47980) 2024-09-11T11:01:20.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff605802640 1 -- 172.21.15.145:0/3931847902 learned_addr learned my addr 172.21.15.145:0/3931847902 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff605802640 1 -- 172.21.15.145:0/3931847902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be9a67aa0 con 0x561be9971570 2024-09-11T11:01:20.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff605802640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be98e73b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8000f90 tx=0x7ff5f8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff4f2604640 1 -- 172.21.15.145:0/3931847902 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8020070 con 0x561be9971570 2024-09-11T11:01:20.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be9a67c70 con 0x561be9971570 2024-09-11T11:01:20.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff4f2604640 1 -- 172.21.15.145:0/3931847902 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8011400 con 0x561be9971570 2024-09-11T11:01:20.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff4f2604640 1 -- 172.21.15.145:0/3931847902 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8016040 con 0x561be9971570 2024-09-11T11:01:20.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.925+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be9a68100 con 0x561be9971570 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff4f2604640 1 -- 172.21.15.145:0/3931847902 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff5f8023070 con 0x561be9971570 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff4f2604640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4ec034650 0x7ff4ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff4f2604640 1 -- 172.21.15.145:0/3931847902 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff5f8048fc0 con 0x561be9971570 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff605001640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4ec034650 0x7ff4ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be99758f0 0x561be9a6be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9a6c380 con 0x561be99758f0 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff606003640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be99758f0 0x561be9a6be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff605001640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4ec034650 0x7ff4ec036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0ad000 tx=0x7ff5fc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff606003640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be99758f0 0x561be9a6be00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff606003640 1 -- 172.21.15.145:0/3931847902 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be99758f0 2024-09-11T11:01:20.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9a6d150 0x561be9a6f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9a6fb80 con 0x561be9a6d150 2024-09-11T11:01:20.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff605802640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9a6d150 0x561be9a6f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff605802640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9a6d150 0x561be9a6f540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff605802640 1 -- 172.21.15.145:0/3931847902 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5f802c070 con 0x561be9a6d150 2024-09-11T11:01:20.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.929+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9a71430 con 0x561be9a6d150 2024-09-11T11:01:20.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605802640 1 -- 172.21.15.145:0/3931847902 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff5f802c070 con 0x561be9a6d150 2024-09-11T11:01:20.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9a70660 con 0x561be9a6d150 2024-09-11T11:01:20.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605802640 1 -- 172.21.15.145:0/3931847902 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5f802c070 con 0x561be9a6d150 2024-09-11T11:01:20.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561be9a727e0 0x561be9a74bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9a75110 con 0x561be9a727e0 2024-09-11T11:01:20.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605001640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561be9a727e0 0x561be9a74bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605001640 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561be9a727e0 0x561be9a74bd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605001640 1 -- 172.21.15.145:0/3931847902 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff5fc0b3040 con 0x561be9a727e0 2024-09-11T11:01:20.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff607cf2980 1 Processor -- start 2024-09-11T11:01:20.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff607cf2980 1 -- start start 2024-09-11T11:01:20.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff607cf2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a82ba0 0x561be9a82fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff607cf2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561be9879800 con 0x561be9a82ba0 2024-09-11T11:01:20.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a82ba0 0x561be9a82fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a82ba0 0x561be9a82fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:47992/0 (socket says 172.21.15.145:47992) 2024-09-11T11:01:20.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605802640 1 -- 172.21.15.145:0/1552395044 learned_addr learned my addr 172.21.15.145:0/1552395044 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605802640 1 -- 172.21.15.145:0/1552395044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be9a83500 con 0x561be9a82ba0 2024-09-11T11:01:20.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.933+0000 7ff605802640 1 --2- 172.21.15.145:0/1552395044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a82ba0 0x561be9a82fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8049330 tx=0x7ff5f8023ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4eb7fe640 1 -- 172.21.15.145:0/1552395044 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f802a040 con 0x561be9a82ba0 2024-09-11T11:01:20.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff607cf2980 1 -- 172.21.15.145:0/1552395044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be9a83790 con 0x561be9a82ba0 2024-09-11T11:01:20.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4eb7fe640 1 -- 172.21.15.145:0/1552395044 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8011810 con 0x561be9a82ba0 2024-09-11T11:01:20.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4eb7fe640 1 -- 172.21.15.145:0/1552395044 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8011b10 con 0x561be9a82ba0 2024-09-11T11:01:20.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff607cf2980 1 -- 172.21.15.145:0/1552395044 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be9a86410 con 0x561be9a82ba0 2024-09-11T11:01:20.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4eb7fe640 1 -- 172.21.15.145:0/1552395044 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff5f8026b80 con 0x561be9a82ba0 2024-09-11T11:01:20.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4eb7fe640 1 --2- 172.21.15.145:0/1552395044 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e0034650 0x7ff4e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4eb7fe640 1 -- 172.21.15.145:0/1552395044 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff5f804baa0 con 0x561be9a82ba0 2024-09-11T11:01:20.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff605001640 1 --2- 172.21.15.145:0/1552395044 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e0034650 0x7ff4e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff607cf2980 1 Processor -- start 2024-09-11T11:01:20.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff607cf2980 1 -- start start 2024-09-11T11:01:20.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff607cf2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a650d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff607cf2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561be9a5d2c0 con 0x561be9a64cf0 2024-09-11T11:01:20.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff605001640 1 --2- 172.21.15.145:0/1552395044 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e0034650 0x7ff4e0036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc000c10 tx=0x7ff5fc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a650d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a650d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48004/0 (socket says 172.21.15.145:48004) 2024-09-11T11:01:20.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff605802640 1 -- 172.21.15.145:0/1899196183 learned_addr learned my addr 172.21.15.145:0/1899196183 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff605802640 1 -- 172.21.15.145:0/1899196183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be9a656a0 con 0x561be9a64cf0 2024-09-11T11:01:20.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff605802640 1 --2- 172.21.15.145:0/1899196183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a650d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80244f0 tx=0x7ff5f8040bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c244edb56ec03a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4e97fa640 1 -- 172.21.15.145:0/1899196183 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8040f70 con 0x561be9a64cf0 2024-09-11T11:01:20.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4e97fa640 1 -- 172.21.15.145:0/1899196183 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f802f450 con 0x561be9a64cf0 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.937+0000 7ff4e97fa640 1 -- 172.21.15.145:0/1899196183 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8041110 con 0x561be9a64cf0 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- 172.21.15.145:0/1899196183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 msgr2=0x561be9a650d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 --2- 172.21.15.145:0/1899196183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a650d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80244f0 tx=0x7ff5f8040bf0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- 172.21.15.145:0/1899196183 shutdown_connections 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 --2- 172.21.15.145:0/1899196183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a650d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- 172.21.15.145:0/1899196183 >> 172.21.15.145:0/1899196183 conn(0x561be9a8b820 msgr2=0x561be9a89920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- 172.21.15.145:0/1899196183 shutdown_connections 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- 172.21.15.145:0/1899196183 wait complete. 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 Processor -- start 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- start start 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561be9a63880 con 0x561be9a64cf0 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff605802640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48018/0 (socket says 172.21.15.145:48018) 2024-09-11T11:01:20.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 learned_addr learned my addr 172.21.15.145:0/549931149 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:20.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561be9a98d30 con 0x561be9a64cf0 2024-09-11T11:01:20.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff605802640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a987f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80463e0 tx=0x7ff5f800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff4d77fe640 1 -- 172.21.15.145:0/549931149 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f806f070 con 0x561be9a64cf0 2024-09-11T11:01:20.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561be9a98d30 con 0x561be9a64cf0 2024-09-11T11:01:20.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff4d77fe640 1 -- 172.21.15.145:0/549931149 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f802d8a0 con 0x561be9a64cf0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff4d77fe640 1 -- 172.21.15.145:0/549931149 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f802dc20 con 0x561be9a64cf0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561be9a98d30 con 0x561be9a64cf0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff4d77fe640 1 -- 172.21.15.145:0/549931149 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff5f8072070 con 0x561be9a64cf0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff4d77fe640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4d0034650 0x7ff4d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff4d77fe640 1 -- 172.21.15.145:0/549931149 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff5f8066030 con 0x561be9a64cf0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff605001640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4d0034650 0x7ff4d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be9aa3810 0x561be9aa5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.941+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aa6420 con 0x561be9aa3810 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff606003640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be9aa3810 0x561be9aa5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff605001640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4d0034650 0x7ff4d0036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0ab510 tx=0x7ff5fc0b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff606003640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be9aa3810 0x561be9aa5cd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 realm 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aa2c40 con 0x561be9aa3810 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aa6eb0 con 0x561be9aa3810 2024-09-11T11:01:20.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9aa7c90 0x561be9aaa080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaa710 con 0x561be9aa7c90 2024-09-11T11:01:20.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff605802640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9aa7c90 0x561be9aaa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff605802640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9aa7c90 0x561be9aaa080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:20.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 20 searching for the correct realm 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.945+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561be9aaccd0 0x561be9aaf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaf740 con 0x561be9aaccd0 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605001640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561be9aaccd0 0x561be9aaf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605001640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561be9aaccd0 0x561be9aaf0c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaf740 con 0x561be9aa7c90 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605802640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff5f8074060 0x7ff5f806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x7ff5f8074060 2024-09-11T11:01:20.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff5f8074060 0x7ff5f806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:20.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff5f8074060 0x7ff5f806f8b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:20.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aaccd0 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.949+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x7ff5f8074060 2024-09-11T11:01:20.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x7ff5f8074060 2024-09-11T11:01:20.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aaccd0 2024-09-11T11:01:20.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.953+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aaccd0 2024-09-11T11:01:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aaccd0 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x7ff5f8074060 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa3810 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x7ff5f8074060 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aaccd0 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x7ff5f8074060 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.957+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aaccd0 2024-09-11T11:01:20.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x561be9aaaf60 con 0x561be9aa7c90 2024-09-11T11:01:20.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:20.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:20.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:20.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:20.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:20.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aab7b0 con 0x561be9aa3810 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aabba0 con 0x561be9aa7c90 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aabba0 con 0x7ff5f8074060 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 zone default found 2024-09-11T11:01:20.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 4 Realm: () 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 zonegroup default 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aafba0 con 0x7ff5f8074060 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.961+0000 7ff607cf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aac0e0 con 0x561be9aaccd0 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:20.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab1ea0 con 0x561be9aaccd0 2024-09-11T11:01:20.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:20.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 20 started sync module instance, tier type = 2024-09-11T11:01:20.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:20.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab1260 con 0x561be9aa7c90 2024-09-11T11:01:20.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94677884409696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab1260 con 0x561be9aa7c90 2024-09-11T11:01:20.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.965+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab2920 con 0x561be9aa3810 2024-09-11T11:01:20.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.969+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.969+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94677884413040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab2890 con 0x561be9aa3810 2024-09-11T11:01:20.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.969+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab3840 con 0x561be9aa7c90 2024-09-11T11:01:20.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.969+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94677884409696] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.969+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94677884413040] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.973+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.973+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94677884415248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab3800 con 0x561be9aa7c90 2024-09-11T11:01:20.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.973+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab40e0 con 0x7ff5f8074060 2024-09-11T11:01:20.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.973+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.973+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94677884419120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab3800 con 0x7ff5f8074060 2024-09-11T11:01:20.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.973+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab4b80 con 0x561be9aa7c90 2024-09-11T11:01:20.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94677884415248] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94677884419120] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94677884420176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab4b40 con 0x561be9aa7c90 2024-09-11T11:01:20.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab4f70 con 0x561be9aaccd0 2024-09-11T11:01:20.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94677884416816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab5810 con 0x561be9aaccd0 2024-09-11T11:01:20.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab61d0 con 0x561be9aaccd0 2024-09-11T11:01:20.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.977+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94677884420176] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.981+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94677884416816] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.981+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.981+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94677884427552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab65c0 con 0x561be9aaccd0 2024-09-11T11:01:20.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.981+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab6e10 con 0x7ff5f8074060 2024-09-11T11:01:20.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94677884427552] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94677884429760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab6e90 con 0x7ff5f8074060 2024-09-11T11:01:20.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 20 add_watcher() i=0 2024-09-11T11:01:20.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 20 add_watcher() i=1 2024-09-11T11:01:20.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 20 add_watcher() i=2 2024-09-11T11:01:20.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 20 add_watcher() i=3 2024-09-11T11:01:20.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 20 add_watcher() i=4 2024-09-11T11:01:20.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 20 add_watcher() i=5 2024-09-11T11:01:20.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 20 add_watcher() i=6 2024-09-11T11:01:20.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94677884429760] v32'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 20 add_watcher() i=7 2024-09-11T11:01:20.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:20.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9aba1a0 con 0x561be9aa3810 2024-09-11T11:01:20.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.985+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94677884431184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab7420 con 0x561be9aa3810 2024-09-11T11:01:20.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.989+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94677884431184] v32'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.989+0000 7ff4b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:20.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.989+0000 7ff607cf2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:20.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.989+0000 7ff607cf2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:20.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.989+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab9910 con 0x561be9aa7c90 2024-09-11T11:01:20.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.989+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:20.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.989+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab99c0 con 0x7ff5f8074060 2024-09-11T11:01:20.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.993+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:20.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.993+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac32e0 con 0x561be9aaccd0 2024-09-11T11:01:20.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.997+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:20.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.997+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac3260 con 0x561be9aa3810 2024-09-11T11:01:20.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.997+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:20.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:20.997+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac3b10 con 0x561be9aa7c90 2024-09-11T11:01:21.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.001+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.001+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac3b10 con 0x561be9aaccd0 2024-09-11T11:01:21.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.001+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.001+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac4080 con 0x561be9aa7c90 2024-09-11T11:01:21.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.005+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.005+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac4530 con 0x561be9aa3810 2024-09-11T11:01:21.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.005+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:21.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.005+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x561be9aa7c90 2024-09-11T11:01:21.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.009+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.009+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x561be9aa7c90 2024-09-11T11:01:21.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.009+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.009+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac2700 con 0x561be9aa7c90 2024-09-11T11:01:21.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.013+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.013+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac2700 con 0x561be9aaccd0 2024-09-11T11:01:21.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.013+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.013+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa7c90 2024-09-11T11:01:21.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.017+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.017+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa3810 2024-09-11T11:01:21.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.017+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'19 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:21.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.017+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa3810 2024-09-11T11:01:21.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.021+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:21.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.021+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa7c90 2024-09-11T11:01:21.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.021+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.021+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa7c90 2024-09-11T11:01:21.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.025+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.025+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aaccd0 2024-09-11T11:01:21.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.025+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.025+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa7c90 2024-09-11T11:01:21.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.029+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.029+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa3810 2024-09-11T11:01:21.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.029+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:21.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.029+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa7c90 2024-09-11T11:01:21.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.033+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'15 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.033+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aa7c90 2024-09-11T11:01:21.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.037+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.037+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5090 con 0x561be9aaccd0 2024-09-11T11:01:21.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.037+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.037+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5120 con 0x561be9aa7c90 2024-09-11T11:01:21.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.037+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'16 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.037+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac5660 con 0x561be9aaccd0 2024-09-11T11:01:21.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.041+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.041+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x561be9aaccd0 2024-09-11T11:01:21.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.041+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'14 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.041+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x561be9aaccd0 2024-09-11T11:01:21.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.045+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.045+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x561be9aa7c90 2024-09-11T11:01:21.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.045+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.045+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x561be9aa3810 2024-09-11T11:01:21.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.049+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:21.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.049+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x561be9aa7c90 2024-09-11T11:01:21.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.053+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.053+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x561be9aa3810 2024-09-11T11:01:21.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.053+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:21.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.053+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac28d0 con 0x7ff5f8074060 2024-09-11T11:01:21.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:21.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff4b67fc640 20 reqs_thread_entry: start 2024-09-11T11:01:21.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:21.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 20 Filter name: none 2024-09-11T11:01:21.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff427fff640 20 reqs_thread_entry: start 2024-09-11T11:01:21.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-11T11:01:21.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac0e50 con 0x7ff5f8074060 2024-09-11T11:01:21.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:21.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-11T11:01:21.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-11T11:01:21.060 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, user does not exist 2024-09-11T11:01:21.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff4b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:21.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.057+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94677884431184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ac0870 con 0x561be9aa3810 2024-09-11T11:01:21.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.061+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94677884431184] v32'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:21.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.061+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94677884409696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab6b50 con 0x561be9aa7c90 2024-09-11T11:01:21.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.061+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94677884409696] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.061+0000 7ff607cf2980 20 remove_watcher() i=0 2024-09-11T11:01:21.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.061+0000 7ff607cf2980 2 removed watcher, disabling cache 2024-09-11T11:01:21.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.061+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94677884413040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab6b50 con 0x561be9aa3810 2024-09-11T11:01:21.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.065+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94677884413040] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x561be9aa3810 2024-09-11T11:01:21.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.065+0000 7ff607cf2980 20 remove_watcher() i=1 2024-09-11T11:01:21.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.065+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94677884415248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab2470 con 0x561be9aa7c90 2024-09-11T11:01:21.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.069+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94677884415248] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.069+0000 7ff607cf2980 20 remove_watcher() i=2 2024-09-11T11:01:21.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.069+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94677884419120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab6b50 con 0x7ff5f8074060 2024-09-11T11:01:21.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.069+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94677884419120] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:21.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.069+0000 7ff607cf2980 20 remove_watcher() i=3 2024-09-11T11:01:21.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.069+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94677884420176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab2470 con 0x561be9aa7c90 2024-09-11T11:01:21.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff605802640 1 -- 172.21.15.145:0/549931149 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94677884420176] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5f8071030 con 0x561be9aa7c90 2024-09-11T11:01:21.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff607cf2980 20 remove_watcher() i=4 2024-09-11T11:01:21.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94677884416816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab6b50 con 0x561be9aaccd0 2024-09-11T11:01:21.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94677884416816] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff607cf2980 20 remove_watcher() i=5 2024-09-11T11:01:21.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94677884427552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab2470 con 0x561be9aaccd0 2024-09-11T11:01:21.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff605001640 1 -- 172.21.15.145:0/549931149 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94677884427552] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff5fc0c9030 con 0x561be9aaccd0 2024-09-11T11:01:21.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff607cf2980 20 remove_watcher() i=6 2024-09-11T11:01:21.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.073+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94677884429760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x561be9ab3330 con 0x7ff5f8074060 2024-09-11T11:01:21.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94677884429760] v32'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6000083f0 con 0x7ff5f8074060 2024-09-11T11:01:21.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 20 remove_watcher() i=7 2024-09-11T11:01:21.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9aa7c90 msgr2=0x561be9aaa080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9aa7c90 0x561be9aaa080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be9aa3810 msgr2=0x561be9aa5cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be9aa3810 0x561be9aa5cd0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff5f8074060 msgr2=0x7ff5f806f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff5f8074060 0x7ff5f806f8b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561be9aaccd0 msgr2=0x561be9aaf0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561be9aaccd0 0x561be9aaf0c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4d0034650 msgr2=0x7ff4d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4d0034650 0x7ff4d0036b10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0ab510 tx=0x7ff5fc0b9040 comp rx=0 tx=0).stop 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 msgr2=0x561be9a987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/549931149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a64cf0 0x561be9a987f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5f80463e0 tx=0x7ff5f800bf30 comp rx=0 tx=0).stop 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 reap_dead start 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff606003640 1 -- 172.21.15.145:0/549931149 reap_dead start 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 shutdown_connections 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 >> 172.21.15.145:0/549931149 conn(0x561be9a8b820 msgr2=0x561be9a898f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 shutdown_connections 2024-09-11T11:01:21.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/549931149 wait complete. 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/1552395044 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e0034650 msgr2=0x7ff4e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/1552395044 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e0034650 0x7ff4e0036b10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc000c10 tx=0x7ff5fc005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/1552395044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a82ba0 msgr2=0x561be9a82fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/1552395044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a82ba0 0x561be9a82fc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8049330 tx=0x7ff5f8023ac0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/1552395044 shutdown_connections 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/1552395044 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e0034650 0x7ff4e0036b10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/1552395044 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9a82ba0 0x561be9a82fc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/1552395044 >> 172.21.15.145:0/1552395044 conn(0x561be9a77cf0 msgr2=0x561be9a7a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/1552395044 shutdown_connections 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/1552395044 wait complete. 2024-09-11T11:01:21.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9a6d150 msgr2=0x561be9a6f540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561be9a6d150 0x561be9a6f540 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be99758f0 msgr2=0x561be9a6be00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561be99758f0 0x561be9a6be00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561be9a727e0 msgr2=0x561be9a74bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561be9a727e0 0x561be9a74bd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4ec034650 msgr2=0x7ff4ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4ec034650 0x7ff4ec036b10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0ad000 tx=0x7ff5fc0a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 msgr2=0x561be98e73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 --2- 172.21.15.145:0/3931847902 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561be9971570 0x561be98e73b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8000f90 tx=0x7ff5f8001260 comp rx=0 tx=0).stop 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff606003640 1 -- 172.21.15.145:0/3931847902 reap_dead start 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 shutdown_connections 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 >> 172.21.15.145:0/3931847902 conn(0x561be996d090 msgr2=0x561be9a57120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 shutdown_connections 2024-09-11T11:01:21.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.077+0000 7ff607cf2980 1 -- 172.21.15.145:0/3931847902 wait complete. 2024-09-11T11:01:21.100 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T11:01:21.101 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-11T11:01:21.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-11T11:01:21.101 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-11T11:01:21.181 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:21.181 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:21.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1707c12980 1 Processor -- start 2024-09-11T11:01:21.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1707c12980 1 -- start start 2024-09-11T11:01:21.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1707c12980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55dbaec44ec0 0x55dbaec472b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1707c12980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dbaeac6ae0 con 0x55dbaebb3290 2024-09-11T11:01:21.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1707c12980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55dbaeaeae30 con 0x55dbaec44ec0 2024-09-11T11:01:21.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1704f21640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55dbaec44ec0 0x55dbaec472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1704f21640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55dbaec44ec0 0x55dbaec472b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48030/0 (socket says 172.21.15.145:48030) 2024-09-11T11:01:21.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1705722640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55dbaebb3290 0x55dbaec437a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48512/0 (socket says 172.21.15.145:48512) 2024-09-11T11:01:21.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1704f21640 1 -- 172.21.15.145:0/3006790780 learned_addr learned my addr 172.21.15.145:0/3006790780 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1704f21640 1 -- 172.21.15.145:0/3006790780 >> v1:172.21.15.102:6789/0 conn(0x55dbaebb3290 legacy=0x55dbaec437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.181+0000 7f1704f21640 1 -- 172.21.15.145:0/3006790780 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbaebb3670 con 0x55dbaec44ec0 2024-09-11T11:01:21.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f1704f21640 1 --2- 172.21.15.145:0/3006790780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaec44ec0 0x55dbaec472b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00a5c0 tx=0x7f16fc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38301da8dd19dea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f16f7fff640 1 -- 172.21.15.145:0/3006790780 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16fc0a6070 con 0x55dbaec44ec0 2024-09-11T11:01:21.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f16f7fff640 1 -- 172.21.15.145:0/3006790780 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16fc0af070 con 0x55dbaec44ec0 2024-09-11T11:01:21.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f16f7fff640 1 -- 172.21.15.145:0/3006790780 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16fc0aa5c0 con 0x55dbaec44ec0 2024-09-11T11:01:21.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f1707c12980 1 -- 172.21.15.145:0/3006790780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaec44ec0 msgr2=0x55dbaec472b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f1707c12980 1 --2- 172.21.15.145:0/3006790780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaec44ec0 0x55dbaec472b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f16fc00a5c0 tx=0x7f16fc01b340 comp rx=0 tx=0).stop 2024-09-11T11:01:21.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f1707c12980 1 -- 172.21.15.145:0/3006790780 shutdown_connections 2024-09-11T11:01:21.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f1707c12980 1 --2- 172.21.15.145:0/3006790780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaec44ec0 0x55dbaec472b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f1707c12980 1 -- 172.21.15.145:0/3006790780 >> 172.21.15.145:0/3006790780 conn(0x55dbaec39090 msgr2=0x55dbaec3b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f1707c12980 1 -- 172.21.15.145:0/3006790780 shutdown_connections 2024-09-11T11:01:21.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.185+0000 7f1707c12980 1 -- 172.21.15.145:0/3006790780 wait complete. 2024-09-11T11:01:21.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1707c12980 1 Processor -- start 2024-09-11T11:01:21.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1707c12980 1 -- start start 2024-09-11T11:01:21.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1707c12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed2bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1707c12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55dbaeaec200 con 0x55dbaebb3290 2024-09-11T11:01:21.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed2bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed2bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48040/0 (socket says 172.21.15.145:48040) 2024-09-11T11:01:21.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1705722640 1 -- 172.21.15.145:0/1730266270 learned_addr learned my addr 172.21.15.145:0/1730266270 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1705722640 1 -- 172.21.15.145:0/1730266270 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbaed2c230 con 0x55dbaebb3290 2024-09-11T11:01:21.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f1705722640 1 --2- 172.21.15.145:0/1730266270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed2bc60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f16f8001e50 tx=0x7f16f8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47078873630199b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f15f3606640 1 -- 172.21.15.145:0/1730266270 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f800e5d0 con 0x55dbaebb3290 2024-09-11T11:01:21.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f15f3606640 1 -- 172.21.15.145:0/1730266270 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f800e770 con 0x55dbaebb3290 2024-09-11T11:01:21.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.201+0000 7f15f3606640 1 -- 172.21.15.145:0/1730266270 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f800eab0 con 0x55dbaebb3290 2024-09-11T11:01:21.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- 172.21.15.145:0/1730266270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 msgr2=0x55dbaed2bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 --2- 172.21.15.145:0/1730266270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed2bc60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f16f8001e50 tx=0x7f16f8001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:21.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- 172.21.15.145:0/1730266270 shutdown_connections 2024-09-11T11:01:21.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 --2- 172.21.15.145:0/1730266270 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed2bc60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- 172.21.15.145:0/1730266270 >> 172.21.15.145:0/1730266270 conn(0x55dbaec39090 msgr2=0x55dbaed27890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- 172.21.15.145:0/1730266270 shutdown_connections 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- 172.21.15.145:0/1730266270 wait complete. 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 Processor -- start 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- start start 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed32f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55dbaec4a220 con 0x55dbaebb3290 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed32f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed32f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48044/0 (socket says 172.21.15.145:48044) 2024-09-11T11:01:21.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1705722640 1 -- 172.21.15.145:0/3854558941 learned_addr learned my addr 172.21.15.145:0/3854558941 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1705722640 1 -- 172.21.15.145:0/3854558941 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbaed334d0 con 0x55dbaebb3290 2024-09-11T11:01:21.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1705722640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed32f90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55dbaed2ce40 tx=0x7f16f8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f15f1e03640 1 -- 172.21.15.145:0/3854558941 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f8001260 con 0x55dbaebb3290 2024-09-11T11:01:21.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbaed33760 con 0x55dbaebb3290 2024-09-11T11:01:21.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f15f1e03640 1 -- 172.21.15.145:0/3854558941 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f800fa40 con 0x55dbaebb3290 2024-09-11T11:01:21.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f15f1e03640 1 -- 172.21.15.145:0/3854558941 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f800fd80 con 0x55dbaebb3290 2024-09-11T11:01:21.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbaed36440 con 0x55dbaebb3290 2024-09-11T11:01:21.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f15f1e03640 1 -- 172.21.15.145:0/3854558941 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f16f8017070 con 0x55dbaebb3290 2024-09-11T11:01:21.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f15f1e03640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15ec034650 0x7f15ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.205+0000 7f15f1e03640 1 -- 172.21.15.145:0/3854558941 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f16f8015020 con 0x55dbaebb3290 2024-09-11T11:01:21.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1704f21640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15ec034650 0x7f15ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1707c12980 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaec44ec0 0x55dbaed39f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed3a5f0 con 0x55dbaec44ec0 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1705f23640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaec44ec0 0x55dbaed39f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1704f21640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15ec034650 0x7f15ec036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0ae000 tx=0x7f16fc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1705f23640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaec44ec0 0x55dbaed39f80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1705f23640 1 -- 172.21.15.145:0/3854558941 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaec44ec0 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1707c12980 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed3b3e0 0x55dbaed3d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed3de00 con 0x55dbaed3b3e0 2024-09-11T11:01:21.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1705722640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed3b3e0 0x55dbaed3d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1705722640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed3b3e0 0x55dbaed3d7d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1705722640 1 -- 172.21.15.145:0/3854558941 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16f802e070 con 0x55dbaed3b3e0 2024-09-11T11:01:21.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed3f6b0 con 0x55dbaed3b3e0 2024-09-11T11:01:21.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1705722640 1 -- 172.21.15.145:0/3854558941 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f16f802e070 con 0x55dbaed3b3e0 2024-09-11T11:01:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.209+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed3e8e0 con 0x55dbaed3b3e0 2024-09-11T11:01:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1705722640 1 -- 172.21.15.145:0/3854558941 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16f802e070 con 0x55dbaed3b3e0 2024-09-11T11:01:21.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1707c12980 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55dbaed40a60 0x55dbaed42e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed43390 con 0x55dbaed40a60 2024-09-11T11:01:21.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1704f21640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55dbaed40a60 0x55dbaed42e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1704f21640 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55dbaed40a60 0x55dbaed42e50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1704f21640 1 -- 172.21.15.145:0/3854558941 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed40a60 2024-09-11T11:01:21.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1707c12980 1 Processor -- start 2024-09-11T11:01:21.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1707c12980 1 -- start start 2024-09-11T11:01:21.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1707c12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed50d90 0x55dbaed511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1707c12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55dbaeb45800 con 0x55dbaed50d90 2024-09-11T11:01:21.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed50d90 0x55dbaed511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed50d90 0x55dbaed511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48050/0 (socket says 172.21.15.145:48050) 2024-09-11T11:01:21.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1705722640 1 -- 172.21.15.145:0/2196533093 learned_addr learned my addr 172.21.15.145:0/2196533093 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1705722640 1 -- 172.21.15.145:0/2196533093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbaed516f0 con 0x55dbaed50d90 2024-09-11T11:01:21.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1705722640 1 --2- 172.21.15.145:0/2196533093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed50d90 0x55dbaed511b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16f8024000 tx=0x7f16f8017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f15eaffd640 1 -- 172.21.15.145:0/2196533093 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f8042020 con 0x55dbaed50d90 2024-09-11T11:01:21.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1707c12980 1 -- 172.21.15.145:0/2196533093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbaed51980 con 0x55dbaed50d90 2024-09-11T11:01:21.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f15eaffd640 1 -- 172.21.15.145:0/2196533093 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f80421c0 con 0x55dbaed50d90 2024-09-11T11:01:21.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f15eaffd640 1 -- 172.21.15.145:0/2196533093 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f804aa70 con 0x55dbaed50d90 2024-09-11T11:01:21.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.213+0000 7f1707c12980 1 -- 172.21.15.145:0/2196533093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbaed51980 con 0x55dbaed50d90 2024-09-11T11:01:21.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f15eaffd640 1 -- 172.21.15.145:0/2196533093 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f16f801a480 con 0x55dbaed50d90 2024-09-11T11:01:21.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f15eaffd640 1 --2- 172.21.15.145:0/2196533093 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15dc034650 0x7f15dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f15eaffd640 1 -- 172.21.15.145:0/2196533093 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f16f803e040 con 0x55dbaed50d90 2024-09-11T11:01:21.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1704f21640 1 --2- 172.21.15.145:0/2196533093 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15dc034650 0x7f15dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 Processor -- start 2024-09-11T11:01:21.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- start start 2024-09-11T11:01:21.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed5d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55dbaed2c5b0 con 0x55dbaed5d4c0 2024-09-11T11:01:21.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1704f21640 1 --2- 172.21.15.145:0/2196533093 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15dc034650 0x7f15dc036b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55dbaed37580 tx=0x7f16fc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed5d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed5d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48064/0 (socket says 172.21.15.145:48064) 2024-09-11T11:01:21.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1705722640 1 -- 172.21.15.145:0/1667484334 learned_addr learned my addr 172.21.15.145:0/1667484334 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1705722640 1 -- 172.21.15.145:0/1667484334 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbaed5de90 con 0x55dbaed5d4c0 2024-09-11T11:01:21.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1705722640 1 --2- 172.21.15.145:0/1667484334 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed5d8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16f80197f0 tx=0x7f16f8047bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3332e84ddc0e1d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f15e8ff9640 1 -- 172.21.15.145:0/1667484334 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f805a040 con 0x55dbaed5d4c0 2024-09-11T11:01:21.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f15e8ff9640 1 -- 172.21.15.145:0/1667484334 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f801a950 con 0x55dbaed5d4c0 2024-09-11T11:01:21.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f15e8ff9640 1 -- 172.21.15.145:0/1667484334 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f80470d0 con 0x55dbaed5d4c0 2024-09-11T11:01:21.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- 172.21.15.145:0/1667484334 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 msgr2=0x55dbaed5d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 --2- 172.21.15.145:0/1667484334 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed5d8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16f80197f0 tx=0x7f16f8047bf0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- 172.21.15.145:0/1667484334 shutdown_connections 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 --2- 172.21.15.145:0/1667484334 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed5d8c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- 172.21.15.145:0/1667484334 >> 172.21.15.145:0/1667484334 conn(0x55dbaed598a0 msgr2=0x55dbaed579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- 172.21.15.145:0/1667484334 shutdown_connections 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- 172.21.15.145:0/1667484334 wait complete. 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 Processor -- start 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- start start 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.217+0000 7f1707c12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55dbaed5e310 con 0x55dbaed5d4c0 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1705722640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed646c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48066/0 (socket says 172.21.15.145:48066) 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 learned_addr learned my addr 172.21.15.145:0/4109442895 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbaed64c00 con 0x55dbaed5d4c0 2024-09-11T11:01:21.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1705722640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed646c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16f801a8e0 tx=0x7f16f8018ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f15daffd640 1 -- 172.21.15.145:0/4109442895 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f80283f0 con 0x55dbaed5d4c0 2024-09-11T11:01:21.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f15daffd640 1 -- 172.21.15.145:0/4109442895 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16f806e030 con 0x55dbaed5d4c0 2024-09-11T11:01:21.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dbaed64c00 con 0x55dbaed5d4c0 2024-09-11T11:01:21.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f15daffd640 1 -- 172.21.15.145:0/4109442895 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16f8053430 con 0x55dbaed5d4c0 2024-09-11T11:01:21.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbaed64c00 con 0x55dbaed5d4c0 2024-09-11T11:01:21.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f15daffd640 1 -- 172.21.15.145:0/4109442895 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f16f8039a00 con 0x55dbaed5d4c0 2024-09-11T11:01:21.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f15daffd640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15d00345b0 0x7f15d0036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f15daffd640 1 -- 172.21.15.145:0/4109442895 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f16f8074ad0 con 0x55dbaed5d4c0 2024-09-11T11:01:21.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1704f21640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15d00345b0 0x7f15d0036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaed6f790 0x55dbaed71c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed723a0 con 0x55dbaed6f790 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1705f23640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaed6f790 0x55dbaed71c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1704f21640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15d00345b0 0x7f15d0036a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0aafd0 tx=0x7f16fc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.221+0000 7f1705f23640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaed6f790 0x55dbaed71c50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 realm 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed6ebc0 con 0x55dbaed6f790 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:21.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed72e60 con 0x55dbaed6f790 2024-09-11T11:01:21.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed73c40 0x55dbaed76030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed766e0 con 0x55dbaed73c40 2024-09-11T11:01:21.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1705722640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed73c40 0x55dbaed76030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1705722640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed73c40 0x55dbaed76030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f16f802e070 con 0x55dbaed73c40 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed76f30 con 0x55dbaed73c40 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f16f802e070 con 0x55dbaed73c40 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 20 searching for the correct realm 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55dbaed78ca0 0x55dbaed7b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed78ca0 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1704f21640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55dbaed78ca0 0x55dbaed7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.225+0000 7f1704f21640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55dbaed78ca0 0x55dbaed7b090 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f16f802e070 con 0x55dbaed73c40 2024-09-11T11:01:21.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705722640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f16f8069050 0x7f16f80285d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x7f16f8069050 2024-09-11T11:01:21.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f16f8069050 0x7f16f80285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f16f8069050 0x7f16f80285d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed78ca0 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x55dbaed73c40 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.229+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f802e070 con 0x55dbaed73c40 2024-09-11T11:01:21.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x7f16f8069050 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x7f16f8069050 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed78ca0 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed78ca0 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.233+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed78ca0 2024-09-11T11:01:21.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x7f16f8069050 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed6f790 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x7f16f8069050 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed78ca0 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x7f16f8069050 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed78ca0 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.237+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7b710 con 0x55dbaed73c40 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:21.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed77880 con 0x55dbaed6f790 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed77490 con 0x55dbaed73c40 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed781b0 con 0x7f16f8069050 2024-09-11T11:01:21.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 zone default found 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 4 Realm: () 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 zonegroup default 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7c020 con 0x7f16f8069050 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7e250 con 0x55dbaed78ca0 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7e5f0 con 0x55dbaed78ca0 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 started sync module instance, tier type = 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.241+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7d690 con 0x55dbaed73c40 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.245+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.245+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94402019578608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7dd20 con 0x55dbaed73c40 2024-09-11T11:01:21.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.245+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7efb0 con 0x55dbaed6f790 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.245+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94402019578608] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.245+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.245+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94402019579760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7efb0 con 0x55dbaed6f790 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.245+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7f970 con 0x55dbaed73c40 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.249+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94402019579760] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.249+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.249+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94402019585072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7f970 con 0x55dbaed73c40 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.249+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed80330 con 0x7f16f8069050 2024-09-11T11:01:21.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.249+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.249+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94402019589760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed802a0 con 0x7f16f8069050 2024-09-11T11:01:21.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.249+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed81250 con 0x55dbaed73c40 2024-09-11T11:01:21.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94402019585072] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94402019589760] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94402019591968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed81210 con 0x55dbaed73c40 2024-09-11T11:01:21.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed81640 con 0x55dbaed78ca0 2024-09-11T11:01:21.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94402019587264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed81e90 con 0x55dbaed78ca0 2024-09-11T11:01:21.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed82890 con 0x55dbaed78ca0 2024-09-11T11:01:21.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.253+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94402019591968] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94402019587264] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94402019593536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed82c80 con 0x55dbaed78ca0 2024-09-11T11:01:21.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed834d0 con 0x7f16f8069050 2024-09-11T11:01:21.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94402019593536] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94402019602048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed83920 con 0x7f16f8069050 2024-09-11T11:01:21.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 20 add_watcher() i=0 2024-09-11T11:01:21.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 20 add_watcher() i=1 2024-09-11T11:01:21.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 20 add_watcher() i=2 2024-09-11T11:01:21.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 20 add_watcher() i=3 2024-09-11T11:01:21.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 20 add_watcher() i=4 2024-09-11T11:01:21.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 20 add_watcher() i=5 2024-09-11T11:01:21.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 20 add_watcher() i=6 2024-09-11T11:01:21.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94402019602048] v32'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 20 add_watcher() i=7 2024-09-11T11:01:21.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:21.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed82430 con 0x55dbaed6f790 2024-09-11T11:01:21.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.257+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94402019603360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed82460 con 0x55dbaed6f790 2024-09-11T11:01:21.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.261+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94402019603360] v32'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.261+0000 7f15bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:21.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.261+0000 7f1707c12980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:21.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.261+0000 7f1707c12980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:21.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.261+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8f280 con 0x55dbaed73c40 2024-09-11T11:01:21.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.265+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.265+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8f360 con 0x7f16f8069050 2024-09-11T11:01:21.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.265+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.265+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8fb20 con 0x55dbaed78ca0 2024-09-11T11:01:21.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.265+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.265+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8ffd0 con 0x55dbaed6f790 2024-09-11T11:01:21.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.269+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.269+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8d0d0 con 0x55dbaed73c40 2024-09-11T11:01:21.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.269+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.269+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8d0d0 con 0x55dbaed78ca0 2024-09-11T11:01:21.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.273+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.273+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8d0d0 con 0x55dbaed73c40 2024-09-11T11:01:21.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.273+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.273+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8cf00 con 0x55dbaed6f790 2024-09-11T11:01:21.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.277+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.277+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed90d60 con 0x55dbaed73c40 2024-09-11T11:01:21.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.281+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.281+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed90d60 con 0x55dbaed73c40 2024-09-11T11:01:21.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.281+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.281+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed911e0 con 0x55dbaed73c40 2024-09-11T11:01:21.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.281+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.281+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed911e0 con 0x55dbaed78ca0 2024-09-11T11:01:21.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.285+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.285+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed911e0 con 0x55dbaed73c40 2024-09-11T11:01:21.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.285+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.285+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed911e0 con 0x55dbaed6f790 2024-09-11T11:01:21.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.289+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'21 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.289+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91690 con 0x55dbaed6f790 2024-09-11T11:01:21.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.289+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.289+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91690 con 0x55dbaed73c40 2024-09-11T11:01:21.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.293+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.293+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91690 con 0x55dbaed73c40 2024-09-11T11:01:21.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.293+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.293+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91690 con 0x55dbaed78ca0 2024-09-11T11:01:21.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.297+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.297+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91690 con 0x55dbaed73c40 2024-09-11T11:01:21.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.297+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.297+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91720 con 0x55dbaed6f790 2024-09-11T11:01:21.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.301+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.301+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91d60 con 0x55dbaed73c40 2024-09-11T11:01:21.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.301+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.301+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91d40 con 0x55dbaed73c40 2024-09-11T11:01:21.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.309+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.309+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91d40 con 0x55dbaed78ca0 2024-09-11T11:01:21.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.309+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.309+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91d40 con 0x55dbaed73c40 2024-09-11T11:01:21.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.313+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.313+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91d40 con 0x55dbaed78ca0 2024-09-11T11:01:21.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.313+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.313+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed91d40 con 0x55dbaed78ca0 2024-09-11T11:01:21.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.313+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'16 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.313+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed92180 con 0x55dbaed78ca0 2024-09-11T11:01:21.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.317+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.317+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed92180 con 0x55dbaed73c40 2024-09-11T11:01:21.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.321+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.321+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed92180 con 0x55dbaed6f790 2024-09-11T11:01:21.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.321+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.321+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed92180 con 0x55dbaed73c40 2024-09-11T11:01:21.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.325+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.325+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed92180 con 0x55dbaed6f790 2024-09-11T11:01:21.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.325+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.325+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed92180 con 0x7f16f8069050 2024-09-11T11:01:21.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f15ba7e4640 20 reqs_thread_entry: start 2024-09-11T11:01:21.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:21.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 20 Filter name: none 2024-09-11T11:01:21.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f152bfff640 20 reqs_thread_entry: start 2024-09-11T11:01:21.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-11T11:01:21.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8c5d0 con 0x7f16f8069050 2024-09-11T11:01:21.331 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, user does not exist 2024-09-11T11:01:21.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-11T11:01:21.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-11T11:01:21.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f15bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:21.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.329+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94402019603360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed8ad40 con 0x55dbaed6f790 2024-09-11T11:01:21.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.333+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94402019603360] v32'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.333+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94402019578608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed83360 con 0x55dbaed73c40 2024-09-11T11:01:21.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.333+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94402019578608] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.333+0000 7f1707c12980 20 remove_watcher() i=0 2024-09-11T11:01:21.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.333+0000 7f1707c12980 2 removed watcher, disabling cache 2024-09-11T11:01:21.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.333+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94402019579760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7d2f0 con 0x55dbaed6f790 2024-09-11T11:01:21.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.337+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94402019579760] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x55dbaed6f790 2024-09-11T11:01:21.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.337+0000 7f1707c12980 20 remove_watcher() i=1 2024-09-11T11:01:21.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.337+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94402019585072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7d2f0 con 0x55dbaed73c40 2024-09-11T11:01:21.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.337+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94402019585072] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.337+0000 7f1707c12980 20 remove_watcher() i=2 2024-09-11T11:01:21.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.337+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94402019589760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7d2f0 con 0x7f16f8069050 2024-09-11T11:01:21.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.341+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94402019589760] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.341+0000 7f1707c12980 20 remove_watcher() i=3 2024-09-11T11:01:21.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.341+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94402019591968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7d2f0 con 0x55dbaed73c40 2024-09-11T11:01:21.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.345+0000 7f1705722640 1 -- 172.21.15.145:0/4109442895 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94402019591968] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16f8090040 con 0x55dbaed73c40 2024-09-11T11:01:21.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.345+0000 7f1707c12980 20 remove_watcher() i=4 2024-09-11T11:01:21.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.345+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94402019587264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7d2f0 con 0x55dbaed78ca0 2024-09-11T11:01:21.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.345+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94402019587264] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.345+0000 7f1707c12980 20 remove_watcher() i=5 2024-09-11T11:01:21.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.345+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94402019593536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7f4c0 con 0x55dbaed78ca0 2024-09-11T11:01:21.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.345+0000 7f1704f21640 1 -- 172.21.15.145:0/4109442895 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94402019593536] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f16fc0aaa80 con 0x55dbaed78ca0 2024-09-11T11:01:21.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.345+0000 7f1707c12980 20 remove_watcher() i=6 2024-09-11T11:01:21.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94402019602048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55dbaed7d2f0 con 0x7f16f8069050 2024-09-11T11:01:21.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94402019602048] v32'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f170000a4d0 con 0x7f16f8069050 2024-09-11T11:01:21.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 20 remove_watcher() i=7 2024-09-11T11:01:21.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed73c40 msgr2=0x55dbaed76030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed73c40 0x55dbaed76030 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaed6f790 msgr2=0x55dbaed71c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaed6f790 0x55dbaed71c50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f16f8069050 msgr2=0x7f16f80285d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f16f8069050 0x7f16f80285d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55dbaed78ca0 msgr2=0x55dbaed7b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55dbaed78ca0 0x55dbaed7b090 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15d00345b0 msgr2=0x7f15d0036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15d00345b0 0x7f15d0036a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0aafd0 tx=0x7f16fc0c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 msgr2=0x55dbaed646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/4109442895 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed5d4c0 0x55dbaed646c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f16f801a8e0 tx=0x7f16f8018ef0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 reap_dead start 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1705f23640 1 -- 172.21.15.145:0/4109442895 reap_dead start 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 shutdown_connections 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 >> 172.21.15.145:0/4109442895 conn(0x55dbaed598a0 msgr2=0x55dbaed57970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 shutdown_connections 2024-09-11T11:01:21.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/4109442895 wait complete. 2024-09-11T11:01:21.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/2196533093 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15dc034650 msgr2=0x7f15dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/2196533093 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15dc034650 0x7f15dc036b10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x55dbaed37580 tx=0x7f16fc005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/2196533093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed50d90 msgr2=0x55dbaed511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/2196533093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed50d90 0x55dbaed511b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f16f8024000 tx=0x7f16f8017d50 comp rx=0 tx=0).stop 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/2196533093 shutdown_connections 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/2196533093 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15dc034650 0x7f15dc036b10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/2196533093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaed50d90 0x55dbaed511b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/2196533093 >> 172.21.15.145:0/2196533093 conn(0x55dbaed45ee0 msgr2=0x55dbaed48960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/2196533093 shutdown_connections 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/2196533093 wait complete. 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed3b3e0 msgr2=0x55dbaed3d7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55dbaed3b3e0 0x55dbaed3d7d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaec44ec0 msgr2=0x55dbaed39f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55dbaec44ec0 0x55dbaed39f80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55dbaed40a60 msgr2=0x55dbaed42e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55dbaed40a60 0x55dbaed42e50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15ec034650 msgr2=0x7f15ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f15ec034650 0x7f15ec036b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f16fc0ae000 tx=0x7f16fc0a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:21.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 msgr2=0x55dbaed32f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 --2- 172.21.15.145:0/3854558941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55dbaebb3290 0x55dbaed32f90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x55dbaed2ce40 tx=0x7f16f8000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1705f23640 1 -- 172.21.15.145:0/3854558941 reap_dead start 2024-09-11T11:01:21.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 shutdown_connections 2024-09-11T11:01:21.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 >> 172.21.15.145:0/3854558941 conn(0x55dbaec39090 msgr2=0x55dbaed26410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 shutdown_connections 2024-09-11T11:01:21.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.349+0000 7f1707c12980 1 -- 172.21.15.145:0/3854558941 wait complete. 2024-09-11T11:01:21.363 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T11:01:21.364 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-11T11:01:21.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-11T11:01:21.364 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-11T11:01:21.441 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:21.441 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:21.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd65a8c7980 1 Processor -- start 2024-09-11T11:01:21.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd65a8c7980 1 -- start start 2024-09-11T11:01:21.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd65a8c7980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556d5d926e90 0x556d5d929280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd65a8c7980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556d5d7a8ae0 con 0x556d5d894ac0 2024-09-11T11:01:21.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd65a8c7980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x556d5d7cce30 con 0x556d5d926e90 2024-09-11T11:01:21.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd657bd6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556d5d926e90 0x556d5d929280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd6583d7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x556d5d894ac0 0x556d5d925770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48516/0 (socket says 172.21.15.145:48516) 2024-09-11T11:01:21.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd6583d7640 1 -- 172.21.15.145:0/892049681 learned_addr learned my addr 172.21.15.145:0/892049681 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:21.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd657bd6640 1 --2- 172.21.15.145:0/892049681 >> v2:172.21.15.102:3300/0 conn(0x556d5d926e90 0x556d5d929280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48070/0 (socket says 172.21.15.145:48070) 2024-09-11T11:01:21.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd657bd6640 1 -- 172.21.15.145:0/892049681 >> v1:172.21.15.102:6789/0 conn(0x556d5d894ac0 legacy=0x556d5d925770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd6573d5640 1 -- 172.21.15.145:0/892049681 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206444518 0 0) 0x556d5d7a8ae0 con 0x556d5d894ac0 2024-09-11T11:01:21.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.441+0000 7fd657bd6640 1 -- 172.21.15.145:0/892049681 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5d894ea0 con 0x556d5d926e90 2024-09-11T11:01:21.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd657bd6640 1 --2- 172.21.15.145:0/892049681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d926e90 0x556d5d929280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd64000a480 tx=0x7fd64001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5538d531378752d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd6573d5640 1 -- 172.21.15.145:0/892049681 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6400b0070 con 0x556d5d926e90 2024-09-11T11:01:21.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd6573d5640 1 -- 172.21.15.145:0/892049681 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6400ab540 con 0x556d5d926e90 2024-09-11T11:01:21.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd6573d5640 1 -- 172.21.15.145:0/892049681 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6400ab840 con 0x556d5d926e90 2024-09-11T11:01:21.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd65a8c7980 1 -- 172.21.15.145:0/892049681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d926e90 msgr2=0x556d5d929280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/892049681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d926e90 0x556d5d929280 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd64000a480 tx=0x7fd64001b280 comp rx=0 tx=0).stop 2024-09-11T11:01:21.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd65a8c7980 1 -- 172.21.15.145:0/892049681 shutdown_connections 2024-09-11T11:01:21.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/892049681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d926e90 0x556d5d929280 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd65a8c7980 1 -- 172.21.15.145:0/892049681 >> 172.21.15.145:0/892049681 conn(0x556d5d91b060 msgr2=0x556d5d91d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd65a8c7980 1 -- 172.21.15.145:0/892049681 shutdown_connections 2024-09-11T11:01:21.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.445+0000 7fd65a8c7980 1 -- 172.21.15.145:0/892049681 wait complete. 2024-09-11T11:01:21.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd65a8c7980 1 Processor -- start 2024-09-11T11:01:21.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd65a8c7980 1 -- start start 2024-09-11T11:01:21.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd65a8c7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da0daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd65a8c7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d5d7ce200 con 0x556d5d894ac0 2024-09-11T11:01:21.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da0daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da0daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48084/0 (socket says 172.21.15.145:48084) 2024-09-11T11:01:21.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd6583d7640 1 -- 172.21.15.145:0/2297653733 learned_addr learned my addr 172.21.15.145:0/2297653733 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd6583d7640 1 -- 172.21.15.145:0/2297653733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5da0e070 con 0x556d5d894ac0 2024-09-11T11:01:21.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2297653733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da0daa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd65000b250 tx=0x7fd65000b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ffcb1258dce807 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd54660c640 1 -- 172.21.15.145:0/2297653733 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65000d640 con 0x556d5d894ac0 2024-09-11T11:01:21.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd54660c640 1 -- 172.21.15.145:0/2297653733 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650008070 con 0x556d5d894ac0 2024-09-11T11:01:21.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.461+0000 7fd54660c640 1 -- 172.21.15.145:0/2297653733 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65000d990 con 0x556d5d894ac0 2024-09-11T11:01:21.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2297653733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 msgr2=0x556d5da0daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2297653733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da0daa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd65000b250 tx=0x7fd65000b710 comp rx=0 tx=0).stop 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2297653733 shutdown_connections 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2297653733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da0daa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2297653733 >> 172.21.15.145:0/2297653733 conn(0x556d5d91b060 msgr2=0x556d5da096d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2297653733 shutdown_connections 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2297653733 wait complete. 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 Processor -- start 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- start start 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da14eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d5d92c250 con 0x556d5d894ac0 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da14eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da14eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48086/0 (socket says 172.21.15.145:48086) 2024-09-11T11:01:21.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd6583d7640 1 -- 172.21.15.145:0/2418927076 learned_addr learned my addr 172.21.15.145:0/2418927076 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd6583d7640 1 -- 172.21.15.145:0/2418927076 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5da153f0 con 0x556d5d894ac0 2024-09-11T11:01:21.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da14eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd650000c10 tx=0x7fd650000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd544e09640 1 -- 172.21.15.145:0/2418927076 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65001a7c0 con 0x556d5d894ac0 2024-09-11T11:01:21.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd544e09640 1 -- 172.21.15.145:0/2418927076 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65001a960 con 0x556d5d894ac0 2024-09-11T11:01:21.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd544e09640 1 -- 172.21.15.145:0/2418927076 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65001ac60 con 0x556d5d894ac0 2024-09-11T11:01:21.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d5da15680 con 0x556d5d894ac0 2024-09-11T11:01:21.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.465+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d5da18360 con 0x556d5d894ac0 2024-09-11T11:01:21.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd544e09640 1 -- 172.21.15.145:0/2418927076 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd650017070 con 0x556d5d894ac0 2024-09-11T11:01:21.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd544e09640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5400346f0 0x7fd540036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd544e09640 1 -- 172.21.15.145:0/2418927076 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fd650015020 con 0x556d5d894ac0 2024-09-11T11:01:21.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5400346f0 0x7fd540036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5d926e90 0x556d5da1be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da1c4f0 con 0x556d5d926e90 2024-09-11T11:01:21.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd658bd8640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5d926e90 0x556d5da1be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5400346f0 0x7fd540036bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ad000 tx=0x7fd6400a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd658bd8640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5d926e90 0x556d5da1be80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd658bd8640 1 -- 172.21.15.145:0/2418927076 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5d926e90 2024-09-11T11:01:21.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da1d2e0 0x556d5da1f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da1fd10 con 0x556d5da1d2e0 2024-09-11T11:01:21.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da1d2e0 0x556d5da1f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da1d2e0 0x556d5da1f6d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd6583d7640 1 -- 172.21.15.145:0/2418927076 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd65002e070 con 0x556d5da1d2e0 2024-09-11T11:01:21.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.469+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da215c0 con 0x556d5da1d2e0 2024-09-11T11:01:21.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd6583d7640 1 -- 172.21.15.145:0/2418927076 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd65002e070 con 0x556d5da1d2e0 2024-09-11T11:01:21.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da207f0 con 0x556d5da1d2e0 2024-09-11T11:01:21.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd6583d7640 1 -- 172.21.15.145:0/2418927076 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd65002e070 con 0x556d5da1d2e0 2024-09-11T11:01:21.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556d5da22970 0x556d5da24d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da252a0 con 0x556d5da22970 2024-09-11T11:01:21.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556d5da22970 0x556d5da24d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556d5da22970 0x556d5da24d60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd657bd6640 1 -- 172.21.15.145:0/2418927076 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd6400b3040 con 0x556d5da22970 2024-09-11T11:01:21.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd65a8c7980 1 Processor -- start 2024-09-11T11:01:21.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd65a8c7980 1 -- start start 2024-09-11T11:01:21.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd65a8c7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da32d30 0x556d5da33150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd65a8c7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d5d827800 con 0x556d5da32d30 2024-09-11T11:01:21.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da32d30 0x556d5da33150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da32d30 0x556d5da33150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48096/0 (socket says 172.21.15.145:48096) 2024-09-11T11:01:21.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd6583d7640 1 -- 172.21.15.145:0/2873402645 learned_addr learned my addr 172.21.15.145:0/2873402645 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.473+0000 7fd6583d7640 1 -- 172.21.15.145:0/2873402645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5da33690 con 0x556d5da32d30 2024-09-11T11:01:21.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2873402645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da32d30 0x556d5da33150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd650048d50 tx=0x7fd650019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd53dffb640 1 -- 172.21.15.145:0/2873402645 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650042070 con 0x556d5da32d30 2024-09-11T11:01:21.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2873402645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d5da33920 con 0x556d5da32d30 2024-09-11T11:01:21.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd53dffb640 1 -- 172.21.15.145:0/2873402645 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65004a490 con 0x556d5da32d30 2024-09-11T11:01:21.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2873402645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d5da365a0 con 0x556d5da32d30 2024-09-11T11:01:21.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd53dffb640 1 -- 172.21.15.145:0/2873402645 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65004f060 con 0x556d5da32d30 2024-09-11T11:01:21.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd53dffb640 1 -- 172.21.15.145:0/2873402645 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd65004a0b0 con 0x556d5da32d30 2024-09-11T11:01:21.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd53dffb640 1 --2- 172.21.15.145:0/2873402645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5300345b0 0x7fd530036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd53dffb640 1 -- 172.21.15.145:0/2873402645 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fd650010070 con 0x556d5da32d30 2024-09-11T11:01:21.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2873402645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5300345b0 0x7fd530036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd65a8c7980 1 Processor -- start 2024-09-11T11:01:21.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd65a8c7980 1 -- start start 2024-09-11T11:01:21.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd65a8c7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da3f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd65a8c7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d5da0e3f0 con 0x556d5da3f610 2024-09-11T11:01:21.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2873402645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5300345b0 0x7fd530036a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd640000c10 tx=0x7fd640005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da3f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da3f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48112/0 (socket says 172.21.15.145:48112) 2024-09-11T11:01:21.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd6583d7640 1 -- 172.21.15.145:0/1750698380 learned_addr learned my addr 172.21.15.145:0/1750698380 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd6583d7640 1 -- 172.21.15.145:0/1750698380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5da3ffc0 con 0x556d5da3f610 2024-09-11T11:01:21.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.477+0000 7fd6583d7640 1 --2- 172.21.15.145:0/1750698380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da3f9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd65001df70 tx=0x7fd65000fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5931834c226e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd5377fe640 1 -- 172.21.15.145:0/1750698380 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65003d470 con 0x556d5da3f610 2024-09-11T11:01:21.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd5377fe640 1 -- 172.21.15.145:0/1750698380 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd650029e20 con 0x556d5da3f610 2024-09-11T11:01:21.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd5377fe640 1 -- 172.21.15.145:0/1750698380 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650028c40 con 0x556d5da3f610 2024-09-11T11:01:21.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- 172.21.15.145:0/1750698380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 msgr2=0x556d5da3f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/1750698380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da3f9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd65001df70 tx=0x7fd65000fa80 comp rx=0 tx=0).stop 2024-09-11T11:01:21.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- 172.21.15.145:0/1750698380 shutdown_connections 2024-09-11T11:01:21.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/1750698380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da3f9f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- 172.21.15.145:0/1750698380 >> 172.21.15.145:0/1750698380 conn(0x556d5da3b9f0 msgr2=0x556d5da39af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- 172.21.15.145:0/1750698380 shutdown_connections 2024-09-11T11:01:21.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- 172.21.15.145:0/1750698380 wait complete. 2024-09-11T11:01:21.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 Processor -- start 2024-09-11T11:01:21.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- start start 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da46750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556d5da40460 con 0x556d5da3f610 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da46750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd6583d7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da46750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48116/0 (socket says 172.21.15.145:48116) 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 learned_addr learned my addr 172.21.15.145:0/2045673135 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d5da46c90 con 0x556d5da3f610 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da46750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd650013e60 tx=0x7fd650005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd535ffb640 1 -- 172.21.15.145:0/2045673135 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd650065040 con 0x556d5da3f610 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556d5da46c90 con 0x556d5da3f610 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd535ffb640 1 -- 172.21.15.145:0/2045673135 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65003d8d0 con 0x556d5da3f610 2024-09-11T11:01:21.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd535ffb640 1 -- 172.21.15.145:0/2045673135 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd65003d470 con 0x556d5da3f610 2024-09-11T11:01:21.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.481+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d5da47100 con 0x556d5da3f610 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd535ffb640 1 -- 172.21.15.145:0/2045673135 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd650071020 con 0x556d5da3f610 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd535ffb640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd528034650 0x7fd528036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd535ffb640 1 -- 172.21.15.145:0/2045673135 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fd65006f020 con 0x556d5da3f610 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5da518b0 0x556d5da53d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd528034650 0x7fd528036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da544a0 con 0x556d5da518b0 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd658bd8640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5da518b0 0x556d5da53d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd528034650 0x7fd528036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ab510 tx=0x7fd6400b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd658bd8640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5da518b0 0x556d5da53d50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 20 realm 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da50da0 con 0x556d5da518b0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da54f70 con 0x556d5da518b0 2024-09-11T11:01:21.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da55d50 0x556d5da58140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da55d50 0x556d5da58140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.485+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da55d50 0x556d5da58140 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd65a8c7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da59010 con 0x556d5da55d50 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd65a8c7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd65a8c7980 20 searching for the correct realm 2024-09-11T11:01:21.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556d5da5a890 0x556d5da5cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5d420 con 0x556d5da5a890 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556d5da5a890 0x556d5da5cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd657bd6640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556d5da5a890 0x556d5da5cd50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5d420 con 0x556d5da55d50 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd6583d7640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd650060030 0x7fd650054870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x7fd650060030 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd658bd8640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd650060030 0x7fd650054870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd658bd8640 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd650060030 0x7fd650054870 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da5a890 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.489+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x7fd650060030 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x7fd650060030 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da5a890 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.493+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da5a890 2024-09-11T11:01:21.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da5a890 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x7fd650060030 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da518b0 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x7fd650060030 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da5a890 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x7fd650060030 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.497+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da5a890 2024-09-11T11:01:21.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556d5da587c0 con 0x556d5da55d50 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da58ce0 con 0x556d5da518b0 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.501+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da590d0 con 0x556d5da55d50 2024-09-11T11:01:21.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:21.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da590d0 con 0x7fd650060030 2024-09-11T11:01:21.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:21.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 zone default found 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 4 Realm: () 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 zonegroup default 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5d8a0 con 0x7fd650060030 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5f680 con 0x556d5da5a890 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5fb10 con 0x556d5da5a890 2024-09-11T11:01:21.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 started sync module instance, tier type = 2024-09-11T11:01:21.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:21.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5eac0 con 0x556d5da55d50 2024-09-11T11:01:21.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93928210952128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5eac0 con 0x556d5da55d50 2024-09-11T11:01:21.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.505+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da605d0 con 0x556d5da518b0 2024-09-11T11:01:21.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.509+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.509+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93928210956512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da60500 con 0x556d5da518b0 2024-09-11T11:01:21.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.509+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da61500 con 0x556d5da55d50 2024-09-11T11:01:21.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.509+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93928210952128] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.509+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93928210956512] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.509+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.509+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93928210958832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da61010 con 0x556d5da55d50 2024-09-11T11:01:21.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.509+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da61da0 con 0x7fd650060030 2024-09-11T11:01:21.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.513+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.513+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93928210962672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da61010 con 0x7fd650060030 2024-09-11T11:01:21.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.513+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da62820 con 0x556d5da55d50 2024-09-11T11:01:21.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.513+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93928210958832] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.513+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93928210962672] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.513+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.513+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93928210963728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da62330 con 0x556d5da55d50 2024-09-11T11:01:21.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.513+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da630c0 con 0x556d5da5a890 2024-09-11T11:01:21.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.517+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.517+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93928210967568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da62330 con 0x556d5da5a890 2024-09-11T11:01:21.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.517+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da63e20 con 0x556d5da5a890 2024-09-11T11:01:21.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.517+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93928210963728] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.517+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93928210967568] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.521+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.521+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93928210969696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5e720 con 0x556d5da5a890 2024-09-11T11:01:21.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.521+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da64970 con 0x7fd650060030 2024-09-11T11:01:21.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93928210969696] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93928210973760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da64930 con 0x7fd650060030 2024-09-11T11:01:21.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd65a8c7980 20 add_watcher() i=0 2024-09-11T11:01:21.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd65a8c7980 20 add_watcher() i=1 2024-09-11T11:01:21.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd65a8c7980 20 add_watcher() i=2 2024-09-11T11:01:21.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd65a8c7980 20 add_watcher() i=3 2024-09-11T11:01:21.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd65a8c7980 20 add_watcher() i=4 2024-09-11T11:01:21.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd65a8c7980 20 add_watcher() i=5 2024-09-11T11:01:21.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.525+0000 7fd65a8c7980 20 add_watcher() i=6 2024-09-11T11:01:21.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93928210973760] v32'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd65a8c7980 20 add_watcher() i=7 2024-09-11T11:01:21.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd65a8c7980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:21.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da67f30 con 0x556d5da518b0 2024-09-11T11:01:21.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93928210970752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da653e0 con 0x556d5da518b0 2024-09-11T11:01:21.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93928210970752] v32'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd50e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:21.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd65a8c7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:21.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd65a8c7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:21.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.529+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da67be0 con 0x556d5da55d50 2024-09-11T11:01:21.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.533+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.533+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da67c90 con 0x7fd650060030 2024-09-11T11:01:21.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.537+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.537+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da70fc0 con 0x556d5da5a890 2024-09-11T11:01:21.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.537+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.537+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da71530 con 0x556d5da518b0 2024-09-11T11:01:21.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.541+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'37 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.541+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da71aa0 con 0x556d5da55d50 2024-09-11T11:01:21.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.541+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.541+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da71aa0 con 0x556d5da5a890 2024-09-11T11:01:21.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.541+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.541+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da71f50 con 0x556d5da55d50 2024-09-11T11:01:21.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.545+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.545+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da71f50 con 0x556d5da518b0 2024-09-11T11:01:21.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.549+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.549+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da724c0 con 0x556d5da55d50 2024-09-11T11:01:21.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.549+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.549+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da724c0 con 0x556d5da55d50 2024-09-11T11:01:21.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.553+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.553+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da724c0 con 0x556d5da55d50 2024-09-11T11:01:21.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.553+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.553+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da724c0 con 0x556d5da5a890 2024-09-11T11:01:21.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.557+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.557+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72970 con 0x556d5da55d50 2024-09-11T11:01:21.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.561+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.561+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72970 con 0x556d5da518b0 2024-09-11T11:01:21.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.561+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'23 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.561+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a00 con 0x556d5da518b0 2024-09-11T11:01:21.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.565+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.565+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a00 con 0x556d5da55d50 2024-09-11T11:01:21.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.565+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.565+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a90 con 0x556d5da55d50 2024-09-11T11:01:21.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.569+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.569+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a90 con 0x556d5da5a890 2024-09-11T11:01:21.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.569+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.569+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a90 con 0x556d5da55d50 2024-09-11T11:01:21.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.573+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.573+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a90 con 0x556d5da518b0 2024-09-11T11:01:21.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.577+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.577+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a90 con 0x556d5da55d50 2024-09-11T11:01:21.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.577+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.577+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a90 con 0x556d5da55d50 2024-09-11T11:01:21.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.581+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.581+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da72a90 con 0x556d5da5a890 2024-09-11T11:01:21.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.585+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.585+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x556d5da55d50 2024-09-11T11:01:21.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.585+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'18 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.585+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x556d5da5a890 2024-09-11T11:01:21.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.589+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.589+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x556d5da5a890 2024-09-11T11:01:21.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.589+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.589+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x556d5da5a890 2024-09-11T11:01:21.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.593+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.593+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x556d5da55d50 2024-09-11T11:01:21.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.597+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.597+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x556d5da518b0 2024-09-11T11:01:21.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.597+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.597+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x556d5da55d50 2024-09-11T11:01:21.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.601+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.601+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x556d5da518b0 2024-09-11T11:01:21.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.605+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.605+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da73060 con 0x7fd650060030 2024-09-11T11:01:21.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.605+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd50d7e2640 20 reqs_thread_entry: start 2024-09-11T11:01:21.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:21.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 20 Filter name: none 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd47effd640 20 reqs_thread_entry: start 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556d5da8e090 con 0x7fd650060030 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:21.611 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, user does not exist 2024-09-11T11:01:21.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd50e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:21.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.609+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93928210970752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da707d0 con 0x556d5da518b0 2024-09-11T11:01:21.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.613+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93928210970752] v32'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.613+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93928210952128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da63880 con 0x556d5da55d50 2024-09-11T11:01:21.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.613+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93928210952128] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.613+0000 7fd65a8c7980 20 remove_watcher() i=0 2024-09-11T11:01:21.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.613+0000 7fd65a8c7980 2 removed watcher, disabling cache 2024-09-11T11:01:21.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.613+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93928210956512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5efc0 con 0x556d5da518b0 2024-09-11T11:01:21.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.617+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93928210956512] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x556d5da518b0 2024-09-11T11:01:21.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.617+0000 7fd65a8c7980 20 remove_watcher() i=1 2024-09-11T11:01:21.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.617+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93928210958832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5efc0 con 0x556d5da55d50 2024-09-11T11:01:21.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.621+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93928210958832] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.621+0000 7fd65a8c7980 20 remove_watcher() i=2 2024-09-11T11:01:21.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.621+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93928210962672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5efc0 con 0x7fd650060030 2024-09-11T11:01:21.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.621+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93928210962672] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.621+0000 7fd65a8c7980 20 remove_watcher() i=3 2024-09-11T11:01:21.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.621+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93928210963728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5efc0 con 0x556d5da55d50 2024-09-11T11:01:21.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd6583d7640 1 -- 172.21.15.145:0/2045673135 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93928210963728] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd650068040 con 0x556d5da55d50 2024-09-11T11:01:21.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd65a8c7980 20 remove_watcher() i=4 2024-09-11T11:01:21.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93928210967568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5efc0 con 0x556d5da5a890 2024-09-11T11:01:21.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93928210967568] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd65a8c7980 20 remove_watcher() i=5 2024-09-11T11:01:21.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93928210969696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5efc0 con 0x556d5da5a890 2024-09-11T11:01:21.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd657bd6640 1 -- 172.21.15.145:0/2045673135 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93928210969696] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6400c9030 con 0x556d5da5a890 2024-09-11T11:01:21.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd65a8c7980 20 remove_watcher() i=6 2024-09-11T11:01:21.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.625+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93928210973760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556d5da5efc0 con 0x7fd650060030 2024-09-11T11:01:21.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93928210973760] v32'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd64800a4d0 con 0x7fd650060030 2024-09-11T11:01:21.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 20 remove_watcher() i=7 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da55d50 msgr2=0x556d5da58140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da55d50 0x556d5da58140 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5da518b0 msgr2=0x556d5da53d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5da518b0 0x556d5da53d50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd650060030 msgr2=0x7fd650054870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd650060030 0x7fd650054870 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556d5da5a890 msgr2=0x556d5da5cd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556d5da5a890 0x556d5da5cd50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd528034650 msgr2=0x7fd528036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd528034650 0x7fd528036b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ab510 tx=0x7fd6400b9040 comp rx=0 tx=0).stop 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd658bd8640 1 -- 172.21.15.145:0/2045673135 reap_dead start 2024-09-11T11:01:21.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 msgr2=0x556d5da46750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da46750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd650013e60 tx=0x7fd650005f00 comp rx=0 tx=0).stop 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 shutdown_connections 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2045673135 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da3f610 0x556d5da46750 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 >> 172.21.15.145:0/2045673135 conn(0x556d5da3b9f0 msgr2=0x556d5da39ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 shutdown_connections 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2045673135 wait complete. 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2873402645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5300345b0 msgr2=0x7fd530036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2873402645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5300345b0 0x7fd530036a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd640000c10 tx=0x7fd640005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2873402645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da32d30 msgr2=0x556d5da33150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2873402645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da32d30 0x556d5da33150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd650048d50 tx=0x7fd650019530 comp rx=0 tx=0).stop 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2873402645 shutdown_connections 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2873402645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5300345b0 0x7fd530036a70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2873402645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5da32d30 0x556d5da33150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2873402645 >> 172.21.15.145:0/2873402645 conn(0x556d5da27e80 msgr2=0x556d5da2a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2873402645 shutdown_connections 2024-09-11T11:01:21.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.629+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2873402645 wait complete. 2024-09-11T11:01:21.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da1d2e0 msgr2=0x556d5da1f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556d5da1d2e0 0x556d5da1f6d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5d926e90 msgr2=0x556d5da1be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556d5d926e90 0x556d5da1be80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556d5da22970 msgr2=0x556d5da24d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556d5da22970 0x556d5da24d60 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5400346f0 msgr2=0x7fd540036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd5400346f0 0x7fd540036bb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd6400ad000 tx=0x7fd6400a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:21.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 msgr2=0x556d5da14eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 --2- 172.21.15.145:0/2418927076 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556d5d894ac0 0x556d5da14eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd650000c10 tx=0x7fd650000ee0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd658bd8640 1 -- 172.21.15.145:0/2418927076 reap_dead start 2024-09-11T11:01:21.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 shutdown_connections 2024-09-11T11:01:21.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 >> 172.21.15.145:0/2418927076 conn(0x556d5d91b060 msgr2=0x556d5da08250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 shutdown_connections 2024-09-11T11:01:21.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.633+0000 7fd65a8c7980 1 -- 172.21.15.145:0/2418927076 wait complete. 2024-09-11T11:01:21.651 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T11:01:21.651 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-11T11:01:21.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-11T11:01:21.651 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-11T11:01:21.730 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:21.730 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:21.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1acd1c980 1 Processor -- start 2024-09-11T11:01:21.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1acd1c980 1 -- start start 2024-09-11T11:01:21.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1acd1c980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5613ad38eac0 0x5613ad390eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1acd1c980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5613ad212ae0 con 0x5613ad2ff290 2024-09-11T11:01:21.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1acd1c980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5613ad236e30 con 0x5613ad38eac0 2024-09-11T11:01:21.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1aa02b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5613ad38eac0 0x5613ad390eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1aa82c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x5613ad2ff290 0x5613ad38d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48522/0 (socket says 172.21.15.145:48522) 2024-09-11T11:01:21.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1aa82c640 1 -- 172.21.15.145:0/1602959522 learned_addr learned my addr 172.21.15.145:0/1602959522 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:21.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1aa02b640 1 -- 172.21.15.145:0/1602959522 >> v1:172.21.15.102:6789/0 conn(0x5613ad2ff290 legacy=0x5613ad38d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.729+0000 7fc1aa02b640 1 -- 172.21.15.145:0/1602959522 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad2ff820 con 0x5613ad38eac0 2024-09-11T11:01:21.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/1602959522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38eac0 0x5613ad390eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000a480 tx=0x7fc1a001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d58e1d6b76f6c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1a982a640 1 -- 172.21.15.145:0/1602959522 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a00b0070 con 0x5613ad38eac0 2024-09-11T11:01:21.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1a982a640 1 -- 172.21.15.145:0/1602959522 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a00ab540 con 0x5613ad38eac0 2024-09-11T11:01:21.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1a982a640 1 -- 172.21.15.145:0/1602959522 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1a00ab840 con 0x5613ad38eac0 2024-09-11T11:01:21.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1602959522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38eac0 msgr2=0x5613ad390eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/1602959522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38eac0 0x5613ad390eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000a480 tx=0x7fc1a001b280 comp rx=0 tx=0).stop 2024-09-11T11:01:21.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1602959522 shutdown_connections 2024-09-11T11:01:21.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/1602959522 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38eac0 0x5613ad390eb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1602959522 >> 172.21.15.145:0/1602959522 conn(0x5613ad385090 msgr2=0x5613ad3874b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1602959522 shutdown_connections 2024-09-11T11:01:21.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.733+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1602959522 wait complete. 2024-09-11T11:01:21.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1acd1c980 1 Processor -- start 2024-09-11T11:01:21.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1acd1c980 1 -- start start 2024-09-11T11:01:21.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1acd1c980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad475a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1acd1c980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5613ad238200 con 0x5613ad2ff290 2024-09-11T11:01:21.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad475a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad475a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48134/0 (socket says 172.21.15.145:48134) 2024-09-11T11:01:21.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1aa82c640 1 -- 172.21.15.145:0/330576809 learned_addr learned my addr 172.21.15.145:0/330576809 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1aa82c640 1 -- 172.21.15.145:0/330576809 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad475fd0 con 0x5613ad2ff290 2024-09-11T11:01:21.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/330576809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad475a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc19c001d90 tx=0x7fc19c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18ce9334e1334a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc098e09640 1 -- 172.21.15.145:0/330576809 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c013030 con 0x5613ad2ff290 2024-09-11T11:01:21.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc098e09640 1 -- 172.21.15.145:0/330576809 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c00e690 con 0x5613ad2ff290 2024-09-11T11:01:21.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.749+0000 7fc098e09640 1 -- 172.21.15.145:0/330576809 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c00ea10 con 0x5613ad2ff290 2024-09-11T11:01:21.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- 172.21.15.145:0/330576809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 msgr2=0x5613ad475a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/330576809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad475a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc19c001d90 tx=0x7fc19c001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- 172.21.15.145:0/330576809 shutdown_connections 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/330576809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad475a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- 172.21.15.145:0/330576809 >> 172.21.15.145:0/330576809 conn(0x5613ad385090 msgr2=0x5613ad471630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- 172.21.15.145:0/330576809 shutdown_connections 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- 172.21.15.145:0/330576809 wait complete. 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 Processor -- start 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- start start 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad47cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5613ad391f00 con 0x5613ad2ff290 2024-09-11T11:01:21.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad47cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad47cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48146/0 (socket says 172.21.15.145:48146) 2024-09-11T11:01:21.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3918554206 learned_addr learned my addr 172.21.15.145:0/3918554206 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3918554206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad47d290 con 0x5613ad2ff290 2024-09-11T11:01:21.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad47cd50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5613ad476be0 tx=0x7fc19c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc097606640 1 -- 172.21.15.145:0/3918554206 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c027070 con 0x5613ad2ff290 2024-09-11T11:01:21.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613ad47d520 con 0x5613ad2ff290 2024-09-11T11:01:21.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc097606640 1 -- 172.21.15.145:0/3918554206 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c019900 con 0x5613ad2ff290 2024-09-11T11:01:21.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc097606640 1 -- 172.21.15.145:0/3918554206 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c019c20 con 0x5613ad2ff290 2024-09-11T11:01:21.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.753+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ad480200 con 0x5613ad2ff290 2024-09-11T11:01:21.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc097606640 1 -- 172.21.15.145:0/3918554206 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc19c02a070 con 0x5613ad2ff290 2024-09-11T11:01:21.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc097606640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc090034650 0x7fc090036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc097606640 1 -- 172.21.15.145:0/3918554206 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc19c01f070 con 0x5613ad2ff290 2024-09-11T11:01:21.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc090034650 0x7fc090036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad38eac0 0x5613ad483d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad484360 con 0x5613ad38eac0 2024-09-11T11:01:21.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1ab02d640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad38eac0 0x5613ad483d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc090034650 0x7fc090036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1a00ad000 tx=0x7fc1a00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1ab02d640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad38eac0 0x5613ad483d20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3918554206 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad38eac0 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad485150 0x5613ad487540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad487b80 con 0x5613ad485150 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad485150 0x5613ad487540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad485150 0x5613ad487540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3918554206 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc19c029030 con 0x5613ad485150 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.757+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad489430 con 0x5613ad485150 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3918554206 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc19c029030 con 0x5613ad485150 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4885a0 con 0x5613ad485150 2024-09-11T11:01:21.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3918554206 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc19c029030 con 0x5613ad485150 2024-09-11T11:01:21.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5613ad48a7e0 0x5613ad48cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad48d110 con 0x5613ad48a7e0 2024-09-11T11:01:21.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5613ad48a7e0 0x5613ad48cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5613ad48a7e0 0x5613ad48cbd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3918554206 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc1a00b3040 con 0x5613ad48a7e0 2024-09-11T11:01:21.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1acd1c980 1 Processor -- start 2024-09-11T11:01:21.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1acd1c980 1 -- start start 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1acd1c980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38ad00 0x5613ad389380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1acd1c980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5613ad291800 con 0x5613ad38ad00 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38ad00 0x5613ad389380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38ad00 0x5613ad389380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48158/0 (socket says 172.21.15.145:48158) 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa82c640 1 -- 172.21.15.145:0/2879585134 learned_addr learned my addr 172.21.15.145:0/2879585134 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa82c640 1 -- 172.21.15.145:0/2879585134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad38b120 con 0x5613ad38ad00 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.761+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/2879585134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38ad00 0x5613ad389380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00bc00 tx=0x7fc19c00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc094e01640 1 -- 172.21.15.145:0/2879585134 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c032a70 con 0x5613ad38ad00 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1acd1c980 1 -- 172.21.15.145:0/2879585134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613ad389920 con 0x5613ad38ad00 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc094e01640 1 -- 172.21.15.145:0/2879585134 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c032c10 con 0x5613ad38ad00 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc094e01640 1 -- 172.21.15.145:0/2879585134 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c041170 con 0x5613ad38ad00 2024-09-11T11:01:21.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1acd1c980 1 -- 172.21.15.145:0/2879585134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ad389df0 con 0x5613ad38ad00 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc094e01640 1 -- 172.21.15.145:0/2879585134 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc19c051030 con 0x5613ad38ad00 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc094e01640 1 --2- 172.21.15.145:0/2879585134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc084034650 0x7fc084036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc094e01640 1 -- 172.21.15.145:0/2879585134 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc19c014070 con 0x5613ad38ad00 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/2879585134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc084034650 0x7fc084036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1acd1c980 1 Processor -- start 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1acd1c980 1 -- start start 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/2879585134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc084034650 0x7fc084036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5613ad481340 tx=0x7fc1a0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1acd1c980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4a9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1acd1c980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5613ad476350 con 0x5613ad4a9680 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4a9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4a9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48170/0 (socket says 172.21.15.145:48170) 2024-09-11T11:01:21.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1aa82c640 1 -- 172.21.15.145:0/1401102922 learned_addr learned my addr 172.21.15.145:0/1401102922 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1aa82c640 1 -- 172.21.15.145:0/1401102922 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad4aa030 con 0x5613ad4a9680 2024-09-11T11:01:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/1401102922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4a9a60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc19c01a1b0 tx=0x7fc19c02ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb1bb3f7232520d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc08e7fc640 1 -- 172.21.15.145:0/1401102922 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c05a040 con 0x5613ad4a9680 2024-09-11T11:01:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc08e7fc640 1 -- 172.21.15.145:0/1401102922 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c063070 con 0x5613ad4a9680 2024-09-11T11:01:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.765+0000 7fc08e7fc640 1 -- 172.21.15.145:0/1401102922 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c048d90 con 0x5613ad4a9680 2024-09-11T11:01:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1401102922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 msgr2=0x5613ad4a9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/1401102922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4a9a60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc19c01a1b0 tx=0x7fc19c02ef60 comp rx=0 tx=0).stop 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1401102922 shutdown_connections 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/1401102922 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4a9a60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1401102922 >> 172.21.15.145:0/1401102922 conn(0x5613ad4a5a60 msgr2=0x5613ad4a3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1401102922 shutdown_connections 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- 172.21.15.145:0/1401102922 wait complete. 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 Processor -- start 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- start start 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5613ad4aa4d0 con 0x5613ad4a9680 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1aa82c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48182/0 (socket says 172.21.15.145:48182) 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 learned_addr learned my addr 172.21.15.145:0/3209530212 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ad4b0da0 con 0x5613ad4a9680 2024-09-11T11:01:21.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4b0860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0472d0 tx=0x7fc19c02e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc08cff9640 1 -- 172.21.15.145:0/3209530212 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c02a900 con 0x5613ad4a9680 2024-09-11T11:01:21.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5613ad4b0da0 con 0x5613ad4a9680 2024-09-11T11:01:21.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc08cff9640 1 -- 172.21.15.145:0/3209530212 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc19c06e070 con 0x5613ad4a9680 2024-09-11T11:01:21.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ad4b1210 con 0x5613ad4a9680 2024-09-11T11:01:21.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc08cff9640 1 -- 172.21.15.145:0/3209530212 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc19c02e0d0 con 0x5613ad4a9680 2024-09-11T11:01:21.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc08cff9640 1 -- 172.21.15.145:0/3209530212 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc19c078060 con 0x5613ad4a9680 2024-09-11T11:01:21.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc08cff9640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc074034650 0x7fc074036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.769+0000 7fc08cff9640 1 -- 172.21.15.145:0/3209530212 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc19c005050 con 0x5613ad4a9680 2024-09-11T11:01:21.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc074034650 0x7fc074036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad4bb9e0 0x5613ad4bdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4be5f0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1ab02d640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad4bb9e0 0x5613ad4bdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc074034650 0x7fc074036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0018eb0 tx=0x7fc1a00b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1ab02d640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad4bb9e0 0x5613ad4bdea0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 realm 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4bae10 con 0x5613ad4bb9e0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4bf0b0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad4bfe90 0x5613ad4c2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c2930 con 0x5613ad4bfe90 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad4bfe90 0x5613ad4c2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad4bfe90 0x5613ad4c2280 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.773+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c2e70 con 0x5613ad4bfe90 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1acd1c980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:21.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1acd1c980 20 searching for the correct realm 2024-09-11T11:01:21.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5613ad4c4650 0x5613ad4c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c71e0 con 0x5613ad4c4650 2024-09-11T11:01:21.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5613ad4c4650 0x5613ad4c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa02b640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5613ad4c4650 0x5613ad4c6b10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c71e0 con 0x5613ad4bfe90 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v25'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa82c640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc19c0863f0 0x7fc19c05e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x7fc19c0863f0 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc19c0863f0 0x7fc19c05e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc19c0863f0 0x7fc19c05e660 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4c4650 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.777+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bfe90 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bfe90 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x7fc19c0863f0 2024-09-11T11:01:21.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x7fc19c0863f0 2024-09-11T11:01:21.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bfe90 2024-09-11T11:01:21.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4c4650 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.781+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bfe90 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4c4650 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4c4650 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x7fc19c0863f0 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bb9e0 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x7fc19c0863f0 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4c4650 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x7fc19c0863f0 2024-09-11T11:01:21.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.785+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bfe90 2024-09-11T11:01:21.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bfe90 2024-09-11T11:01:21.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4c4650 2024-09-11T11:01:21.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bfe90 2024-09-11T11:01:21.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fc19c067070 con 0x5613ad4bfe90 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c2a80 con 0x5613ad4bb9e0 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c2e70 con 0x5613ad4bfe90 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c2e70 con 0x7fc19c0863f0 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 zone default found 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 4 Realm: () 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:21.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 zonegroup default 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.789+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c7660 con 0x7fc19c0863f0 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c93e0 con 0x5613ad4c4650 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c9860 con 0x5613ad4c4650 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 20 started sync module instance, tier type = 2024-09-11T11:01:21.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:21.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c8880 con 0x5613ad4bfe90 2024-09-11T11:01:21.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94642511842720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c8880 con 0x5613ad4bfe90 2024-09-11T11:01:21.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.793+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ca360 con 0x5613ad4bb9e0 2024-09-11T11:01:21.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.797+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.797+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94642511846960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ca320 con 0x5613ad4bb9e0 2024-09-11T11:01:21.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.797+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cb290 con 0x5613ad4bfe90 2024-09-11T11:01:21.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.797+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94642511842720] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.797+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94642511846960] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.797+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.797+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94642511849296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cb290 con 0x5613ad4bfe90 2024-09-11T11:01:21.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.797+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cb6e0 con 0x7fc19c0863f0 2024-09-11T11:01:21.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94642511840208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cb6a0 con 0x7fc19c0863f0 2024-09-11T11:01:21.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cc5a0 con 0x5613ad4bfe90 2024-09-11T11:01:21.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94642511849296] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94642511840208] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94642511854288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cc0f0 con 0x5613ad4bfe90 2024-09-11T11:01:21.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cce70 con 0x5613ad4c4650 2024-09-11T11:01:21.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94642511858112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cc0f0 con 0x5613ad4c4650 2024-09-11T11:01:21.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cdbf0 con 0x5613ad4c4650 2024-09-11T11:01:21.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.801+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94642511854288] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94642511858112] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94642511860240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cdfe0 con 0x5613ad4c4650 2024-09-11T11:01:21.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ce870 con 0x7fc19c0863f0 2024-09-11T11:01:21.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94642511860240] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94642511861296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ce490 con 0x7fc19c0863f0 2024-09-11T11:01:21.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 20 add_watcher() i=0 2024-09-11T11:01:21.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 20 add_watcher() i=1 2024-09-11T11:01:21.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 20 add_watcher() i=2 2024-09-11T11:01:21.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 20 add_watcher() i=3 2024-09-11T11:01:21.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 20 add_watcher() i=4 2024-09-11T11:01:21.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 20 add_watcher() i=5 2024-09-11T11:01:21.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.805+0000 7fc1acd1c980 20 add_watcher() i=6 2024-09-11T11:01:21.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94642511861296] v32'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1acd1c980 20 add_watcher() i=7 2024-09-11T11:01:21.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1acd1c980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:21.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4d1d80 con 0x5613ad4bb9e0 2024-09-11T11:01:21.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94642511864240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cf2a0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94642511864240] v32'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc0617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1acd1c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1acd1c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:21.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.809+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4da6a0 con 0x5613ad4bfe90 2024-09-11T11:01:21.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.813+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.813+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4da720 con 0x7fc19c0863f0 2024-09-11T11:01:21.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.813+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.813+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dae10 con 0x5613ad4c4650 2024-09-11T11:01:21.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.817+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.817+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4db380 con 0x5613ad4bb9e0 2024-09-11T11:01:21.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.817+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.817+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4db830 con 0x5613ad4bfe90 2024-09-11T11:01:21.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.821+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.821+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4db830 con 0x5613ad4c4650 2024-09-11T11:01:21.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.821+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.821+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dbbf0 con 0x5613ad4bfe90 2024-09-11T11:01:21.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.825+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.825+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dbbf0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.825+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.825+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dc160 con 0x5613ad4bfe90 2024-09-11T11:01:21.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.829+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.829+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dc160 con 0x5613ad4bfe90 2024-09-11T11:01:21.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.829+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.829+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dc160 con 0x5613ad4bfe90 2024-09-11T11:01:21.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.833+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.833+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dc160 con 0x5613ad4c4650 2024-09-11T11:01:21.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.833+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.833+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dc710 con 0x5613ad4bfe90 2024-09-11T11:01:21.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.837+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.837+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dc710 con 0x5613ad4bb9e0 2024-09-11T11:01:21.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.837+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'25 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.837+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.841+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.841+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bfe90 2024-09-11T11:01:21.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.841+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.841+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bfe90 2024-09-11T11:01:21.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.845+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.845+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4c4650 2024-09-11T11:01:21.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.849+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.849+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bfe90 2024-09-11T11:01:21.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.849+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.849+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.853+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.853+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bfe90 2024-09-11T11:01:21.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.853+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.853+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bfe90 2024-09-11T11:01:21.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.857+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.857+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4c4650 2024-09-11T11:01:21.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.857+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.857+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bfe90 2024-09-11T11:01:21.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.861+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.861+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4c4650 2024-09-11T11:01:21.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.865+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.865+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4c4650 2024-09-11T11:01:21.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.865+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.865+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4c4650 2024-09-11T11:01:21.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.865+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.865+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bfe90 2024-09-11T11:01:21.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.869+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.869+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.873+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.873+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bfe90 2024-09-11T11:01:21.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.873+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.873+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.877+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.877+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4dcbc0 con 0x7fc19c0863f0 2024-09-11T11:01:21.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.877+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.877+0000 7fbfdbfff640 20 reqs_thread_entry: start 2024-09-11T11:01:21.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.877+0000 7fc1acd1c980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:21.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.877+0000 7fc1acd1c980 20 Filter name: none 2024-09-11T11:01:21.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fbfd9ffb640 20 reqs_thread_entry: start 2024-09-11T11:01:21.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc1acd1c980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:21.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc1acd1c980 20 rados->read ofs=0 len=0 2024-09-11T11:01:21.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4d9a10 con 0x5613ad4bb9e0 2024-09-11T11:01:21.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc1acd1c980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:21.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc1acd1c980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-11T11:01:21.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc1acd1c980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:21.883 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, user does not exist 2024-09-11T11:01:21.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc0617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:21.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.881+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94642511864240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4d77f0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.885+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94642511864240] v32'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.885+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94642511842720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ce180 con 0x5613ad4bfe90 2024-09-11T11:01:21.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.885+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94642511842720] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.885+0000 7fc1acd1c980 20 remove_watcher() i=0 2024-09-11T11:01:21.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.885+0000 7fc1acd1c980 2 removed watcher, disabling cache 2024-09-11T11:01:21.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.885+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94642511846960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4c8d80 con 0x5613ad4bb9e0 2024-09-11T11:01:21.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94642511846960] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x5613ad4bb9e0 2024-09-11T11:01:21.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1acd1c980 20 remove_watcher() i=1 2024-09-11T11:01:21.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94642511849296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ce180 con 0x5613ad4bfe90 2024-09-11T11:01:21.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94642511849296] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1acd1c980 20 remove_watcher() i=2 2024-09-11T11:01:21.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94642511840208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ca750 con 0x7fc19c0863f0 2024-09-11T11:01:21.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94642511840208] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1acd1c980 20 remove_watcher() i=3 2024-09-11T11:01:21.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.889+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94642511854288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ca750 con 0x5613ad4bfe90 2024-09-11T11:01:21.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.893+0000 7fc1aa82c640 1 -- 172.21.15.145:0/3209530212 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94642511854288] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc19c083040 con 0x5613ad4bfe90 2024-09-11T11:01:21.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.893+0000 7fc1acd1c980 20 remove_watcher() i=4 2024-09-11T11:01:21.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.893+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94642511858112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ca750 con 0x5613ad4c4650 2024-09-11T11:01:21.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.893+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94642511858112] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.893+0000 7fc1acd1c980 20 remove_watcher() i=5 2024-09-11T11:01:21.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.893+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94642511860240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4cc9c0 con 0x5613ad4c4650 2024-09-11T11:01:21.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1aa02b640 1 -- 172.21.15.145:0/3209530212 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94642511860240] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a00c9030 con 0x5613ad4c4650 2024-09-11T11:01:21.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 20 remove_watcher() i=6 2024-09-11T11:01:21.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94642511861296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5613ad4ca750 con 0x7fc19c0863f0 2024-09-11T11:01:21.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94642511861296] v32'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc1a400a4d0 con 0x7fc19c0863f0 2024-09-11T11:01:21.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 20 remove_watcher() i=7 2024-09-11T11:01:21.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad4bfe90 msgr2=0x5613ad4c2280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad4bfe90 0x5613ad4c2280 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad4bb9e0 msgr2=0x5613ad4bdea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad4bb9e0 0x5613ad4bdea0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc19c0863f0 msgr2=0x7fc19c05e660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc19c0863f0 0x7fc19c05e660 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5613ad4c4650 msgr2=0x5613ad4c6b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5613ad4c4650 0x5613ad4c6b10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc074034650 msgr2=0x7fc074036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc074034650 0x7fc074036b10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0018eb0 tx=0x7fc1a00b9040 comp rx=0 tx=0).stop 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3209530212 reap_dead start 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 msgr2=0x5613ad4b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4b0860 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc19c0472d0 tx=0x7fc19c02e6e0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 shutdown_connections 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3209530212 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad4a9680 0x5613ad4b0860 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 >> 172.21.15.145:0/3209530212 conn(0x5613ad4a5a60 msgr2=0x5613ad4a3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 shutdown_connections 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3209530212 wait complete. 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/2879585134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc084034650 msgr2=0x7fc084036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/2879585134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc084034650 0x7fc084036b10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x5613ad481340 tx=0x7fc1a0005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/2879585134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38ad00 msgr2=0x5613ad389380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/2879585134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38ad00 0x5613ad389380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00bc00 tx=0x7fc19c00df80 comp rx=0 tx=0).stop 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 -- 172.21.15.145:0/2879585134 shutdown_connections 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.897+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/2879585134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc084034650 0x7fc084036b10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/2879585134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad38ad00 0x5613ad389380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/2879585134 >> 172.21.15.145:0/2879585134 conn(0x5613ad48fc20 msgr2=0x5613ad4926a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/2879585134 shutdown_connections 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/2879585134 wait complete. 2024-09-11T11:01:21.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad485150 msgr2=0x5613ad487540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5613ad485150 0x5613ad487540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad38eac0 msgr2=0x5613ad483d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5613ad38eac0 0x5613ad483d20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5613ad48a7e0 msgr2=0x5613ad48cbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5613ad48a7e0 0x5613ad48cbd0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc090034650 msgr2=0x7fc090036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc090034650 0x7fc090036b10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1a00ad000 tx=0x7fc1a00a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 msgr2=0x5613ad47cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 --2- 172.21.15.145:0/3918554206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5613ad2ff290 0x5613ad47cd50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5613ad476be0 tx=0x7fc19c000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1ab02d640 1 -- 172.21.15.145:0/3918554206 reap_dead start 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 shutdown_connections 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 >> 172.21.15.145:0/3918554206 conn(0x5613ad385090 msgr2=0x5613ad4701b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:21.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 shutdown_connections 2024-09-11T11:01:21.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.901+0000 7fc1acd1c980 1 -- 172.21.15.145:0/3918554206 wait complete. 2024-09-11T11:01:21.913 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-11T11:01:21.914 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-11T11:01:21.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-11T11:01:21.914 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-11T11:01:21.995 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:21.995 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:21.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.993+0000 7fe063df7980 1 Processor -- start 2024-09-11T11:01:21.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.993+0000 7fe063df7980 1 -- start start 2024-09-11T11:01:21.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.993+0000 7fe063df7980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5591461cb380 0x559146259360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:21.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.993+0000 7fe063df7980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5591460deae0 con 0x5591462598a0 2024-09-11T11:01:21.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.993+0000 7fe063df7980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x559146102e30 con 0x5591461cb380 2024-09-11T11:01:21.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.997+0000 7fe061907640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5591461cb380 0x559146259360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:21.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.997+0000 7fe061907640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5591461cb380 0x559146259360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48192/0 (socket says 172.21.15.145:48192) 2024-09-11T11:01:21.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.997+0000 7fe061106640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x5591462598a0 0x55914625bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48536/0 (socket says 172.21.15.145:48536) 2024-09-11T11:01:21.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.997+0000 7fe061907640 1 -- 172.21.15.145:0/258901670 learned_addr learned my addr 172.21.15.145:0/258901670 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:21.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.997+0000 7fe061907640 1 -- 172.21.15.145:0/258901670 >> v1:172.21.15.102:6789/0 conn(0x5591462598a0 legacy=0x55914625bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:21.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.997+0000 7fe061907640 1 -- 172.21.15.145:0/258901670 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591461cb910 con 0x5591461cb380 2024-09-11T11:01:22.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:21.997+0000 7fe061907640 1 --2- 172.21.15.145:0/258901670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146259360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe05400a5c0 tx=0x7fe05401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62784029ff99b764 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe060905640 1 -- 172.21.15.145:0/258901670 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0540a6070 con 0x5591461cb380 2024-09-11T11:01:22.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe060905640 1 -- 172.21.15.145:0/258901670 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0540af070 con 0x5591461cb380 2024-09-11T11:01:22.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe060905640 1 -- 172.21.15.145:0/258901670 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0540aa5c0 con 0x5591461cb380 2024-09-11T11:01:22.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe063df7980 1 -- 172.21.15.145:0/258901670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 msgr2=0x559146259360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe063df7980 1 --2- 172.21.15.145:0/258901670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146259360 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe05400a5c0 tx=0x7fe05401b340 comp rx=0 tx=0).stop 2024-09-11T11:01:22.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe063df7980 1 -- 172.21.15.145:0/258901670 shutdown_connections 2024-09-11T11:01:22.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe063df7980 1 --2- 172.21.15.145:0/258901670 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146259360 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe063df7980 1 -- 172.21.15.145:0/258901670 >> 172.21.15.145:0/258901670 conn(0x559146251050 msgr2=0x559146253470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe063df7980 1 -- 172.21.15.145:0/258901670 shutdown_connections 2024-09-11T11:01:22.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.001+0000 7fe063df7980 1 -- 172.21.15.145:0/258901670 wait complete. 2024-09-11T11:01:22.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe063df7980 1 Processor -- start 2024-09-11T11:01:22.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe063df7980 1 -- start start 2024-09-11T11:01:22.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe063df7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146256ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe063df7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559146104200 con 0x5591461cb380 2024-09-11T11:01:22.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe061907640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146256ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe061907640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146256ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48198/0 (socket says 172.21.15.145:48198) 2024-09-11T11:01:22.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe061907640 1 -- 172.21.15.145:0/2097520883 learned_addr learned my addr 172.21.15.145:0/2097520883 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe061907640 1 -- 172.21.15.145:0/2097520883 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559146257090 con 0x5591461cb380 2024-09-11T11:01:22.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fe061907640 1 --2- 172.21.15.145:0/2097520883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146256ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe05400a5c0 tx=0x7fe054003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9329bbf0e540d4c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fdf4fe07640 1 -- 172.21.15.145:0/2097520883 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0540aa9f0 con 0x5591461cb380 2024-09-11T11:01:22.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fdf4fe07640 1 -- 172.21.15.145:0/2097520883 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0540aab90 con 0x5591461cb380 2024-09-11T11:01:22.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.017+0000 7fdf4fe07640 1 -- 172.21.15.145:0/2097520883 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0540bd3f0 con 0x5591461cb380 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- 172.21.15.145:0/2097520883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 msgr2=0x559146256ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 --2- 172.21.15.145:0/2097520883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146256ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe05400a5c0 tx=0x7fe054003030 comp rx=0 tx=0).stop 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- 172.21.15.145:0/2097520883 shutdown_connections 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 --2- 172.21.15.145:0/2097520883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x559146256ac0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- 172.21.15.145:0/2097520883 >> 172.21.15.145:0/2097520883 conn(0x559146251050 msgr2=0x55914633d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- 172.21.15.145:0/2097520883 shutdown_connections 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- 172.21.15.145:0/2097520883 wait complete. 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 Processor -- start 2024-09-11T11:01:22.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- start start 2024-09-11T11:01:22.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x55914634af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55914625dec0 con 0x5591461cb380 2024-09-11T11:01:22.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe061907640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x55914634af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe061907640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x55914634af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48214/0 (socket says 172.21.15.145:48214) 2024-09-11T11:01:22.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe061907640 1 -- 172.21.15.145:0/1699738671 learned_addr learned my addr 172.21.15.145:0/1699738671 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe061907640 1 -- 172.21.15.145:0/1699738671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55914634b4c0 con 0x5591461cb380 2024-09-11T11:01:22.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe061907640 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x55914634af80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe05400a5c0 tx=0x7fe0540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fdf4e604640 1 -- 172.21.15.145:0/1699738671 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0540c6750 con 0x5591461cb380 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fdf4e604640 1 -- 172.21.15.145:0/1699738671 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0540c68f0 con 0x5591461cb380 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55914634b750 con 0x5591461cb380 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fdf4e604640 1 -- 172.21.15.145:0/1699738671 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0540c6bd0 con 0x5591461cb380 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55914634e430 con 0x5591461cb380 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 Processor -- start 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.021+0000 7fe063df7980 1 -- start start 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x559146358140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55914615d800 con 0x559146357d40 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fdf4e604640 1 -- 172.21.15.145:0/1699738671 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe0540ce020 con 0x5591461cb380 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fdf4e604640 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf48034650 0x7fdf48036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fdf4e604640 1 -- 172.21.15.145:0/1699738671 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe0540cc020 con 0x5591461cb380 2024-09-11T11:01:22.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe062108640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x559146358140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe061907640 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf48034650 0x7fdf48036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe062108640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x559146358140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48228/0 (socket says 172.21.15.145:48228) 2024-09-11T11:01:22.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe062108640 1 -- 172.21.15.145:0/734291938 learned_addr learned my addr 172.21.15.145:0/734291938 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe061907640 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf48034650 0x7fdf48036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0540d1fd0 tx=0x7fe0540e5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe062108640 1 -- 172.21.15.145:0/734291938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559146358680 con 0x559146357d40 2024-09-11T11:01:22.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe062108640 1 --2- 172.21.15.145:0/734291938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x559146358140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00a430 tx=0x7fe05c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4e7e06d731caa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fdf47fff640 1 -- 172.21.15.145:0/734291938 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe05c00f6e0 con 0x559146357d40 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fdf47fff640 1 -- 172.21.15.145:0/734291938 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c015070 con 0x559146357d40 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fdf47fff640 1 -- 172.21.15.145:0/734291938 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe05c00fa10 con 0x559146357d40 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 -- 172.21.15.145:0/734291938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 msgr2=0x559146358140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 --2- 172.21.15.145:0/734291938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x559146358140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00a430 tx=0x7fe05c00a8f0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 -- 172.21.15.145:0/734291938 shutdown_connections 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 --2- 172.21.15.145:0/734291938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x559146358140 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 -- 172.21.15.145:0/734291938 >> 172.21.15.145:0/734291938 conn(0x5591462598a0 msgr2=0x559146353650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 -- 172.21.15.145:0/734291938 shutdown_connections 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 -- 172.21.15.145:0/734291938 wait complete. 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 Processor -- start 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 -- start start 2024-09-11T11:01:22.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x55914635f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe063df7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559146359060 con 0x559146357d40 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe062108640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x55914635f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe062108640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x55914635f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48234/0 (socket says 172.21.15.145:48234) 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.025+0000 7fe062108640 1 -- 172.21.15.145:0/1903732917 learned_addr learned my addr 172.21.15.145:0/1903732917 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe062108640 1 -- 172.21.15.145:0/1903732917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55914635f6a0 con 0x559146357d40 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe062108640 1 --2- 172.21.15.145:0/1903732917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x55914635f160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x559146358af0 tx=0x7fe05c003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fdf467fc640 1 -- 172.21.15.145:0/1903732917 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe05c00fe00 con 0x559146357d40 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe063df7980 1 -- 172.21.15.145:0/1903732917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55914635f930 con 0x559146357d40 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fdf467fc640 1 -- 172.21.15.145:0/1903732917 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c010a20 con 0x559146357d40 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fdf467fc640 1 -- 172.21.15.145:0/1903732917 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe05c010dc0 con 0x559146357d40 2024-09-11T11:01:22.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe063df7980 1 -- 172.21.15.145:0/1903732917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559146362610 con 0x559146357d40 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe063df7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe063df7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fdf467fc640 1 -- 172.21.15.145:0/1903732917 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe05c01a480 con 0x559146357d40 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fdf467fc640 1 --2- 172.21.15.145:0/1903732917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf3c034650 0x7fdf3c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe063df7980 1 Processor -- start 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fdf467fc640 1 -- 172.21.15.145:0/1903732917 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe05c04a280 con 0x559146357d40 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe062108640 1 --2- 172.21.15.145:0/1903732917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf3c034650 0x7fdf3c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe063df7980 1 -- start start 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe063df7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591463789f0 0x559146378e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe063df7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5591462551f0 con 0x5591463789f0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe062108640 1 --2- 172.21.15.145:0/1903732917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf3c034650 0x7fdf3c036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe05c02efd0 tx=0x7fe05c024f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe061907640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591463789f0 0x559146378e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe061907640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591463789f0 0x559146378e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48240/0 (socket says 172.21.15.145:48240) 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe061907640 1 -- 172.21.15.145:0/3938137542 learned_addr learned my addr 172.21.15.145:0/3938137542 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.029+0000 7fe061907640 1 -- 172.21.15.145:0/3938137542 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591463793e0 con 0x5591463789f0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe061907640 1 --2- 172.21.15.145:0/3938137542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591463789f0 0x559146378e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0540e50d0 tx=0x7fe0540bc9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fdf267e4640 1 -- 172.21.15.145:0/3938137542 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0540c5670 con 0x5591463789f0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe063df7980 1 -- 172.21.15.145:0/3938137542 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55914637bf40 con 0x5591463789f0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fdf267e4640 1 -- 172.21.15.145:0/3938137542 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0540ee070 con 0x5591463789f0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fdf267e4640 1 -- 172.21.15.145:0/3938137542 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe0540e3420 con 0x5591463789f0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe063df7980 1 -- 172.21.15.145:0/3938137542 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55914637c340 con 0x5591463789f0 2024-09-11T11:01:22.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fdf267e4640 1 -- 172.21.15.145:0/3938137542 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe0540cf990 con 0x5591463789f0 2024-09-11T11:01:22.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fdf267e4640 1 --2- 172.21.15.145:0/3938137542 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdea40347f0 0x7fdea4036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fdf267e4640 1 -- 172.21.15.145:0/3938137542 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe0540e6070 con 0x5591463789f0 2024-09-11T11:01:22.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe061106640 1 --2- 172.21.15.145:0/3938137542 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdea40347f0 0x7fdea4036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fde97fff640 20 reqs_thread_entry: start 2024-09-11T11:01:22.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe061106640 1 --2- 172.21.15.145:0/3938137542 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdea40347f0 0x7fdea4036cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe04c000f70 tx=0x7fe04c001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe063df7980 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55914637e4f0 0x559146380980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559146381050 con 0x55914637e4f0 2024-09-11T11:01:22.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe062108640 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55914637e4f0 0x559146380980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe062108640 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55914637e4f0 0x559146380980 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.033+0000 7fe062108640 1 -- 172.21.15.145:0/1699738671 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe05c00e070 con 0x55914637e4f0 2024-09-11T11:01:22.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.037+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559146382910 con 0x55914637e4f0 2024-09-11T11:01:22.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.037+0000 7fe062108640 1 -- 172.21.15.145:0/1699738671 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(2 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe05c00e070 con 0x55914637e4f0 2024-09-11T11:01:22.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.037+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5591463873a0 con 0x55914637e4f0 2024-09-11T11:01:22.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.037+0000 7fe062108640 1 -- 172.21.15.145:0/1699738671 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [stat,call,call,writefull 0~993] v32'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7fe05c00e070 con 0x55914637e4f0 2024-09-11T11:01:22.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1903732917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf3c034650 msgr2=0x7fdf3c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1903732917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf3c034650 0x7fdf3c036b10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe05c02efd0 tx=0x7fe05c024f20 comp rx=0 tx=0).stop 2024-09-11T11:01:22.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1903732917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 msgr2=0x55914635f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1903732917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x55914635f160 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x559146358af0 tx=0x7fe05c003380 comp rx=0 tx=0).stop 2024-09-11T11:01:22.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1903732917 shutdown_connections 2024-09-11T11:01:22.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1903732917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf3c034650 0x7fdf3c036b10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1903732917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559146357d40 0x55914635f160 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1903732917 >> 172.21.15.145:0/1903732917 conn(0x5591462598a0 msgr2=0x559146353220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1903732917 shutdown_connections 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1903732917 wait complete. 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/3938137542 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdea40347f0 msgr2=0x7fdea4036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/3938137542 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdea40347f0 0x7fdea4036cb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe04c000f70 tx=0x7fe04c001300 comp rx=0 tx=0).stop 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/3938137542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591463789f0 msgr2=0x559146378e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/3938137542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591463789f0 0x559146378e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe0540e50d0 tx=0x7fe0540bc9b0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/3938137542 shutdown_connections 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/3938137542 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdea40347f0 0x7fdea4036cb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/3938137542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591463789f0 0x559146378e10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/3938137542 >> 172.21.15.145:0/3938137542 conn(0x55914636d9c0 msgr2=0x5591463702b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/3938137542 shutdown_connections 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/3938137542 wait complete. 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55914637e4f0 msgr2=0x559146380980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55914637e4f0 0x559146380980 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf48034650 msgr2=0x7fdf48036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf48034650 0x7fdf48036b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe0540d1fd0 tx=0x7fe0540e5040 comp rx=0 tx=0).stop 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 msgr2=0x55914634af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x55914634af80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe05400a5c0 tx=0x7fe0540180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 shutdown_connections 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55914637e4f0 0x559146380980 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf48034650 0x7fdf48036b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 --2- 172.21.15.145:0/1699738671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5591461cb380 0x55914634af80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 >> 172.21.15.145:0/1699738671 conn(0x559146251050 msgr2=0x55914633d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 shutdown_connections 2024-09-11T11:01:22.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.041+0000 7fe063df7980 1 -- 172.21.15.145:0/1699738671 wait complete. 2024-09-11T11:01:22.057 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"27698d38-fc40-410e-96d8-191ffc71147c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-11T11:01:22.057 DEBUG:tasks.util.rgw: json result: {'id': '27698d38-fc40-410e-96d8-191ffc71147c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-11T11:01:22.059 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-11T11:01:22.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-11T11:01:22.059 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-11T11:01:22.131 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:22.131 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:22.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.129+0000 7f02bab80980 1 Processor -- start 2024-09-11T11:01:22.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.129+0000 7f02bab80980 1 -- start start 2024-09-11T11:01:22.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.129+0000 7f02bab80980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f1b274ff90 0x55f1b274ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.129+0000 7f02bab80980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f1b2661ae0 con 0x55f1b274fb80 2024-09-11T11:01:22.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.129+0000 7f02bab80980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55f1b2685e30 con 0x55f1b274ff90 2024-09-11T11:01:22.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.129+0000 7f02b7e8f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f1b274ff90 0x55f1b274ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.129+0000 7f02b7e8f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f1b274ff90 0x55f1b274ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48256/0 (socket says 172.21.15.145:48256) 2024-09-11T11:01:22.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.129+0000 7f02b7e8f640 1 -- 172.21.15.145:0/2660089690 learned_addr learned my addr 172.21.15.145:0/2660089690 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02b7e8f640 1 -- 172.21.15.145:0/2660089690 >> v1:172.21.15.102:6789/0 conn(0x55f1b274fb80 legacy=0x55f1b274e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02b7e8f640 1 -- 172.21.15.145:0/2660089690 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b274f0b0 con 0x55f1b274ff90 2024-09-11T11:01:22.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/2660089690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274ff90 0x55f1b274ea50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00a5c0 tx=0x7f02ac01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8bec03f83a103b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02b768e640 1 -- 172.21.15.145:0/2660089690 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ac0a6070 con 0x55f1b274ff90 2024-09-11T11:01:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02b768e640 1 -- 172.21.15.145:0/2660089690 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ac0af070 con 0x55f1b274ff90 2024-09-11T11:01:22.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02b768e640 1 -- 172.21.15.145:0/2660089690 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02ac0aa5c0 con 0x55f1b274ff90 2024-09-11T11:01:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02bab80980 1 -- 172.21.15.145:0/2660089690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274ff90 msgr2=0x55f1b274ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02bab80980 1 --2- 172.21.15.145:0/2660089690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274ff90 0x55f1b274ea50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00a5c0 tx=0x7f02ac01b340 comp rx=0 tx=0).stop 2024-09-11T11:01:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02bab80980 1 -- 172.21.15.145:0/2660089690 shutdown_connections 2024-09-11T11:01:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02bab80980 1 --2- 172.21.15.145:0/2660089690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274ff90 0x55f1b274ea50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02bab80980 1 -- 172.21.15.145:0/2660089690 >> 172.21.15.145:0/2660089690 conn(0x55f1b27d5160 msgr2=0x55f1b27d7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02bab80980 1 -- 172.21.15.145:0/2660089690 shutdown_connections 2024-09-11T11:01:22.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.133+0000 7f02bab80980 1 -- 172.21.15.145:0/2660089690 wait complete. 2024-09-11T11:01:22.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.149+0000 7f02bab80980 1 Processor -- start 2024-09-11T11:01:22.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.149+0000 7f02bab80980 1 -- start start 2024-09-11T11:01:22.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.149+0000 7f02bab80980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.149+0000 7f02bab80980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f1b2687200 con 0x55f1b274fb80 2024-09-11T11:01:22.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.149+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.149+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48258/0 (socket says 172.21.15.145:48258) 2024-09-11T11:01:22.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.149+0000 7f02b8690640 1 -- 172.21.15.145:0/4275422627 learned_addr learned my addr 172.21.15.145:0/4275422627 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.149+0000 7f02b8690640 1 -- 172.21.15.145:0/4275422627 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b28c7180 con 0x55f1b274fb80 2024-09-11T11:01:22.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02b8690640 1 --2- 172.21.15.145:0/4275422627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28c6bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02a80016c0 tx=0x7f02a8001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a54a4b1ecc014b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f01a660c640 1 -- 172.21.15.145:0/4275422627 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a8016070 con 0x55f1b274fb80 2024-09-11T11:01:22.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f01a660c640 1 -- 172.21.15.145:0/4275422627 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a800f640 con 0x55f1b274fb80 2024-09-11T11:01:22.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f01a660c640 1 -- 172.21.15.145:0/4275422627 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a800f9a0 con 0x55f1b274fb80 2024-09-11T11:01:22.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- 172.21.15.145:0/4275422627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 msgr2=0x55f1b28c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 --2- 172.21.15.145:0/4275422627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28c6bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f02a80016c0 tx=0x7f02a8001b80 comp rx=0 tx=0).stop 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- 172.21.15.145:0/4275422627 shutdown_connections 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 --2- 172.21.15.145:0/4275422627 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28c6bb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- 172.21.15.145:0/4275422627 >> 172.21.15.145:0/4275422627 conn(0x55f1b27d5160 msgr2=0x55f1b28c27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- 172.21.15.145:0/4275422627 shutdown_connections 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- 172.21.15.145:0/4275422627 wait complete. 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 Processor -- start 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- start start 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f1b27e51b0 con 0x55f1b274fb80 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48266/0 (socket says 172.21.15.145:48266) 2024-09-11T11:01:22.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02b8690640 1 -- 172.21.15.145:0/3208622566 learned_addr learned my addr 172.21.15.145:0/3208622566 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02b8690640 1 -- 172.21.15.145:0/3208622566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b28ce4a0 con 0x55f1b274fb80 2024-09-11T11:01:22.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02b8690640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28cdf60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f02a800f610 tx=0x7f02a8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f01a4e09640 1 -- 172.21.15.145:0/3208622566 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a8021020 con 0x55f1b274fb80 2024-09-11T11:01:22.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f01a4e09640 1 -- 172.21.15.145:0/3208622566 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a8011770 con 0x55f1b274fb80 2024-09-11T11:01:22.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1b28ce730 con 0x55f1b274fb80 2024-09-11T11:01:22.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f01a4e09640 1 -- 172.21.15.145:0/3208622566 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a8016040 con 0x55f1b274fb80 2024-09-11T11:01:22.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.153+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b28d1410 con 0x55f1b274fb80 2024-09-11T11:01:22.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f01a4e09640 1 -- 172.21.15.145:0/3208622566 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f02a8024020 con 0x55f1b274fb80 2024-09-11T11:01:22.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f01a4e09640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f01a00346f0 0x7f01a0036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f01a4e09640 1 -- 172.21.15.145:0/3208622566 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f02a80497b0 con 0x55f1b274fb80 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f01a00346f0 0x7f01a0036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02bab80980 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b274ff90 0x55f1b28d4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b28d5510 con 0x55f1b274ff90 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02b8e91640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b274ff90 0x55f1b28d4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f01a00346f0 0x7f01a0036bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0ae000 tx=0x7f02ac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02b8e91640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b274ff90 0x55f1b28d4ef0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02b8e91640 1 -- 172.21.15.145:0/3208622566 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b274ff90 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02bab80980 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b28d6300 0x55f1b28d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b28d8d30 con 0x55f1b28d6300 2024-09-11T11:01:22.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02b8690640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b28d6300 0x55f1b28d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02b8690640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b28d6300 0x55f1b28d86f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02b8690640 1 -- 172.21.15.145:0/3208622566 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02a800f070 con 0x55f1b28d6300 2024-09-11T11:01:22.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.157+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b28da5e0 con 0x55f1b28d6300 2024-09-11T11:01:22.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b8690640 1 -- 172.21.15.145:0/3208622566 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f02a800f070 con 0x55f1b28d6300 2024-09-11T11:01:22.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b28d9810 con 0x55f1b28d6300 2024-09-11T11:01:22.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b8690640 1 -- 172.21.15.145:0/3208622566 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02a800f070 con 0x55f1b28d6300 2024-09-11T11:01:22.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02bab80980 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f1b28db990 0x55f1b28ddd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b28de2c0 con 0x55f1b28db990 2024-09-11T11:01:22.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f1b28db990 0x55f1b28ddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f1b28db990 0x55f1b28ddd80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b7e8f640 1 -- 172.21.15.145:0/3208622566 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b28db990 2024-09-11T11:01:22.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02bab80980 1 Processor -- start 2024-09-11T11:01:22.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02bab80980 1 -- start start 2024-09-11T11:01:22.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02bab80980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28ebcc0 0x55f1b28ec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02bab80980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f1b26e0800 con 0x55f1b28ebcc0 2024-09-11T11:01:22.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28ebcc0 0x55f1b28ec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28ebcc0 0x55f1b28ec0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48276/0 (socket says 172.21.15.145:48276) 2024-09-11T11:01:22.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b8690640 1 -- 172.21.15.145:0/1588797929 learned_addr learned my addr 172.21.15.145:0/1588797929 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b8690640 1 -- 172.21.15.145:0/1588797929 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b28ec620 con 0x55f1b28ebcc0 2024-09-11T11:01:22.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.161+0000 7f02b8690640 1 --2- 172.21.15.145:0/1588797929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28ebcc0 0x55f1b28ec0e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f02a8047da0 tx=0x7f02a801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f019dffb640 1 -- 172.21.15.145:0/1588797929 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a803f070 con 0x55f1b28ebcc0 2024-09-11T11:01:22.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f019dffb640 1 -- 172.21.15.145:0/1588797929 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a8042a90 con 0x55f1b28ebcc0 2024-09-11T11:01:22.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02bab80980 1 -- 172.21.15.145:0/1588797929 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1b28ec8b0 con 0x55f1b28ebcc0 2024-09-11T11:01:22.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f019dffb640 1 -- 172.21.15.145:0/1588797929 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a8042d70 con 0x55f1b28ebcc0 2024-09-11T11:01:22.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02bab80980 1 -- 172.21.15.145:0/1588797929 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b28ef530 con 0x55f1b28ebcc0 2024-09-11T11:01:22.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f019dffb640 1 -- 172.21.15.145:0/1588797929 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f02a8049ac0 con 0x55f1b28ebcc0 2024-09-11T11:01:22.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f019dffb640 1 --2- 172.21.15.145:0/1588797929 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0190034650 0x7f0190036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f019dffb640 1 -- 172.21.15.145:0/1588797929 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f02a804e850 con 0x55f1b28ebcc0 2024-09-11T11:01:22.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/1588797929 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0190034650 0x7f0190036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02bab80980 1 Processor -- start 2024-09-11T11:01:22.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02bab80980 1 -- start start 2024-09-11T11:01:22.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/1588797929 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0190034650 0x7f0190036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55f1b28d2550 tx=0x7f02ac005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02bab80980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02bab80980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f1b28c7500 con 0x55f1b28f8610 2024-09-11T11:01:22.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28f89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48282/0 (socket says 172.21.15.145:48282) 2024-09-11T11:01:22.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02b8690640 1 -- 172.21.15.145:0/3293457990 learned_addr learned my addr 172.21.15.145:0/3293457990 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02b8690640 1 -- 172.21.15.145:0/3293457990 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b28f8fc0 con 0x55f1b28f8610 2024-09-11T11:01:22.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f02b8690640 1 --2- 172.21.15.145:0/3293457990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28f89f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f02a80419f0 tx=0x7f02a802f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d0313eb9643dd2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f01977fe640 1 -- 172.21.15.145:0/3293457990 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a805b070 con 0x55f1b28f8610 2024-09-11T11:01:22.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f01977fe640 1 -- 172.21.15.145:0/3293457990 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a803a570 con 0x55f1b28f8610 2024-09-11T11:01:22.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.165+0000 7f01977fe640 1 -- 172.21.15.145:0/3293457990 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a804ece0 con 0x55f1b28f8610 2024-09-11T11:01:22.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- 172.21.15.145:0/3293457990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 msgr2=0x55f1b28f89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 --2- 172.21.15.145:0/3293457990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28f89f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f02a80419f0 tx=0x7f02a802f500 comp rx=0 tx=0).stop 2024-09-11T11:01:22.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- 172.21.15.145:0/3293457990 shutdown_connections 2024-09-11T11:01:22.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 --2- 172.21.15.145:0/3293457990 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28f89f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- 172.21.15.145:0/3293457990 >> 172.21.15.145:0/3293457990 conn(0x55f1b28f49f0 msgr2=0x55f1b28f2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- 172.21.15.145:0/3293457990 shutdown_connections 2024-09-11T11:01:22.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- 172.21.15.145:0/3293457990 wait complete. 2024-09-11T11:01:22.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 Processor -- start 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- start start 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f1b28f9460 con 0x55f1b28f8610 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02b8690640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48298/0 (socket says 172.21.15.145:48298) 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 learned_addr learned my addr 172.21.15.145:0/720860199 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1b28ffd30 con 0x55f1b28f8610 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02b8690640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28ff7f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f02a8044010 tx=0x7f02a8056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f0195ffb640 1 -- 172.21.15.145:0/720860199 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a802f400 con 0x55f1b28f8610 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f1b28ffd30 con 0x55f1b28f8610 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f0195ffb640 1 -- 172.21.15.145:0/720860199 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02a804ee90 con 0x55f1b28f8610 2024-09-11T11:01:22.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f0195ffb640 1 -- 172.21.15.145:0/720860199 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f02a8011dd0 con 0x55f1b28f8610 2024-09-11T11:01:22.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1b29001a0 con 0x55f1b28f8610 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f0195ffb640 1 -- 172.21.15.145:0/720860199 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f02a806d020 con 0x55f1b28f8610 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f0195ffb640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0188034600 0x7f0188036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f0195ffb640 1 -- 172.21.15.145:0/720860199 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f02a8068d60 con 0x55f1b28f8610 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0188034600 0x7f0188036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.169+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b290a800 0x55f1b290cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b290d3f0 con 0x55f1b290a800 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8e91640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b290a800 0x55f1b290cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0188034600 0x7f0188036ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02ac01b380 tx=0x7f02ac0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8e91640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b290a800 0x55f1b290cca0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 realm 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2909cf0 con 0x55f1b290a800 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b290deb0 con 0x55f1b290a800 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b290ec90 0x55f1b2911080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b29116e0 con 0x55f1b290ec90 2024-09-11T11:01:22.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8690640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b290ec90 0x55f1b2911080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8690640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b290ec90 0x55f1b2911080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2911f80 con 0x55f1b290ec90 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 20 searching for the correct realm 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f1b2913cf0 0x55f1b29160e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b2913cf0 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.173+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f1b2913cf0 0x55f1b29160e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b7e8f640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f1b2913cf0 0x55f1b29160e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8690640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f02a801ec50 0x7f02a801e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x7f02a801ec50 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f02a801ec50 0x7f02a801e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f02a801ec50 0x7f02a801e070 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b2913cf0 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.177+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x7f02a801ec50 2024-09-11T11:01:22.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x7f02a801ec50 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b2913cf0 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b2913cf0 2024-09-11T11:01:22.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.181+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b2913cf0 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x7f02a801ec50 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290a800 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x7f02a801ec50 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b2913cf0 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x7f02a801ec50 2024-09-11T11:01:22.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b2913cf0 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.185+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916760 con 0x55f1b290ec90 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:22.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2912900 con 0x55f1b290a800 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2912d80 con 0x55f1b290ec90 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b29131a0 con 0x7f02a801ec50 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 zone default found 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 4 Realm: () 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 zonegroup default 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2916bc0 con 0x7f02a801ec50 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2918df0 con 0x55f1b2913cf0 2024-09-11T11:01:22.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2919190 con 0x55f1b2913cf0 2024-09-11T11:01:22.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 started sync module instance, tier type = 2024-09-11T11:01:22.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:22.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.189+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2918230 con 0x55f1b290ec90 2024-09-11T11:01:22.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.193+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.193+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94496571360848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2918230 con 0x55f1b290ec90 2024-09-11T11:01:22.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.193+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b29199e0 con 0x55f1b290a800 2024-09-11T11:01:22.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.193+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.193+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94496571364656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2919e00 con 0x55f1b290a800 2024-09-11T11:01:22.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.193+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291a880 con 0x55f1b290ec90 2024-09-11T11:01:22.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.193+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94496571360848] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.197+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94496571364656] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.197+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.197+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94496571368304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2919950 con 0x55f1b290ec90 2024-09-11T11:01:22.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.197+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291b120 con 0x7f02a801ec50 2024-09-11T11:01:22.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.197+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.197+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94496571370608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2919950 con 0x7f02a801ec50 2024-09-11T11:01:22.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.197+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291bbe0 con 0x55f1b290ec90 2024-09-11T11:01:22.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.201+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94496571368304] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.201+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94496571370608] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.201+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.201+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94496571371664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291bba0 con 0x55f1b290ec90 2024-09-11T11:01:22.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.201+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291bfd0 con 0x55f1b2913cf0 2024-09-11T11:01:22.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.201+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.201+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94496571358592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291c870 con 0x55f1b2913cf0 2024-09-11T11:01:22.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.201+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291d270 con 0x55f1b2913cf0 2024-09-11T11:01:22.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94496571371664] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94496571358592] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94496571373232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291d660 con 0x55f1b2913cf0 2024-09-11T11:01:22.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291def0 con 0x7f02a801ec50 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94496571373232] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94496571379072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291db10 con 0x7f02a801ec50 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 20 add_watcher() i=0 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 20 add_watcher() i=1 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 20 add_watcher() i=2 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 20 add_watcher() i=3 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 20 add_watcher() i=4 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 20 add_watcher() i=5 2024-09-11T11:01:22.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 20 add_watcher() i=6 2024-09-11T11:01:22.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94496571379072] v32'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 20 add_watcher() i=7 2024-09-11T11:01:22.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:22.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.205+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2921340 con 0x55f1b290a800 2024-09-11T11:01:22.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94496571381808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b291e800 con 0x55f1b290a800 2024-09-11T11:01:22.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94496571381808] v32'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f016e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:22.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02bab80980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:22.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02bab80980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:22.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02bab80980 5 note: GC not initialized 2024-09-11T11:01:22.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f016d7e2640 20 reqs_thread_entry: start 2024-09-11T11:01:22.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02bab80980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:22.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02bab80980 20 Filter name: none 2024-09-11T11:01:22.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f00deffd640 20 reqs_thread_entry: start 2024-09-11T11:01:22.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.209+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f90 con 0x55f1b290ec90 2024-09-11T11:01:22.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f90 con 0x55f1b290ec90 2024-09-11T11:01:22.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.213+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x7f02a801ec50 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x7f02a801ec50 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.217+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.221+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f016e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:22.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.225+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94496571381808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.229+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94496571381808] v32'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.229+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94496571360848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.229+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94496571360848] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.229+0000 7f02bab80980 20 remove_watcher() i=0 2024-09-11T11:01:22.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.229+0000 7f02bab80980 2 removed watcher, disabling cache 2024-09-11T11:01:22.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.229+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94496571364656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290a800 2024-09-11T11:01:22.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.233+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94496571364656] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x55f1b290a800 2024-09-11T11:01:22.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.233+0000 7f02bab80980 20 remove_watcher() i=1 2024-09-11T11:01:22.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.233+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94496571368304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.233+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94496571368304] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.233+0000 7f02bab80980 20 remove_watcher() i=2 2024-09-11T11:01:22.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.233+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94496571370608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x7f02a801ec50 2024-09-11T11:01:22.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.237+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94496571370608] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.237+0000 7f02bab80980 20 remove_watcher() i=3 2024-09-11T11:01:22.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.237+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94496571371664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b290ec90 2024-09-11T11:01:22.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02b8690640 1 -- 172.21.15.145:0/720860199 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94496571371664] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02a805d030 con 0x55f1b290ec90 2024-09-11T11:01:22.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02bab80980 20 remove_watcher() i=4 2024-09-11T11:01:22.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94496571358592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94496571358592] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02bab80980 20 remove_watcher() i=5 2024-09-11T11:01:22.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94496571373232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x55f1b2913cf0 2024-09-11T11:01:22.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02b7e8f640 1 -- 172.21.15.145:0/720860199 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94496571373232] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02ac0aab30 con 0x55f1b2913cf0 2024-09-11T11:01:22.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02bab80980 20 remove_watcher() i=6 2024-09-11T11:01:22.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.241+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94496571379072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f1b2944f50 con 0x7f02a801ec50 2024-09-11T11:01:22.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94496571379072] v32'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f02b00083f0 con 0x7f02a801ec50 2024-09-11T11:01:22.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 20 remove_watcher() i=7 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b290ec90 msgr2=0x55f1b2911080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b290ec90 0x55f1b2911080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b290a800 msgr2=0x55f1b290cca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b290a800 0x55f1b290cca0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f02a801ec50 msgr2=0x7f02a801e070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f02a801ec50 0x7f02a801e070 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f1b2913cf0 msgr2=0x55f1b29160e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f1b2913cf0 0x55f1b29160e0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0188034600 msgr2=0x7f0188036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0188034600 0x7f0188036ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f02ac01b380 tx=0x7f02ac0c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 msgr2=0x55f1b28ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/720860199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28f8610 0x55f1b28ff7f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f02a8044010 tx=0x7f02a8056000 comp rx=0 tx=0).stop 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02b8e91640 1 -- 172.21.15.145:0/720860199 reap_dead start 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 shutdown_connections 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 >> 172.21.15.145:0/720860199 conn(0x55f1b28f49f0 msgr2=0x55f1b28f2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 shutdown_connections 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/720860199 wait complete. 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/1588797929 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0190034650 msgr2=0x7f0190036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/1588797929 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0190034650 0x7f0190036b10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x55f1b28d2550 tx=0x7f02ac005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/1588797929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28ebcc0 msgr2=0x55f1b28ec0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/1588797929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28ebcc0 0x55f1b28ec0e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f02a8047da0 tx=0x7f02a801cee0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/1588797929 shutdown_connections 2024-09-11T11:01:22.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/1588797929 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0190034650 0x7f0190036b10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/1588797929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b28ebcc0 0x55f1b28ec0e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/1588797929 >> 172.21.15.145:0/1588797929 conn(0x55f1b28e0e10 msgr2=0x55f1b28e3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/1588797929 shutdown_connections 2024-09-11T11:01:22.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/1588797929 wait complete. 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b28d6300 msgr2=0x55f1b28d86f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f1b28d6300 0x55f1b28d86f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b274ff90 msgr2=0x55f1b28d4ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f1b274ff90 0x55f1b28d4ef0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f1b28db990 msgr2=0x55f1b28ddd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.245+0000 7f02bab80980 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f1b28db990 0x55f1b28ddd80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f01a00346f0 msgr2=0x7f01a0036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02bab80980 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f01a00346f0 0x7f01a0036bb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f02ac0ae000 tx=0x7f02ac0a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 msgr2=0x55f1b28cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02bab80980 1 --2- 172.21.15.145:0/3208622566 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f1b274fb80 0x55f1b28cdf60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f02a800f610 tx=0x7f02a8001260 comp rx=0 tx=0).stop 2024-09-11T11:01:22.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02b8e91640 1 -- 172.21.15.145:0/3208622566 reap_dead start 2024-09-11T11:01:22.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 shutdown_connections 2024-09-11T11:01:22.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 >> 172.21.15.145:0/3208622566 conn(0x55f1b27d5160 msgr2=0x55f1b28c1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 shutdown_connections 2024-09-11T11:01:22.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.249+0000 7f02bab80980 1 -- 172.21.15.145:0/3208622566 wait complete. 2024-09-11T11:01:22.262 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[],"summary":[]} 2024-09-11T11:01:22.262 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-11T11:01:22.262 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:01:22.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:01:22.263 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:01:22.342 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:22.342 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:22.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694398d980 1 Processor -- start 2024-09-11T11:01:22.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694398d980 1 -- start start 2024-09-11T11:01:22.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694398d980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5598bfb35df0 0x5598bfb381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694398d980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598bf9bbae0 con 0x5598bfb38750 2024-09-11T11:01:22.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694398d980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5598bf9dfe30 con 0x5598bfb35df0 2024-09-11T11:01:22.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694149d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5598bfb35df0 0x5598bfb381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694149d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5598bfb35df0 0x5598bfb381e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48312/0 (socket says 172.21.15.145:48312) 2024-09-11T11:01:22.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694149d640 1 -- 172.21.15.145:0/792522157 learned_addr learned my addr 172.21.15.145:0/792522157 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694149d640 1 -- 172.21.15.145:0/792522157 >> v1:172.21.15.102:6789/0 conn(0x5598bfb38750 legacy=0x5598bfb3ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.341+0000 7f694149d640 1 -- 172.21.15.145:0/792522157 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bfb3d3f0 con 0x5598bfb35df0 2024-09-11T11:01:22.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f694149d640 1 --2- 172.21.15.145:0/792522157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfb381e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f693400a4e0 tx=0x7f693401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4339e2f78de18d99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f693bfff640 1 -- 172.21.15.145:0/792522157 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340aa540 con 0x5598bfb35df0 2024-09-11T11:01:22.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f693bfff640 1 -- 172.21.15.145:0/792522157 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69340aa6e0 con 0x5598bfb35df0 2024-09-11T11:01:22.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f693bfff640 1 -- 172.21.15.145:0/792522157 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340aaa40 con 0x5598bfb35df0 2024-09-11T11:01:22.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f694398d980 1 -- 172.21.15.145:0/792522157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 msgr2=0x5598bfb381e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f694398d980 1 --2- 172.21.15.145:0/792522157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfb381e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f693400a4e0 tx=0x7f693401b090 comp rx=0 tx=0).stop 2024-09-11T11:01:22.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f694398d980 1 -- 172.21.15.145:0/792522157 shutdown_connections 2024-09-11T11:01:22.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f694398d980 1 --2- 172.21.15.145:0/792522157 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfb381e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f694398d980 1 -- 172.21.15.145:0/792522157 >> 172.21.15.145:0/792522157 conn(0x5598bfaa9280 msgr2=0x5598bfaa9690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f694398d980 1 -- 172.21.15.145:0/792522157 shutdown_connections 2024-09-11T11:01:22.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.345+0000 7f694398d980 1 -- 172.21.15.145:0/792522157 wait complete. 2024-09-11T11:01:22.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.361+0000 7f694398d980 1 Processor -- start 2024-09-11T11:01:22.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.361+0000 7f694398d980 1 -- start start 2024-09-11T11:01:22.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.361+0000 7f694398d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc20cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.361+0000 7f694398d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5598bf9e1200 con 0x5598bfb35df0 2024-09-11T11:01:22.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.361+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc20cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.361+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc20cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48324/0 (socket says 172.21.15.145:48324) 2024-09-11T11:01:22.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.361+0000 7f694149d640 1 -- 172.21.15.145:0/4217268168 learned_addr learned my addr 172.21.15.145:0/4217268168 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694149d640 1 -- 172.21.15.145:0/4217268168 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bfc21280 con 0x5598bfb35df0 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694149d640 1 --2- 172.21.15.145:0/4217268168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc20cb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6934017ca0 tx=0x7f69340033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb130d2b5341de28 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f682f606640 1 -- 172.21.15.145:0/4217268168 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340b9070 con 0x5598bfb35df0 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f682f606640 1 -- 172.21.15.145:0/4217268168 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69340aaa80 con 0x5598bfb35df0 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f682f606640 1 -- 172.21.15.145:0/4217268168 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340aad60 con 0x5598bfb35df0 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- 172.21.15.145:0/4217268168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 msgr2=0x5598bfc20cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 --2- 172.21.15.145:0/4217268168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc20cb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6934017ca0 tx=0x7f69340033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- 172.21.15.145:0/4217268168 shutdown_connections 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 --2- 172.21.15.145:0/4217268168 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc20cb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- 172.21.15.145:0/4217268168 >> 172.21.15.145:0/4217268168 conn(0x5598bfaa9280 msgr2=0x5598bfc1c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- 172.21.15.145:0/4217268168 shutdown_connections 2024-09-11T11:01:22.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- 172.21.15.145:0/4217268168 wait complete. 2024-09-11T11:01:22.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 Processor -- start 2024-09-11T11:01:22.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- start start 2024-09-11T11:01:22.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc27e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5598bfb3ce30 con 0x5598bfb35df0 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc27e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc27e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48326/0 (socket says 172.21.15.145:48326) 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694149d640 1 -- 172.21.15.145:0/1712046230 learned_addr learned my addr 172.21.15.145:0/1712046230 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694149d640 1 -- 172.21.15.145:0/1712046230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bfc28340 con 0x5598bfb35df0 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694149d640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc27e00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f693401aec0 tx=0x7f6934017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f682de03640 1 -- 172.21.15.145:0/1712046230 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340cc070 con 0x5598bfb35df0 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f682de03640 1 -- 172.21.15.145:0/1712046230 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69340c7410 con 0x5598bfb35df0 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598bfc285d0 con 0x5598bfb35df0 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f682de03640 1 -- 172.21.15.145:0/1712046230 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340b9070 con 0x5598bfb35df0 2024-09-11T11:01:22.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.365+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598bfc2b2b0 con 0x5598bfb35df0 2024-09-11T11:01:22.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f682de03640 1 -- 172.21.15.145:0/1712046230 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69340b3040 con 0x5598bfb35df0 2024-09-11T11:01:22.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f682de03640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6828034650 0x7f6828036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f682de03640 1 -- 172.21.15.145:0/1712046230 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f69340c4070 con 0x5598bfb35df0 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f6940c9c640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6828034650 0x7f6828036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f694398d980 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfb38750 0x5598bfc2ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc2f4d0 con 0x5598bfb38750 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f6941c9e640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfb38750 0x5598bfc2ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f6940c9c640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6828034650 0x7f6828036b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f692c001e20 tx=0x7f692c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f6941c9e640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfb38750 0x5598bfc2ef00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f6941c9e640 1 -- 172.21.15.145:0/1712046230 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfb38750 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f694398d980 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc30280 0x5598bfc32670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc32cd0 con 0x5598bfc30280 2024-09-11T11:01:22.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f694149d640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc30280 0x5598bfc32670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.369+0000 7f694149d640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc30280 0x5598bfc32670 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694149d640 1 -- 172.21.15.145:0/1712046230 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f69340d1c90 con 0x5598bfc30280 2024-09-11T11:01:22.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc34580 con 0x5598bfc30280 2024-09-11T11:01:22.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694149d640 1 -- 172.21.15.145:0/1712046230 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f69340d1c90 con 0x5598bfc30280 2024-09-11T11:01:22.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc337b0 con 0x5598bfc30280 2024-09-11T11:01:22.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694149d640 1 -- 172.21.15.145:0/1712046230 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f69340d1c90 con 0x5598bfc30280 2024-09-11T11:01:22.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694398d980 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5598bfc35930 0x5598bfc37d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc38260 con 0x5598bfc35930 2024-09-11T11:01:22.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f6940c9c640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5598bfc35930 0x5598bfc37d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f6940c9c640 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5598bfc35930 0x5598bfc37d20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f6940c9c640 1 -- 172.21.15.145:0/1712046230 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f692c00d040 con 0x5598bfc35930 2024-09-11T11:01:22.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694398d980 1 Processor -- start 2024-09-11T11:01:22.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694398d980 1 -- start start 2024-09-11T11:01:22.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694398d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc45c20 0x5598bfc46040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694398d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5598bfa3a800 con 0x5598bfc45c20 2024-09-11T11:01:22.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc45c20 0x5598bfc46040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc45c20 0x5598bfc46040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48334/0 (socket says 172.21.15.145:48334) 2024-09-11T11:01:22.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.373+0000 7f694149d640 1 -- 172.21.15.145:0/4220075945 learned_addr learned my addr 172.21.15.145:0/4220075945 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694149d640 1 -- 172.21.15.145:0/4220075945 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bfc46580 con 0x5598bfc45c20 2024-09-11T11:01:22.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694149d640 1 --2- 172.21.15.145:0/4220075945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc45c20 0x5598bfc46040 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f69340e2e90 tx=0x7f69340cfec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f6826ffd640 1 -- 172.21.15.145:0/4220075945 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340e4b50 con 0x5598bfc45c20 2024-09-11T11:01:22.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f6826ffd640 1 -- 172.21.15.145:0/4220075945 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69340e8070 con 0x5598bfc45c20 2024-09-11T11:01:22.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694398d980 1 -- 172.21.15.145:0/4220075945 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598bfc46810 con 0x5598bfc45c20 2024-09-11T11:01:22.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f6826ffd640 1 -- 172.21.15.145:0/4220075945 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340e4e60 con 0x5598bfc45c20 2024-09-11T11:01:22.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694398d980 1 -- 172.21.15.145:0/4220075945 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598bfc49490 con 0x5598bfc45c20 2024-09-11T11:01:22.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f6826ffd640 1 -- 172.21.15.145:0/4220075945 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f69340ea020 con 0x5598bfc45c20 2024-09-11T11:01:22.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f6826ffd640 1 --2- 172.21.15.145:0/4220075945 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f68180346a0 0x7f6818036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f6826ffd640 1 -- 172.21.15.145:0/4220075945 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f69340d6040 con 0x5598bfc45c20 2024-09-11T11:01:22.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f6940c9c640 1 --2- 172.21.15.145:0/4220075945 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f68180346a0 0x7f6818036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694398d980 1 Processor -- start 2024-09-11T11:01:22.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694398d980 1 -- start start 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f6940c9c640 1 --2- 172.21.15.145:0/4220075945 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f68180346a0 0x7f6818036b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x5598bfc2c3f0 tx=0x7f692c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694398d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc52920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694398d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5598bfc21540 con 0x5598bfc52540 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc52920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc52920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48338/0 (socket says 172.21.15.145:48338) 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694149d640 1 -- 172.21.15.145:0/1760930303 learned_addr learned my addr 172.21.15.145:0/1760930303 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.377+0000 7f694149d640 1 -- 172.21.15.145:0/1760930303 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bfc52ef0 con 0x5598bfc52540 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694149d640 1 --2- 172.21.15.145:0/1760930303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc52920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f693401b0b0 tx=0x7f69340c7ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9797e8300dbc14ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f6824ff9640 1 -- 172.21.15.145:0/1760930303 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6934105070 con 0x5598bfc52540 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f6824ff9640 1 -- 172.21.15.145:0/1760930303 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69340cebe0 con 0x5598bfc52540 2024-09-11T11:01:22.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f6824ff9640 1 -- 172.21.15.145:0/1760930303 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69340da960 con 0x5598bfc52540 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- 172.21.15.145:0/1760930303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 msgr2=0x5598bfc52920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 --2- 172.21.15.145:0/1760930303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc52920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f693401b0b0 tx=0x7f69340c7ca0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- 172.21.15.145:0/1760930303 shutdown_connections 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 --2- 172.21.15.145:0/1760930303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc52920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- 172.21.15.145:0/1760930303 >> 172.21.15.145:0/1760930303 conn(0x5598bfc4e920 msgr2=0x5598bfc4ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- 172.21.15.145:0/1760930303 shutdown_connections 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- 172.21.15.145:0/1760930303 wait complete. 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 Processor -- start 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- start start 2024-09-11T11:01:22.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5598bfc52ef0 con 0x5598bfc52540 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694149d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48346/0 (socket says 172.21.15.145:48346) 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 learned_addr learned my addr 172.21.15.145:0/3494455519 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598bfc59af0 con 0x5598bfc52540 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694149d640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc595b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f69340d1fd0 tx=0x7f69340d1b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f6816ffd640 1 -- 172.21.15.145:0/3494455519 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6934110070 con 0x5598bfc52540 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598bfc59af0 con 0x5598bfc52540 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f6816ffd640 1 -- 172.21.15.145:0/3494455519 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69340cf890 con 0x5598bfc52540 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f6816ffd640 1 -- 172.21.15.145:0/3494455519 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6934105040 con 0x5598bfc52540 2024-09-11T11:01:22.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.381+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598bfc59f60 con 0x5598bfc52540 2024-09-11T11:01:22.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6816ffd640 1 -- 172.21.15.145:0/3494455519 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6934113070 con 0x5598bfc52540 2024-09-11T11:01:22.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6816ffd640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f680c034650 0x7f680c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6816ffd640 1 -- 172.21.15.145:0/3494455519 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6934116b00 con 0x5598bfc52540 2024-09-11T11:01:22.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfc64580 0x5598bfc66a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6940c9c640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f680c034650 0x7f680c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc67190 con 0x5598bfc64580 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6941c9e640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfc64580 0x5598bfc66a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6940c9c640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f680c034650 0x7f680c036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5598bfc344d0 tx=0x7f692c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6941c9e640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfc64580 0x5598bfc66a40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 realm 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc63a30 con 0x5598bfc64580 2024-09-11T11:01:22.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc67c60 con 0x5598bfc64580 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc68810 0x5598bfc6acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694149d640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc68810 0x5598bfc6acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694149d640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc68810 0x5598bfc6acd0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.385+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6bce0 con 0x5598bfc68810 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f694398d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f694398d980 20 searching for the correct realm 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5598bfc6d510 0x5598bfc6f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc700a0 con 0x5598bfc6d510 2024-09-11T11:01:22.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6940c9c640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5598bfc6d510 0x5598bfc6f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6940c9c640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5598bfc6d510 0x5598bfc6f9d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc700a0 con 0x5598bfc68810 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f694149d640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6934115070 0x7f6934100870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x7f6934115070 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6941c9e640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6934115070 0x7f6934100870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6941c9e640 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6934115070 0x7f6934100870 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc6d510 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.389+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x7f6934115070 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x7f6934115070 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc6d510 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.393+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc6d510 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc6d510 2024-09-11T11:01:22.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x7f6934115070 2024-09-11T11:01:22.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc64580 2024-09-11T11:01:22.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x7f6934115070 2024-09-11T11:01:22.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc6d510 2024-09-11T11:01:22.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x7f6934115070 2024-09-11T11:01:22.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.397+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc6d510 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6b440 con 0x5598bfc68810 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:22.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6be10 con 0x5598bfc64580 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6c200 con 0x5598bfc68810 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc6c200 con 0x7f6934115070 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 zone default found 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 4 Realm: () 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 zonegroup default 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.401+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc70520 con 0x7f6934115070 2024-09-11T11:01:22.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc722a0 con 0x5598bfc6d510 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc72640 con 0x5598bfc6d510 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 20 started sync module instance, tier type = 2024-09-11T11:01:22.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:22.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc71740 con 0x5598bfc68810 2024-09-11T11:01:22.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94114540887184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc71740 con 0x5598bfc68810 2024-09-11T11:01:22.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.405+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc73140 con 0x5598bfc64580 2024-09-11T11:01:22.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.409+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.409+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94114540891152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc73100 con 0x5598bfc64580 2024-09-11T11:01:22.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.409+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc74070 con 0x5598bfc68810 2024-09-11T11:01:22.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.409+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94114540891152] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.409+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94114540887184] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.413+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.413+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94114540884624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc74070 con 0x5598bfc68810 2024-09-11T11:01:22.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.413+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc744d0 con 0x7f6934115070 2024-09-11T11:01:22.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.413+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.413+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94114540893488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc74490 con 0x7f6934115070 2024-09-11T11:01:22.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.413+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc75390 con 0x5598bfc68810 2024-09-11T11:01:22.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.413+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94114540893488] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.413+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94114540884624] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.417+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.417+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94114540895104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc74ee0 con 0x5598bfc68810 2024-09-11T11:01:22.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.417+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc75c30 con 0x5598bfc6d510 2024-09-11T11:01:22.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.417+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.417+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94114540902272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc74ee0 con 0x5598bfc6d510 2024-09-11T11:01:22.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.417+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc76990 con 0x5598bfc6d510 2024-09-11T11:01:22.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.417+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94114540895104] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.421+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94114540902272] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.421+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.421+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94114540898496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc76950 con 0x5598bfc6d510 2024-09-11T11:01:22.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.421+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc77230 con 0x7f6934115070 2024-09-11T11:01:22.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.421+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94114540898496] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94114540904400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc76950 con 0x7f6934115070 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f694398d980 20 add_watcher() i=0 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f694398d980 20 add_watcher() i=1 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f694398d980 20 add_watcher() i=2 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f694398d980 20 add_watcher() i=3 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f694398d980 20 add_watcher() i=4 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f694398d980 20 add_watcher() i=5 2024-09-11T11:01:22.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.425+0000 7f694398d980 20 add_watcher() i=6 2024-09-11T11:01:22.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.429+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94114540904400] v32'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.429+0000 7f694398d980 20 add_watcher() i=7 2024-09-11T11:01:22.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.429+0000 7f694398d980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:22.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.429+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc7a380 con 0x5598bfc64580 2024-09-11T11:01:22.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.429+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.429+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94114540907904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc778a0 con 0x5598bfc64580 2024-09-11T11:01:22.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94114540907904] v32'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f67f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:22.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:22.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 5 note: GC not initialized 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f67f67e4640 20 reqs_thread_entry: start 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 20 Filter name: none 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f6767fff640 20 reqs_thread_entry: start 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d550 con 0x5598bfc64580 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.435 INFO:teuthology.orchestra.run.smithi145.stderr:could not fetch user info: no user info saved 2024-09-11T11:01:22.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f67f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:22.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.433+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94114540907904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x5598bfc64580 2024-09-11T11:01:22.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94114540907904] v32'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94114540887184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x5598bfc68810 2024-09-11T11:01:22.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94114540887184] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f694398d980 20 remove_watcher() i=0 2024-09-11T11:01:22.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f694398d980 2 removed watcher, disabling cache 2024-09-11T11:01:22.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94114540891152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x5598bfc64580 2024-09-11T11:01:22.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94114540891152] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x5598bfc64580 2024-09-11T11:01:22.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f694398d980 20 remove_watcher() i=1 2024-09-11T11:01:22.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.437+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94114540884624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x5598bfc68810 2024-09-11T11:01:22.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.441+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94114540884624] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.441+0000 7f694398d980 20 remove_watcher() i=2 2024-09-11T11:01:22.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.441+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94114540893488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x7f6934115070 2024-09-11T11:01:22.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.441+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94114540893488] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.441+0000 7f694398d980 20 remove_watcher() i=3 2024-09-11T11:01:22.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.441+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94114540895104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x5598bfc68810 2024-09-11T11:01:22.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f694149d640 1 -- 172.21.15.145:0/3494455519 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94114540895104] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693411c070 con 0x5598bfc68810 2024-09-11T11:01:22.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f694398d980 20 remove_watcher() i=4 2024-09-11T11:01:22.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94114540902272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x5598bfc6d510 2024-09-11T11:01:22.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94114540902272] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f694398d980 20 remove_watcher() i=5 2024-09-11T11:01:22.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94114540898496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x5598bfc6d510 2024-09-11T11:01:22.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f6940c9c640 1 -- 172.21.15.145:0/3494455519 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94114540898496] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f692c036040 con 0x5598bfc6d510 2024-09-11T11:01:22.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f694398d980 20 remove_watcher() i=6 2024-09-11T11:01:22.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.445+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94114540904400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5598bfc9d510 con 0x7f6934115070 2024-09-11T11:01:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94114540904400] v32'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f693c0083f0 con 0x7f6934115070 2024-09-11T11:01:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 20 remove_watcher() i=7 2024-09-11T11:01:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc68810 msgr2=0x5598bfc6acd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc68810 0x5598bfc6acd0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfc64580 msgr2=0x5598bfc66a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfc64580 0x5598bfc66a40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6934115070 msgr2=0x7f6934100870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6934115070 0x7f6934100870 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5598bfc6d510 msgr2=0x5598bfc6f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5598bfc6d510 0x5598bfc6f9d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f680c034650 msgr2=0x7f680c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f680c034650 0x7f680c036b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x5598bfc344d0 tx=0x7f692c011000 comp rx=0 tx=0).stop 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 msgr2=0x5598bfc595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc595b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f69340d1fd0 tx=0x7f69340d1b70 comp rx=0 tx=0).stop 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f6941c9e640 1 -- 172.21.15.145:0/3494455519 reap_dead start 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 shutdown_connections 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/3494455519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc52540 0x5598bfc595b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 >> 172.21.15.145:0/3494455519 conn(0x5598bfc4e920 msgr2=0x5598bfc4c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 shutdown_connections 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/3494455519 wait complete. 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/4220075945 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f68180346a0 msgr2=0x7f6818036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/4220075945 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f68180346a0 0x7f6818036b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x5598bfc2c3f0 tx=0x7f692c006000 comp rx=0 tx=0).stop 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/4220075945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc45c20 msgr2=0x5598bfc46040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/4220075945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc45c20 0x5598bfc46040 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f69340e2e90 tx=0x7f69340cfec0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/4220075945 shutdown_connections 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/4220075945 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f68180346a0 0x7f6818036b60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/4220075945 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfc45c20 0x5598bfc46040 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/4220075945 >> 172.21.15.145:0/4220075945 conn(0x5598bfc3ad70 msgr2=0x5598bfc3d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/4220075945 shutdown_connections 2024-09-11T11:01:22.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/4220075945 wait complete. 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc30280 msgr2=0x5598bfc32670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5598bfc30280 0x5598bfc32670 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfb38750 msgr2=0x5598bfc2ef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5598bfb38750 0x5598bfc2ef00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5598bfc35930 msgr2=0x5598bfc37d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5598bfc35930 0x5598bfc37d20 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6828034650 msgr2=0x7f6828036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6828034650 0x7f6828036b10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f692c001e20 tx=0x7f692c0013a0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 msgr2=0x5598bfc27e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 --2- 172.21.15.145:0/1712046230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5598bfb35df0 0x5598bfc27e00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f693401aec0 tx=0x7f6934017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:22.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f6941c9e640 1 -- 172.21.15.145:0/1712046230 reap_dead start 2024-09-11T11:01:22.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 shutdown_connections 2024-09-11T11:01:22.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 >> 172.21.15.145:0/1712046230 conn(0x5598bfaa9280 msgr2=0x5598bfc1b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 shutdown_connections 2024-09-11T11:01:22.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.449+0000 7f694398d980 1 -- 172.21.15.145:0/1712046230 wait complete. 2024-09-11T11:01:22.464 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T11:01:22.464 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-11T11:01:22.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-11T11:01:22.465 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-11T11:01:22.552 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:22.552 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:22.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.549+0000 7fd151df0980 1 Processor -- start 2024-09-11T11:01:22.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.549+0000 7fd151df0980 1 -- start start 2024-09-11T11:01:22.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd151df0980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55869035dc00 0x55869035fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd151df0980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5586901dfae0 con 0x558690359880 2024-09-11T11:01:22.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd151df0980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x558690203e30 con 0x55869035dc00 2024-09-11T11:01:22.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14f0ff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55869035dc00 0x55869035fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14f0ff640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55869035dc00 0x55869035fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48356/0 (socket says 172.21.15.145:48356) 2024-09-11T11:01:22.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14f0ff640 1 -- 172.21.15.145:0/4138944984 learned_addr learned my addr 172.21.15.145:0/4138944984 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14f900640 1 --1- 172.21.15.145:0/4138944984 >> v1:172.21.15.102:6789/0 conn(0x558690359880 0x558690359c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48558/0 (socket says 172.21.15.145:48558) 2024-09-11T11:01:22.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14f0ff640 1 -- 172.21.15.145:0/4138944984 >> v1:172.21.15.102:6789/0 conn(0x558690359880 legacy=0x558690359c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14f0ff640 1 -- 172.21.15.145:0/4138944984 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558690361540 con 0x55869035dc00 2024-09-11T11:01:22.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/4138944984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55869035dc00 0x55869035fff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd14400a5c0 tx=0x7fd14401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d033bf2e29cd3359 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14e8fe640 1 -- 172.21.15.145:0/4138944984 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1440a6070 con 0x55869035dc00 2024-09-11T11:01:22.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14e8fe640 1 -- 172.21.15.145:0/4138944984 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1440af070 con 0x55869035dc00 2024-09-11T11:01:22.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.553+0000 7fd14e8fe640 1 -- 172.21.15.145:0/4138944984 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd1440aa5c0 con 0x55869035dc00 2024-09-11T11:01:22.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.557+0000 7fd151df0980 1 -- 172.21.15.145:0/4138944984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55869035dc00 msgr2=0x55869035fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.557+0000 7fd151df0980 1 --2- 172.21.15.145:0/4138944984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55869035dc00 0x55869035fff0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd14400a5c0 tx=0x7fd14401b340 comp rx=0 tx=0).stop 2024-09-11T11:01:22.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.557+0000 7fd151df0980 1 -- 172.21.15.145:0/4138944984 shutdown_connections 2024-09-11T11:01:22.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.557+0000 7fd151df0980 1 --2- 172.21.15.145:0/4138944984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55869035dc00 0x55869035fff0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.557+0000 7fd151df0980 1 -- 172.21.15.145:0/4138944984 >> 172.21.15.145:0/4138944984 conn(0x5586902cd1d0 msgr2=0x5586902cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.557+0000 7fd151df0980 1 -- 172.21.15.145:0/4138944984 shutdown_connections 2024-09-11T11:01:22.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.557+0000 7fd151df0980 1 -- 172.21.15.145:0/4138944984 wait complete. 2024-09-11T11:01:22.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.569+0000 7fd151df0980 1 Processor -- start 2024-09-11T11:01:22.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.569+0000 7fd151df0980 1 -- start start 2024-09-11T11:01:22.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.569+0000 7fd151df0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x558690444c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.569+0000 7fd151df0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558690205200 con 0x558690359880 2024-09-11T11:01:22.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x558690444c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x558690444c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48370/0 (socket says 172.21.15.145:48370) 2024-09-11T11:01:22.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 -- 172.21.15.145:0/4066473731 learned_addr learned my addr 172.21.15.145:0/4066473731 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 -- 172.21.15.145:0/4066473731 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558690445260 con 0x558690359880 2024-09-11T11:01:22.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 --2- 172.21.15.145:0/4066473731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x558690444c90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd148001690 tx=0x7fd148001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148761c3b629e55e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd03de0b640 1 -- 172.21.15.145:0/4066473731 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd148003460 con 0x558690359880 2024-09-11T11:01:22.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd03de0b640 1 -- 172.21.15.145:0/4066473731 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd148003600 con 0x558690359880 2024-09-11T11:01:22.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd03de0b640 1 -- 172.21.15.145:0/4066473731 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd148003920 con 0x558690359880 2024-09-11T11:01:22.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 -- 172.21.15.145:0/4066473731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 msgr2=0x558690444c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 --2- 172.21.15.145:0/4066473731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x558690444c90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd148001690 tx=0x7fd148001b50 comp rx=0 tx=0).stop 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 -- 172.21.15.145:0/4066473731 shutdown_connections 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 --2- 172.21.15.145:0/4066473731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x558690444c90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 -- 172.21.15.145:0/4066473731 >> 172.21.15.145:0/4066473731 conn(0x5586902cd1d0 msgr2=0x5586904408c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 -- 172.21.15.145:0/4066473731 shutdown_connections 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 -- 172.21.15.145:0/4066473731 wait complete. 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 Processor -- start 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 -- start start 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x55869044bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd151df0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558690361040 con 0x558690359880 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x55869044bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x55869044bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48386/0 (socket says 172.21.15.145:48386) 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 -- 172.21.15.145:0/903353226 learned_addr learned my addr 172.21.15.145:0/903353226 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 -- 172.21.15.145:0/903353226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55869044c4e0 con 0x558690359880 2024-09-11T11:01:22.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.573+0000 7fd14f900640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x55869044bfa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd148000f90 tx=0x7fd148001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd037fff640 1 -- 172.21.15.145:0/903353226 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd148022020 con 0x558690359880 2024-09-11T11:01:22.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55869044c770 con 0x558690359880 2024-09-11T11:01:22.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd037fff640 1 -- 172.21.15.145:0/903353226 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd148006840 con 0x558690359880 2024-09-11T11:01:22.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd037fff640 1 -- 172.21.15.145:0/903353226 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14801e800 con 0x558690359880 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55869044f450 con 0x558690359880 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd037fff640 1 -- 172.21.15.145:0/903353226 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd148025020 con 0x558690359880 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd037fff640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd038034600 0x7fd038036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd037fff640 1 -- 172.21.15.145:0/903353226 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fd148049ae0 con 0x558690359880 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd038034600 0x7fd038036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd151df0980 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55869035dc00 0x5586904530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904535e0 con 0x55869035dc00 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd150101640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55869035dc00 0x5586904530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd038034600 0x7fd038036ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd1440ae000 tx=0x7fd1440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd150101640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55869035dc00 0x5586904530a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd150101640 1 -- 172.21.15.145:0/903353226 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x55869035dc00 2024-09-11T11:01:22.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd151df0980 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5586904543d0 0x5586904567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690456df0 con 0x5586904543d0 2024-09-11T11:01:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd14f900640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5586904543d0 0x5586904567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.577+0000 7fd14f900640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5586904543d0 0x5586904567c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd14f900640 1 -- 172.21.15.145:0/903353226 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd14801b040 con 0x5586904543d0 2024-09-11T11:01:22.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904586a0 con 0x5586904543d0 2024-09-11T11:01:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd14f900640 1 -- 172.21.15.145:0/903353226 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd14801b040 con 0x5586904543d0 2024-09-11T11:01:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690457810 con 0x5586904543d0 2024-09-11T11:01:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd14f900640 1 -- 172.21.15.145:0/903353226 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd14801b040 con 0x5586904543d0 2024-09-11T11:01:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd151df0980 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558690459a50 0x55869045be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55869045c380 con 0x558690459a50 2024-09-11T11:01:22.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558690459a50 0x55869045be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558690459a50 0x55869045be40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd14f0ff640 1 -- 172.21.15.145:0/903353226 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690459a50 2024-09-11T11:01:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd151df0980 1 Processor -- start 2024-09-11T11:01:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd151df0980 1 -- start start 2024-09-11T11:01:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd151df0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690469d60 0x55869046a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.581+0000 7fd151df0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55869025e800 con 0x558690469d60 2024-09-11T11:01:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690469d60 0x55869046a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690469d60 0x55869046a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48390/0 (socket says 172.21.15.145:48390) 2024-09-11T11:01:22.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd14f900640 1 -- 172.21.15.145:0/3933329864 learned_addr learned my addr 172.21.15.145:0/3933329864 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd14f900640 1 -- 172.21.15.145:0/3933329864 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55869046a6c0 con 0x558690469d60 2024-09-11T11:01:22.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd14f900640 1 --2- 172.21.15.145:0/3933329864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690469d60 0x55869046a180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd148006810 tx=0x7fd148010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd0357fa640 1 -- 172.21.15.145:0/3933329864 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd148041250 con 0x558690469d60 2024-09-11T11:01:22.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd0357fa640 1 -- 172.21.15.145:0/3933329864 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1480413f0 con 0x558690469d60 2024-09-11T11:01:22.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd151df0980 1 -- 172.21.15.145:0/3933329864 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55869046a950 con 0x558690469d60 2024-09-11T11:01:22.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd0357fa640 1 -- 172.21.15.145:0/3933329864 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14801eb90 con 0x558690469d60 2024-09-11T11:01:22.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd151df0980 1 -- 172.21.15.145:0/3933329864 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55869046d5d0 con 0x558690469d60 2024-09-11T11:01:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd0357fa640 1 -- 172.21.15.145:0/3933329864 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd148049440 con 0x558690469d60 2024-09-11T11:01:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd0357fa640 1 --2- 172.21.15.145:0/3933329864 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0280346a0 0x7fd028036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd0357fa640 1 -- 172.21.15.145:0/3933329864 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fd1480406d0 con 0x558690469d60 2024-09-11T11:01:22.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/3933329864 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0280346a0 0x7fd028036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd151df0980 1 Processor -- start 2024-09-11T11:01:22.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd151df0980 1 -- start start 2024-09-11T11:01:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd151df0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x558690476a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd151df0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558690445580 con 0x558690476660 2024-09-11T11:01:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.585+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/3933329864 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0280346a0 0x7fd028036b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x558690450590 tx=0x7fd144005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x558690476a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x558690476a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48394/0 (socket says 172.21.15.145:48394) 2024-09-11T11:01:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 -- 172.21.15.145:0/455106287 learned_addr learned my addr 172.21.15.145:0/455106287 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 -- 172.21.15.145:0/455106287 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558690477030 con 0x558690476660 2024-09-11T11:01:22.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 --2- 172.21.15.145:0/455106287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x558690476a60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd1480035d0 tx=0x7fd148033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab53f76f7e0a7a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd02effd640 1 -- 172.21.15.145:0/455106287 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd148062070 con 0x558690476660 2024-09-11T11:01:22.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd02effd640 1 -- 172.21.15.145:0/455106287 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd148028a20 con 0x558690476660 2024-09-11T11:01:22.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd02effd640 1 -- 172.21.15.145:0/455106287 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd148033650 con 0x558690476660 2024-09-11T11:01:22.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 -- 172.21.15.145:0/455106287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 msgr2=0x558690476a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 --2- 172.21.15.145:0/455106287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x558690476a60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd1480035d0 tx=0x7fd148033d90 comp rx=0 tx=0).stop 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 -- 172.21.15.145:0/455106287 shutdown_connections 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 --2- 172.21.15.145:0/455106287 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x558690476a60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 -- 172.21.15.145:0/455106287 >> 172.21.15.145:0/455106287 conn(0x558690472a40 msgr2=0x558690470b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 -- 172.21.15.145:0/455106287 shutdown_connections 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 -- 172.21.15.145:0/455106287 wait complete. 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 Processor -- start 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 -- start start 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x55869047d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd151df0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5586904774b0 con 0x558690476660 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x55869047d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x55869047d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48396/0 (socket says 172.21.15.145:48396) 2024-09-11T11:01:22.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 learned_addr learned my addr 172.21.15.145:0/2240138448 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55869047ddd0 con 0x558690476660 2024-09-11T11:01:22.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd14f900640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x55869047d890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd14803e5b0 tx=0x7fd148034190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd02d7fa640 1 -- 172.21.15.145:0/2240138448 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd14806d020 con 0x558690476660 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.589+0000 7fd02d7fa640 1 -- 172.21.15.145:0/2240138448 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1480400a0 con 0x558690476660 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55869047ddd0 con 0x558690476660 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd02d7fa640 1 -- 172.21.15.145:0/2240138448 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd148062040 con 0x558690476660 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55869047ddd0 con 0x558690476660 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd02d7fa640 1 -- 172.21.15.145:0/2240138448 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd148070020 con 0x558690476660 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd02d7fa640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0180346a0 0x7fd018036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd02d7fa640 1 -- 172.21.15.145:0/2240138448 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fd14805a070 con 0x558690476660 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0180346a0 0x7fd018036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558690488960 0x55869048ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55869048b570 con 0x558690488960 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd150101640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558690488960 0x55869048ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0180346a0 0x7fd018036b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd144000c10 tx=0x7fd1440c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd150101640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558690488960 0x55869048ae20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 20 realm 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690487d90 con 0x558690488960 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:22.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55869048c000 con 0x558690488960 2024-09-11T11:01:22.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55869048cde0 0x55869048f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55869048f860 con 0x55869048cde0 2024-09-11T11:01:22.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.593+0000 7fd14f900640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55869048cde0 0x55869048f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f900640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55869048cde0 0x55869048f1d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd151df0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd151df0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd151df0980 20 searching for the correct realm 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558690491e20 0x558690494210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558690494890 con 0x558690491e20 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558690491e20 0x558690494210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f0ff640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558690491e20 0x558690494210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558690494890 con 0x55869048cde0 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f900640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd148072020 0x7fd14806e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x7fd148072020 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd150101640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd148072020 0x7fd14806e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd150101640 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd148072020 0x7fd14806e980 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.597+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690491e20 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x7fd148072020 2024-09-11T11:01:22.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x7fd148072020 2024-09-11T11:01:22.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690491e20 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.601+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690491e20 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690491e20 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x7fd148072020 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690488960 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x7fd148072020 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690491e20 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x7fd148072020 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.605+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x558690491e20 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5586904900b0 con 0x55869048cde0 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690490900 con 0x558690488960 2024-09-11T11:01:22.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690490cf0 con 0x55869048cde0 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.609+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690490cf0 con 0x7fd148072020 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 zone default found 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 4 Realm: () 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:22.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 zonegroup default 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690494d10 con 0x7fd148072020 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690496af0 con 0x558690491e20 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558690496f60 con 0x558690491e20 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 started sync module instance, tier type = 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690495f30 con 0x55869048cde0 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94036434707504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690495f30 con 0x55869048cde0 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.613+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690497a20 con 0x558690488960 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.617+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.617+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94036434711856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690497950 con 0x558690488960 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.617+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690498940 con 0x55869048cde0 2024-09-11T11:01:22.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.617+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94036434707504] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.617+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94036434711856] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.617+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.617+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94036434714128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690498900 con 0x55869048cde0 2024-09-11T11:01:22.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.617+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904991e0 con 0x7fd148072020 2024-09-11T11:01:22.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94036434718000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690498900 con 0x7fd148072020 2024-09-11T11:01:22.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690499c60 con 0x55869048cde0 2024-09-11T11:01:22.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94036434714128] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94036434718000] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94036434719056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558690499c60 con 0x55869048cde0 2024-09-11T11:01:22.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55869049a050 con 0x558690491e20 2024-09-11T11:01:22.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94036434715696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55869049a8f0 con 0x558690491e20 2024-09-11T11:01:22.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.621+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55869049b2b0 con 0x558690491e20 2024-09-11T11:01:22.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94036434719056] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94036434715696] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94036434726400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55869049b6a0 con 0x558690491e20 2024-09-11T11:01:22.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55869049bf30 con 0x7fd148072020 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94036434726400] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94036434720624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55869049bb50 con 0x7fd148072020 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 20 add_watcher() i=0 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 20 add_watcher() i=1 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 20 add_watcher() i=2 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 20 add_watcher() i=3 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 20 add_watcher() i=4 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 20 add_watcher() i=5 2024-09-11T11:01:22.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.625+0000 7fd151df0980 20 add_watcher() i=6 2024-09-11T11:01:22.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94036434720624] v32'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd151df0980 20 add_watcher() i=7 2024-09-11T11:01:22.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd151df0980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:22.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55869049f3b0 con 0x558690488960 2024-09-11T11:01:22.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94036434729072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55869049c8a0 con 0x558690488960 2024-09-11T11:01:22.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94036434729072] v32'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:22.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd151df0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:22.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd151df0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:22.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.629+0000 7fd151df0980 5 note: GC not initialized 2024-09-11T11:01:22.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd004fe1640 20 reqs_thread_entry: start 2024-09-11T11:01:22.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:22.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 20 Filter name: none 2024-09-11T11:01:22.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fcf7e7fc640 20 reqs_thread_entry: start 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904c2af0 con 0x558690488960 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904c1290 con 0x558690488960 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904c1680 con 0x558690488960 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-11T11:01:22.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c6090 con 0x558690488960 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.633+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94036434885632 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904c6620 con 0x55869048cde0 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94036434719056 notify 137438953472 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55869046a950 con 0x55869048cde0 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd02effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94036434719056 notifier 4297 bl.length()=567 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd02effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:22.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd02effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:22.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd02effd640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd014003eb0 con 0x55869048cde0 2024-09-11T11:01:22.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.4 [notify cookie 94036434885632 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94036434885632 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55869046a6c0 con 0x55869048cde0 2024-09-11T11:01:22.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c1c00 con 0x558690488960 2024-09-11T11:01:22.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd151df0980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-11T11:01:22.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd151df0980 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-11T11:01:22.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd151df0980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94036434885632 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904c6a50 con 0x7fd148072020 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== watch-notify(notify (1) cookie 94036434718000 notify 137438953472 ret 0) ==== 211+0+0 (crc 0 0 0) 0x5586904c27a0 con 0x7fd148072020 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd02e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953472 cookie 94036434718000 notifier 4297 bl.length()=169 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd02e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd02e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.637+0000 7fd02e7fc640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fcf84003410 con 0x7fd148072020 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 notify.3 [notify cookie 94036434885632 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== watch-notify(notify_complete (2) cookie 94036434885632 notify 137438953472 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5586904c2540 con 0x7fd148072020 2024-09-11T11:01:22.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c1c00 con 0x558690488960 2024-09-11T11:01:22.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd151df0980 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd151df0980 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd151df0980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94036434885632 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5586904c6a50 con 0x7fd148072020 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== watch-notify(notify (1) cookie 94036434718000 notify 137438953473 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5586904c2540 con 0x7fd148072020 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd02effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94036434718000 notifier 4297 bl.length()=177 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd02effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd02effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(72 notify.3 [notify cookie 94036434885632 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd02effd640 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fd014003eb0 con 0x7fd148072020 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== watch-notify(notify_complete (2) cookie 94036434885632 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd140029480 con 0x7fd148072020 2024-09-11T11:01:22.645 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:22.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd005fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:22.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.641+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94036434729072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c08c0 con 0x558690488960 2024-09-11T11:01:22.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.645+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94036434729072] v32'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.645+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94036434707504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c08c0 con 0x55869048cde0 2024-09-11T11:01:22.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.645+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94036434707504] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.645+0000 7fd151df0980 20 remove_watcher() i=0 2024-09-11T11:01:22.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.645+0000 7fd151df0980 2 removed watcher, disabling cache 2024-09-11T11:01:22.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.645+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94036434711856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c08c0 con 0x558690488960 2024-09-11T11:01:22.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.649+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94036434711856] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x558690488960 2024-09-11T11:01:22.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.649+0000 7fd151df0980 20 remove_watcher() i=1 2024-09-11T11:01:22.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.649+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94036434714128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c08c0 con 0x55869048cde0 2024-09-11T11:01:22.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.649+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94036434714128] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.649+0000 7fd151df0980 20 remove_watcher() i=2 2024-09-11T11:01:22.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.649+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94036434718000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c08c0 con 0x7fd148072020 2024-09-11T11:01:22.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.653+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94036434718000] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.653+0000 7fd151df0980 20 remove_watcher() i=3 2024-09-11T11:01:22.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.653+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94036434719056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c08c0 con 0x55869048cde0 2024-09-11T11:01:22.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.653+0000 7fd14f900640 1 -- 172.21.15.145:0/2240138448 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94036434719056] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd148065040 con 0x55869048cde0 2024-09-11T11:01:22.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.653+0000 7fd151df0980 20 remove_watcher() i=4 2024-09-11T11:01:22.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.653+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94036434715696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904991e0 con 0x558690491e20 2024-09-11T11:01:22.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94036434715696] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 20 remove_watcher() i=5 2024-09-11T11:01:22.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94036434726400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c08c0 con 0x558690491e20 2024-09-11T11:01:22.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd14f0ff640 1 -- 172.21.15.145:0/2240138448 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94036434726400] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1440aaad0 con 0x558690491e20 2024-09-11T11:01:22.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 20 remove_watcher() i=6 2024-09-11T11:01:22.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94036434720624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5586904c08c0 con 0x7fd148072020 2024-09-11T11:01:22.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94036434720624] v32'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd1400083f0 con 0x7fd148072020 2024-09-11T11:01:22.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 20 remove_watcher() i=7 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55869048cde0 msgr2=0x55869048f1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55869048cde0 0x55869048f1d0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558690488960 msgr2=0x55869048ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558690488960 0x55869048ae20 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd148072020 msgr2=0x7fd14806e980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd148072020 0x7fd14806e980 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558690491e20 msgr2=0x558690494210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558690491e20 0x558690494210 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0180346a0 msgr2=0x7fd018036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0180346a0 0x7fd018036b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd144000c10 tx=0x7fd1440c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 msgr2=0x55869047d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/2240138448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690476660 0x55869047d890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd14803e5b0 tx=0x7fd148034190 comp rx=0 tx=0).stop 2024-09-11T11:01:22.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 reap_dead start 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd150101640 1 -- 172.21.15.145:0/2240138448 reap_dead start 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 shutdown_connections 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 >> 172.21.15.145:0/2240138448 conn(0x558690472a40 msgr2=0x558690470b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 shutdown_connections 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/2240138448 wait complete. 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/3933329864 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0280346a0 msgr2=0x7fd028036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/3933329864 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0280346a0 0x7fd028036b60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x558690450590 tx=0x7fd144005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/3933329864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690469d60 msgr2=0x55869046a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/3933329864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690469d60 0x55869046a180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd148006810 tx=0x7fd148010f90 comp rx=0 tx=0).stop 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/3933329864 shutdown_connections 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/3933329864 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd0280346a0 0x7fd028036b60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/3933329864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690469d60 0x55869046a180 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/3933329864 >> 172.21.15.145:0/3933329864 conn(0x55869045eeb0 msgr2=0x558690461930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/3933329864 shutdown_connections 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/3933329864 wait complete. 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5586904543d0 msgr2=0x5586904567c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5586904543d0 0x5586904567c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55869035dc00 msgr2=0x5586904530a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55869035dc00 0x5586904530a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558690459a50 msgr2=0x55869045be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.657+0000 7fd151df0980 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558690459a50 0x55869045be40 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd038034600 msgr2=0x7fd038036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd151df0980 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd038034600 0x7fd038036ac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd1440ae000 tx=0x7fd1440a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 msgr2=0x55869044bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd151df0980 1 --2- 172.21.15.145:0/903353226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558690359880 0x55869044bfa0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd148000f90 tx=0x7fd148001260 comp rx=0 tx=0).stop 2024-09-11T11:01:22.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd150101640 1 -- 172.21.15.145:0/903353226 reap_dead start 2024-09-11T11:01:22.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 shutdown_connections 2024-09-11T11:01:22.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 >> 172.21.15.145:0/903353226 conn(0x5586902cd1d0 msgr2=0x55869043f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 shutdown_connections 2024-09-11T11:01:22.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.661+0000 7fd151df0980 1 -- 172.21.15.145:0/903353226 wait complete. 2024-09-11T11:01:22.672 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:22.672 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-11T11:01:22.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-11T11:01:22.672 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-11T11:01:22.756 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:22.756 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:22.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.753+0000 7f14fbcc0980 1 Processor -- start 2024-09-11T11:01:22.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.753+0000 7f14fbcc0980 1 -- start start 2024-09-11T11:01:22.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14fbcc0980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55abc9184620 0x55abc9184a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14fbcc0980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55abc9095ae0 con 0x55abc9184f70 2024-09-11T11:01:22.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14fbcc0980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55abc90b9e30 con 0x55abc9184620 2024-09-11T11:01:22.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14f97d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55abc9184620 0x55abc9184a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14f97d0640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55abc9184620 0x55abc9184a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48402/0 (socket says 172.21.15.145:48402) 2024-09-11T11:01:22.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14f97d0640 1 -- 172.21.15.145:0/1020369303 learned_addr learned my addr 172.21.15.145:0/1020369303 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14f8fcf640 1 --1- 172.21.15.145:0/1020369303 >> v1:172.21.15.102:6789/0 conn(0x55abc9184f70 0x55abc9187990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48564/0 (socket says 172.21.15.145:48564) 2024-09-11T11:01:22.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14f97d0640 1 -- 172.21.15.145:0/1020369303 >> v1:172.21.15.102:6789/0 conn(0x55abc9184f70 legacy=0x55abc9187990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.757+0000 7f14f97d0640 1 -- 172.21.15.145:0/1020369303 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc91881c0 con 0x55abc9184620 2024-09-11T11:01:22.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14f97d0640 1 --2- 172.21.15.145:0/1020369303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184620 0x55abc9184a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f14f400a5c0 tx=0x7f14f401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce12ecf040bab13e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14f3fff640 1 -- 172.21.15.145:0/1020369303 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40a6070 con 0x55abc9184620 2024-09-11T11:01:22.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14f3fff640 1 -- 172.21.15.145:0/1020369303 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f40af070 con 0x55abc9184620 2024-09-11T11:01:22.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14f3fff640 1 -- 172.21.15.145:0/1020369303 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40aa470 con 0x55abc9184620 2024-09-11T11:01:22.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1020369303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184620 msgr2=0x55abc9184a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1020369303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184620 0x55abc9184a00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f14f400a5c0 tx=0x7f14f401b340 comp rx=0 tx=0).stop 2024-09-11T11:01:22.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1020369303 shutdown_connections 2024-09-11T11:01:22.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1020369303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184620 0x55abc9184a00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1020369303 >> 172.21.15.145:0/1020369303 conn(0x55abc91831d0 msgr2=0x55abc91835e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1020369303 shutdown_connections 2024-09-11T11:01:22.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.761+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1020369303 wait complete. 2024-09-11T11:01:22.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 Processor -- start 2024-09-11T11:01:22.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 -- start start 2024-09-11T11:01:22.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc92ff3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55abc90bb200 con 0x55abc9184f70 2024-09-11T11:01:22.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc92ff3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc92ff3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48414/0 (socket says 172.21.15.145:48414) 2024-09-11T11:01:22.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14f97d0640 1 -- 172.21.15.145:0/2423150325 learned_addr learned my addr 172.21.15.145:0/2423150325 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14f97d0640 1 -- 172.21.15.145:0/2423150325 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc92ff9a0 con 0x55abc9184f70 2024-09-11T11:01:22.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14f97d0640 1 --2- 172.21.15.145:0/2423150325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc92ff3d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f14f401b380 tx=0x7f14f4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236eee5a02099ba9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f13e7606640 1 -- 172.21.15.145:0/2423150325 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40aa8f0 con 0x55abc9184f70 2024-09-11T11:01:22.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f13e7606640 1 -- 172.21.15.145:0/2423150325 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f40aaab0 con 0x55abc9184f70 2024-09-11T11:01:22.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f13e7606640 1 -- 172.21.15.145:0/2423150325 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40aadd0 con 0x55abc9184f70 2024-09-11T11:01:22.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 -- 172.21.15.145:0/2423150325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 msgr2=0x55abc92ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/2423150325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc92ff3d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f14f401b380 tx=0x7f14f4003030 comp rx=0 tx=0).stop 2024-09-11T11:01:22.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 -- 172.21.15.145:0/2423150325 shutdown_connections 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/2423150325 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc92ff3d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 -- 172.21.15.145:0/2423150325 >> 172.21.15.145:0/2423150325 conn(0x55abc91831d0 msgr2=0x55abc92faf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 -- 172.21.15.145:0/2423150325 shutdown_connections 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 -- 172.21.15.145:0/2423150325 wait complete. 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 Processor -- start 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.777+0000 7f14fbcc0980 1 -- start start 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14fbcc0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc93066f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14fbcc0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55abc921d8c0 con 0x55abc9184f70 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc93066f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc93066f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48416/0 (socket says 172.21.15.145:48416) 2024-09-11T11:01:22.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f97d0640 1 -- 172.21.15.145:0/1057788727 learned_addr learned my addr 172.21.15.145:0/1057788727 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f97d0640 1 -- 172.21.15.145:0/1057788727 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc9306c30 con 0x55abc9184f70 2024-09-11T11:01:22.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f97d0640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc93066f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f14f401b820 tx=0x7f14f40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f13e5e03640 1 -- 172.21.15.145:0/1057788727 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40cb020 con 0x55abc9184f70 2024-09-11T11:01:22.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abc9306ec0 con 0x55abc9184f70 2024-09-11T11:01:22.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f13e5e03640 1 -- 172.21.15.145:0/1057788727 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f40c6570 con 0x55abc9184f70 2024-09-11T11:01:22.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f13e5e03640 1 -- 172.21.15.145:0/1057788727 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40c6870 con 0x55abc9184f70 2024-09-11T11:01:22.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc9309ba0 con 0x55abc9184f70 2024-09-11T11:01:22.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f13e5e03640 1 -- 172.21.15.145:0/1057788727 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f14f40ce020 con 0x55abc9184f70 2024-09-11T11:01:22.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f13e5e03640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13e00346a0 0x7f13e0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f13e5e03640 1 -- 172.21.15.145:0/1057788727 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f14f40e4fb0 con 0x55abc9184f70 2024-09-11T11:01:22.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13e00346a0 0x7f13e0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc930b670 0x55abc930dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc930e100 con 0x55abc930b670 2024-09-11T11:01:22.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f9fd1640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc930b670 0x55abc930dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13e00346a0 0x7f13e0036b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14e4000f70 tx=0x7f14e4001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.781+0000 7f14f9fd1640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc930b670 0x55abc930dac0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1057788727 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc930b670 2024-09-11T11:01:22.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc930eef0 0x55abc93112e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc9311910 con 0x55abc930eef0 2024-09-11T11:01:22.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14f97d0640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc930eef0 0x55abc93112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14f97d0640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc930eef0 0x55abc93112e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14f97d0640 1 -- 172.21.15.145:0/1057788727 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14f40bd910 con 0x55abc930eef0 2024-09-11T11:01:22.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc93131c0 con 0x55abc930eef0 2024-09-11T11:01:22.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14f97d0640 1 -- 172.21.15.145:0/1057788727 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f14f40bd910 con 0x55abc930eef0 2024-09-11T11:01:22.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc93123f0 con 0x55abc930eef0 2024-09-11T11:01:22.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14f97d0640 1 -- 172.21.15.145:0/1057788727 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14f40bd910 con 0x55abc930eef0 2024-09-11T11:01:22.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55abc9314570 0x55abc9316960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc9316ea0 con 0x55abc9314570 2024-09-11T11:01:22.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55abc9314570 0x55abc9316960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.785+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55abc9314570 0x55abc9316960 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1057788727 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f14e400f6a0 con 0x55abc9314570 2024-09-11T11:01:22.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14fbcc0980 1 Processor -- start 2024-09-11T11:01:22.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14fbcc0980 1 -- start start 2024-09-11T11:01:22.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14fbcc0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc93248f0 0x55abc9324d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14fbcc0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55abc9114800 con 0x55abc93248f0 2024-09-11T11:01:22.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc93248f0 0x55abc9324d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc93248f0 0x55abc9324d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48418/0 (socket says 172.21.15.145:48418) 2024-09-11T11:01:22.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14f97d0640 1 -- 172.21.15.145:0/3268154184 learned_addr learned my addr 172.21.15.145:0/3268154184 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14f97d0640 1 -- 172.21.15.145:0/3268154184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc9325250 con 0x55abc93248f0 2024-09-11T11:01:22.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14f97d0640 1 --2- 172.21.15.145:0/3268154184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc93248f0 0x55abc9324d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14f40bc540 tx=0x7f14f40bf190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f13deffd640 1 -- 172.21.15.145:0/3268154184 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40ee030 con 0x55abc93248f0 2024-09-11T11:01:22.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f13deffd640 1 -- 172.21.15.145:0/3268154184 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f40c6de0 con 0x55abc93248f0 2024-09-11T11:01:22.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14fbcc0980 1 -- 172.21.15.145:0/3268154184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abc93254e0 con 0x55abc93248f0 2024-09-11T11:01:22.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f13deffd640 1 -- 172.21.15.145:0/3268154184 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40cf880 con 0x55abc93248f0 2024-09-11T11:01:22.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14fbcc0980 1 -- 172.21.15.145:0/3268154184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc93254e0 con 0x55abc93248f0 2024-09-11T11:01:22.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f13deffd640 1 -- 172.21.15.145:0/3268154184 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f14f40f1070 con 0x55abc93248f0 2024-09-11T11:01:22.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f13deffd640 1 --2- 172.21.15.145:0/3268154184 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13d0034650 0x7f13d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f13deffd640 1 -- 172.21.15.145:0/3268154184 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f14f40ef070 con 0x55abc93248f0 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/3268154184 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13d0034650 0x7f13d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.789+0000 7f14fbcc0980 1 Processor -- start 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- start start 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/3268154184 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13d0034650 0x7f13d0036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55abc9313190 tx=0x7f14e400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9331500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55abc92ffc60 con 0x55abc9331100 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9331500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9331500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48428/0 (socket says 172.21.15.145:48428) 2024-09-11T11:01:22.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 -- 172.21.15.145:0/4021608442 learned_addr learned my addr 172.21.15.145:0/4021608442 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 -- 172.21.15.145:0/4021608442 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc9331ad0 con 0x55abc9331100 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 --2- 172.21.15.145:0/4021608442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9331500 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14f40c6fb0 tx=0x7f14f40e98b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802e0f441f2284ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f13dcff9640 1 -- 172.21.15.145:0/4021608442 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f4009420 con 0x55abc9331100 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f13dcff9640 1 -- 172.21.15.145:0/4021608442 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f40cfa20 con 0x55abc9331100 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f13dcff9640 1 -- 172.21.15.145:0/4021608442 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40f6150 con 0x55abc9331100 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- 172.21.15.145:0/4021608442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 msgr2=0x55abc9331500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/4021608442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9331500 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14f40c6fb0 tx=0x7f14f40e98b0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- 172.21.15.145:0/4021608442 shutdown_connections 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/4021608442 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9331500 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- 172.21.15.145:0/4021608442 >> 172.21.15.145:0/4021608442 conn(0x55abc932d480 msgr2=0x55abc932b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- 172.21.15.145:0/4021608442 shutdown_connections 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- 172.21.15.145:0/4021608442 wait complete. 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 Processor -- start 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- start start 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9338260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14fbcc0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55abc9331e90 con 0x55abc9331100 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9338260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9338260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48442/0 (socket says 172.21.15.145:48442) 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 learned_addr learned my addr 172.21.15.145:0/1105595499 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55abc93387a0 con 0x55abc9331100 2024-09-11T11:01:22.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.793+0000 7f14f97d0640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9338260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f14f40f9040 tx=0x7f14f40baf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f13ceffd640 1 -- 172.21.15.145:0/1105595499 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f4009420 con 0x55abc9331100 2024-09-11T11:01:22.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f13ceffd640 1 -- 172.21.15.145:0/1105595499 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f4114030 con 0x55abc9331100 2024-09-11T11:01:22.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55abc93387a0 con 0x55abc9331100 2024-09-11T11:01:22.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f13ceffd640 1 -- 172.21.15.145:0/1105595499 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f40bc5b0 con 0x55abc9331100 2024-09-11T11:01:22.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55abc93387a0 con 0x55abc9331100 2024-09-11T11:01:22.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f13ceffd640 1 -- 172.21.15.145:0/1105595499 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f14f410b040 con 0x55abc9331100 2024-09-11T11:01:22.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f13ceffd640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13c4034650 0x7f13c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f13ceffd640 1 -- 172.21.15.145:0/1105595499 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f14f40fe040 con 0x55abc9331100 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13c4034650 0x7f13c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc9343230 0x55abc93456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc9345e40 con 0x55abc9343230 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14f9fd1640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc9343230 0x55abc93456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13c4034650 0x7f13c4036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14e400c010 tx=0x7f14e4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14f9fd1640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc9343230 0x55abc93456f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 20 realm 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc9342660 con 0x55abc9343230 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc9346900 con 0x55abc9343230 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc93476e0 0x55abc9349ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc934a180 con 0x55abc93476e0 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.797+0000 7f14f97d0640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc93476e0 0x55abc9349ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f97d0640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc93476e0 0x55abc9349ad0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f14f40bd910 con 0x55abc93476e0 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14fbcc0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc934a9d0 con 0x55abc93476e0 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f14f40bd910 con 0x55abc93476e0 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14fbcc0980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:22.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14fbcc0980 20 searching for the correct realm 2024-09-11T11:01:22.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55abc934c740 0x55abc934eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc934c740 2024-09-11T11:01:22.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55abc934c740 0x55abc934eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f8fcf640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55abc934c740 0x55abc934eb30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f14f40bd910 con 0x55abc93476e0 2024-09-11T11:01:22.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f97d0640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f14f40f3030 0x7f14f40ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x7f14f40f3030 2024-09-11T11:01:22.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f9fd1640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f14f40f3030 0x7f14f40ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.801+0000 7f14f9fd1640 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f14f40f3030 0x7f14f40ad120 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc934c740 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f40bd910 con 0x55abc93476e0 2024-09-11T11:01:22.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f40bd910 con 0x55abc93476e0 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x7f14f40f3030 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x7f14f40f3030 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.805+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc934c740 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc934c740 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc934c740 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x7f14f40f3030 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc9343230 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x7f14f40f3030 2024-09-11T11:01:22.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.809+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc934c740 2024-09-11T11:01:22.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x7f14f40f3030 2024-09-11T11:01:22.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc934c740 2024-09-11T11:01:22.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55abc934f1b0 con 0x55abc93476e0 2024-09-11T11:01:22.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc934b380 con 0x55abc9343230 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.813+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc934bc20 con 0x55abc93476e0 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc934afc0 con 0x7f14f40f3030 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 zone default found 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 4 Realm: () 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:22.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 zonegroup default 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc934fae0 con 0x7f14f40f3030 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc9351d90 con 0x55abc934c740 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc9352130 con 0x55abc934c740 2024-09-11T11:01:22.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 started sync module instance, tier type = 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9351220 con 0x55abc93476e0 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94196303468352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9351220 con 0x55abc93476e0 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.817+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9352bf0 con 0x55abc9343230 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.821+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.821+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94196303472384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9352b20 con 0x55abc9343230 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.821+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9353af0 con 0x55abc93476e0 2024-09-11T11:01:22.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.821+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94196303468352] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.821+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94196303472384] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.821+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.821+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94196303474656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9353600 con 0x55abc93476e0 2024-09-11T11:01:22.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.821+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9354390 con 0x7f14f40f3030 2024-09-11T11:01:22.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.825+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.825+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94196303478496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9353600 con 0x7f14f40f3030 2024-09-11T11:01:22.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.825+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9354e10 con 0x55abc93476e0 2024-09-11T11:01:22.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.825+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94196303474656] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.825+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94196303478496] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.825+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.825+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94196303479552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9354920 con 0x55abc93476e0 2024-09-11T11:01:22.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.825+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc93556b0 con 0x55abc934c740 2024-09-11T11:01:22.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94196303483392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9354920 con 0x55abc934c740 2024-09-11T11:01:22.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9356410 con 0x55abc934c740 2024-09-11T11:01:22.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94196303479552] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94196303465840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9356cb0 con 0x55abc934c740 2024-09-11T11:01:22.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9357670 con 0x7f14f40f3030 2024-09-11T11:01:22.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94196303483392] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94196303465840] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94196303489024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9356c20 con 0x7f14f40f3030 2024-09-11T11:01:22.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 20 add_watcher() i=0 2024-09-11T11:01:22.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 20 add_watcher() i=1 2024-09-11T11:01:22.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 20 add_watcher() i=2 2024-09-11T11:01:22.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 20 add_watcher() i=3 2024-09-11T11:01:22.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 20 add_watcher() i=4 2024-09-11T11:01:22.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 20 add_watcher() i=5 2024-09-11T11:01:22.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.829+0000 7f14fbcc0980 20 add_watcher() i=6 2024-09-11T11:01:22.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94196303489024] v32'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 20 add_watcher() i=7 2024-09-11T11:01:22.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:22.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc935a6a0 con 0x55abc9343230 2024-09-11T11:01:22.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94196303491520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9357ac0 con 0x55abc9343230 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94196303491520] v32'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f13affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 5 note: GC not initialized 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f13aefe5640 20 reqs_thread_entry: start 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 20 Filter name: none 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f13acfe1640 20 reqs_thread_entry: start 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc937dc20 con 0x7f14f40f3030 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.833+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc937c3c0 con 0x55abc9343230 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 20 rados_obj.operate() r=0 bl.length=7 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:22.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55abc937c7b0 con 0x55abc9343230 2024-09-11T11:01:22.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:22.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:22.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:22.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:22.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-11T11:01:22.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 20 get_user_info_from_index found 0 xattrs 2024-09-11T11:01:22.841 INFO:teuthology.orchestra.run.smithi145.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-11T11:01:22.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f13affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:22.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.837+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94196303491520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc935cf50 con 0x55abc9343230 2024-09-11T11:01:22.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94196303491520] v32'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94196303468352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc937ba50 con 0x55abc93476e0 2024-09-11T11:01:22.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94196303468352] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14fbcc0980 20 remove_watcher() i=0 2024-09-11T11:01:22.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14fbcc0980 2 removed watcher, disabling cache 2024-09-11T11:01:22.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94196303472384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9351740 con 0x55abc9343230 2024-09-11T11:01:22.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94196303472384] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x55abc9343230 2024-09-11T11:01:22.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14fbcc0980 20 remove_watcher() i=1 2024-09-11T11:01:22.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.841+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94196303474656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc937ba50 con 0x55abc93476e0 2024-09-11T11:01:22.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.845+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94196303474656] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.845+0000 7f14fbcc0980 20 remove_watcher() i=2 2024-09-11T11:01:22.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.845+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94196303478496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9352700 con 0x7f14f40f3030 2024-09-11T11:01:22.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.845+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94196303478496] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.845+0000 7f14fbcc0980 20 remove_watcher() i=3 2024-09-11T11:01:22.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.845+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94196303479552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9351740 con 0x55abc93476e0 2024-09-11T11:01:22.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14f97d0640 1 -- 172.21.15.145:0/1105595499 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94196303479552] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14f4133040 con 0x55abc93476e0 2024-09-11T11:01:22.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14fbcc0980 20 remove_watcher() i=4 2024-09-11T11:01:22.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94196303483392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9352fe0 con 0x55abc934c740 2024-09-11T11:01:22.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94196303483392] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14fbcc0980 20 remove_watcher() i=5 2024-09-11T11:01:22.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94196303465840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc937ba50 con 0x55abc934c740 2024-09-11T11:01:22.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14f8fcf640 1 -- 172.21.15.145:0/1105595499 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94196303465840] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14e4037040 con 0x55abc934c740 2024-09-11T11:01:22.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14fbcc0980 20 remove_watcher() i=6 2024-09-11T11:01:22.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.849+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94196303489024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55abc9352700 con 0x7f14f40f3030 2024-09-11T11:01:22.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94196303489024] v32'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f14ec00a4d0 con 0x7f14f40f3030 2024-09-11T11:01:22.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 20 remove_watcher() i=7 2024-09-11T11:01:22.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc93476e0 msgr2=0x55abc9349ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc93476e0 0x55abc9349ad0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc9343230 msgr2=0x55abc93456f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc9343230 0x55abc93456f0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f14f40f3030 msgr2=0x7f14f40ad120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f14f40f3030 0x7f14f40ad120 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55abc934c740 msgr2=0x55abc934eb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55abc934c740 0x55abc934eb30 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13c4034650 msgr2=0x7f13c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13c4034650 0x7f13c4036b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f14e400c010 tx=0x7f14e4010000 comp rx=0 tx=0).stop 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 msgr2=0x55abc9338260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1105595499 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9331100 0x55abc9338260 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f14f40f9040 tx=0x7f14f40baf50 comp rx=0 tx=0).stop 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1105595499 reap_dead start 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 shutdown_connections 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 >> 172.21.15.145:0/1105595499 conn(0x55abc932d480 msgr2=0x55abc932b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 shutdown_connections 2024-09-11T11:01:22.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1105595499 wait complete. 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/3268154184 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13d0034650 msgr2=0x7f13d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/3268154184 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13d0034650 0x7f13d0036b10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55abc9313190 tx=0x7f14e400f000 comp rx=0 tx=0).stop 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/3268154184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc93248f0 msgr2=0x55abc9324d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/3268154184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc93248f0 0x55abc9324d10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f14f40bc540 tx=0x7f14f40bf190 comp rx=0 tx=0).stop 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/3268154184 shutdown_connections 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/3268154184 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13d0034650 0x7f13d0036b10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/3268154184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc93248f0 0x55abc9324d10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/3268154184 >> 172.21.15.145:0/3268154184 conn(0x55abc9319a40 msgr2=0x55abc931c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/3268154184 shutdown_connections 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/3268154184 wait complete. 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc930eef0 msgr2=0x55abc93112e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55abc930eef0 0x55abc93112e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc930b670 msgr2=0x55abc930dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55abc930b670 0x55abc930dac0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55abc9314570 msgr2=0x55abc9316960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55abc9314570 0x55abc9316960 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13e00346a0 msgr2=0x7f13e0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f13e00346a0 0x7f13e0036b60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f14e4000f70 tx=0x7f14e4001380 comp rx=0 tx=0).stop 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 msgr2=0x55abc93066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 --2- 172.21.15.145:0/1057788727 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55abc9184f70 0x55abc93066f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f14f401b820 tx=0x7f14f40180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14f9fd1640 1 -- 172.21.15.145:0/1057788727 reap_dead start 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 shutdown_connections 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 >> 172.21.15.145:0/1057788727 conn(0x55abc91831d0 msgr2=0x55abc92f9ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 shutdown_connections 2024-09-11T11:01:22.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.853+0000 7f14fbcc0980 1 -- 172.21.15.145:0/1057788727 wait complete. 2024-09-11T11:01:22.866 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-11T11:01:22.867 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:01:22.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:01:22.867 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:01:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:22.945 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f9481530980 1 Processor -- start 2024-09-11T11:01:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f9481530980 1 -- start start 2024-09-11T11:01:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f9481530980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562c71742690 0x562c71742a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f9481530980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562c715caae0 con 0x562c71742fe0 2024-09-11T11:01:22.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f9481530980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x562c715eee30 con 0x562c71742690 2024-09-11T11:01:22.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f947f040640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562c71742690 0x562c71742a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f947e83f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x562c71742fe0 0x562c71747a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48580/0 (socket says 172.21.15.145:48580) 2024-09-11T11:01:22.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f947f040640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562c71742690 0x562c71742a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48450/0 (socket says 172.21.15.145:48450) 2024-09-11T11:01:22.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f947e83f640 1 -- 172.21.15.145:0/4247332710 learned_addr learned my addr 172.21.15.145:0/4247332710 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:22.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f947f040640 1 -- 172.21.15.145:0/4247332710 >> v1:172.21.15.102:6789/0 conn(0x562c71742fe0 legacy=0x562c71747a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.945+0000 7f947f040640 1 -- 172.21.15.145:0/4247332710 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7174a260 con 0x562c71742690 2024-09-11T11:01:22.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f947f040640 1 --2- 172.21.15.145:0/4247332710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c71742a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f946800a420 tx=0x7f946801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5124fee5632278ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f947e03e640 1 -- 172.21.15.145:0/4247332710 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680af070 con 0x562c71742690 2024-09-11T11:01:22.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f947e03e640 1 -- 172.21.15.145:0/4247332710 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94680aa530 con 0x562c71742690 2024-09-11T11:01:22.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f947e03e640 1 -- 172.21.15.145:0/4247332710 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680aa850 con 0x562c71742690 2024-09-11T11:01:22.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f9481530980 1 -- 172.21.15.145:0/4247332710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 msgr2=0x562c71742a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f9481530980 1 --2- 172.21.15.145:0/4247332710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c71742a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f946800a420 tx=0x7f946801afd0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f9481530980 1 -- 172.21.15.145:0/4247332710 shutdown_connections 2024-09-11T11:01:22.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f9481530980 1 --2- 172.21.15.145:0/4247332710 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c71742a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f9481530980 1 -- 172.21.15.145:0/4247332710 >> 172.21.15.145:0/4247332710 conn(0x562c7173e1b0 msgr2=0x562c717405d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f9481530980 1 -- 172.21.15.145:0/4247332710 shutdown_connections 2024-09-11T11:01:22.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.949+0000 7f9481530980 1 -- 172.21.15.145:0/4247332710 wait complete. 2024-09-11T11:01:22.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 Processor -- start 2024-09-11T11:01:22.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 -- start start 2024-09-11T11:01:22.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c7182dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562c715f0200 con 0x562c71742690 2024-09-11T11:01:22.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c7182dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c7182dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48454/0 (socket says 172.21.15.145:48454) 2024-09-11T11:01:22.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f947f040640 1 -- 172.21.15.145:0/1641130735 learned_addr learned my addr 172.21.15.145:0/1641130735 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f947f040640 1 -- 172.21.15.145:0/1641130735 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c7182e080 con 0x562c71742690 2024-09-11T11:01:22.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f947f040640 1 --2- 172.21.15.145:0/1641130735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c7182dab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94680ad040 tx=0x7f94680033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8329b808433d9c65 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f936d60a640 1 -- 172.21.15.145:0/1641130735 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680af050 con 0x562c71742690 2024-09-11T11:01:22.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f936d60a640 1 -- 172.21.15.145:0/1641130735 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94680b0040 con 0x562c71742690 2024-09-11T11:01:22.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f936d60a640 1 -- 172.21.15.145:0/1641130735 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680aaca0 con 0x562c71742690 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 -- 172.21.15.145:0/1641130735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 msgr2=0x562c7182dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 --2- 172.21.15.145:0/1641130735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c7182dab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94680ad040 tx=0x7f94680033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 -- 172.21.15.145:0/1641130735 shutdown_connections 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 --2- 172.21.15.145:0/1641130735 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c7182dab0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 -- 172.21.15.145:0/1641130735 >> 172.21.15.145:0/1641130735 conn(0x562c7173e1b0 msgr2=0x562c718296e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 -- 172.21.15.145:0/1641130735 shutdown_connections 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.965+0000 7f9481530980 1 -- 172.21.15.145:0/1641130735 wait complete. 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f9481530980 1 Processor -- start 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f9481530980 1 -- start start 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f9481530980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c716b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f9481530980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562c71749ca0 con 0x562c71742690 2024-09-11T11:01:22.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c716b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c716b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48468/0 (socket says 172.21.15.145:48468) 2024-09-11T11:01:22.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f947f040640 1 -- 172.21.15.145:0/1062165693 learned_addr learned my addr 172.21.15.145:0/1062165693 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f947f040640 1 -- 172.21.15.145:0/1062165693 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c716b9a10 con 0x562c71742690 2024-09-11T11:01:22.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f947f040640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c716b94d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9468019680 tx=0x7f9468019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f936be07640 1 -- 172.21.15.145:0/1062165693 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680c5070 con 0x562c71742690 2024-09-11T11:01:22.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c716b7bf0 con 0x562c71742690 2024-09-11T11:01:22.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f936be07640 1 -- 172.21.15.145:0/1062165693 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94680b6d60 con 0x562c71742690 2024-09-11T11:01:22.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f936be07640 1 -- 172.21.15.145:0/1062165693 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680c15f0 con 0x562c71742690 2024-09-11T11:01:22.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c716b80e0 con 0x562c71742690 2024-09-11T11:01:22.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f936be07640 1 -- 172.21.15.145:0/1062165693 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f94680c8070 con 0x562c71742690 2024-09-11T11:01:22.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f936be07640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9364034650 0x7f9364036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f936be07640 1 -- 172.21.15.145:0/1062165693 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f94680bb070 con 0x562c71742690 2024-09-11T11:01:22.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f947e83f640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9364034650 0x7f9364036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f9481530980 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71742fe0 0x562c7183e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7183e600 con 0x562c71742fe0 2024-09-11T11:01:22.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.969+0000 7f947f841640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71742fe0 0x562c7183e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947e83f640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9364034650 0x7f9364036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9478001da0 tx=0x7f9478001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947f841640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71742fe0 0x562c7183e0c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947f841640 1 -- 172.21.15.145:0/1062165693 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71742fe0 2024-09-11T11:01:22.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f9481530980 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c7183f020 0x562c718414e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c71841c50 con 0x562c7183f020 2024-09-11T11:01:22.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947f040640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c7183f020 0x562c718414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947f040640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c7183f020 0x562c718414e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947f040640 1 -- 172.21.15.145:0/1062165693 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94680d1070 con 0x562c7183f020 2024-09-11T11:01:22.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c71843500 con 0x562c7183f020 2024-09-11T11:01:22.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947f040640 1 -- 172.21.15.145:0/1062165693 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94680d1070 con 0x562c7183f020 2024-09-11T11:01:22.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c71842670 con 0x562c7183f020 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947f040640 1 -- 172.21.15.145:0/1062165693 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94680d1070 con 0x562c7183f020 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f9481530980 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562c718448b0 0x562c71846ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c718471e0 con 0x562c718448b0 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947e83f640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562c718448b0 0x562c71846ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.973+0000 7f947e83f640 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562c718448b0 0x562c71846ca0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f947e83f640 1 -- 172.21.15.145:0/1062165693 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f947800e6c0 con 0x562c718448b0 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9481530980 1 Processor -- start 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9481530980 1 -- start start 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9481530980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71854bc0 0x562c71854fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9481530980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562c71649800 con 0x562c71854bc0 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71854bc0 0x562c71854fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71854bc0 0x562c71854fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48474/0 (socket says 172.21.15.145:48474) 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f947f040640 1 -- 172.21.15.145:0/1775971427 learned_addr learned my addr 172.21.15.145:0/1775971427 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f947f040640 1 -- 172.21.15.145:0/1775971427 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c71855520 con 0x562c71854bc0 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f947f040640 1 --2- 172.21.15.145:0/1775971427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71854bc0 0x562c71854fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94680c84d0 tx=0x7f94680a9670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9369602640 1 -- 172.21.15.145:0/1775971427 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680e22a0 con 0x562c71854bc0 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9481530980 1 -- 172.21.15.145:0/1775971427 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c718557b0 con 0x562c71854bc0 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9369602640 1 -- 172.21.15.145:0/1775971427 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94680bfa50 con 0x562c71854bc0 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9369602640 1 -- 172.21.15.145:0/1775971427 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680bfd50 con 0x562c71854bc0 2024-09-11T11:01:22.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9481530980 1 -- 172.21.15.145:0/1775971427 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c71858430 con 0x562c71854bc0 2024-09-11T11:01:22.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9369602640 1 -- 172.21.15.145:0/1775971427 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f94680e7070 con 0x562c71854bc0 2024-09-11T11:01:22.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9369602640 1 --2- 172.21.15.145:0/1775971427 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9358034650 0x7f9358036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.977+0000 7f9369602640 1 -- 172.21.15.145:0/1775971427 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f94680ee850 con 0x562c71854bc0 2024-09-11T11:01:22.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947e83f640 1 --2- 172.21.15.145:0/1775971427 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9358034650 0x7f9358036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 Processor -- start 2024-09-11T11:01:22.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- start start 2024-09-11T11:01:22.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947e83f640 1 --2- 172.21.15.145:0/1775971427 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9358034650 0x7f9358036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x562c716b8b70 tx=0x7f947800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c71861720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562c7182e340 con 0x562c71861320 2024-09-11T11:01:22.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c71861720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c71861720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48486/0 (socket says 172.21.15.145:48486) 2024-09-11T11:01:22.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 -- 172.21.15.145:0/87385333 learned_addr learned my addr 172.21.15.145:0/87385333 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 -- 172.21.15.145:0/87385333 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c71861cf0 con 0x562c71861320 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 --2- 172.21.15.145:0/87385333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c71861720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f94680df690 tx=0x7f94680df400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804c23780c2af7d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9362ffd640 1 -- 172.21.15.145:0/87385333 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680e9e00 con 0x562c71861320 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9362ffd640 1 -- 172.21.15.145:0/87385333 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94680fc070 con 0x562c71861320 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9362ffd640 1 -- 172.21.15.145:0/87385333 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680d4520 con 0x562c71861320 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- 172.21.15.145:0/87385333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 msgr2=0x562c71861720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 --2- 172.21.15.145:0/87385333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c71861720 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f94680df690 tx=0x7f94680df400 comp rx=0 tx=0).stop 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- 172.21.15.145:0/87385333 shutdown_connections 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 --2- 172.21.15.145:0/87385333 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c71861720 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- 172.21.15.145:0/87385333 >> 172.21.15.145:0/87385333 conn(0x562c7185d750 msgr2=0x562c7185b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:22.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- 172.21.15.145:0/87385333 shutdown_connections 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- 172.21.15.145:0/87385333 wait complete. 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 Processor -- start 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- start start 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c718685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f9481530980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562c718621c0 con 0x562c71861320 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c718685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c718685b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48500/0 (socket says 172.21.15.145:48500) 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 learned_addr learned my addr 172.21.15.145:0/4168222699 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:22.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.981+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c71868af0 con 0x562c71861320 2024-09-11T11:01:22.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947f040640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c718685b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94680e2500 tx=0x7f94680f5000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f93617fa640 1 -- 172.21.15.145:0/4168222699 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680e9e00 con 0x562c71861320 2024-09-11T11:01:22.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f93617fa640 1 -- 172.21.15.145:0/4168222699 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94680c17e0 con 0x562c71861320 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562c71868af0 con 0x562c71861320 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f93617fa640 1 -- 172.21.15.145:0/4168222699 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94680c1ac0 con 0x562c71861320 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c71868af0 con 0x562c71861320 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f93617fa640 1 -- 172.21.15.145:0/4168222699 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9468112060 con 0x562c71861320 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f93617fa640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9348034650 0x7f9348036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f93617fa640 1 -- 172.21.15.145:0/4168222699 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f946810caa0 con 0x562c71861320 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947e83f640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9348034650 0x7f9348036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71873580 0x562c71875a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c71876190 con 0x562c71873580 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947f841640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71873580 0x562c71875a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947f841640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71873580 0x562c71875a40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947e83f640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9348034650 0x7f9348036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x562c71843460 tx=0x7f9478010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 20 realm 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c71872a30 con 0x562c71873580 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c71876c60 con 0x562c71873580 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:22.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:22.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c71877840 0x562c71879d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7187a470 con 0x562c71877840 2024-09-11T11:01:22.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.985+0000 7f947f040640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c71877840 0x562c71879d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947f040640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c71877840 0x562c71879d00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:22.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f9481530980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:22.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:22.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7187ad10 con 0x562c71877840 2024-09-11T11:01:22.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:22.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f9481530980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:22.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f9481530980 20 searching for the correct realm 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562c7187ca80 0x562c7187ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c7187ca80 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947e83f640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562c7187ca80 0x562c7187ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947e83f640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562c7187ca80 0x562c7187ee70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947f040640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9468114070 0x7f94681077a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x7f9468114070 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947f841640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9468114070 0x7f94681077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.989+0000 7f947f841640 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9468114070 0x7f94681077a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:22.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c7187ca80 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:22.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:23.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x7f9468114070 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x7f9468114070 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.993+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c7187ca80 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c7187ca80 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c7187ca80 2024-09-11T11:01:23.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x7f9468114070 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71873580 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:22.997+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x7f9468114070 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c7187ca80 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x7f9468114070 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:23.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:23.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c7187ca80 2024-09-11T11:01:23.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:23.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f480 con 0x562c71877840 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7187b6c0 con 0x562c71873580 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.001+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7187bb10 con 0x562c71877840 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7187bf30 con 0x7f9468114070 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 zone default found 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 4 Realm: () 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 zonegroup default 2024-09-11T11:01:23.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7187f8e0 con 0x7f9468114070 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c71881b10 con 0x562c7187ca80 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c71881eb0 con 0x562c7187ca80 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 started sync module instance, tier type = 2024-09-11T11:01:23.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:23.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.005+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71880f50 con 0x562c71877840 2024-09-11T11:01:23.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.009+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.009+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94748883293296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71880f50 con 0x562c71877840 2024-09-11T11:01:23.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.009+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71882870 con 0x562c71873580 2024-09-11T11:01:23.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.009+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.009+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94748883297216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c718827e0 con 0x562c71873580 2024-09-11T11:01:23.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.009+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71883790 con 0x562c71877840 2024-09-11T11:01:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.009+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94748883293296] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.009+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94748883297216] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94748883299424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71883750 con 0x562c71877840 2024-09-11T11:01:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71884030 con 0x7f9468114070 2024-09-11T11:01:23.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94748883303296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71883750 con 0x7f9468114070 2024-09-11T11:01:23.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71884ac0 con 0x562c71877840 2024-09-11T11:01:23.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94748883299424] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94748883303296] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94748883304352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71884ac0 con 0x562c71877840 2024-09-11T11:01:23.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.013+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71884eb0 con 0x562c7187ca80 2024-09-11T11:01:23.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94748883300992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71885750 con 0x562c7187ca80 2024-09-11T11:01:23.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71886110 con 0x562c7187ca80 2024-09-11T11:01:23.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94748883304352] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94748883300992] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94748883311712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71886500 con 0x562c7187ca80 2024-09-11T11:01:23.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71886d50 con 0x7f9468114070 2024-09-11T11:01:23.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94748883311712] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94748883313920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71887140 con 0x7f9468114070 2024-09-11T11:01:23.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 20 add_watcher() i=0 2024-09-11T11:01:23.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 20 add_watcher() i=1 2024-09-11T11:01:23.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 20 add_watcher() i=2 2024-09-11T11:01:23.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 20 add_watcher() i=3 2024-09-11T11:01:23.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 20 add_watcher() i=4 2024-09-11T11:01:23.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 20 add_watcher() i=5 2024-09-11T11:01:23.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.017+0000 7f9481530980 20 add_watcher() i=6 2024-09-11T11:01:23.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94748883313920] v32'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f9481530980 20 add_watcher() i=7 2024-09-11T11:01:23.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f9481530980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:23.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c7188a1a0 con 0x562c71873580 2024-09-11T11:01:23.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94748883314976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71887560 con 0x562c71873580 2024-09-11T11:01:23.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94748883314976] v32'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f9335fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f9481530980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:23.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f9481530980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:23.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.021+0000 7f9481530980 5 note: GC not initialized 2024-09-11T11:01:23.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9334fe1640 20 reqs_thread_entry: start 2024-09-11T11:01:23.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9481530980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:23.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9481530980 20 Filter name: none 2024-09-11T11:01:23.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f92ae7fc640 20 reqs_thread_entry: start 2024-09-11T11:01:23.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9481530980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562c718ad3f0 con 0x562c71873580 2024-09-11T11:01:23.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9481530980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:23.027 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:23.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9335fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94748883314976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c718ac340 con 0x562c71873580 2024-09-11T11:01:23.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94748883314976] v32'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.025+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94748883293296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71886920 con 0x562c71877840 2024-09-11T11:01:23.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.029+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94748883293296] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.029+0000 7f9481530980 20 remove_watcher() i=0 2024-09-11T11:01:23.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.029+0000 7f9481530980 2 removed watcher, disabling cache 2024-09-11T11:01:23.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.029+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94748883297216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71881450 con 0x562c71873580 2024-09-11T11:01:23.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.029+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94748883297216] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x562c71873580 2024-09-11T11:01:23.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.029+0000 7f9481530980 20 remove_watcher() i=1 2024-09-11T11:01:23.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.029+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94748883299424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c718823c0 con 0x562c71877840 2024-09-11T11:01:23.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.033+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94748883299424] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.033+0000 7f9481530980 20 remove_watcher() i=2 2024-09-11T11:01:23.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.033+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94748883303296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c718823c0 con 0x7f9468114070 2024-09-11T11:01:23.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.033+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94748883303296] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.033+0000 7f9481530980 20 remove_watcher() i=3 2024-09-11T11:01:23.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.033+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94748883304352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71883b80 con 0x562c71877840 2024-09-11T11:01:23.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f947f040640 1 -- 172.21.15.145:0/4168222699 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94748883304352] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94680d1070 con 0x562c71877840 2024-09-11T11:01:23.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f9481530980 20 remove_watcher() i=4 2024-09-11T11:01:23.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94748883300992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c718823c0 con 0x562c7187ca80 2024-09-11T11:01:23.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94748883300992] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f9481530980 20 remove_watcher() i=5 2024-09-11T11:01:23.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94748883311712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c718823c0 con 0x562c7187ca80 2024-09-11T11:01:23.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f947e83f640 1 -- 172.21.15.145:0/4168222699 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94748883311712] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f947800e6c0 con 0x562c7187ca80 2024-09-11T11:01:23.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f9481530980 20 remove_watcher() i=6 2024-09-11T11:01:23.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.037+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94748883313920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562c71885c60 con 0x7f9468114070 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94748883313920] v32'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94700083f0 con 0x7f9468114070 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 20 remove_watcher() i=7 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c71877840 msgr2=0x562c71879d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c71877840 0x562c71879d00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71873580 msgr2=0x562c71875a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71873580 0x562c71875a40 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9468114070 msgr2=0x7f94681077a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9468114070 0x7f94681077a0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562c7187ca80 msgr2=0x562c7187ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562c7187ca80 0x562c7187ee70 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9348034650 msgr2=0x7f9348036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9348034650 0x7f9348036b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x562c71843460 tx=0x7f9478010000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f947f841640 1 -- 172.21.15.145:0/4168222699 reap_dead start 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 msgr2=0x562c718685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c718685b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94680e2500 tx=0x7f94680f5000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 shutdown_connections 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/4168222699 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71861320 0x562c718685b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 >> 172.21.15.145:0/4168222699 conn(0x562c7185d750 msgr2=0x562c7185b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 shutdown_connections 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/4168222699 wait complete. 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1775971427 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9358034650 msgr2=0x7f9358036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1775971427 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9358034650 0x7f9358036b10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x562c716b8b70 tx=0x7f947800f000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1775971427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71854bc0 msgr2=0x562c71854fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1775971427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71854bc0 0x562c71854fe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f94680c84d0 tx=0x7f94680a9670 comp rx=0 tx=0).stop 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1775971427 shutdown_connections 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1775971427 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9358034650 0x7f9358036b10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1775971427 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71854bc0 0x562c71854fe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1775971427 >> 172.21.15.145:0/1775971427 conn(0x562c71849d10 msgr2=0x562c7184c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1775971427 shutdown_connections 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1775971427 wait complete. 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c7183f020 msgr2=0x562c718414e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562c7183f020 0x562c718414e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71742fe0 msgr2=0x562c7183e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562c71742fe0 0x562c7183e0c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562c718448b0 msgr2=0x562c71846ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562c718448b0 0x562c71846ca0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9364034650 msgr2=0x7f9364036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9364034650 0x7f9364036b10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9478001da0 tx=0x7f9478001300 comp rx=0 tx=0).stop 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 msgr2=0x562c716b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 --2- 172.21.15.145:0/1062165693 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562c71742690 0x562c716b94d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9468019680 tx=0x7f9468019810 comp rx=0 tx=0).stop 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f947f841640 1 -- 172.21.15.145:0/1062165693 reap_dead start 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 shutdown_connections 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 >> 172.21.15.145:0/1062165693 conn(0x562c7173e1b0 msgr2=0x562c71828260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 shutdown_connections 2024-09-11T11:01:23.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.041+0000 7f9481530980 1 -- 172.21.15.145:0/1062165693 wait complete. 2024-09-11T11:01:23.055 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:23.055 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-11T11:01:23.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-11T11:01:23.056 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-11T11:01:23.128 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:23.128 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:23.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.124+0000 7f509eda6980 1 Processor -- start 2024-09-11T11:01:23.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.124+0000 7f509eda6980 1 -- start start 2024-09-11T11:01:23.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509eda6980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56227c7cfa90 0x56227c7d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509eda6980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56227c653ae0 con 0x56227c73fac0 2024-09-11T11:01:23.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509eda6980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x56227c677e30 con 0x56227c7cfa90 2024-09-11T11:01:23.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509c0b5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56227c7cfa90 0x56227c7d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509c8b6640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x56227c73fac0 0x56227c7ce370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48588/0 (socket says 172.21.15.145:48588) 2024-09-11T11:01:23.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509c8b6640 1 -- 172.21.15.145:0/3998439084 learned_addr learned my addr 172.21.15.145:0/3998439084 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:23.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509c0b5640 1 --2- 172.21.15.145:0/3998439084 >> v2:172.21.15.102:3300/0 conn(0x56227c7cfa90 0x56227c7d1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48508/0 (socket says 172.21.15.145:48508) 2024-09-11T11:01:23.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509c0b5640 1 -- 172.21.15.145:0/3998439084 >> v1:172.21.15.102:6789/0 conn(0x56227c73fac0 legacy=0x56227c7ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509c0b5640 1 -- 172.21.15.145:0/3998439084 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56227c7d33d0 con 0x56227c7cfa90 2024-09-11T11:01:23.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509c0b5640 1 --2- 172.21.15.145:0/3998439084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c7cfa90 0x56227c7d1e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f508400a480 tx=0x7f508401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abec7563b27f420 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509b8b4640 1 -- 172.21.15.145:0/3998439084 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50840b0070 con 0x56227c7cfa90 2024-09-11T11:01:23.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509b8b4640 1 -- 172.21.15.145:0/3998439084 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50840ab540 con 0x56227c7cfa90 2024-09-11T11:01:23.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.128+0000 7f509b8b4640 1 -- 172.21.15.145:0/3998439084 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50840ab840 con 0x56227c7cfa90 2024-09-11T11:01:23.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.132+0000 7f509eda6980 1 -- 172.21.15.145:0/3998439084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c7cfa90 msgr2=0x56227c7d1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.132+0000 7f509eda6980 1 --2- 172.21.15.145:0/3998439084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c7cfa90 0x56227c7d1e80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f508400a480 tx=0x7f508401b280 comp rx=0 tx=0).stop 2024-09-11T11:01:23.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.132+0000 7f509eda6980 1 -- 172.21.15.145:0/3998439084 shutdown_connections 2024-09-11T11:01:23.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.132+0000 7f509eda6980 1 --2- 172.21.15.145:0/3998439084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c7cfa90 0x56227c7d1e80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.132+0000 7f509eda6980 1 -- 172.21.15.145:0/3998439084 >> 172.21.15.145:0/3998439084 conn(0x56227c7c6060 msgr2=0x56227c7c8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.132+0000 7f509eda6980 1 -- 172.21.15.145:0/3998439084 shutdown_connections 2024-09-11T11:01:23.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.132+0000 7f509eda6980 1 -- 172.21.15.145:0/3998439084 wait complete. 2024-09-11T11:01:23.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.144+0000 7f509eda6980 1 Processor -- start 2024-09-11T11:01:23.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.144+0000 7f509eda6980 1 -- start start 2024-09-11T11:01:23.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.144+0000 7f509eda6980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.144+0000 7f509eda6980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56227c679200 con 0x56227c73fac0 2024-09-11T11:01:23.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8b6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48516/0 (socket says 172.21.15.145:48516) 2024-09-11T11:01:23.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 -- 172.21.15.145:0/2214860919 learned_addr learned my addr 172.21.15.145:0/2214860919 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 -- 172.21.15.145:0/2214860919 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56227c8b70b0 con 0x56227c73fac0 2024-09-11T11:01:23.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 --2- 172.21.15.145:0/2214860919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8b6ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f50940017b0 tx=0x7f5094001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ade8ee6c77a8f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f4f8ae0d640 1 -- 172.21.15.145:0/2214860919 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094016070 con 0x56227c73fac0 2024-09-11T11:01:23.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f4f8ae0d640 1 -- 172.21.15.145:0/2214860919 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094004530 con 0x56227c73fac0 2024-09-11T11:01:23.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f4f8ae0d640 1 -- 172.21.15.145:0/2214860919 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094004870 con 0x56227c73fac0 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 -- 172.21.15.145:0/2214860919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 msgr2=0x56227c8b6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 --2- 172.21.15.145:0/2214860919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8b6ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f50940017b0 tx=0x7f5094001c70 comp rx=0 tx=0).stop 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 -- 172.21.15.145:0/2214860919 shutdown_connections 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 --2- 172.21.15.145:0/2214860919 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8b6ae0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 -- 172.21.15.145:0/2214860919 >> 172.21.15.145:0/2214860919 conn(0x56227c7c6060 msgr2=0x56227c8b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 -- 172.21.15.145:0/2214860919 shutdown_connections 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 -- 172.21.15.145:0/2214860919 wait complete. 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 Processor -- start 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 -- start start 2024-09-11T11:01:23.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8bdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509eda6980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56227c7d2e10 con 0x56227c73fac0 2024-09-11T11:01:23.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8bdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8bdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48518/0 (socket says 172.21.15.145:48518) 2024-09-11T11:01:23.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 -- 172.21.15.145:0/2161493512 learned_addr learned my addr 172.21.15.145:0/2161493512 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.148+0000 7f509c8b6640 1 -- 172.21.15.145:0/2161493512 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56227c8be400 con 0x56227c73fac0 2024-09-11T11:01:23.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509c8b6640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8bdec0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5094004500 tx=0x7f5094001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f4f8960a640 1 -- 172.21.15.145:0/2161493512 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094021020 con 0x56227c73fac0 2024-09-11T11:01:23.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f4f8960a640 1 -- 172.21.15.145:0/2161493512 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094011400 con 0x56227c73fac0 2024-09-11T11:01:23.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f4f8960a640 1 -- 172.21.15.145:0/2161493512 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094016040 con 0x56227c73fac0 2024-09-11T11:01:23.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56227c8be690 con 0x56227c73fac0 2024-09-11T11:01:23.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56227c8c1370 con 0x56227c73fac0 2024-09-11T11:01:23.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f4f8960a640 1 -- 172.21.15.145:0/2161493512 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5094024020 con 0x56227c73fac0 2024-09-11T11:01:23.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f4f8960a640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f840346a0 0x7f4f84036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f4f8960a640 1 -- 172.21.15.145:0/2161493512 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f5094049060 con 0x56227c73fac0 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509c0b5640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f840346a0 0x7f4f84036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509eda6980 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c7cfa90 0x56227c8c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c8c5500 con 0x56227c7cfa90 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509d0b7640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c7cfa90 0x56227c8c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509c0b5640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f840346a0 0x7f4f84036b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50840ad000 tx=0x7f50840a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509d0b7640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c7cfa90 0x56227c8c4fc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509d0b7640 1 -- 172.21.15.145:0/2161493512 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c7cfa90 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509eda6980 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c8c6260 0x56227c8c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c8c8c60 con 0x56227c8c6260 2024-09-11T11:01:23.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.152+0000 7f509c8b6640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c8c6260 0x56227c8c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509c8b6640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c8c6260 0x56227c8c8650 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509c8b6640 1 -- 172.21.15.145:0/2161493512 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f509400f070 con 0x56227c8c6260 2024-09-11T11:01:23.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c8ca510 con 0x56227c8c6260 2024-09-11T11:01:23.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509c8b6640 1 -- 172.21.15.145:0/2161493512 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f509400f070 con 0x56227c8c6260 2024-09-11T11:01:23.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c8c9770 con 0x56227c8c6260 2024-09-11T11:01:23.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509c8b6640 1 -- 172.21.15.145:0/2161493512 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f509400f070 con 0x56227c8c6260 2024-09-11T11:01:23.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509eda6980 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56227c8cb8c0 0x56227c8cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c8ce1f0 con 0x56227c8cb8c0 2024-09-11T11:01:23.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509c0b5640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56227c8cb8c0 0x56227c8cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509c0b5640 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56227c8cb8c0 0x56227c8cdcb0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509c0b5640 1 -- 172.21.15.145:0/2161493512 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f50840b3040 con 0x56227c8cb8c0 2024-09-11T11:01:23.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509eda6980 1 Processor -- start 2024-09-11T11:01:23.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509eda6980 1 -- start start 2024-09-11T11:01:23.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509eda6980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8dbc40 0x56227c8dc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509eda6980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56227c6d2800 con 0x56227c8dbc40 2024-09-11T11:01:23.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.156+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8dbc40 0x56227c8dc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8dbc40 0x56227c8dc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48522/0 (socket says 172.21.15.145:48522) 2024-09-11T11:01:23.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c8b6640 1 -- 172.21.15.145:0/2674852759 learned_addr learned my addr 172.21.15.145:0/2674852759 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c8b6640 1 -- 172.21.15.145:0/2674852759 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56227c8dc5a0 con 0x56227c8dbc40 2024-09-11T11:01:23.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c8b6640 1 --2- 172.21.15.145:0/2674852759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8dbc40 0x56227c8dc060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f50940493d0 tx=0x7f509401c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f4f827fc640 1 -- 172.21.15.145:0/2674852759 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940189f0 con 0x56227c8dbc40 2024-09-11T11:01:23.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f4f827fc640 1 -- 172.21.15.145:0/2674852759 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509401ca40 con 0x56227c8dbc40 2024-09-11T11:01:23.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509eda6980 1 -- 172.21.15.145:0/2674852759 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56227c8dc830 con 0x56227c8dbc40 2024-09-11T11:01:23.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f4f827fc640 1 -- 172.21.15.145:0/2674852759 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509401cd20 con 0x56227c8dbc40 2024-09-11T11:01:23.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509eda6980 1 -- 172.21.15.145:0/2674852759 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56227c8df4b0 con 0x56227c8dbc40 2024-09-11T11:01:23.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f4f827fc640 1 -- 172.21.15.145:0/2674852759 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5094040c90 con 0x56227c8dbc40 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f4f827fc640 1 --2- 172.21.15.145:0/2674852759 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f740346a0 0x7f4f74036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f4f827fc640 1 -- 172.21.15.145:0/2674852759 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f509404aaf0 con 0x56227c8dbc40 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c0b5640 1 --2- 172.21.15.145:0/2674852759 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f740346a0 0x7f4f74036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509eda6980 1 Processor -- start 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509eda6980 1 -- start start 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c0b5640 1 --2- 172.21.15.145:0/2674852759 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f740346a0 0x7f4f74036b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f509402d880 tx=0x7f5084005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509eda6980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c8e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509eda6980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56227c8b7430 con 0x56227c8e85b0 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c8e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c8e89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48526/0 (socket says 172.21.15.145:48526) 2024-09-11T11:01:23.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c8b6640 1 -- 172.21.15.145:0/2646591796 learned_addr learned my addr 172.21.15.145:0/2646591796 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.160+0000 7f509c8b6640 1 -- 172.21.15.145:0/2646591796 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56227c8e8f80 con 0x56227c8e85b0 2024-09-11T11:01:23.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509c8b6640 1 --2- 172.21.15.145:0/2646591796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c8e89b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5094011f70 tx=0x7f509402f4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf33b098d852bc41 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f4f73fff640 1 -- 172.21.15.145:0/2646591796 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094047740 con 0x56227c8e85b0 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f4f73fff640 1 -- 172.21.15.145:0/2646591796 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5094047c60 con 0x56227c8e85b0 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f4f73fff640 1 -- 172.21.15.145:0/2646591796 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50940478e0 con 0x56227c8e85b0 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- 172.21.15.145:0/2646591796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 msgr2=0x56227c8e89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 --2- 172.21.15.145:0/2646591796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c8e89b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5094011f70 tx=0x7f509402f4c0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- 172.21.15.145:0/2646591796 shutdown_connections 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 --2- 172.21.15.145:0/2646591796 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c8e89b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- 172.21.15.145:0/2646591796 >> 172.21.15.145:0/2646591796 conn(0x56227c8e4990 msgr2=0x56227c8e2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- 172.21.15.145:0/2646591796 shutdown_connections 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- 172.21.15.145:0/2646591796 wait complete. 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 Processor -- start 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- start start 2024-09-11T11:01:23.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c7cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56227c8e93a0 con 0x56227c8e85b0 2024-09-11T11:01:23.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c7cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509c8b6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c7cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48528/0 (socket says 172.21.15.145:48528) 2024-09-11T11:01:23.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 learned_addr learned my addr 172.21.15.145:0/3153570474 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56227c7ca390 con 0x56227c8e85b0 2024-09-11T11:01:23.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509c8b6640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c7cbc70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5094011f70 tx=0x7f509402ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f4f727fc640 1 -- 172.21.15.145:0/3153570474 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5094047e10 con 0x56227c8e85b0 2024-09-11T11:01:23.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f4f727fc640 1 -- 172.21.15.145:0/3153570474 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f509402f7f0 con 0x56227c8e85b0 2024-09-11T11:01:23.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56227c7ca390 con 0x56227c8e85b0 2024-09-11T11:01:23.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f4f727fc640 1 -- 172.21.15.145:0/3153570474 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f509404cbc0 con 0x56227c8e85b0 2024-09-11T11:01:23.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.164+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56227c7ca390 con 0x56227c8e85b0 2024-09-11T11:01:23.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f4f727fc640 1 -- 172.21.15.145:0/3153570474 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f50940405f0 con 0x56227c8e85b0 2024-09-11T11:01:23.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f4f727fc640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f680346a0 0x7f4f68036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f4f727fc640 1 -- 172.21.15.145:0/3153570474 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f509405a030 con 0x56227c8e85b0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509c0b5640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f680346a0 0x7f4f68036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c8fc9f0 0x56227c8feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c8ff600 con 0x56227c8fc9f0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509d0b7640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c8fc9f0 0x56227c8feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509c0b5640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f680346a0 0x7f4f68036b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f508400a480 tx=0x7f50840b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509d0b7640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c8fc9f0 0x56227c8feeb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 20 realm 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c8fbe20 con 0x56227c8fc9f0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c900090 con 0x56227c8fc9f0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c900e70 0x56227c903260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c9038f0 con 0x56227c900e70 2024-09-11T11:01:23.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509c8b6640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c900e70 0x56227c903260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.168+0000 7f509c8b6640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c900e70 0x56227c903260 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509eda6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c904140 con 0x56227c900e70 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509eda6980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509eda6980 20 searching for the correct realm 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56227c905eb0 0x56227c9082a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c905eb0 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c0b5640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56227c905eb0 0x56227c9082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c0b5640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56227c905eb0 0x56227c9082a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c8b6640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5094026020 0x7f5094029880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x7f5094026020 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509d0b7640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5094026020 0x7f5094029880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509d0b7640 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5094026020 0x7f5094029880 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.172+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c905eb0 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x7f5094026020 2024-09-11T11:01:23.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x7f5094026020 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c905eb0 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.176+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c905eb0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c905eb0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x7f5094026020 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c8fc9f0 2024-09-11T11:01:23.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x7f5094026020 2024-09-11T11:01:23.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c905eb0 2024-09-11T11:01:23.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x7f5094026020 2024-09-11T11:01:23.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.180+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c905eb0 2024-09-11T11:01:23.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56227c908920 con 0x56227c900e70 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:23.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c904ac0 con 0x56227c8fc9f0 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c905360 con 0x56227c900e70 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c904700 con 0x7f5094026020 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 zone default found 2024-09-11T11:01:23.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 4 Realm: () 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 zonegroup default 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.184+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c909250 con 0x7f5094026020 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c90afd0 con 0x56227c905eb0 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c90b430 con 0x56227c905eb0 2024-09-11T11:01:23.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 20 started sync module instance, tier type = 2024-09-11T11:01:23.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:23.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90a470 con 0x56227c900e70 2024-09-11T11:01:23.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94706118732144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90a470 con 0x56227c900e70 2024-09-11T11:01:23.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.188+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90beb0 con 0x56227c8fc9f0 2024-09-11T11:01:23.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.192+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.192+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94706118736384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90c2d0 con 0x56227c8fc9f0 2024-09-11T11:01:23.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.192+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90cda0 con 0x56227c900e70 2024-09-11T11:01:23.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.192+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94706118732144] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.196+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94706118736384] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.196+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.196+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94706118740112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90be20 con 0x56227c900e70 2024-09-11T11:01:23.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.196+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90d670 con 0x7f5094026020 2024-09-11T11:01:23.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.196+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.196+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94706118742464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90be20 con 0x7f5094026020 2024-09-11T11:01:23.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.196+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90e0b0 con 0x56227c900e70 2024-09-11T11:01:23.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.200+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94706118740112] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.200+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94706118742464] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.200+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.200+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94706118743520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90dc00 con 0x56227c900e70 2024-09-11T11:01:23.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.200+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90e950 con 0x56227c905eb0 2024-09-11T11:01:23.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.200+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.200+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94706118747296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90dc00 con 0x56227c905eb0 2024-09-11T11:01:23.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.200+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90f7c0 con 0x56227c905eb0 2024-09-11T11:01:23.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.204+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94706118743520] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.204+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94706118747296] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.204+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.204+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94706118750992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90fb60 con 0x56227c905eb0 2024-09-11T11:01:23.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.204+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c9103b0 con 0x7f5094026020 2024-09-11T11:01:23.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.208+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94706118750992] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94706118753120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c910430 con 0x7f5094026020 2024-09-11T11:01:23.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 20 add_watcher() i=0 2024-09-11T11:01:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 20 add_watcher() i=1 2024-09-11T11:01:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 20 add_watcher() i=2 2024-09-11T11:01:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 20 add_watcher() i=3 2024-09-11T11:01:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 20 add_watcher() i=4 2024-09-11T11:01:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 20 add_watcher() i=5 2024-09-11T11:01:23.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 20 add_watcher() i=6 2024-09-11T11:01:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94706118753120] v32'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 20 add_watcher() i=7 2024-09-11T11:01:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:23.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c913760 con 0x56227c8fc9f0 2024-09-11T11:01:23.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.212+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94706118766992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c9105a0 con 0x56227c8fc9f0 2024-09-11T11:01:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94706118766992] v32'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f4f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 5 note: GC not initialized 2024-09-11T11:01:23.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f4f51fe3640 20 reqs_thread_entry: start 2024-09-11T11:01:23.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:23.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 20 Filter name: none 2024-09-11T11:01:23.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f4ec37fe640 20 reqs_thread_entry: start 2024-09-11T11:01:23.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:23.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c936ed0 con 0x56227c8fc9f0 2024-09-11T11:01:23.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:23.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:23.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:23.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c9369b0 con 0x7f5094026020 2024-09-11T11:01:23.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.216+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c93d140 con 0x56227c8fc9f0 2024-09-11T11:01:23.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509eda6980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:23.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509eda6980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509eda6980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:23.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94706118938064 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56227c939e60 con 0x56227c900e70 2024-09-11T11:01:23.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94706118743520 notify 137438953473 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56227c8dc830 con 0x56227c900e70 2024-09-11T11:01:23.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f4f73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94706118743520 notifier 4318 bl.length()=567 2024-09-11T11:01:23.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(65 notify.4 [notify cookie 94706118938064 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f4f73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:23.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f4f73fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f4f73fff640 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4f60003eb0 con 0x56227c900e70 2024-09-11T11:01:23.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.220+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94706118938064 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56227c8dc5a0 con 0x56227c900e70 2024-09-11T11:01:23.225 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:23.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.224+0000 7f4f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.224+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94706118766992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c934d00 con 0x56227c8fc9f0 2024-09-11T11:01:23.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.224+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94706118766992] v32'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.224+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94706118732144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c934d00 con 0x56227c900e70 2024-09-11T11:01:23.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.224+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94706118732144] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.224+0000 7f509eda6980 20 remove_watcher() i=0 2024-09-11T11:01:23.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.224+0000 7f509eda6980 2 removed watcher, disabling cache 2024-09-11T11:01:23.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.224+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94706118736384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c934d00 con 0x56227c8fc9f0 2024-09-11T11:01:23.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.228+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94706118736384] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x56227c8fc9f0 2024-09-11T11:01:23.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.228+0000 7f509eda6980 20 remove_watcher() i=1 2024-09-11T11:01:23.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.228+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94706118740112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90ba00 con 0x56227c900e70 2024-09-11T11:01:23.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.228+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94706118740112] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.228+0000 7f509eda6980 20 remove_watcher() i=2 2024-09-11T11:01:23.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.228+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94706118742464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c934d00 con 0x7f5094026020 2024-09-11T11:01:23.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94706118742464] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509eda6980 20 remove_watcher() i=3 2024-09-11T11:01:23.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94706118743520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90c890 con 0x56227c900e70 2024-09-11T11:01:23.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509c8b6640 1 -- 172.21.15.145:0/3153570474 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94706118743520] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5094050070 con 0x56227c900e70 2024-09-11T11:01:23.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509eda6980 20 remove_watcher() i=4 2024-09-11T11:01:23.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94706118747296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90ba00 con 0x56227c905eb0 2024-09-11T11:01:23.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94706118747296] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509eda6980 20 remove_watcher() i=5 2024-09-11T11:01:23.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.232+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94706118750992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c934d00 con 0x56227c905eb0 2024-09-11T11:01:23.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509c0b5640 1 -- 172.21.15.145:0/3153570474 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94706118750992] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50840c9030 con 0x56227c905eb0 2024-09-11T11:01:23.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 20 remove_watcher() i=6 2024-09-11T11:01:23.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94706118753120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56227c90c890 con 0x7f5094026020 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94706118753120] v32'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f508c0083f0 con 0x7f5094026020 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 20 remove_watcher() i=7 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c900e70 msgr2=0x56227c903260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c900e70 0x56227c903260 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c8fc9f0 msgr2=0x56227c8feeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c8fc9f0 0x56227c8feeb0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5094026020 msgr2=0x7f5094029880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5094026020 0x7f5094029880 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56227c905eb0 msgr2=0x56227c9082a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56227c905eb0 0x56227c9082a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f680346a0 msgr2=0x7f4f68036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f680346a0 0x7f4f68036b60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f508400a480 tx=0x7f50840b9040 comp rx=0 tx=0).stop 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 msgr2=0x56227c7cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c7cbc70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5094011f70 tx=0x7f509402ff00 comp rx=0 tx=0).stop 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509d0b7640 1 -- 172.21.15.145:0/3153570474 reap_dead start 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 shutdown_connections 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 --2- 172.21.15.145:0/3153570474 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8e85b0 0x56227c7cbc70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 >> 172.21.15.145:0/3153570474 conn(0x56227c8e4990 msgr2=0x56227c8e2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 shutdown_connections 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.236+0000 7f509eda6980 1 -- 172.21.15.145:0/3153570474 wait complete. 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2674852759 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f740346a0 msgr2=0x7f4f74036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2674852759 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f740346a0 0x7f4f74036b60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f509402d880 tx=0x7f5084005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:23.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2674852759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8dbc40 msgr2=0x56227c8dc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2674852759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8dbc40 0x56227c8dc060 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f50940493d0 tx=0x7f509401c990 comp rx=0 tx=0).stop 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2674852759 shutdown_connections 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2674852759 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f740346a0 0x7f4f74036b60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2674852759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c8dbc40 0x56227c8dc060 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2674852759 >> 172.21.15.145:0/2674852759 conn(0x56227c8d0d90 msgr2=0x56227c8d3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2674852759 shutdown_connections 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2674852759 wait complete. 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c8c6260 msgr2=0x56227c8c8650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56227c8c6260 0x56227c8c8650 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c7cfa90 msgr2=0x56227c8c4fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56227c7cfa90 0x56227c8c4fc0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56227c8cb8c0 msgr2=0x56227c8cdcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56227c8cb8c0 0x56227c8cdcb0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f840346a0 msgr2=0x7f4f84036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4f840346a0 0x7f4f84036b60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f50840ad000 tx=0x7f50840a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:23.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 msgr2=0x56227c8bdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 --2- 172.21.15.145:0/2161493512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56227c73fac0 0x56227c8bdec0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5094004500 tx=0x7f5094001260 comp rx=0 tx=0).stop 2024-09-11T11:01:23.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509d0b7640 1 -- 172.21.15.145:0/2161493512 reap_dead start 2024-09-11T11:01:23.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 shutdown_connections 2024-09-11T11:01:23.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 >> 172.21.15.145:0/2161493512 conn(0x56227c7c6060 msgr2=0x56227c8b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 shutdown_connections 2024-09-11T11:01:23.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.240+0000 7f509eda6980 1 -- 172.21.15.145:0/2161493512 wait complete. 2024-09-11T11:01:23.252 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:23.253 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:01:23.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:01:23.253 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:01:23.328 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:23.328 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:23.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.324+0000 7f36d46c5980 1 Processor -- start 2024-09-11T11:01:23.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.324+0000 7f36d46c5980 1 -- start start 2024-09-11T11:01:23.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.324+0000 7f36d46c5980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e3074247c0 0x55e307423280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.324+0000 7f36d46c5980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e307335ae0 con 0x55e3074243b0 2024-09-11T11:01:23.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.324+0000 7f36d46c5980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55e307359e30 con 0x55e3074247c0 2024-09-11T11:01:23.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d19d4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e3074247c0 0x55e307423280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d21d5640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55e3074243b0 0x55e307422b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48602/0 (socket says 172.21.15.145:48602) 2024-09-11T11:01:23.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d21d5640 1 -- 172.21.15.145:0/1225204810 learned_addr learned my addr 172.21.15.145:0/1225204810 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:23.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d19d4640 1 -- 172.21.15.145:0/1225204810 >> v1:172.21.15.102:6789/0 conn(0x55e3074243b0 legacy=0x55e307422b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d19d4640 1 -- 172.21.15.145:0/1225204810 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3074238e0 con 0x55e3074247c0 2024-09-11T11:01:23.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d19d4640 1 --2- 172.21.15.145:0/1225204810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074247c0 0x55e307423280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f36c800a480 tx=0x7f36c801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34a07ca15655313 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d11d3640 1 -- 172.21.15.145:0/1225204810 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36c80b0070 con 0x55e3074247c0 2024-09-11T11:01:23.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d11d3640 1 -- 172.21.15.145:0/1225204810 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c80ab540 con 0x55e3074247c0 2024-09-11T11:01:23.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.328+0000 7f36d11d3640 1 -- 172.21.15.145:0/1225204810 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36c80ab840 con 0x55e3074247c0 2024-09-11T11:01:23.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.332+0000 7f36d46c5980 1 -- 172.21.15.145:0/1225204810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074247c0 msgr2=0x55e307423280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.332+0000 7f36d46c5980 1 --2- 172.21.15.145:0/1225204810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074247c0 0x55e307423280 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f36c800a480 tx=0x7f36c801b280 comp rx=0 tx=0).stop 2024-09-11T11:01:23.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.332+0000 7f36d46c5980 1 -- 172.21.15.145:0/1225204810 shutdown_connections 2024-09-11T11:01:23.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.332+0000 7f36d46c5980 1 --2- 172.21.15.145:0/1225204810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074247c0 0x55e307423280 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.332+0000 7f36d46c5980 1 -- 172.21.15.145:0/1225204810 >> 172.21.15.145:0/1225204810 conn(0x55e3074a91b0 msgr2=0x55e3074ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.332+0000 7f36d46c5980 1 -- 172.21.15.145:0/1225204810 shutdown_connections 2024-09-11T11:01:23.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.332+0000 7f36d46c5980 1 -- 172.21.15.145:0/1225204810 wait complete. 2024-09-11T11:01:23.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 Processor -- start 2024-09-11T11:01:23.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- start start 2024-09-11T11:01:23.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e30759ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e30735b200 con 0x55e3074243b0 2024-09-11T11:01:23.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e30759ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e30759ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48552/0 (socket says 172.21.15.145:48552) 2024-09-11T11:01:23.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d21d5640 1 -- 172.21.15.145:0/986444782 learned_addr learned my addr 172.21.15.145:0/986444782 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d21d5640 1 -- 172.21.15.145:0/986444782 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e30759b1e0 con 0x55e3074243b0 2024-09-11T11:01:23.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d21d5640 1 --2- 172.21.15.145:0/986444782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e30759ac10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0017b0 tx=0x7f36cc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20da2cb924288dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f35c0608640 1 -- 172.21.15.145:0/986444782 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc016070 con 0x55e3074243b0 2024-09-11T11:01:23.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f35c0608640 1 -- 172.21.15.145:0/986444782 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc004530 con 0x55e3074243b0 2024-09-11T11:01:23.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f35c0608640 1 -- 172.21.15.145:0/986444782 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc004870 con 0x55e3074243b0 2024-09-11T11:01:23.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- 172.21.15.145:0/986444782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 msgr2=0x55e30759ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 --2- 172.21.15.145:0/986444782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e30759ac10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0017b0 tx=0x7f36cc001c70 comp rx=0 tx=0).stop 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- 172.21.15.145:0/986444782 shutdown_connections 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 --2- 172.21.15.145:0/986444782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e30759ac10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- 172.21.15.145:0/986444782 >> 172.21.15.145:0/986444782 conn(0x55e3074a91b0 msgr2=0x55e307596840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- 172.21.15.145:0/986444782 shutdown_connections 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- 172.21.15.145:0/986444782 wait complete. 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 Processor -- start 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- start start 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e3075a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d46c5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e3074b9200 con 0x55e3074243b0 2024-09-11T11:01:23.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e3075a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e3075a1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48560/0 (socket says 172.21.15.145:48560) 2024-09-11T11:01:23.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.348+0000 7f36d21d5640 1 -- 172.21.15.145:0/2284715049 learned_addr learned my addr 172.21.15.145:0/2284715049 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d21d5640 1 -- 172.21.15.145:0/2284715049 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3075a2510 con 0x55e3074243b0 2024-09-11T11:01:23.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d21d5640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e3075a1fd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36cc014040 tx=0x7f36cc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f35bee05640 1 -- 172.21.15.145:0/2284715049 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc020070 con 0x55e3074243b0 2024-09-11T11:01:23.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f35bee05640 1 -- 172.21.15.145:0/2284715049 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc011400 con 0x55e3074243b0 2024-09-11T11:01:23.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3075a27a0 con 0x55e3074243b0 2024-09-11T11:01:23.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3075a5480 con 0x55e3074243b0 2024-09-11T11:01:23.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f35bee05640 1 -- 172.21.15.145:0/2284715049 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc016040 con 0x55e3074243b0 2024-09-11T11:01:23.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f35bee05640 1 -- 172.21.15.145:0/2284715049 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f36cc023070 con 0x55e3074243b0 2024-09-11T11:01:23.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f35bee05640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35b80346a0 0x7f35b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f35bee05640 1 -- 172.21.15.145:0/2284715049 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f36cc048e60 con 0x55e3074243b0 2024-09-11T11:01:23.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d19d4640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35b80346a0 0x7f35b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d46c5980 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3074247c0 0x55e3075a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075a9610 con 0x55e3074247c0 2024-09-11T11:01:23.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d29d6640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3074247c0 0x55e3075a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d19d4640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35b80346a0 0x7f35b8036b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f36c80ad000 tx=0x7f36c80a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d29d6640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3074247c0 0x55e3075a90d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d29d6640 1 -- 172.21.15.145:0/2284715049 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3074247c0 2024-09-11T11:01:23.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d46c5980 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075aa400 0x55e3075ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.352+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ace20 con 0x55e3075aa400 2024-09-11T11:01:23.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d21d5640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075aa400 0x55e3075ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d21d5640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075aa400 0x55e3075ac7f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d21d5640 1 -- 172.21.15.145:0/2284715049 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36cc02c070 con 0x55e3075aa400 2024-09-11T11:01:23.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ae6d0 con 0x55e3075aa400 2024-09-11T11:01:23.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d21d5640 1 -- 172.21.15.145:0/2284715049 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f36cc02c070 con 0x55e3075aa400 2024-09-11T11:01:23.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ad840 con 0x55e3075aa400 2024-09-11T11:01:23.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d21d5640 1 -- 172.21.15.145:0/2284715049 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36cc02c070 con 0x55e3075aa400 2024-09-11T11:01:23.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d46c5980 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e3075afa80 0x55e3075b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075b23b0 con 0x55e3075afa80 2024-09-11T11:01:23.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d19d4640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e3075afa80 0x55e3075b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d19d4640 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e3075afa80 0x55e3075b1e70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.356+0000 7f36d19d4640 1 -- 172.21.15.145:0/2284715049 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f36c80b3040 con 0x55e3075afa80 2024-09-11T11:01:23.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d46c5980 1 Processor -- start 2024-09-11T11:01:23.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d46c5980 1 -- start start 2024-09-11T11:01:23.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d46c5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075bfd60 0x55e3075c0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d46c5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e3073b4800 con 0x55e3075bfd60 2024-09-11T11:01:23.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075bfd60 0x55e3075c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075bfd60 0x55e3075c0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48568/0 (socket says 172.21.15.145:48568) 2024-09-11T11:01:23.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d21d5640 1 -- 172.21.15.145:0/3440411526 learned_addr learned my addr 172.21.15.145:0/3440411526 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d21d5640 1 -- 172.21.15.145:0/3440411526 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3075c06c0 con 0x55e3075bfd60 2024-09-11T11:01:23.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d21d5640 1 --2- 172.21.15.145:0/3440411526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075bfd60 0x55e3075c0180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36cc024b60 tx=0x7f36cc024fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f35b7fff640 1 -- 172.21.15.145:0/3440411526 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc0116e0 con 0x55e3075bfd60 2024-09-11T11:01:23.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d46c5980 1 -- 172.21.15.145:0/3440411526 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3075c0950 con 0x55e3075bfd60 2024-09-11T11:01:23.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f35b7fff640 1 -- 172.21.15.145:0/3440411526 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc011880 con 0x55e3075bfd60 2024-09-11T11:01:23.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f35b7fff640 1 -- 172.21.15.145:0/3440411526 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc011b60 con 0x55e3075bfd60 2024-09-11T11:01:23.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d46c5980 1 -- 172.21.15.145:0/3440411526 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3075c35d0 con 0x55e3075bfd60 2024-09-11T11:01:23.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f35b7fff640 1 -- 172.21.15.145:0/3440411526 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f36cc04c070 con 0x55e3075bfd60 2024-09-11T11:01:23.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f35b7fff640 1 --2- 172.21.15.145:0/3440411526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35ac0346a0 0x7f35ac036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f35b7fff640 1 -- 172.21.15.145:0/3440411526 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f36cc03eaf0 con 0x55e3075bfd60 2024-09-11T11:01:23.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d19d4640 1 --2- 172.21.15.145:0/3440411526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35ac0346a0 0x7f35ac036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d46c5980 1 Processor -- start 2024-09-11T11:01:23.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d46c5980 1 -- start start 2024-09-11T11:01:23.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.360+0000 7f36d19d4640 1 --2- 172.21.15.145:0/3440411526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35ac0346a0 0x7f35ac036b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55e3075a65c0 tx=0x7f36c8005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e30759b560 con 0x55e3075cc750 2024-09-11T11:01:23.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48578/0 (socket says 172.21.15.145:48578) 2024-09-11T11:01:23.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 -- 172.21.15.145:0/162189332 learned_addr learned my addr 172.21.15.145:0/162189332 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 -- 172.21.15.145:0/162189332 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3075cd120 con 0x55e3075cc750 2024-09-11T11:01:23.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 --2- 172.21.15.145:0/162189332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075ccb50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f36cc001cb0 tx=0x7f36cc032e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fd8f7b7dbb7795 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f35b5ffb640 1 -- 172.21.15.145:0/162189332 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc060070 con 0x55e3075cc750 2024-09-11T11:01:23.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f35b5ffb640 1 -- 172.21.15.145:0/162189332 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc03edd0 con 0x55e3075cc750 2024-09-11T11:01:23.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f35b5ffb640 1 -- 172.21.15.145:0/162189332 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc02dda0 con 0x55e3075cc750 2024-09-11T11:01:23.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 -- 172.21.15.145:0/162189332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 msgr2=0x55e3075ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 --2- 172.21.15.145:0/162189332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075ccb50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f36cc001cb0 tx=0x7f36cc032e00 comp rx=0 tx=0).stop 2024-09-11T11:01:23.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 -- 172.21.15.145:0/162189332 shutdown_connections 2024-09-11T11:01:23.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 --2- 172.21.15.145:0/162189332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075ccb50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 -- 172.21.15.145:0/162189332 >> 172.21.15.145:0/162189332 conn(0x55e3075c8ad0 msgr2=0x55e3075c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 -- 172.21.15.145:0/162189332 shutdown_connections 2024-09-11T11:01:23.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 -- 172.21.15.145:0/162189332 wait complete. 2024-09-11T11:01:23.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 Processor -- start 2024-09-11T11:01:23.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 -- start start 2024-09-11T11:01:23.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075d38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d46c5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e3075cd4e0 con 0x55e3075cc750 2024-09-11T11:01:23.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075d38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075d38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48588/0 (socket says 172.21.15.145:48588) 2024-09-11T11:01:23.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 learned_addr learned my addr 172.21.15.145:0/4142120749 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.364+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3075d3df0 con 0x55e3075cc750 2024-09-11T11:01:23.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d21d5640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075d38b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0021c0 tx=0x7f36cc033ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f35a3fff640 1 -- 172.21.15.145:0/4142120749 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc06b020 con 0x55e3075cc750 2024-09-11T11:01:23.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f35a3fff640 1 -- 172.21.15.145:0/4142120749 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36cc026d30 con 0x55e3075cc750 2024-09-11T11:01:23.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3075d3df0 con 0x55e3075cc750 2024-09-11T11:01:23.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f35a3fff640 1 -- 172.21.15.145:0/4142120749 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36cc060030 con 0x55e3075cc750 2024-09-11T11:01:23.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3075d3df0 con 0x55e3075cc750 2024-09-11T11:01:23.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f35a3fff640 1 -- 172.21.15.145:0/4142120749 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f36cc06e020 con 0x55e3075cc750 2024-09-11T11:01:23.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f35a3fff640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f359c0346a0 0x7f359c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f35a3fff640 1 -- 172.21.15.145:0/4142120749 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f36cc061070 con 0x55e3075cc750 2024-09-11T11:01:23.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d19d4640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f359c0346a0 0x7f359c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3075de9a0 0x55e3075e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075e1590 con 0x55e3075de9a0 2024-09-11T11:01:23.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d29d6640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3075de9a0 0x55e3075e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d19d4640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f359c0346a0 0x7f359c036b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36c800a480 tx=0x7f36c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d29d6640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3075de9a0 0x55e3075e0e40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 20 realm 2024-09-11T11:01:23.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075dde90 con 0x55e3075de9a0 2024-09-11T11:01:23.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075e2060 con 0x55e3075de9a0 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075e2c40 0x55e3075e5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075e5870 con 0x55e3075e2c40 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.368+0000 7f36d21d5640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075e2c40 0x55e3075e5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d21d5640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075e2c40 0x55e3075e5100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d46c5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075e6110 con 0x55e3075e2c40 2024-09-11T11:01:23.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d46c5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:23.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d46c5980 20 searching for the correct realm 2024-09-11T11:01:23.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e3075e7e80 0x55e3075ea270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e7e80 2024-09-11T11:01:23.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d19d4640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e3075e7e80 0x55e3075ea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d19d4640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e3075e7e80 0x55e3075ea270 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d21d5640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f36cc070020 0x7f36cc03e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x7f36cc070020 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d29d6640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f36cc070020 0x7f36cc03e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d29d6640 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f36cc070020 0x7f36cc03e4b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.372+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e7e80 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x7f36cc070020 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x7f36cc070020 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.376+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e7e80 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e7e80 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e7e80 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x7f36cc070020 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075de9a0 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x7f36cc070020 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.380+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e7e80 2024-09-11T11:01:23.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x7f36cc070020 2024-09-11T11:01:23.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e7e80 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ea8f0 con 0x55e3075e2c40 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:23.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075e6ac0 con 0x55e3075de9a0 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075e6f10 con 0x55e3075e2c40 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.384+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075e6f10 con 0x7f36cc070020 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:23.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 zone default found 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 4 Realm: () 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 zonegroup default 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075eada0 con 0x7f36cc070020 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ecfd0 con 0x55e3075e7e80 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ed370 con 0x55e3075e7e80 2024-09-11T11:01:23.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 started sync module instance, tier type = 2024-09-11T11:01:23.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:23.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ec410 con 0x55e3075e2c40 2024-09-11T11:01:23.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94433569589248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ec410 con 0x55e3075e2c40 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.388+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075edc40 con 0x55e3075de9a0 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.392+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.392+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94433569593104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075edc00 con 0x55e3075de9a0 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.392+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075eeb50 con 0x55e3075e2c40 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.392+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94433569589248] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.392+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94433569593104] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.392+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.392+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94433569595440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ebf60 con 0x55e3075e2c40 2024-09-11T11:01:23.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.392+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ef000 con 0x7f36cc070020 2024-09-11T11:01:23.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94433569598288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ef420 con 0x7f36cc070020 2024-09-11T11:01:23.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075efe60 con 0x55e3075e2c40 2024-09-11T11:01:23.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94433569598288] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94433569595440] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94433569601840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075eef70 con 0x55e3075e2c40 2024-09-11T11:01:23.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075f0700 con 0x55e3075e7e80 2024-09-11T11:01:23.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94433569604176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075eef70 con 0x55e3075e7e80 2024-09-11T11:01:23.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.396+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075f1460 con 0x55e3075e7e80 2024-09-11T11:01:23.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.400+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94433569604176] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.400+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94433569601840] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.400+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.400+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94433569606304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075f1880 con 0x55e3075e7e80 2024-09-11T11:01:23.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.400+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075f2110 con 0x7f36cc070020 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94433569606304] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94433569607360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075f2500 con 0x7f36cc070020 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 20 add_watcher() i=0 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 20 add_watcher() i=1 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 20 add_watcher() i=2 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 20 add_watcher() i=3 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 20 add_watcher() i=4 2024-09-11T11:01:23.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 20 add_watcher() i=5 2024-09-11T11:01:23.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 20 add_watcher() i=6 2024-09-11T11:01:23.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94433569607360] v32'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 20 add_watcher() i=7 2024-09-11T11:01:23.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:23.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e3075f5a00 con 0x55e3075de9a0 2024-09-11T11:01:23.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.404+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94433569610784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075f2e10 con 0x55e3075de9a0 2024-09-11T11:01:23.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94433569610784] v32'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f3588fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 5 note: GC not initialized 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f35037fe640 20 reqs_thread_entry: start 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 20 Filter name: none 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f35017fa640 20 reqs_thread_entry: start 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e307618b30 con 0x55e3075de9a0 2024-09-11T11:01:23.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:23.412 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:23.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f3588fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.408+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94433569610784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e307617a80 con 0x55e3075de9a0 2024-09-11T11:01:23.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.412+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94433569610784] v32'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.412+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94433569589248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075f1c20 con 0x55e3075e2c40 2024-09-11T11:01:23.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.412+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94433569589248] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.412+0000 7f36d46c5980 20 remove_watcher() i=0 2024-09-11T11:01:23.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.412+0000 7f36d46c5980 2 removed watcher, disabling cache 2024-09-11T11:01:23.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.412+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94433569593104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ec800 con 0x55e3075de9a0 2024-09-11T11:01:23.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.412+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94433569593104] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x55e3075de9a0 2024-09-11T11:01:23.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.412+0000 7f36d46c5980 20 remove_watcher() i=1 2024-09-11T11:01:23.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.416+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94433569595440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ec800 con 0x55e3075e2c40 2024-09-11T11:01:23.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.416+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94433569595440] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.416+0000 7f36d46c5980 20 remove_watcher() i=2 2024-09-11T11:01:23.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.416+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94433569598288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ec800 con 0x7f36cc070020 2024-09-11T11:01:23.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.416+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94433569598288] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.416+0000 7f36d46c5980 20 remove_watcher() i=3 2024-09-11T11:01:23.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.416+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94433569601840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075eeb50 con 0x55e3075e2c40 2024-09-11T11:01:23.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.420+0000 7f36d21d5640 1 -- 172.21.15.145:0/4142120749 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94433569601840] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36cc04b030 con 0x55e3075e2c40 2024-09-11T11:01:23.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.420+0000 7f36d46c5980 20 remove_watcher() i=4 2024-09-11T11:01:23.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.420+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94433569604176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ec800 con 0x55e3075e7e80 2024-09-11T11:01:23.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.420+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94433569604176] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.420+0000 7f36d46c5980 20 remove_watcher() i=5 2024-09-11T11:01:23.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.420+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94433569606304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075ef930 con 0x55e3075e7e80 2024-09-11T11:01:23.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.420+0000 7f36d19d4640 1 -- 172.21.15.145:0/4142120749 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94433569606304] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c80d8070 con 0x55e3075e7e80 2024-09-11T11:01:23.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.420+0000 7f36d46c5980 20 remove_watcher() i=6 2024-09-11T11:01:23.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94433569607360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e3075eeb50 con 0x7f36cc070020 2024-09-11T11:01:23.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94433569607360] v32'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36c40083f0 con 0x7f36cc070020 2024-09-11T11:01:23.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 20 remove_watcher() i=7 2024-09-11T11:01:23.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075e2c40 msgr2=0x55e3075e5100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075e2c40 0x55e3075e5100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3075de9a0 msgr2=0x55e3075e0e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3075de9a0 0x55e3075e0e40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f36cc070020 msgr2=0x7f36cc03e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f36cc070020 0x7f36cc03e4b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e3075e7e80 msgr2=0x55e3075ea270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e3075e7e80 0x55e3075ea270 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f359c0346a0 msgr2=0x7f359c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f359c0346a0 0x7f359c036b60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f36c800a480 tx=0x7f36c80a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d29d6640 1 -- 172.21.15.145:0/4142120749 reap_dead start 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 msgr2=0x55e3075d38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075d38b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f36cc0021c0 tx=0x7f36cc033ac0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 shutdown_connections 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/4142120749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075cc750 0x55e3075d38b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 >> 172.21.15.145:0/4142120749 conn(0x55e3075c8ad0 msgr2=0x55e3075c6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 shutdown_connections 2024-09-11T11:01:23.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/4142120749 wait complete. 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/3440411526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35ac0346a0 msgr2=0x7f35ac036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/3440411526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35ac0346a0 0x7f35ac036b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55e3075a65c0 tx=0x7f36c8005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/3440411526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075bfd60 msgr2=0x55e3075c0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/3440411526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075bfd60 0x55e3075c0180 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f36cc024b60 tx=0x7f36cc024fa0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/3440411526 shutdown_connections 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/3440411526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35ac0346a0 0x7f35ac036b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 --2- 172.21.15.145:0/3440411526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3075bfd60 0x55e3075c0180 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/3440411526 >> 172.21.15.145:0/3440411526 conn(0x55e3075b4eb0 msgr2=0x55e3075b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/3440411526 shutdown_connections 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.424+0000 7f36d46c5980 1 -- 172.21.15.145:0/3440411526 wait complete. 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075aa400 msgr2=0x55e3075ac7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e3075aa400 0x55e3075ac7f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3074247c0 msgr2=0x55e3075a90d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e3074247c0 0x55e3075a90d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e3075afa80 msgr2=0x55e3075b1e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e3075afa80 0x55e3075b1e70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35b80346a0 msgr2=0x7f35b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f35b80346a0 0x7f35b8036b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f36c80ad000 tx=0x7f36c80a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 msgr2=0x55e3075a1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 --2- 172.21.15.145:0/2284715049 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e3074243b0 0x55e3075a1fd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f36cc014040 tx=0x7f36cc001260 comp rx=0 tx=0).stop 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d29d6640 1 -- 172.21.15.145:0/2284715049 reap_dead start 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 shutdown_connections 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 >> 172.21.15.145:0/2284715049 conn(0x55e3074a91b0 msgr2=0x55e3075953c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 shutdown_connections 2024-09-11T11:01:23.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.428+0000 7f36d46c5980 1 -- 172.21.15.145:0/2284715049 wait complete. 2024-09-11T11:01:23.439 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:23.439 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-11T11:01:23.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-11T11:01:23.439 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-11T11:01:23.509 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:23.510 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:23.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61dfce980 1 Processor -- start 2024-09-11T11:01:23.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61dfce980 1 -- start start 2024-09-11T11:01:23.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61dfce980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55bec0bb3a10 0x55bec0bb5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61dfce980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bec0a37ae0 con 0x55bec0baf690 2024-09-11T11:01:23.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61dfce980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55bec0a5be30 con 0x55bec0bb3a10 2024-09-11T11:01:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61b2dd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55bec0bb3a10 0x55bec0bb5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61bade640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55bec0baf690 0x55bec0bafa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48618/0 (socket says 172.21.15.145:48618) 2024-09-11T11:01:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61b2dd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55bec0bb3a10 0x55bec0bb5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48592/0 (socket says 172.21.15.145:48592) 2024-09-11T11:01:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61bade640 1 -- 172.21.15.145:0/159509271 learned_addr learned my addr 172.21.15.145:0/159509271 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61b2dd640 1 -- 172.21.15.145:0/159509271 >> v1:172.21.15.102:6789/0 conn(0x55bec0baf690 legacy=0x55bec0bafa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.508+0000 7ff61b2dd640 1 -- 172.21.15.145:0/159509271 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec0bb7350 con 0x55bec0bb3a10 2024-09-11T11:01:23.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/159509271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0bb3a10 0x55bec0bb5e00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff60400a480 tx=0x7ff60401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfefeebce2891f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61aadc640 1 -- 172.21.15.145:0/159509271 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6040b0070 con 0x55bec0bb3a10 2024-09-11T11:01:23.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61aadc640 1 -- 172.21.15.145:0/159509271 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6040ab540 con 0x55bec0bb3a10 2024-09-11T11:01:23.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61aadc640 1 -- 172.21.15.145:0/159509271 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6040ab840 con 0x55bec0bb3a10 2024-09-11T11:01:23.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61dfce980 1 -- 172.21.15.145:0/159509271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0bb3a10 msgr2=0x55bec0bb5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61dfce980 1 --2- 172.21.15.145:0/159509271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0bb3a10 0x55bec0bb5e00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff60400a480 tx=0x7ff60401b280 comp rx=0 tx=0).stop 2024-09-11T11:01:23.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61dfce980 1 -- 172.21.15.145:0/159509271 shutdown_connections 2024-09-11T11:01:23.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61dfce980 1 --2- 172.21.15.145:0/159509271 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0bb3a10 0x55bec0bb5e00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61dfce980 1 -- 172.21.15.145:0/159509271 >> 172.21.15.145:0/159509271 conn(0x55bec0bab1b0 msgr2=0x55bec0bad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61dfce980 1 -- 172.21.15.145:0/159509271 shutdown_connections 2024-09-11T11:01:23.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.512+0000 7ff61dfce980 1 -- 172.21.15.145:0/159509271 wait complete. 2024-09-11T11:01:23.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.524+0000 7ff61dfce980 1 Processor -- start 2024-09-11T11:01:23.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.524+0000 7ff61dfce980 1 -- start start 2024-09-11T11:01:23.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.524+0000 7ff61dfce980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0b26370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.524+0000 7ff61dfce980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bec0a5d200 con 0x55bec0baf690 2024-09-11T11:01:23.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0b26370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0b26370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48596/0 (socket says 172.21.15.145:48596) 2024-09-11T11:01:23.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 -- 172.21.15.145:0/3282590589 learned_addr learned my addr 172.21.15.145:0/3282590589 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 -- 172.21.15.145:0/3282590589 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec0b26940 con 0x55bec0baf690 2024-09-11T11:01:23.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 --2- 172.21.15.145:0/3282590589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0b26370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff6140015f0 tx=0x7ff614001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b70a5a29365605 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff509e0b640 1 -- 172.21.15.145:0/3282590589 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff614004530 con 0x55bec0baf690 2024-09-11T11:01:23.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff509e0b640 1 -- 172.21.15.145:0/3282590589 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6140046f0 con 0x55bec0baf690 2024-09-11T11:01:23.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff509e0b640 1 -- 172.21.15.145:0/3282590589 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff614004a90 con 0x55bec0baf690 2024-09-11T11:01:23.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 -- 172.21.15.145:0/3282590589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 msgr2=0x55bec0b26370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3282590589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0b26370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff6140015f0 tx=0x7ff614001ab0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 -- 172.21.15.145:0/3282590589 shutdown_connections 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3282590589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0b26370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 -- 172.21.15.145:0/3282590589 >> 172.21.15.145:0/3282590589 conn(0x55bec0bab1b0 msgr2=0x55bec0c96650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 -- 172.21.15.145:0/3282590589 shutdown_connections 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 -- 172.21.15.145:0/3282590589 wait complete. 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 Processor -- start 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 -- start start 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0ca3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61dfce980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bec0bb6e50 con 0x55bec0baf690 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0ca3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0ca3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48608/0 (socket says 172.21.15.145:48608) 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 -- 172.21.15.145:0/2414884560 learned_addr learned my addr 172.21.15.145:0/2414884560 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 -- 172.21.15.145:0/2414884560 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec0ca44d0 con 0x55bec0baf690 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.528+0000 7ff61bade640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0ca3f90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55bec0b25ef0 tx=0x7ff614000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff503fff640 1 -- 172.21.15.145:0/2414884560 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff614013760 con 0x55bec0baf690 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bec0ca4760 con 0x55bec0baf690 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff503fff640 1 -- 172.21.15.145:0/2414884560 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff614013900 con 0x55bec0baf690 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff503fff640 1 -- 172.21.15.145:0/2414884560 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff614013be0 con 0x55bec0baf690 2024-09-11T11:01:23.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec0ca7440 con 0x55bec0baf690 2024-09-11T11:01:23.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff503fff640 1 -- 172.21.15.145:0/2414884560 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff614010070 con 0x55bec0baf690 2024-09-11T11:01:23.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff503fff640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff504034650 0x7ff504036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff503fff640 1 -- 172.21.15.145:0/2414884560 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff614018070 con 0x55bec0baf690 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff504034650 0x7ff504036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61dfce980 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0bb3a10 0x55bec0caaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cab5d0 con 0x55bec0bb3a10 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61c2df640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0bb3a10 0x55bec0caaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff504034650 0x7ff504036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6040ad000 tx=0x7ff6040a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61c2df640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0bb3a10 0x55bec0caaf60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61c2df640 1 -- 172.21.15.145:0/2414884560 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0bb3a10 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61dfce980 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0cac3c0 0x55bec0cae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0caedf0 con 0x55bec0cac3c0 2024-09-11T11:01:23.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61bade640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0cac3c0 0x55bec0cae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.532+0000 7ff61bade640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0cac3c0 0x55bec0cae7b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61bade640 1 -- 172.21.15.145:0/2414884560 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff61401b030 con 0x55bec0cac3c0 2024-09-11T11:01:23.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cb06a0 con 0x55bec0cac3c0 2024-09-11T11:01:23.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61bade640 1 -- 172.21.15.145:0/2414884560 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff61401b030 con 0x55bec0cac3c0 2024-09-11T11:01:23.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0caf8d0 con 0x55bec0cac3c0 2024-09-11T11:01:23.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61bade640 1 -- 172.21.15.145:0/2414884560 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff61401b030 con 0x55bec0cac3c0 2024-09-11T11:01:23.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61dfce980 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bec0cb1a50 0x55bec0cb3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cb4380 con 0x55bec0cb1a50 2024-09-11T11:01:23.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bec0cb1a50 0x55bec0cb3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bec0cb1a50 0x55bec0cb3e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61b2dd640 1 -- 172.21.15.145:0/2414884560 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff6040b3040 con 0x55bec0cb1a50 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61dfce980 1 Processor -- start 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61dfce980 1 -- start start 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61dfce980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cc1d60 0x55bec0cc2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61dfce980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bec0ab6800 con 0x55bec0cc1d60 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cc1d60 0x55bec0cc2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cc1d60 0x55bec0cc2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48620/0 (socket says 172.21.15.145:48620) 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61bade640 1 -- 172.21.15.145:0/3088862981 learned_addr learned my addr 172.21.15.145:0/3088862981 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.536+0000 7ff61bade640 1 -- 172.21.15.145:0/3088862981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec0cc26c0 con 0x55bec0cc1d60 2024-09-11T11:01:23.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61bade640 1 --2- 172.21.15.145:0/3088862981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cc1d60 0x55bec0cc2180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff6140483e0 tx=0x7ff614012ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff5017fa640 1 -- 172.21.15.145:0/3088862981 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff61404e070 con 0x55bec0cc1d60 2024-09-11T11:01:23.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff5017fa640 1 -- 172.21.15.145:0/3088862981 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff614041470 con 0x55bec0cc1d60 2024-09-11T11:01:23.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61dfce980 1 -- 172.21.15.145:0/3088862981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bec0cc2950 con 0x55bec0cc1d60 2024-09-11T11:01:23.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff5017fa640 1 -- 172.21.15.145:0/3088862981 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff614043040 con 0x55bec0cc1d60 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61dfce980 1 -- 172.21.15.145:0/3088862981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec0cc55d0 con 0x55bec0cc1d60 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff5017fa640 1 -- 172.21.15.145:0/3088862981 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff614051070 con 0x55bec0cc1d60 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff5017fa640 1 --2- 172.21.15.145:0/3088862981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4f4034650 0x7ff4f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff5017fa640 1 -- 172.21.15.145:0/3088862981 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff614054af0 con 0x55bec0cc1d60 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/3088862981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4f4034650 0x7ff4f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61dfce980 1 Processor -- start 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61dfce980 1 -- start start 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61dfce980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0ccea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61dfce980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bec0b24b60 con 0x55bec0cce6b0 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/3088862981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4f4034650 0x7ff4f4036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55bec0ca8580 tx=0x7ff604005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0ccea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0ccea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48624/0 (socket says 172.21.15.145:48624) 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61bade640 1 -- 172.21.15.145:0/3571603007 learned_addr learned my addr 172.21.15.145:0/3571603007 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61bade640 1 -- 172.21.15.145:0/3571603007 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec0ccf060 con 0x55bec0cce6b0 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff61bade640 1 --2- 172.21.15.145:0/3571603007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0ccea90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff61401df40 tx=0x7ff614040f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8974d9a289cf7d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff4faffd640 1 -- 172.21.15.145:0/3571603007 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff61405e040 con 0x55bec0cce6b0 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff4faffd640 1 -- 172.21.15.145:0/3571603007 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61402be30 con 0x55bec0cce6b0 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.540+0000 7ff4faffd640 1 -- 172.21.15.145:0/3571603007 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6140484c0 con 0x55bec0cce6b0 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- 172.21.15.145:0/3571603007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 msgr2=0x55bec0ccea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3571603007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0ccea90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff61401df40 tx=0x7ff614040f90 comp rx=0 tx=0).stop 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- 172.21.15.145:0/3571603007 shutdown_connections 2024-09-11T11:01:23.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3571603007 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0ccea90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- 172.21.15.145:0/3571603007 >> 172.21.15.145:0/3571603007 conn(0x55bec0ccaa90 msgr2=0x55bec0cc8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- 172.21.15.145:0/3571603007 shutdown_connections 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- 172.21.15.145:0/3571603007 wait complete. 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 Processor -- start 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- start start 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0cd5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bec0ccf500 con 0x55bec0cce6b0 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0cd5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61bade640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0cd5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48630/0 (socket says 172.21.15.145:48630) 2024-09-11T11:01:23.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 learned_addr learned my addr 172.21.15.145:0/3414860956 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bec0cd5d70 con 0x55bec0cce6b0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61bade640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0cd5830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff614040fd0 tx=0x7ff61401ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff4f97fa640 1 -- 172.21.15.145:0/3414860956 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff614070070 con 0x55bec0cce6b0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bec0cd5d70 con 0x55bec0cce6b0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff4f97fa640 1 -- 172.21.15.145:0/3414860956 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff61405e040 con 0x55bec0cce6b0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff4f97fa640 1 -- 172.21.15.145:0/3414860956 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff61405d070 con 0x55bec0cce6b0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bec0cd5d70 con 0x55bec0cce6b0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.544+0000 7ff4f97fa640 1 -- 172.21.15.145:0/3414860956 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff614073070 con 0x55bec0cce6b0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff4f97fa640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e4034650 0x7ff4e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff4f97fa640 1 -- 172.21.15.145:0/3414860956 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff614076b00 con 0x55bec0cce6b0 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e4034650 0x7ff4e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0ce0970 0x55bec0ce2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce3560 con 0x55bec0ce0970 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61c2df640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0ce0970 0x55bec0ce2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e4034650 0x7ff4e4036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff604018eb0 tx=0x7ff6040b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61c2df640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0ce0970 0x55bec0ce2e10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 realm 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cdfe60 con 0x55bec0ce0970 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce4030 con 0x55bec0ce0970 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0ce4e10 0x55bec0ce7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61bade640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0ce4e10 0x55bec0ce7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61bade640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0ce4e10 0x55bec0ce7200 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce80d0 con 0x55bec0ce4e10 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 20 searching for the correct realm 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bec0ce9970 0x55bec0cebe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cec500 con 0x55bec0ce9970 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.548+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bec0ce9970 0x55bec0cebe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61b2dd640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bec0ce9970 0x55bec0cebe30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cec500 con 0x55bec0ce4e10 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61bade640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff614075070 0x7ff6140541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x7ff614075070 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff614075070 0x7ff6140541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff614075070 0x7ff6140541e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce9970 2024-09-11T11:01:23.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.552+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x7ff614075070 2024-09-11T11:01:23.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x7ff614075070 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce9970 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce9970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce9970 2024-09-11T11:01:23.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x7ff614075070 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.556+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce0970 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x7ff614075070 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce9970 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x7ff614075070 2024-09-11T11:01:23.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce9970 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7880 con 0x55bec0ce4e10 2024-09-11T11:01:23.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce7da0 con 0x55bec0ce0970 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.560+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce8190 con 0x55bec0ce4e10 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ce8190 con 0x7ff614075070 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 zone default found 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 4 Realm: () 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:23.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 zonegroup default 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cec980 con 0x7ff614075070 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cee700 con 0x55bec0ce9970 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ceebb0 con 0x55bec0ce9970 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 started sync module instance, tier type = 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cedba0 con 0x55bec0ce4e10 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94277766930624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cedba0 con 0x55bec0ce4e10 2024-09-11T11:01:23.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.564+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cef630 con 0x55bec0ce0970 2024-09-11T11:01:23.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.568+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.568+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94277766934912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cef5a0 con 0x55bec0ce0970 2024-09-11T11:01:23.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.568+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf0550 con 0x55bec0ce4e10 2024-09-11T11:01:23.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.568+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94277766934912] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.568+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94277766930624] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.572+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.572+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94277766928112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf0510 con 0x55bec0ce4e10 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.572+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf0e20 con 0x7ff614075070 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.572+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.572+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94277766941040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf0510 con 0x7ff614075070 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.572+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf18a0 con 0x55bec0ce4e10 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.572+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94277766941040] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.572+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94277766928112] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.576+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.576+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94277766938688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf13b0 con 0x55bec0ce4e10 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.576+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf2140 con 0x55bec0ce9970 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.576+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.576+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94277766945936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf13b0 con 0x55bec0ce9970 2024-09-11T11:01:23.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.576+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf2fb0 con 0x55bec0ce9970 2024-09-11T11:01:23.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.576+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94277766938688] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.576+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94277766945936] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94277766949632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf3350 con 0x55bec0ce9970 2024-09-11T11:01:23.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf3ba0 con 0x7ff614075070 2024-09-11T11:01:23.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94277766952240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf4000 con 0x7ff614075070 2024-09-11T11:01:23.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 20 add_watcher() i=0 2024-09-11T11:01:23.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 20 add_watcher() i=1 2024-09-11T11:01:23.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 20 add_watcher() i=2 2024-09-11T11:01:23.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 20 add_watcher() i=3 2024-09-11T11:01:23.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 20 add_watcher() i=4 2024-09-11T11:01:23.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 20 add_watcher() i=5 2024-09-11T11:01:23.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94277766949632] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.580+0000 7ff61dfce980 20 add_watcher() i=6 2024-09-11T11:01:23.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94277766952240] v32'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 20 add_watcher() i=7 2024-09-11T11:01:23.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:23.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf0d90 con 0x55bec0ce0970 2024-09-11T11:01:23.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94277766953616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf0d90 con 0x55bec0ce0970 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94277766953616] v32'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff4d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 5 note: GC not initialized 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff4d0fe1640 20 reqs_thread_entry: start 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 20 Filter name: none 2024-09-11T11:01:23.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff44a7fc640 20 reqs_thread_entry: start 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.584+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0d1a670 con 0x55bec0ce0970 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0d1a190 con 0x7ff614075070 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0d20850 con 0x55bec0ce0970 2024-09-11T11:01:23.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v32'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:23.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:23.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94277767135936 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bec0d1d630 con 0x55bec0ce4e10 2024-09-11T11:01:23.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94277766938688 notify 137438953474 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55bec0cc2950 con 0x55bec0ce4e10 2024-09-11T11:01:23.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff4faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94277766938688 notifier 4332 bl.length()=567 2024-09-11T11:01:23.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff4faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:23.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff4faffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff4faffd640 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff4e0003eb0 con 0x55bec0ce4e10 2024-09-11T11:01:23.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(65 notify.4 [notify cookie 94277767135936 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.588+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.592+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94277767135936 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bec0cc26c0 con 0x55bec0ce4e10 2024-09-11T11:01:23.594 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:23.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.592+0000 7ff4d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.592+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94277766953616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0d184a0 con 0x55bec0ce0970 2024-09-11T11:01:23.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.592+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94277766953616] v32'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.592+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94277766930624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0d184a0 con 0x55bec0ce4e10 2024-09-11T11:01:23.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.596+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94277766930624] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.596+0000 7ff61dfce980 20 remove_watcher() i=0 2024-09-11T11:01:23.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.596+0000 7ff61dfce980 2 removed watcher, disabling cache 2024-09-11T11:01:23.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.596+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94277766934912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0d184a0 con 0x55bec0ce0970 2024-09-11T11:01:23.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.596+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94277766934912] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x55bec0ce0970 2024-09-11T11:01:23.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.596+0000 7ff61dfce980 20 remove_watcher() i=1 2024-09-11T11:01:23.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.596+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94277766928112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cef180 con 0x55bec0ce4e10 2024-09-11T11:01:23.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94277766928112] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61dfce980 20 remove_watcher() i=2 2024-09-11T11:01:23.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94277766941040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ced6f0 con 0x7ff614075070 2024-09-11T11:01:23.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94277766941040] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61dfce980 20 remove_watcher() i=3 2024-09-11T11:01:23.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94277766938688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cef180 con 0x55bec0ce4e10 2024-09-11T11:01:23.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61bade640 1 -- 172.21.15.145:0/3414860956 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94277766938688] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff61407c070 con 0x55bec0ce4e10 2024-09-11T11:01:23.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61dfce980 20 remove_watcher() i=4 2024-09-11T11:01:23.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.600+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94277766945936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cf0970 con 0x55bec0ce9970 2024-09-11T11:01:23.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94277766945936] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 20 remove_watcher() i=5 2024-09-11T11:01:23.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94277766949632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0ced6f0 con 0x55bec0ce9970 2024-09-11T11:01:23.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61b2dd640 1 -- 172.21.15.145:0/3414860956 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94277766949632] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff6040c9030 con 0x55bec0ce9970 2024-09-11T11:01:23.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 20 remove_watcher() i=6 2024-09-11T11:01:23.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94277766952240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bec0cef180 con 0x7ff614075070 2024-09-11T11:01:23.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94277766952240] v32'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff60c0083f0 con 0x7ff614075070 2024-09-11T11:01:23.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 20 remove_watcher() i=7 2024-09-11T11:01:23.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0ce4e10 msgr2=0x55bec0ce7200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0ce4e10 0x55bec0ce7200 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0ce0970 msgr2=0x55bec0ce2e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0ce0970 0x55bec0ce2e10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff614075070 msgr2=0x7ff6140541e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff614075070 0x7ff6140541e0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bec0ce9970 msgr2=0x55bec0cebe30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bec0ce9970 0x55bec0cebe30 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e4034650 msgr2=0x7ff4e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4e4034650 0x7ff4e4036b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff604018eb0 tx=0x7ff6040b9040 comp rx=0 tx=0).stop 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 msgr2=0x55bec0cd5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0cd5830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff614040fd0 tx=0x7ff61401ded0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61c2df640 1 -- 172.21.15.145:0/3414860956 reap_dead start 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 shutdown_connections 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3414860956 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cce6b0 0x55bec0cd5830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 >> 172.21.15.145:0/3414860956 conn(0x55bec0ccaa90 msgr2=0x55bec0cc8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 shutdown_connections 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3414860956 wait complete. 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3088862981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4f4034650 msgr2=0x7ff4f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3088862981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4f4034650 0x7ff4f4036b10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x55bec0ca8580 tx=0x7ff604005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3088862981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cc1d60 msgr2=0x55bec0cc2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3088862981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cc1d60 0x55bec0cc2180 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff6140483e0 tx=0x7ff614012ef0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3088862981 shutdown_connections 2024-09-11T11:01:23.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3088862981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff4f4034650 0x7ff4f4036b10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/3088862981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0cc1d60 0x55bec0cc2180 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3088862981 >> 172.21.15.145:0/3088862981 conn(0x55bec0cb6eb0 msgr2=0x55bec0cb9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3088862981 shutdown_connections 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/3088862981 wait complete. 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0cac3c0 msgr2=0x55bec0cae7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bec0cac3c0 0x55bec0cae7b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0bb3a10 msgr2=0x55bec0caaf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bec0bb3a10 0x55bec0caaf60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bec0cb1a50 msgr2=0x55bec0cb3e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.604+0000 7ff61dfce980 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bec0cb1a50 0x55bec0cb3e40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff504034650 msgr2=0x7ff504036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61dfce980 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff504034650 0x7ff504036b10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff6040ad000 tx=0x7ff6040a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 msgr2=0x55bec0ca3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61dfce980 1 --2- 172.21.15.145:0/2414884560 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bec0baf690 0x55bec0ca3f90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55bec0b25ef0 tx=0x7ff614000f50 comp rx=0 tx=0).stop 2024-09-11T11:01:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61c2df640 1 -- 172.21.15.145:0/2414884560 reap_dead start 2024-09-11T11:01:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 shutdown_connections 2024-09-11T11:01:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 >> 172.21.15.145:0/2414884560 conn(0x55bec0bab1b0 msgr2=0x55bec0c96290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 shutdown_connections 2024-09-11T11:01:23.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.608+0000 7ff61dfce980 1 -- 172.21.15.145:0/2414884560 wait complete. 2024-09-11T11:01:23.618 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:23.618 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:01:23.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:01:23.619 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:01:23.694 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:23.694 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:23.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a90085980 1 Processor -- start 2024-09-11T11:01:23.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a90085980 1 -- start start 2024-09-11T11:01:23.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a90085980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ce4cccfac0 0x55ce4cd5e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a90085980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce4cbe3ae0 con 0x55ce4cd5e8b0 2024-09-11T11:01:23.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a90085980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55ce4cc07e30 con 0x55ce4cccfac0 2024-09-11T11:01:23.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a8db95640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ce4cccfac0 0x55ce4cd5e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a8db95640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ce4cccfac0 0x55ce4cd5e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48646/0 (socket says 172.21.15.145:48646) 2024-09-11T11:01:23.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a8db95640 1 -- 172.21.15.145:0/635851104 learned_addr learned my addr 172.21.15.145:0/635851104 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a8db95640 1 -- 172.21.15.145:0/635851104 >> v1:172.21.15.102:6789/0 conn(0x55ce4cd5e8b0 legacy=0x55ce4cd60ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.692+0000 7f6a8db95640 1 -- 172.21.15.145:0/635851104 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4cd633d0 con 0x55ce4cccfac0 2024-09-11T11:01:23.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a8db95640 1 --2- 172.21.15.145:0/635851104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4cd5e370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000a5c0 tx=0x7f6a8001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8bfe7101af37ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a8cb93640 1 -- 172.21.15.145:0/635851104 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800a6070 con 0x55ce4cccfac0 2024-09-11T11:01:23.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a8cb93640 1 -- 172.21.15.145:0/635851104 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800af070 con 0x55ce4cccfac0 2024-09-11T11:01:23.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a8cb93640 1 -- 172.21.15.145:0/635851104 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800aa5c0 con 0x55ce4cccfac0 2024-09-11T11:01:23.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a90085980 1 -- 172.21.15.145:0/635851104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 msgr2=0x55ce4cd5e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a90085980 1 --2- 172.21.15.145:0/635851104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4cd5e370 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000a5c0 tx=0x7f6a8001b340 comp rx=0 tx=0).stop 2024-09-11T11:01:23.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a90085980 1 -- 172.21.15.145:0/635851104 shutdown_connections 2024-09-11T11:01:23.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a90085980 1 --2- 172.21.15.145:0/635851104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4cd5e370 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a90085980 1 -- 172.21.15.145:0/635851104 >> 172.21.15.145:0/635851104 conn(0x55ce4cd56060 msgr2=0x55ce4cd58480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a90085980 1 -- 172.21.15.145:0/635851104 shutdown_connections 2024-09-11T11:01:23.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.696+0000 7f6a90085980 1 -- 172.21.15.145:0/635851104 wait complete. 2024-09-11T11:01:23.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.708+0000 7f6a90085980 1 Processor -- start 2024-09-11T11:01:23.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.708+0000 7f6a90085980 1 -- start start 2024-09-11T11:01:23.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.708+0000 7f6a90085980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4ce46a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.708+0000 7f6a90085980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ce4cc09200 con 0x55ce4cccfac0 2024-09-11T11:01:23.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.708+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4ce46a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.708+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4ce46a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48658/0 (socket says 172.21.15.145:48658) 2024-09-11T11:01:23.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.708+0000 7f6a8db95640 1 -- 172.21.15.145:0/3281271207 learned_addr learned my addr 172.21.15.145:0/3281271207 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a8db95640 1 -- 172.21.15.145:0/3281271207 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4ce47020 con 0x55ce4cccfac0 2024-09-11T11:01:23.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a8db95640 1 --2- 172.21.15.145:0/3281271207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4ce46a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6a800199f0 tx=0x7f6a80003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40cb04959e091cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f697be07640 1 -- 172.21.15.145:0/3281271207 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800aaa00 con 0x55ce4cccfac0 2024-09-11T11:01:23.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f697be07640 1 -- 172.21.15.145:0/3281271207 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800aaba0 con 0x55ce4cccfac0 2024-09-11T11:01:23.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f697be07640 1 -- 172.21.15.145:0/3281271207 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800bd3f0 con 0x55ce4cccfac0 2024-09-11T11:01:23.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- 172.21.15.145:0/3281271207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 msgr2=0x55ce4ce46a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 --2- 172.21.15.145:0/3281271207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4ce46a50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6a800199f0 tx=0x7f6a80003030 comp rx=0 tx=0).stop 2024-09-11T11:01:23.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- 172.21.15.145:0/3281271207 shutdown_connections 2024-09-11T11:01:23.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 --2- 172.21.15.145:0/3281271207 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4ce46a50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- 172.21.15.145:0/3281271207 >> 172.21.15.145:0/3281271207 conn(0x55ce4cd56060 msgr2=0x55ce4ce42680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- 172.21.15.145:0/3281271207 shutdown_connections 2024-09-11T11:01:23.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- 172.21.15.145:0/3281271207 wait complete. 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 Processor -- start 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- start start 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4cd5bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ce4cd62e10 con 0x55ce4cccfac0 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4cd5bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4cd5bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48660/0 (socket says 172.21.15.145:48660) 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a8db95640 1 -- 172.21.15.145:0/564491909 learned_addr learned my addr 172.21.15.145:0/564491909 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a8db95640 1 -- 172.21.15.145:0/564491909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4cd5a390 con 0x55ce4cccfac0 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a8db95640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4cd5bc70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6a800199f0 tx=0x7f6a800180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f697a604640 1 -- 172.21.15.145:0/564491909 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800bd7c0 con 0x55ce4cccfac0 2024-09-11T11:01:23.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4cd5a620 con 0x55ce4cccfac0 2024-09-11T11:01:23.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f697a604640 1 -- 172.21.15.145:0/564491909 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800bd960 con 0x55ce4cccfac0 2024-09-11T11:01:23.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f697a604640 1 -- 172.21.15.145:0/564491909 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800bdc40 con 0x55ce4cccfac0 2024-09-11T11:01:23.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.712+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4cd5ab10 con 0x55ce4cccfac0 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f697a604640 1 -- 172.21.15.145:0/564491909 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a800ce020 con 0x55ce4cccfac0 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f697a604640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6974034650 0x7f6974036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f697a604640 1 -- 172.21.15.145:0/564491909 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6a800cc020 con 0x55ce4cccfac0 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a8d394640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6974034650 0x7f6974036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a90085980 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4cd5e8b0 0x55ce4ce570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce57600 con 0x55ce4cd5e8b0 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a8e396640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4cd5e8b0 0x55ce4ce570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a8e396640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4cd5e8b0 0x55ce4ce570c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a8d394640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6974034650 0x7f6974036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a84001e20 tx=0x7f6a840013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a8e396640 1 -- 172.21.15.145:0/564491909 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4cd5e8b0 2024-09-11T11:01:23.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a90085980 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce580d0 0x55ce4ce5a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce5ad00 con 0x55ce4ce580d0 2024-09-11T11:01:23.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a8db95640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce580d0 0x55ce4ce5a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a8db95640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce580d0 0x55ce4ce5a590 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a8db95640 1 -- 172.21.15.145:0/564491909 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce580d0 2024-09-11T11:01:23.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.716+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce5c5b0 con 0x55ce4ce580d0 2024-09-11T11:01:23.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8db95640 1 -- 172.21.15.145:0/564491909 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce580d0 2024-09-11T11:01:23.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce5b7e0 con 0x55ce4ce580d0 2024-09-11T11:01:23.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8db95640 1 -- 172.21.15.145:0/564491909 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce580d0 2024-09-11T11:01:23.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ce4ce5d960 0x55ce4ce5fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce60290 con 0x55ce4ce5d960 2024-09-11T11:01:23.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8d394640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ce4ce5d960 0x55ce4ce5fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8d394640 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ce4ce5d960 0x55ce4ce5fd50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8d394640 1 -- 172.21.15.145:0/564491909 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a8400d040 con 0x55ce4ce5d960 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 Processor -- start 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 -- start start 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce6dc50 0x55ce4ce6e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ce4cc62800 con 0x55ce4ce6dc50 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce6dc50 0x55ce4ce6e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce6dc50 0x55ce4ce6e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48670/0 (socket says 172.21.15.145:48670) 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8db95640 1 -- 172.21.15.145:0/2572599230 learned_addr learned my addr 172.21.15.145:0/2572599230 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8db95640 1 -- 172.21.15.145:0/2572599230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4ce6e5b0 con 0x55ce4ce6dc50 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a8db95640 1 --2- 172.21.15.145:0/2572599230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce6dc50 0x55ce4ce6e070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6a800c7fb0 tx=0x7f6a800bcc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f69737fe640 1 -- 172.21.15.145:0/2572599230 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800ed070 con 0x55ce4ce6dc50 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 -- 172.21.15.145:0/2572599230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4ce6e840 con 0x55ce4ce6dc50 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f69737fe640 1 -- 172.21.15.145:0/2572599230 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800bcda0 con 0x55ce4ce6dc50 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f69737fe640 1 -- 172.21.15.145:0/2572599230 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800e32a0 con 0x55ce4ce6dc50 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.720+0000 7f6a90085980 1 -- 172.21.15.145:0/2572599230 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4ce714c0 con 0x55ce4ce6dc50 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f69737fe640 1 -- 172.21.15.145:0/2572599230 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a800e3440 con 0x55ce4ce6dc50 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f69737fe640 1 --2- 172.21.15.145:0/2572599230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6968034650 0x7f6968036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f69737fe640 1 -- 172.21.15.145:0/2572599230 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6a800d3100 con 0x55ce4ce6dc50 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a8d394640 1 --2- 172.21.15.145:0/2572599230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6968034650 0x7f6968036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 Processor -- start 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 -- start start 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a8d394640 1 --2- 172.21.15.145:0/2572599230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6968034650 0x7f6968036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55ce4cd5b3a0 tx=0x7f6a84006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce7aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ce4ce472e0 con 0x55ce4ce7a650 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce7aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce7aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48686/0 (socket says 172.21.15.145:48686) 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a8db95640 1 -- 172.21.15.145:0/2186142248 learned_addr learned my addr 172.21.15.145:0/2186142248 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a8db95640 1 -- 172.21.15.145:0/2186142248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4ce7b000 con 0x55ce4ce7a650 2024-09-11T11:01:23.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a8db95640 1 --2- 172.21.15.145:0/2186142248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce7aa30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a800043a0 tx=0x7f6a800dc720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28599e2185d6591 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f69717fa640 1 -- 172.21.15.145:0/2186142248 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800e0570 con 0x55ce4ce7a650 2024-09-11T11:01:23.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f69717fa640 1 -- 172.21.15.145:0/2186142248 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a8010a070 con 0x55ce4ce7a650 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f69717fa640 1 -- 172.21.15.145:0/2186142248 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800c7c30 con 0x55ce4ce7a650 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 -- 172.21.15.145:0/2186142248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 msgr2=0x55ce4ce7aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 --2- 172.21.15.145:0/2186142248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce7aa30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6a800043a0 tx=0x7f6a800dc720 comp rx=0 tx=0).stop 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 -- 172.21.15.145:0/2186142248 shutdown_connections 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 --2- 172.21.15.145:0/2186142248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce7aa30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 -- 172.21.15.145:0/2186142248 >> 172.21.15.145:0/2186142248 conn(0x55ce4ce76a30 msgr2=0x55ce4ce74b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 -- 172.21.15.145:0/2186142248 shutdown_connections 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 -- 172.21.15.145:0/2186142248 wait complete. 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 Processor -- start 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.724+0000 7f6a90085980 1 -- start start 2024-09-11T11:01:23.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a90085980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce81850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a90085980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ce4ce7b4a0 con 0x55ce4ce7a650 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce81850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8db95640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce81850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48700/0 (socket says 172.21.15.145:48700) 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 learned_addr learned my addr 172.21.15.145:0/3000889938 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce4ce81d90 con 0x55ce4ce7a650 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8db95640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce81850 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a800aab70 tx=0x7f6a800dafa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f695f7fe640 1 -- 172.21.15.145:0/3000889938 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800e0e00 con 0x55ce4ce7a650 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f695f7fe640 1 -- 172.21.15.145:0/3000889938 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800c7590 con 0x55ce4ce7a650 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce4ce81d90 con 0x55ce4ce7a650 2024-09-11T11:01:23.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f695f7fe640 1 -- 172.21.15.145:0/3000889938 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a800c78b0 con 0x55ce4ce7a650 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce4ce81d90 con 0x55ce4ce7a650 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f695f7fe640 1 -- 172.21.15.145:0/3000889938 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a800c53e0 con 0x55ce4ce7a650 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f695f7fe640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6958034650 0x7f6958036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f695f7fe640 1 -- 172.21.15.145:0/3000889938 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6a8011bb30 con 0x55ce4ce7a650 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8d394640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6958034650 0x7f6958036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4ce8c7c0 0x55ce4ce8ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce8f3b0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8e396640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4ce8c7c0 0x55ce4ce8ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8d394640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6958034650 0x7f6958036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55ce4ce5c500 tx=0x7f6a84011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.728+0000 7f6a8e396640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4ce8c7c0 0x55ce4ce8ec60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 realm 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce8bcb0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce8fe80 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce90a60 0x55ce4ce92f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93690 con 0x55ce4ce90a60 2024-09-11T11:01:23.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8db95640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce90a60 0x55ce4ce92f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8db95640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce90a60 0x55ce4ce92f20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 20 searching for the correct realm 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ce4ce95ca0 0x55ce4ce98090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce986a0 con 0x55ce4ce95ca0 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8d394640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ce4ce95ca0 0x55ce4ce98090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8d394640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ce4ce95ca0 0x55ce4ce98090 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.732+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce986a0 con 0x55ce4ce90a60 2024-09-11T11:01:23.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8db95640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a80009040 0x7f6a800e8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x7f6a80009040 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a80009040 0x7f6a800e8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a80009040 0x7f6a800e8810 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce95ca0 2024-09-11T11:01:23.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x7f6a80009040 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.736+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x7f6a80009040 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce95ca0 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce95ca0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce95ca0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x7f6a80009040 2024-09-11T11:01:23.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.740+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x7f6a80009040 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce95ca0 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x7f6a80009040 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce95ca0 2024-09-11T11:01:23.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce93f30 con 0x55ce4ce90a60 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:23.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce94780 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.744+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce94b70 con 0x55ce4ce90a60 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce94b70 con 0x7f6a80009040 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 zone default found 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 4 Realm: () 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 zonegroup default 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce98b00 con 0x7f6a80009040 2024-09-11T11:01:23.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9a880 con 0x55ce4ce95ca0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9ac20 con 0x55ce4ce95ca0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 started sync module instance, tier type = 2024-09-11T11:01:23.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce99d20 con 0x55ce4ce90a60 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94344542003776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce99d20 con 0x55ce4ce90a60 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.748+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9b690 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.752+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.752+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94344542007712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9b5c0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.752+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9c550 con 0x55ce4ce90a60 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.752+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94344542003776] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.752+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94344542007712] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.752+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.752+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94344542009984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9c0a0 con 0x55ce4ce90a60 2024-09-11T11:01:23.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.752+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9ce20 con 0x7f6a80009040 2024-09-11T11:01:23.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94344542013808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9c0a0 con 0x7f6a80009040 2024-09-11T11:01:23.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9d8a0 con 0x55ce4ce90a60 2024-09-11T11:01:23.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94344542013808] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94344542009984] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94344542001264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9d3b0 con 0x55ce4ce90a60 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9e140 con 0x55ce4ce95ca0 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94344542018704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9d3b0 con 0x55ce4ce95ca0 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9efb0 con 0x55ce4ce95ca0 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.756+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94344542001264] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94344542014864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9efb0 con 0x55ce4ce95ca0 2024-09-11T11:01:23.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9f9b0 con 0x7f6a80009040 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94344542018704] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94344542014864] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94344542020832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9eb00 con 0x7f6a80009040 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 20 add_watcher() i=0 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 20 add_watcher() i=1 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 20 add_watcher() i=2 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 20 add_watcher() i=3 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 20 add_watcher() i=4 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 20 add_watcher() i=5 2024-09-11T11:01:23.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 20 add_watcher() i=6 2024-09-11T11:01:23.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94344542020832] v32'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 20 add_watcher() i=7 2024-09-11T11:01:23.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:23.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9eb00 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.760+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94344542024896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9eb00 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94344542024896] v32'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f693f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 5 note: GC not initialized 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f693e7fc640 20 reqs_thread_entry: start 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 20 Filter name: none 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f68affff640 20 reqs_thread_entry: start 2024-09-11T11:01:23.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ce4cec5b40 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:23.771 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:23.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f693f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.764+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94344542024896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4cec4a90 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.768+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94344542024896] v32'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.768+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94344542003776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9f4c0 con 0x55ce4ce90a60 2024-09-11T11:01:23.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.768+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94344542003776] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.768+0000 7f6a90085980 20 remove_watcher() i=0 2024-09-11T11:01:23.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.768+0000 7f6a90085980 2 removed watcher, disabling cache 2024-09-11T11:01:23.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.768+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94344542007712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9f4c0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94344542007712] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x55ce4ce8c7c0 2024-09-11T11:01:23.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a90085980 20 remove_watcher() i=1 2024-09-11T11:01:23.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94344542009984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9b1a0 con 0x55ce4ce90a60 2024-09-11T11:01:23.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94344542009984] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a90085980 20 remove_watcher() i=2 2024-09-11T11:01:23.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94344542013808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9f4c0 con 0x7f6a80009040 2024-09-11T11:01:23.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94344542013808] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a90085980 20 remove_watcher() i=3 2024-09-11T11:01:23.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.772+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94344542001264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9ba80 con 0x55ce4ce90a60 2024-09-11T11:01:23.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a8db95640 1 -- 172.21.15.145:0/3000889938 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94344542001264] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a800bc400 con 0x55ce4ce90a60 2024-09-11T11:01:23.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a90085980 20 remove_watcher() i=4 2024-09-11T11:01:23.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94344542018704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9b1a0 con 0x55ce4ce95ca0 2024-09-11T11:01:23.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94344542018704] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a90085980 20 remove_watcher() i=5 2024-09-11T11:01:23.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94344542014864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9c970 con 0x55ce4ce95ca0 2024-09-11T11:01:23.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a8d394640 1 -- 172.21.15.145:0/3000889938 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94344542014864] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a84036040 con 0x55ce4ce95ca0 2024-09-11T11:01:23.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a90085980 20 remove_watcher() i=6 2024-09-11T11:01:23.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.776+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94344542020832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ce4ce9ce20 con 0x7f6a80009040 2024-09-11T11:01:23.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94344542020832] v32'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a8800a4d0 con 0x7f6a80009040 2024-09-11T11:01:23.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 20 remove_watcher() i=7 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce90a60 msgr2=0x55ce4ce92f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce90a60 0x55ce4ce92f20 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4ce8c7c0 msgr2=0x55ce4ce8ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4ce8c7c0 0x55ce4ce8ec60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a80009040 msgr2=0x7f6a800e8810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a80009040 0x7f6a800e8810 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ce4ce95ca0 msgr2=0x55ce4ce98090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ce4ce95ca0 0x55ce4ce98090 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6958034650 msgr2=0x7f6958036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6958034650 0x7f6958036b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55ce4ce5c500 tx=0x7f6a84011000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 msgr2=0x55ce4ce81850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a8e396640 1 -- 172.21.15.145:0/3000889938 reap_dead start 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce81850 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6a800aab70 tx=0x7f6a800dafa0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 shutdown_connections 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/3000889938 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce7a650 0x55ce4ce81850 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 >> 172.21.15.145:0/3000889938 conn(0x55ce4ce76a30 msgr2=0x55ce4ce74b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 shutdown_connections 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/3000889938 wait complete. 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/2572599230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6968034650 msgr2=0x7f6968036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/2572599230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6968034650 0x7f6968036b10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x55ce4cd5b3a0 tx=0x7f6a84006000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/2572599230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce6dc50 msgr2=0x55ce4ce6e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/2572599230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce6dc50 0x55ce4ce6e070 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6a800c7fb0 tx=0x7f6a800bcc70 comp rx=0 tx=0).stop 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/2572599230 shutdown_connections 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/2572599230 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6968034650 0x7f6968036b10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/2572599230 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4ce6dc50 0x55ce4ce6e070 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/2572599230 >> 172.21.15.145:0/2572599230 conn(0x55ce4ce62da0 msgr2=0x55ce4ce65820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/2572599230 shutdown_connections 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/2572599230 wait complete. 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce580d0 msgr2=0x55ce4ce5a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ce4ce580d0 0x55ce4ce5a590 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4cd5e8b0 msgr2=0x55ce4ce570c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ce4cd5e8b0 0x55ce4ce570c0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ce4ce5d960 msgr2=0x55ce4ce5fd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ce4ce5d960 0x55ce4ce5fd50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6974034650 msgr2=0x7f6974036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6974034650 0x7f6974036b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6a84001e20 tx=0x7f6a840013a0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 msgr2=0x55ce4cd5bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 --2- 172.21.15.145:0/564491909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ce4cccfac0 0x55ce4cd5bc70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6a800199f0 tx=0x7f6a800180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a8e396640 1 -- 172.21.15.145:0/564491909 reap_dead start 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 shutdown_connections 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 >> 172.21.15.145:0/564491909 conn(0x55ce4cd56060 msgr2=0x55ce4ce41200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 shutdown_connections 2024-09-11T11:01:23.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.780+0000 7f6a90085980 1 -- 172.21.15.145:0/564491909 wait complete. 2024-09-11T11:01:23.793 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:23.793 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-11T11:01:23.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-11T11:01:23.793 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-11T11:01:23.868 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:23.868 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:23.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.864+0000 7f8fbab1e980 1 Processor -- start 2024-09-11T11:01:23.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.864+0000 7f8fbab1e980 1 -- start start 2024-09-11T11:01:23.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.864+0000 7f8fbab1e980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5557d6f2c270 0x5557d6fba300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.864+0000 7f8fbab1e980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557d6e3fae0 con 0x5557d6fba840 2024-09-11T11:01:23.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.864+0000 7f8fbab1e980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5557d6e63e30 con 0x5557d6f2c270 2024-09-11T11:01:23.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb862e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5557d6f2c270 0x5557d6fba300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb7e2d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x5557d6fba840 0x5557d6fbcc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48640/0 (socket says 172.21.15.145:48640) 2024-09-11T11:01:23.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb862e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5557d6f2c270 0x5557d6fba300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48706/0 (socket says 172.21.15.145:48706) 2024-09-11T11:01:23.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/2442302406 learned_addr learned my addr 172.21.15.145:0/2442302406 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:23.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb862e640 1 -- 172.21.15.145:0/2442302406 >> v1:172.21.15.102:6789/0 conn(0x5557d6fba840 legacy=0x5557d6fbcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb862e640 1 -- 172.21.15.145:0/2442302406 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d6fbf360 con 0x5557d6f2c270 2024-09-11T11:01:23.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb862e640 1 --2- 172.21.15.145:0/2442302406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d6fba300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000a420 tx=0x7f8fb001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2ca633a7f7c855 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb762c640 1 -- 172.21.15.145:0/2442302406 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00af070 con 0x5557d6f2c270 2024-09-11T11:01:23.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb762c640 1 -- 172.21.15.145:0/2442302406 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb00aa530 con 0x5557d6f2c270 2024-09-11T11:01:23.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.868+0000 7f8fb762c640 1 -- 172.21.15.145:0/2442302406 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00aa850 con 0x5557d6f2c270 2024-09-11T11:01:23.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.872+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2442302406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 msgr2=0x5557d6fba300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.872+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2442302406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d6fba300 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000a420 tx=0x7f8fb001afd0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.872+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2442302406 shutdown_connections 2024-09-11T11:01:23.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.872+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2442302406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d6fba300 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.872+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2442302406 >> 172.21.15.145:0/2442302406 conn(0x5557d6fb2030 msgr2=0x5557d6fb4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.872+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2442302406 shutdown_connections 2024-09-11T11:01:23.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.872+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2442302406 wait complete. 2024-09-11T11:01:23.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 Processor -- start 2024-09-11T11:01:23.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- start start 2024-09-11T11:01:23.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d6e65200 con 0x5557d6f2c270 2024-09-11T11:01:23.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48714/0 (socket says 172.21.15.145:48714) 2024-09-11T11:01:23.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fb862e640 1 -- 172.21.15.145:0/2778091584 learned_addr learned my addr 172.21.15.145:0/2778091584 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fb862e640 1 -- 172.21.15.145:0/2778091584 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d70a3080 con 0x5557d6f2c270 2024-09-11T11:01:23.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fb862e640 1 --2- 172.21.15.145:0/2778091584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a2ab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00ad040 tx=0x7f8fb00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90adba44b88b453f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8ea660c640 1 -- 172.21.15.145:0/2778091584 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00af050 con 0x5557d6f2c270 2024-09-11T11:01:23.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8ea660c640 1 -- 172.21.15.145:0/2778091584 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb00b0040 con 0x5557d6f2c270 2024-09-11T11:01:23.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8ea660c640 1 -- 172.21.15.145:0/2778091584 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00aaca0 con 0x5557d6f2c270 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2778091584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 msgr2=0x5557d70a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2778091584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a2ab0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00ad040 tx=0x7f8fb00033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2778091584 shutdown_connections 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2778091584 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a2ab0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2778091584 >> 172.21.15.145:0/2778091584 conn(0x5557d6fb2030 msgr2=0x5557d709e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2778091584 shutdown_connections 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2778091584 wait complete. 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 Processor -- start 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- start start 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fbab1e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d6fbedd0 con 0x5557d6f2c270 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48730/0 (socket says 172.21.15.145:48730) 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.884+0000 7f8fb862e640 1 -- 172.21.15.145:0/2322611765 learned_addr learned my addr 172.21.15.145:0/2322611765 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fb862e640 1 -- 172.21.15.145:0/2322611765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d70aa280 con 0x5557d6f2c270 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fb862e640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a9d40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0019680 tx=0x7f8fb0019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8ea4e09640 1 -- 172.21.15.145:0/2322611765 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00c5070 con 0x5557d6f2c270 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557d70aa510 con 0x5557d6f2c270 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8ea4e09640 1 -- 172.21.15.145:0/2322611765 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb00b6d60 con 0x5557d6f2c270 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8ea4e09640 1 -- 172.21.15.145:0/2322611765 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00cf060 con 0x5557d6f2c270 2024-09-11T11:01:23.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d70ad1f0 con 0x5557d6f2c270 2024-09-11T11:01:23.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8ea4e09640 1 -- 172.21.15.145:0/2322611765 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8fb00c8070 con 0x5557d6f2c270 2024-09-11T11:01:23.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8ea4e09640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8ea0034650 0x7f8ea0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8ea4e09640 1 -- 172.21.15.145:0/2322611765 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8fb00bb070 con 0x5557d6f2c270 2024-09-11T11:01:23.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8ea0034650 0x7f8ea0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d6fba840 0x5557d70b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70b12f0 con 0x5557d6fba840 2024-09-11T11:01:23.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fb8e2f640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d6fba840 0x5557d70b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8ea0034650 0x7f8ea0036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8000f70 tx=0x7f8fa80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fb8e2f640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d6fba840 0x5557d70b0cd0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/2322611765 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d6fba840 2024-09-11T11:01:23.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70b2130 0x5557d70b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70b4b60 con 0x5557d70b2130 2024-09-11T11:01:23.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.888+0000 7f8fb862e640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70b2130 0x5557d70b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb862e640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70b2130 0x5557d70b4520 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb862e640 1 -- 172.21.15.145:0/2322611765 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fb00c7030 con 0x5557d70b2130 2024-09-11T11:01:23.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70b6410 con 0x5557d70b2130 2024-09-11T11:01:23.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb862e640 1 -- 172.21.15.145:0/2322611765 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fb00c7030 con 0x5557d70b2130 2024-09-11T11:01:23.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70b5640 con 0x5557d70b2130 2024-09-11T11:01:23.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb862e640 1 -- 172.21.15.145:0/2322611765 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fb00c7030 con 0x5557d70b2130 2024-09-11T11:01:23.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70b77c0 0x5557d70b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70ba0f0 con 0x5557d70b77c0 2024-09-11T11:01:23.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70b77c0 0x5557d70b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70b77c0 0x5557d70b9bb0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/2322611765 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70b77c0 2024-09-11T11:01:23.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fbab1e980 1 Processor -- start 2024-09-11T11:01:23.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fbab1e980 1 -- start start 2024-09-11T11:01:23.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fbab1e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6fb7c60 0x5557d6fb62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fbab1e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d6ebe800 con 0x5557d6fb7c60 2024-09-11T11:01:23.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6fb7c60 0x5557d6fb62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6fb7c60 0x5557d6fb62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48744/0 (socket says 172.21.15.145:48744) 2024-09-11T11:01:23.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.892+0000 7f8fb862e640 1 -- 172.21.15.145:0/909349733 learned_addr learned my addr 172.21.15.145:0/909349733 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb862e640 1 -- 172.21.15.145:0/909349733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d6fb8080 con 0x5557d6fb7c60 2024-09-11T11:01:23.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb862e640 1 --2- 172.21.15.145:0/909349733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6fb7c60 0x5557d6fb62e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00e55d0 tx=0x7f8fb00d3d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8e9dffb640 1 -- 172.21.15.145:0/909349733 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00bfc90 con 0x5557d6fb7c60 2024-09-11T11:01:23.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8e9dffb640 1 -- 172.21.15.145:0/909349733 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb00bfe30 con 0x5557d6fb7c60 2024-09-11T11:01:23.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fbab1e980 1 -- 172.21.15.145:0/909349733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557d6fb6880 con 0x5557d6fb7c60 2024-09-11T11:01:23.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8e9dffb640 1 -- 172.21.15.145:0/909349733 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00e3cb0 con 0x5557d6fb7c60 2024-09-11T11:01:23.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fbab1e980 1 -- 172.21.15.145:0/909349733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d6fb6880 con 0x5557d6fb7c60 2024-09-11T11:01:23.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8e9dffb640 1 -- 172.21.15.145:0/909349733 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8fb00c15b0 con 0x5557d6fb7c60 2024-09-11T11:01:23.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8e9dffb640 1 --2- 172.21.15.145:0/909349733 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e90034600 0x7f8e90036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8e9dffb640 1 -- 172.21.15.145:0/909349733 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8fb00f0ae0 con 0x5557d6fb7c60 2024-09-11T11:01:23.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/909349733 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e90034600 0x7f8e90036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fbab1e980 1 Processor -- start 2024-09-11T11:01:23.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fbab1e980 1 -- start start 2024-09-11T11:01:23.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/909349733 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e90034600 0x7f8e90036ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800bf60 tx=0x7f8fa800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fbab1e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70d64d0 0x5557d70d68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fbab1e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d70a3340 con 0x5557d70d64d0 2024-09-11T11:01:23.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70d64d0 0x5557d70d68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70d64d0 0x5557d70d68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48752/0 (socket says 172.21.15.145:48752) 2024-09-11T11:01:23.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb862e640 1 -- 172.21.15.145:0/2509470485 learned_addr learned my addr 172.21.15.145:0/2509470485 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb862e640 1 -- 172.21.15.145:0/2509470485 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d70d6e80 con 0x5557d70d64d0 2024-09-11T11:01:23.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.896+0000 7f8fb862e640 1 --2- 172.21.15.145:0/2509470485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70d64d0 0x5557d70d68b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00c0a50 tx=0x7f8fb00e3f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131a847f9777e09a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8e977fe640 1 -- 172.21.15.145:0/2509470485 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00f2120 con 0x5557d70d64d0 2024-09-11T11:01:23.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8e977fe640 1 -- 172.21.15.145:0/2509470485 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb00c18a0 con 0x5557d70d64d0 2024-09-11T11:01:23.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8e977fe640 1 -- 172.21.15.145:0/2509470485 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00c0df0 con 0x5557d70d64d0 2024-09-11T11:01:23.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2509470485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70d64d0 msgr2=0x5557d70d68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2509470485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70d64d0 0x5557d70d68b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00c0a50 tx=0x7f8fb00e3f10 comp rx=0 tx=0).stop 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2509470485 shutdown_connections 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2509470485 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70d64d0 0x5557d70d68b0 secure :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00c0a50 tx=0x7f8fb00e3f10 comp rx=0 tx=0).stop 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2509470485 >> 172.21.15.145:0/2509470485 conn(0x5557d70d28b0 msgr2=0x5557d70d09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2509470485 shutdown_connections 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2509470485 wait complete. 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 Processor -- start 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- start start 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70dd890 0x5557d70ddcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d70d7320 con 0x5557d70dd890 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70dd890 0x5557d70ddcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fb862e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70dd890 0x5557d70ddcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48756/0 (socket says 172.21.15.145:48756) 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 learned_addr learned my addr 172.21.15.145:0/3820108824 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:23.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d70de1f0 con 0x5557d70dd890 2024-09-11T11:01:23.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fb862e640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70dd890 0x5557d70ddcb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00ddac0 tx=0x7f8fb00ee000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8e95ffb640 1 -- 172.21.15.145:0/3820108824 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00d3a50 con 0x5557d70dd890 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8e95ffb640 1 -- 172.21.15.145:0/3820108824 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb00c0df0 con 0x5557d70dd890 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557d70de1f0 con 0x5557d70dd890 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8e95ffb640 1 -- 172.21.15.145:0/3820108824 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fb00e5770 con 0x5557d70dd890 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.900+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d70de1f0 con 0x5557d70dd890 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8e95ffb640 1 -- 172.21.15.145:0/3820108824 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8fb010f020 con 0x5557d70dd890 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8e95ffb640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e88034650 0x7f8e88036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8e95ffb640 1 -- 172.21.15.145:0/3820108824 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8fb0112ac0 con 0x5557d70dd890 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e88034650 0x7f8e88036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d70e8cd0 0x5557d70eb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70eb8e0 con 0x5557d70e8cd0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb8e2f640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d70e8cd0 0x5557d70eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e88034650 0x7f8e88036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5557d70ba4f0 tx=0x7f8fa8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb8e2f640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d70e8cd0 0x5557d70eb190 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 realm 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70e8140 con 0x5557d70e8cd0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:23.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70ec3b0 con 0x5557d70e8cd0 2024-09-11T11:01:23.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70ed190 0x5557d70ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70efc00 con 0x5557d70ed190 2024-09-11T11:01:23.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb862e640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70ed190 0x5557d70ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb862e640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70ed190 0x5557d70ef580 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.904+0000 7f8fbab1e980 20 searching for the correct realm 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d70f21c0 0x5557d70f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f4c30 con 0x5557d70f21c0 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d70f21c0 0x5557d70f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb7e2d640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d70f21c0 0x5557d70f45b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f4c30 con 0x5557d70ed190 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb862e640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70d64d0 0x7f8fb00e7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70d64d0 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70d64d0 0x7f8fb00e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70d64d0 0x7f8fb00e7410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:23.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70f21c0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.908+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70d64d0 2024-09-11T11:01:23.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70d64d0 2024-09-11T11:01:23.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70f21c0 2024-09-11T11:01:23.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70f21c0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.912+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70f21c0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70d64d0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70e8cd0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70d64d0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70f21c0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70d64d0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70f21c0 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.916+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0450 con 0x5557d70ed190 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:23.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f0ca0 con 0x5557d70e8cd0 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f1090 con 0x5557d70ed190 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f1090 con 0x5557d70d64d0 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:23.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 zone default found 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 4 Realm: () 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 zonegroup default 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f5090 con 0x5557d70d64d0 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f15d0 con 0x5557d70f21c0 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f73f0 con 0x5557d70f21c0 2024-09-11T11:01:23.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 started sync module instance, tier type = 2024-09-11T11:01:23.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:23.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.920+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f6750 con 0x5557d70ed190 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93835758627952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f6750 con 0x5557d70ed190 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f7eb0 con 0x5557d70e8cd0 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93835758631360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f7de0 con 0x5557d70e8cd0 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f8dd0 con 0x5557d70ed190 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93835758627952] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93835758631360] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93835758633632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f8d90 con 0x5557d70ed190 2024-09-11T11:01:23.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.924+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f9670 con 0x5557d70d64d0 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.928+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.928+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93835758637504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f8d90 con 0x5557d70d64d0 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.928+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fa130 con 0x5557d70ed190 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.928+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93835758637504] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.928+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93835758633632] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.928+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.928+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93835758635200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fa0f0 con 0x5557d70ed190 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.928+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fa520 con 0x5557d70f21c0 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93835758638560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fad70 con 0x5557d70f21c0 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fb770 con 0x5557d70f21c0 2024-09-11T11:01:23.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93835758635200] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93835758638560] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93835758640128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fbb60 con 0x5557d70f21c0 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fc3b0 con 0x5557d70d64d0 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93835758640128] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93835758648160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fc430 con 0x5557d70d64d0 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 20 add_watcher() i=0 2024-09-11T11:01:23.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 20 add_watcher() i=1 2024-09-11T11:01:23.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 20 add_watcher() i=2 2024-09-11T11:01:23.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 20 add_watcher() i=3 2024-09-11T11:01:23.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 20 add_watcher() i=4 2024-09-11T11:01:23.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 20 add_watcher() i=5 2024-09-11T11:01:23.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.932+0000 7f8fbab1e980 20 add_watcher() i=6 2024-09-11T11:01:23.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93835758648160] v32'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 20 add_watcher() i=7 2024-09-11T11:01:23.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:23.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d70ff750 con 0x5557d70e8cd0 2024-09-11T11:01:23.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93835758649584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70fc9c0 con 0x5557d70e8cd0 2024-09-11T11:01:23.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93835758649584] v32'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8e6e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 5 note: GC not initialized 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8e6d7e2640 20 reqs_thread_entry: start 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 20 Filter name: none 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8ddeffd640 20 reqs_thread_entry: start 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d7122ee0 con 0x5557d70e8cd0 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:23.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.936+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d7123950 con 0x5557d70f21c0 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-11T11:01:23.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d7129340 con 0x5557d70e8cd0 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v32'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93835758833072 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d71249f0 con 0x5557d70ed190 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 93835758635200 notify 137438953475 ret 0) ==== 720+0+0 (crc 0 0 0) 0x5557d6fb8080 con 0x5557d70ed190 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8e977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 93835758635200 notifier 4346 bl.length()=678 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8e977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8e977fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8e977fe640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8e7c003eb0 con 0x5557d70ed190 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(65 notify.4 [notify cookie 93835758833072 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 93835758833072 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8fb00db040 con 0x5557d70ed190 2024-09-11T11:01:23.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.940+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d7128db0 con 0x5557d70f21c0 2024-09-11T11:01:23.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.944+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.944+0000 7f8fbab1e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-11T11:01:23.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.944+0000 7f8fbab1e980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:23.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.944+0000 7f8fbab1e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-11T11:01:23.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.944+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93835758833072 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d7124540 con 0x5557d70ed190 2024-09-11T11:01:23.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 93835758633632 notify 137438953476 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f8fb00db040 con 0x5557d70ed190 2024-09-11T11:01:23.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8e96ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 93835758633632 notifier 4346 bl.length()=177 2024-09-11T11:01:23.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8e96ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-11T11:01:23.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8e96ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:23.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8e96ffd640 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f8dec003410 con 0x5557d70ed190 2024-09-11T11:01:23.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(68 notify.2 [notify cookie 93835758833072 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 93835758833072 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5557d70ad1f0 con 0x5557d70ed190 2024-09-11T11:01:23.951 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-11T11:01:23.943796Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:23.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8e6e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:23.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93835758649584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d7124970 con 0x5557d70e8cd0 2024-09-11T11:01:23.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.948+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93835758649584] v32'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.952+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93835758627952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d7120c80 con 0x5557d70ed190 2024-09-11T11:01:23.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.952+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93835758627952] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.952+0000 7f8fbab1e980 20 remove_watcher() i=0 2024-09-11T11:01:23.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.952+0000 7f8fbab1e980 2 removed watcher, disabling cache 2024-09-11T11:01:23.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.952+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93835758631360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d7120c80 con 0x5557d70e8cd0 2024-09-11T11:01:23.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.952+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93835758631360] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70e8cd0 2024-09-11T11:01:23.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.952+0000 7f8fbab1e980 20 remove_watcher() i=1 2024-09-11T11:01:23.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.952+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93835758633632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f79c0 con 0x5557d70ed190 2024-09-11T11:01:23.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.956+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93835758633632] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.956+0000 7f8fbab1e980 20 remove_watcher() i=2 2024-09-11T11:01:23.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.956+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93835758637504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d7120c80 con 0x5557d70d64d0 2024-09-11T11:01:23.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.956+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93835758637504] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.956+0000 7f8fbab1e980 20 remove_watcher() i=3 2024-09-11T11:01:23.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.956+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93835758635200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f79c0 con 0x5557d70ed190 2024-09-11T11:01:23.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.960+0000 7f8fb862e640 1 -- 172.21.15.145:0/3820108824 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93835758635200] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fb00f6070 con 0x5557d70ed190 2024-09-11T11:01:23.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.960+0000 7f8fbab1e980 20 remove_watcher() i=4 2024-09-11T11:01:23.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.960+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93835758638560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f91c0 con 0x5557d70f21c0 2024-09-11T11:01:23.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.960+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93835758638560] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.960+0000 7f8fbab1e980 20 remove_watcher() i=5 2024-09-11T11:01:23.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.960+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93835758640128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d70f9640 con 0x5557d70f21c0 2024-09-11T11:01:23.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fb7e2d640 1 -- 172.21.15.145:0/3820108824 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93835758640128] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa800e620 con 0x5557d70f21c0 2024-09-11T11:01:23.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 20 remove_watcher() i=6 2024-09-11T11:01:23.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93835758648160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d7120c80 con 0x5557d70d64d0 2024-09-11T11:01:23.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93835758648160] v32'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fa00083f0 con 0x5557d70d64d0 2024-09-11T11:01:23.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 20 remove_watcher() i=7 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70ed190 msgr2=0x5557d70ef580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70ed190 0x5557d70ef580 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d70e8cd0 msgr2=0x5557d70eb190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d70e8cd0 0x5557d70eb190 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70d64d0 msgr2=0x7f8fb00e7410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70d64d0 0x7f8fb00e7410 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d70f21c0 msgr2=0x5557d70f45b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d70f21c0 0x5557d70f45b0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e88034650 msgr2=0x7f8e88036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e88034650 0x7f8e88036b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5557d70ba4f0 tx=0x7f8fa8010000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/3820108824 reap_dead start 2024-09-11T11:01:23.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70dd890 msgr2=0x5557d70ddcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70dd890 0x5557d70ddcb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00ddac0 tx=0x7f8fb00ee000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 shutdown_connections 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/3820108824 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d70dd890 0x5557d70ddcb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 >> 172.21.15.145:0/3820108824 conn(0x5557d70d28b0 msgr2=0x5557d70d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 shutdown_connections 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/3820108824 wait complete. 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/909349733 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e90034600 msgr2=0x7f8e90036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/909349733 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e90034600 0x7f8e90036ac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800bf60 tx=0x7f8fa800f000 comp rx=0 tx=0).stop 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/909349733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6fb7c60 msgr2=0x5557d6fb62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/909349733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6fb7c60 0x5557d6fb62e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00e55d0 tx=0x7f8fb00d3d60 comp rx=0 tx=0).stop 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/909349733 shutdown_connections 2024-09-11T11:01:23.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/909349733 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8e90034600 0x7f8e90036ac0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/909349733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6fb7c60 0x5557d6fb62e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/909349733 >> 172.21.15.145:0/909349733 conn(0x5557d70bccd0 msgr2=0x5557d70bf750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/909349733 shutdown_connections 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.964+0000 7f8fbab1e980 1 -- 172.21.15.145:0/909349733 wait complete. 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70b2130 msgr2=0x5557d70b4520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d70b2130 0x5557d70b4520 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d6fba840 msgr2=0x5557d70b0cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d6fba840 0x5557d70b0cd0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70b77c0 msgr2=0x5557d70b9bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d70b77c0 0x5557d70b9bb0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8ea0034650 msgr2=0x7f8ea0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8ea0034650 0x7f8ea0036b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8000f70 tx=0x7f8fa80012c0 comp rx=0 tx=0).stop 2024-09-11T11:01:23.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 msgr2=0x5557d70a9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:23.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 --2- 172.21.15.145:0/2322611765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d6f2c270 0x5557d70a9d40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0019680 tx=0x7f8fb0019810 comp rx=0 tx=0).stop 2024-09-11T11:01:23.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fb8e2f640 1 -- 172.21.15.145:0/2322611765 reap_dead start 2024-09-11T11:01:23.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 shutdown_connections 2024-09-11T11:01:23.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 >> 172.21.15.145:0/2322611765 conn(0x5557d6fb2030 msgr2=0x5557d709d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:23.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 shutdown_connections 2024-09-11T11:01:23.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:23.968+0000 7f8fbab1e980 1 -- 172.21.15.145:0/2322611765 wait complete. 2024-09-11T11:01:23.979 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-11T11:01:23.943796Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:23.979 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:01:23.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:01:23.979 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:01:24.053 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:24.053 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:24.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d7352980 1 Processor -- start 2024-09-11T11:01:24.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d7352980 1 -- start start 2024-09-11T11:01:24.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d7352980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556e8b14cc60 0x556e8b14f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d7352980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556e8afceae0 con 0x556e8b1488e0 2024-09-11T11:01:24.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d7352980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x556e8aff2e30 con 0x556e8b14cc60 2024-09-11T11:01:24.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d4661640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556e8b14cc60 0x556e8b14f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d4661640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556e8b14cc60 0x556e8b14f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48770/0 (socket says 172.21.15.145:48770) 2024-09-11T11:01:24.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d4661640 1 -- 172.21.15.145:0/2170970890 learned_addr learned my addr 172.21.15.145:0/2170970890 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d4e62640 1 --1- 172.21.15.145:0/2170970890 >> v1:172.21.15.102:6789/0 conn(0x556e8b1488e0 0x556e8b148cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48656/0 (socket says 172.21.15.145:48656) 2024-09-11T11:01:24.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d4661640 1 -- 172.21.15.145:0/2170970890 >> v1:172.21.15.102:6789/0 conn(0x556e8b1488e0 legacy=0x556e8b148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.052+0000 7f76d4661640 1 -- 172.21.15.145:0/2170970890 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e8b1505a0 con 0x556e8b14cc60 2024-09-11T11:01:24.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d4661640 1 --2- 172.21.15.145:0/2170970890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b14cc60 0x556e8b14f050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00a5c0 tx=0x7f76bc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23855d3f83451a97 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d3e60640 1 -- 172.21.15.145:0/2170970890 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76bc0a6070 con 0x556e8b14cc60 2024-09-11T11:01:24.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d3e60640 1 -- 172.21.15.145:0/2170970890 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76bc0af070 con 0x556e8b14cc60 2024-09-11T11:01:24.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d3e60640 1 -- 172.21.15.145:0/2170970890 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76bc0aa5c0 con 0x556e8b14cc60 2024-09-11T11:01:24.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d7352980 1 -- 172.21.15.145:0/2170970890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b14cc60 msgr2=0x556e8b14f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d7352980 1 --2- 172.21.15.145:0/2170970890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b14cc60 0x556e8b14f050 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00a5c0 tx=0x7f76bc01b340 comp rx=0 tx=0).stop 2024-09-11T11:01:24.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d7352980 1 -- 172.21.15.145:0/2170970890 shutdown_connections 2024-09-11T11:01:24.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d7352980 1 --2- 172.21.15.145:0/2170970890 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b14cc60 0x556e8b14f050 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d7352980 1 -- 172.21.15.145:0/2170970890 >> 172.21.15.145:0/2170970890 conn(0x556e8b0bc230 msgr2=0x556e8b0bc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d7352980 1 -- 172.21.15.145:0/2170970890 shutdown_connections 2024-09-11T11:01:24.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.056+0000 7f76d7352980 1 -- 172.21.15.145:0/2170970890 wait complete. 2024-09-11T11:01:24.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d7352980 1 Processor -- start 2024-09-11T11:01:24.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d7352980 1 -- start start 2024-09-11T11:01:24.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d7352980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b233c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d7352980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556e8aff4200 con 0x556e8b1488e0 2024-09-11T11:01:24.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b233c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b233c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48776/0 (socket says 172.21.15.145:48776) 2024-09-11T11:01:24.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d4e62640 1 -- 172.21.15.145:0/3227301768 learned_addr learned my addr 172.21.15.145:0/3227301768 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d4e62640 1 -- 172.21.15.145:0/3227301768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e8b234200 con 0x556e8b1488e0 2024-09-11T11:01:24.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f76d4e62640 1 --2- 172.21.15.145:0/3227301768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b233c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f76c4001e50 tx=0x7f76c4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35536e5f1bd5c38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f75c2e0d640 1 -- 172.21.15.145:0/3227301768 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c400e5d0 con 0x556e8b1488e0 2024-09-11T11:01:24.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f75c2e0d640 1 -- 172.21.15.145:0/3227301768 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c400e770 con 0x556e8b1488e0 2024-09-11T11:01:24.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.068+0000 7f75c2e0d640 1 -- 172.21.15.145:0/3227301768 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c400eab0 con 0x556e8b1488e0 2024-09-11T11:01:24.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- 172.21.15.145:0/3227301768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 msgr2=0x556e8b233c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 --2- 172.21.15.145:0/3227301768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b233c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f76c4001e50 tx=0x7f76c4001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- 172.21.15.145:0/3227301768 shutdown_connections 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 --2- 172.21.15.145:0/3227301768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b233c30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- 172.21.15.145:0/3227301768 >> 172.21.15.145:0/3227301768 conn(0x556e8b0bc230 msgr2=0x556e8b22f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- 172.21.15.145:0/3227301768 shutdown_connections 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- 172.21.15.145:0/3227301768 wait complete. 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 Processor -- start 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- start start 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b23afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556e8b1500a0 con 0x556e8b1488e0 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b23afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b23afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48784/0 (socket says 172.21.15.145:48784) 2024-09-11T11:01:24.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d4e62640 1 -- 172.21.15.145:0/446288102 learned_addr learned my addr 172.21.15.145:0/446288102 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d4e62640 1 -- 172.21.15.145:0/446288102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e8b23b4e0 con 0x556e8b1488e0 2024-09-11T11:01:24.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d4e62640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b23afa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x556e8b234e10 tx=0x7f76c4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f75c160a640 1 -- 172.21.15.145:0/446288102 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c4001260 con 0x556e8b1488e0 2024-09-11T11:01:24.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e8b23b770 con 0x556e8b1488e0 2024-09-11T11:01:24.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f75c160a640 1 -- 172.21.15.145:0/446288102 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c400fa40 con 0x556e8b1488e0 2024-09-11T11:01:24.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f75c160a640 1 -- 172.21.15.145:0/446288102 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c400fd80 con 0x556e8b1488e0 2024-09-11T11:01:24.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e8b23e450 con 0x556e8b1488e0 2024-09-11T11:01:24.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f75c160a640 1 -- 172.21.15.145:0/446288102 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f76c4017070 con 0x556e8b1488e0 2024-09-11T11:01:24.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f75c160a640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75bc034650 0x7f75bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f75c160a640 1 -- 172.21.15.145:0/446288102 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f76c4015020 con 0x556e8b1488e0 2024-09-11T11:01:24.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d4661640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75bc034650 0x7f75bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b14cc60 0x556e8b241f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2425e0 con 0x556e8b14cc60 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.072+0000 7f76d5663640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b14cc60 0x556e8b241f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d4661640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75bc034650 0x7f75bc036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0ae000 tx=0x7f76bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d5663640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b14cc60 0x556e8b241f70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d5663640 1 -- 172.21.15.145:0/446288102 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b14cc60 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d7352980 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b2433d0 0x556e8b2457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b245e00 con 0x556e8b2433d0 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d4e62640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b2433d0 0x556e8b2457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d4e62640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b2433d0 0x556e8b2457c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d4e62640 1 -- 172.21.15.145:0/446288102 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b2433d0 2024-09-11T11:01:24.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2476b0 con 0x556e8b2433d0 2024-09-11T11:01:24.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d4e62640 1 -- 172.21.15.145:0/446288102 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b2433d0 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2468e0 con 0x556e8b2433d0 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d4e62640 1 -- 172.21.15.145:0/446288102 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b2433d0 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d7352980 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556e8b248a60 0x556e8b24ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b24b390 con 0x556e8b248a60 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.076+0000 7f76d4661640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556e8b248a60 0x556e8b24ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d4661640 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556e8b248a60 0x556e8b24ae50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d4661640 1 -- 172.21.15.145:0/446288102 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b248a60 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d7352980 1 Processor -- start 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d7352980 1 -- start start 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d7352980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b258d90 0x556e8b2591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d7352980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556e8b04d800 con 0x556e8b258d90 2024-09-11T11:01:24.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b258d90 0x556e8b2591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b258d90 0x556e8b2591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48790/0 (socket says 172.21.15.145:48790) 2024-09-11T11:01:24.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d4e62640 1 -- 172.21.15.145:0/2750176366 learned_addr learned my addr 172.21.15.145:0/2750176366 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d4e62640 1 -- 172.21.15.145:0/2750176366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e8b2596f0 con 0x556e8b258d90 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d4e62640 1 --2- 172.21.15.145:0/2750176366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b258d90 0x556e8b2591b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f76c4024000 tx=0x7f76c4017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f75ba7fc640 1 -- 172.21.15.145:0/2750176366 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c4042020 con 0x556e8b258d90 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d7352980 1 -- 172.21.15.145:0/2750176366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e8b259980 con 0x556e8b258d90 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f75ba7fc640 1 -- 172.21.15.145:0/2750176366 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c40421c0 con 0x556e8b258d90 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f75ba7fc640 1 -- 172.21.15.145:0/2750176366 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c404aa70 con 0x556e8b258d90 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d7352980 1 -- 172.21.15.145:0/2750176366 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e8b259980 con 0x556e8b258d90 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f75ba7fc640 1 -- 172.21.15.145:0/2750176366 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f76c401a480 con 0x556e8b258d90 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f75ba7fc640 1 --2- 172.21.15.145:0/2750176366 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75ac034650 0x7f75ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f75ba7fc640 1 -- 172.21.15.145:0/2750176366 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f76c403e040 con 0x556e8b258d90 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d4661640 1 --2- 172.21.15.145:0/2750176366 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75ac034650 0x7f75ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.080+0000 7f76d7352980 1 Processor -- start 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- start start 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4661640 1 --2- 172.21.15.145:0/2750176366 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75ac034650 0x7f75ac036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x556e8b23f590 tx=0x7f76bc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b2658a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556e8b234580 con 0x556e8b2654c0 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b2658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b2658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48798/0 (socket says 172.21.15.145:48798) 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 -- 172.21.15.145:0/3941402094 learned_addr learned my addr 172.21.15.145:0/3941402094 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 -- 172.21.15.145:0/3941402094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e8b265e70 con 0x556e8b2654c0 2024-09-11T11:01:24.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 --2- 172.21.15.145:0/3941402094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b2658a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f76c40178c0 tx=0x7f76c401a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f98e036bd03960 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f75abfff640 1 -- 172.21.15.145:0/3941402094 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c4063070 con 0x556e8b2654c0 2024-09-11T11:01:24.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f75abfff640 1 -- 172.21.15.145:0/3941402094 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c40283f0 con 0x556e8b2654c0 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f75abfff640 1 -- 172.21.15.145:0/3941402094 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c405a040 con 0x556e8b2654c0 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- 172.21.15.145:0/3941402094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 msgr2=0x556e8b2658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 --2- 172.21.15.145:0/3941402094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b2658a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f76c40178c0 tx=0x7f76c401a8a0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- 172.21.15.145:0/3941402094 shutdown_connections 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 --2- 172.21.15.145:0/3941402094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b2658a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- 172.21.15.145:0/3941402094 >> 172.21.15.145:0/3941402094 conn(0x556e8b2618a0 msgr2=0x556e8b25f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- 172.21.15.145:0/3941402094 shutdown_connections 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- 172.21.15.145:0/3941402094 wait complete. 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 Processor -- start 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- start start 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b26c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556e8b266310 con 0x556e8b2654c0 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b26c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b26c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48804/0 (socket says 172.21.15.145:48804) 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 learned_addr learned my addr 172.21.15.145:0/3919995379 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e8b26cbc0 con 0x556e8b2654c0 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d4e62640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b26c680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f76c40285a0 tx=0x7f76c4010260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f75aa7fc640 1 -- 172.21.15.145:0/3919995379 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c4063030 con 0x556e8b2654c0 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f75aa7fc640 1 -- 172.21.15.145:0/3919995379 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c406f070 con 0x556e8b2654c0 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f75aa7fc640 1 -- 172.21.15.145:0/3919995379 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76c4053610 con 0x556e8b2654c0 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556e8b26cbc0 con 0x556e8b2654c0 2024-09-11T11:01:24.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.084+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e8b26cbc0 con 0x556e8b2654c0 2024-09-11T11:01:24.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f75aa7fc640 1 -- 172.21.15.145:0/3919995379 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f76c4053c50 con 0x556e8b2654c0 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f75aa7fc640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75a00346a0 0x7f75a0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f75aa7fc640 1 -- 172.21.15.145:0/3919995379 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f76c4064070 con 0x556e8b2654c0 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d4661640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75a00346a0 0x7f75a0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b277760 0x556e8b279c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b27a350 con 0x556e8b277760 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d5663640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b277760 0x556e8b279c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d4661640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75a00346a0 0x7f75a0036b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76bc000c10 tx=0x7f76bc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d5663640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b277760 0x556e8b279c00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 20 realm 2024-09-11T11:01:24.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b276c50 con 0x556e8b277760 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b27ae20 con 0x556e8b277760 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b27ba00 0x556e8b27dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b27e630 con 0x556e8b27ba00 2024-09-11T11:01:24.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.088+0000 7f76d4e62640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b27ba00 0x556e8b27dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4e62640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b27ba00 0x556e8b27dec0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d7352980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b27eed0 con 0x556e8b27ba00 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d7352980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d7352980 20 searching for the correct realm 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556e8b280c40 0x556e8b283030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b280c40 2024-09-11T11:01:24.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4661640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556e8b280c40 0x556e8b283030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4661640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556e8b280c40 0x556e8b283030 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4e62640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f76c4033c00 0x7f76c40046b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x7f76c4033c00 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d5663640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f76c4033c00 0x7f76c40046b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d5663640 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f76c4033c00 0x7f76c40046b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.092+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b280c40 2024-09-11T11:01:24.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x7f76c4033c00 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x7f76c4033c00 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b280c40 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.096+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b280c40 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b280c40 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x7f76c4033c00 2024-09-11T11:01:24.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b277760 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x7f76c4033c00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b280c40 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x7f76c4033c00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.100+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b280c40 2024-09-11T11:01:24.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2836b0 con 0x556e8b27ba00 2024-09-11T11:01:24.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b27f820 con 0x556e8b277760 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b27fc70 con 0x556e8b27ba00 2024-09-11T11:01:24.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b27fc70 con 0x7f76c4033c00 2024-09-11T11:01:24.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 zone default found 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 4 Realm: () 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 zonegroup default 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b283b60 con 0x7f76c4033c00 2024-09-11T11:01:24.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.104+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b285970 con 0x556e8b280c40 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b285e20 con 0x556e8b280c40 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 20 started sync module instance, tier type = 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b284d80 con 0x556e8b27ba00 2024-09-11T11:01:24.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93933269439136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b284d80 con 0x556e8b27ba00 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b286950 con 0x556e8b277760 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93933269443616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b286910 con 0x556e8b277760 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.108+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b287880 con 0x556e8b27ba00 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.112+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93933269439136] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.112+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93933269443616] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.112+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.112+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93933269445952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b286910 con 0x556e8b27ba00 2024-09-11T11:01:24.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.112+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b287ca0 con 0x7f76c4033c00 2024-09-11T11:01:24.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.112+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.112+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93933269436624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b288150 con 0x7f76c4033c00 2024-09-11T11:01:24.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.112+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b288b70 con 0x556e8b27ba00 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93933269445952] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93933269436624] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93933269452384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b287c50 con 0x556e8b27ba00 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b289410 con 0x556e8b280c40 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93933269454688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b287c50 con 0x556e8b280c40 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b28a280 con 0x556e8b280c40 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.116+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93933269452384] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.120+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.120+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93933269447568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b28aad0 con 0x556e8b280c40 2024-09-11T11:01:24.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.120+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b28b380 con 0x7f76c4033c00 2024-09-11T11:01:24.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.124+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93933269454688] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93933269447568] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93933269456816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b28aad0 con 0x7f76c4033c00 2024-09-11T11:01:24.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 20 add_watcher() i=0 2024-09-11T11:01:24.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 20 add_watcher() i=1 2024-09-11T11:01:24.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 20 add_watcher() i=2 2024-09-11T11:01:24.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 20 add_watcher() i=3 2024-09-11T11:01:24.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 20 add_watcher() i=4 2024-09-11T11:01:24.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 20 add_watcher() i=5 2024-09-11T11:01:24.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 20 add_watcher() i=6 2024-09-11T11:01:24.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93933269456816] v32'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 20 add_watcher() i=7 2024-09-11T11:01:24.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:24.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b28aad0 con 0x556e8b277760 2024-09-11T11:01:24.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.128+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93933269460512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b28bb50 con 0x556e8b277760 2024-09-11T11:01:24.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93933269460512] v32'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f758afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 5 note: GC not initialized 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f7589fe3640 20 reqs_thread_entry: start 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 20 Filter name: none 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f74fb7fe640 20 reqs_thread_entry: start 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2b1430 con 0x556e8b277760 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 20 rados_obj.operate() r=0 bl.length=502 2024-09-11T11:01:24.137 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-11T11:01:23.943796Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:24.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f758afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.132+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93933269460512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2affe0 con 0x556e8b277760 2024-09-11T11:01:24.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.136+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93933269460512] v32'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.136+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93933269439136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2af2c0 con 0x556e8b27ba00 2024-09-11T11:01:24.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.136+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93933269439136] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.136+0000 7f76d7352980 20 remove_watcher() i=0 2024-09-11T11:01:24.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.136+0000 7f76d7352980 2 removed watcher, disabling cache 2024-09-11T11:01:24.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.136+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93933269443616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2af2c0 con 0x556e8b277760 2024-09-11T11:01:24.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93933269443616] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x556e8b277760 2024-09-11T11:01:24.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d7352980 20 remove_watcher() i=1 2024-09-11T11:01:24.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93933269445952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2af2c0 con 0x556e8b27ba00 2024-09-11T11:01:24.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93933269445952] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d7352980 20 remove_watcher() i=2 2024-09-11T11:01:24.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93933269436624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b286d40 con 0x7f76c4033c00 2024-09-11T11:01:24.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93933269436624] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d7352980 20 remove_watcher() i=3 2024-09-11T11:01:24.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.140+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93933269452384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2af2c0 con 0x556e8b27ba00 2024-09-11T11:01:24.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.144+0000 7f76d4e62640 1 -- 172.21.15.145:0/3919995379 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93933269452384] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76c402e070 con 0x556e8b27ba00 2024-09-11T11:01:24.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.144+0000 7f76d7352980 20 remove_watcher() i=4 2024-09-11T11:01:24.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.144+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93933269454688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b286d40 con 0x556e8b280c40 2024-09-11T11:01:24.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.144+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93933269454688] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.144+0000 7f76d7352980 20 remove_watcher() i=5 2024-09-11T11:01:24.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.144+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93933269447568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b288660 con 0x556e8b280c40 2024-09-11T11:01:24.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d4661640 1 -- 172.21.15.145:0/3919995379 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93933269447568] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76bc0aaae0 con 0x556e8b280c40 2024-09-11T11:01:24.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 20 remove_watcher() i=6 2024-09-11T11:01:24.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93933269456816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556e8b2af2c0 con 0x7f76c4033c00 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93933269456816] v32'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f76cc00a4d0 con 0x7f76c4033c00 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 20 remove_watcher() i=7 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b27ba00 msgr2=0x556e8b27dec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b27ba00 0x556e8b27dec0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b277760 msgr2=0x556e8b279c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b277760 0x556e8b279c00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f76c4033c00 msgr2=0x7f76c40046b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f76c4033c00 0x7f76c40046b0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556e8b280c40 msgr2=0x556e8b283030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556e8b280c40 0x556e8b283030 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75a00346a0 msgr2=0x7f75a0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75a00346a0 0x7f75a0036b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76bc000c10 tx=0x7f76bc0c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 msgr2=0x556e8b26c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d5663640 1 -- 172.21.15.145:0/3919995379 reap_dead start 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b26c680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f76c40285a0 tx=0x7f76c4010260 comp rx=0 tx=0).stop 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 shutdown_connections 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/3919995379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b2654c0 0x556e8b26c680 secure :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f76c40285a0 tx=0x7f76c4010260 comp rx=0 tx=0).stop 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 >> 172.21.15.145:0/3919995379 conn(0x556e8b2618a0 msgr2=0x556e8b25f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 shutdown_connections 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/3919995379 wait complete. 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/2750176366 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75ac034650 msgr2=0x7f75ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/2750176366 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75ac034650 0x7f75ac036b10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x556e8b23f590 tx=0x7f76bc005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/2750176366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b258d90 msgr2=0x556e8b2591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/2750176366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b258d90 0x556e8b2591b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f76c4024000 tx=0x7f76c4017d50 comp rx=0 tx=0).stop 2024-09-11T11:01:24.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/2750176366 shutdown_connections 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/2750176366 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75ac034650 0x7f75ac036b10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/2750176366 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b258d90 0x556e8b2591b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/2750176366 >> 172.21.15.145:0/2750176366 conn(0x556e8b24dee0 msgr2=0x556e8b250960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/2750176366 shutdown_connections 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/2750176366 wait complete. 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b2433d0 msgr2=0x556e8b2457c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556e8b2433d0 0x556e8b2457c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b14cc60 msgr2=0x556e8b241f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556e8b14cc60 0x556e8b241f70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556e8b248a60 msgr2=0x556e8b24ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556e8b248a60 0x556e8b24ae50 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75bc034650 msgr2=0x7f75bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f75bc034650 0x7f75bc036b10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0ae000 tx=0x7f76bc0a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:24.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 msgr2=0x556e8b23afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 --2- 172.21.15.145:0/446288102 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556e8b1488e0 0x556e8b23afa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x556e8b234e10 tx=0x7f76c4000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d5663640 1 -- 172.21.15.145:0/446288102 reap_dead start 2024-09-11T11:01:24.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 shutdown_connections 2024-09-11T11:01:24.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 >> 172.21.15.145:0/446288102 conn(0x556e8b0bc230 msgr2=0x556e8b22e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 shutdown_connections 2024-09-11T11:01:24.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.152+0000 7f76d7352980 1 -- 172.21.15.145:0/446288102 wait complete. 2024-09-11T11:01:24.165 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-11T11:01:23.943796Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:24.165 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-11T11:01:24.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-11T11:01:24.166 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-11T11:01:24.238 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:24.238 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:24.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c3c26980 1 Processor -- start 2024-09-11T11:01:24.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c3c26980 1 -- start start 2024-09-11T11:01:24.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c3c26980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55b126f773c0 0x55b126f75b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c3c26980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b126e88ae0 con 0x55b126f777d0 2024-09-11T11:01:24.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c3c26980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55b126eace30 con 0x55b126f773c0 2024-09-11T11:01:24.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c1736640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55b126f773c0 0x55b126f75b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c1736640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55b126f773c0 0x55b126f75b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48812/0 (socket says 172.21.15.145:48812) 2024-09-11T11:01:24.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c1736640 1 -- 172.21.15.145:0/2792463760 learned_addr learned my addr 172.21.15.145:0/2792463760 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c1736640 1 -- 172.21.15.145:0/2792463760 >> v1:172.21.15.102:6789/0 conn(0x55b126f777d0 legacy=0x55b126f760c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.236+0000 7ff9c1736640 1 -- 172.21.15.145:0/2792463760 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b126f768f0 con 0x55b126f773c0 2024-09-11T11:01:24.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9c1736640 1 --2- 172.21.15.145:0/2792463760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b126f75b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00a4e0 tx=0x7ff9bc01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac9b71db7061576 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9b3fff640 1 -- 172.21.15.145:0/2792463760 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0aa540 con 0x55b126f773c0 2024-09-11T11:01:24.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9b3fff640 1 -- 172.21.15.145:0/2792463760 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0aa6e0 con 0x55b126f773c0 2024-09-11T11:01:24.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9b3fff640 1 -- 172.21.15.145:0/2792463760 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0aaa40 con 0x55b126f773c0 2024-09-11T11:01:24.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2792463760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 msgr2=0x55b126f75b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2792463760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b126f75b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00a4e0 tx=0x7ff9bc01b090 comp rx=0 tx=0).stop 2024-09-11T11:01:24.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2792463760 shutdown_connections 2024-09-11T11:01:24.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2792463760 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b126f75b80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2792463760 >> 172.21.15.145:0/2792463760 conn(0x55b126ffc1c0 msgr2=0x55b126ffe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2792463760 shutdown_connections 2024-09-11T11:01:24.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.240+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2792463760 wait complete. 2024-09-11T11:01:24.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.252+0000 7ff9c3c26980 1 Processor -- start 2024-09-11T11:01:24.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.252+0000 7ff9c3c26980 1 -- start start 2024-09-11T11:01:24.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.252+0000 7ff9c3c26980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270edc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.252+0000 7ff9c3c26980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b126eae200 con 0x55b126f773c0 2024-09-11T11:01:24.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.252+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.252+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270edc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48824/0 (socket says 172.21.15.145:48824) 2024-09-11T11:01:24.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.252+0000 7ff9c1736640 1 -- 172.21.15.145:0/3707975909 learned_addr learned my addr 172.21.15.145:0/3707975909 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c1736640 1 -- 172.21.15.145:0/3707975909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1270ee1d0 con 0x55b126f773c0 2024-09-11T11:01:24.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c1736640 1 --2- 172.21.15.145:0/3707975909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270edc00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc017ca0 tx=0x7ff9bc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3c2756cf8545d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff8af606640 1 -- 172.21.15.145:0/3707975909 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0b9070 con 0x55b126f773c0 2024-09-11T11:01:24.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff8af606640 1 -- 172.21.15.145:0/3707975909 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0aab30 con 0x55b126f773c0 2024-09-11T11:01:24.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff8af606640 1 -- 172.21.15.145:0/3707975909 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0aae10 con 0x55b126f773c0 2024-09-11T11:01:24.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3707975909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 msgr2=0x55b1270edc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/3707975909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270edc00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc017ca0 tx=0x7ff9bc0033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3707975909 shutdown_connections 2024-09-11T11:01:24.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/3707975909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270edc00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3707975909 >> 172.21.15.145:0/3707975909 conn(0x55b126ffc1c0 msgr2=0x55b1270e9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3707975909 shutdown_connections 2024-09-11T11:01:24.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3707975909 wait complete. 2024-09-11T11:01:24.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 Processor -- start 2024-09-11T11:01:24.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- start start 2024-09-11T11:01:24.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b12700c210 con 0x55b126f773c0 2024-09-11T11:01:24.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48830/0 (socket says 172.21.15.145:48830) 2024-09-11T11:01:24.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c1736640 1 -- 172.21.15.145:0/2934587148 learned_addr learned my addr 172.21.15.145:0/2934587148 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c1736640 1 -- 172.21.15.145:0/2934587148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1270f53f0 con 0x55b126f773c0 2024-09-11T11:01:24.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c1736640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270f4eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc017ca0 tx=0x7ff9bc017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff8ade03640 1 -- 172.21.15.145:0/2934587148 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0b9070 con 0x55b126f773c0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1270f5680 con 0x55b126f773c0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff8ade03640 1 -- 172.21.15.145:0/2934587148 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0c8470 con 0x55b126f773c0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff8ade03640 1 -- 172.21.15.145:0/2934587148 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0a3b40 con 0x55b126f773c0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.256+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1270f8360 con 0x55b126f773c0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff8ade03640 1 -- 172.21.15.145:0/2934587148 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9bc0b3040 con 0x55b126f773c0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff8ade03640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 0x7ff8a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff8ade03640 1 -- 172.21.15.145:0/2934587148 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff9bc0c4070 con 0x55b126f773c0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 0x7ff8a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b126f777d0 0x55b1270fbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1270fc530 con 0x55b126f777d0 2024-09-11T11:01:24.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c1f37640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b126f777d0 0x55b1270fbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 0x7ff8a8036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8001e20 tx=0x7ff9b80013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c1f37640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b126f777d0 0x55b1270fbfb0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2934587148 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b126f777d0 2024-09-11T11:01:24.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b1270fd2e0 0x55b1270ff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1270ffd30 con 0x55b1270fd2e0 2024-09-11T11:01:24.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c1736640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b1270fd2e0 0x55b1270ff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c1736640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b1270fd2e0 0x55b1270ff6d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c1736640 1 -- 172.21.15.145:0/2934587148 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b1270fd2e0 2024-09-11T11:01:24.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.260+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1271015e0 con 0x55b1270fd2e0 2024-09-11T11:01:24.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c1736640 1 -- 172.21.15.145:0/2934587148 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b1270fd2e0 2024-09-11T11:01:24.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127100750 con 0x55b1270fd2e0 2024-09-11T11:01:24.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c1736640 1 -- 172.21.15.145:0/2934587148 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b1270fd2e0 2024-09-11T11:01:24.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55b127102990 0x55b127104d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b1271052c0 con 0x55b127102990 2024-09-11T11:01:24.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55b127102990 0x55b127104d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55b127102990 0x55b127104d80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2934587148 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff9b800d040 con 0x55b127102990 2024-09-11T11:01:24.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c3c26980 1 Processor -- start 2024-09-11T11:01:24.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c3c26980 1 -- start start 2024-09-11T11:01:24.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c3c26980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b127112cb0 0x55b1271130d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c3c26980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b126f07800 con 0x55b127112cb0 2024-09-11T11:01:24.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b127112cb0 0x55b1271130d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b127112cb0 0x55b1271130d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48842/0 (socket says 172.21.15.145:48842) 2024-09-11T11:01:24.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c1736640 1 -- 172.21.15.145:0/444803344 learned_addr learned my addr 172.21.15.145:0/444803344 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c1736640 1 -- 172.21.15.145:0/444803344 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b127113610 con 0x55b127112cb0 2024-09-11T11:01:24.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.264+0000 7ff9c1736640 1 --2- 172.21.15.145:0/444803344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b127112cb0 0x55b1271130d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0e4ec0 tx=0x7ff9bc0be0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a6ffd640 1 -- 172.21.15.145:0/444803344 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0e8070 con 0x55b127112cb0 2024-09-11T11:01:24.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- 172.21.15.145:0/444803344 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1271138a0 con 0x55b127112cb0 2024-09-11T11:01:24.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a6ffd640 1 -- 172.21.15.145:0/444803344 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0b4a40 con 0x55b127112cb0 2024-09-11T11:01:24.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a6ffd640 1 -- 172.21.15.145:0/444803344 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0a9b90 con 0x55b127112cb0 2024-09-11T11:01:24.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- 172.21.15.145:0/444803344 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b127116520 con 0x55b127112cb0 2024-09-11T11:01:24.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a6ffd640 1 -- 172.21.15.145:0/444803344 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9bc0a93c0 con 0x55b127112cb0 2024-09-11T11:01:24.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a6ffd640 1 --2- 172.21.15.145:0/444803344 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff898034650 0x7ff898036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a6ffd640 1 -- 172.21.15.145:0/444803344 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff9bc0edab0 con 0x55b127112cb0 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/444803344 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff898034650 0x7ff898036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 Processor -- start 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- start start 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b12711f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/444803344 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff898034650 0x7ff898036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55b1270f94a0 tx=0x7ff9b8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b1270ee490 con 0x55b12711f600 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b12711f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b12711f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48848/0 (socket says 172.21.15.145:48848) 2024-09-11T11:01:24.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c1736640 1 -- 172.21.15.145:0/3174139084 learned_addr learned my addr 172.21.15.145:0/3174139084 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c1736640 1 -- 172.21.15.145:0/3174139084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b12711ffb0 con 0x55b12711f600 2024-09-11T11:01:24.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c1736640 1 --2- 172.21.15.145:0/3174139084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b12711f9e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0c79d0 tx=0x7ff9bc0f5460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cce74ec79bc60b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a4ff9640 1 -- 172.21.15.145:0/3174139084 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0edd80 con 0x55b12711f600 2024-09-11T11:01:24.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a4ff9640 1 -- 172.21.15.145:0/3174139084 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0dcc90 con 0x55b12711f600 2024-09-11T11:01:24.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff8a4ff9640 1 -- 172.21.15.145:0/3174139084 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc006810 con 0x55b12711f600 2024-09-11T11:01:24.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3174139084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 msgr2=0x55b12711f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/3174139084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b12711f9e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0c79d0 tx=0x7ff9bc0f5460 comp rx=0 tx=0).stop 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3174139084 shutdown_connections 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/3174139084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b12711f9e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3174139084 >> 172.21.15.145:0/3174139084 conn(0x55b12711b9e0 msgr2=0x55b127119ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3174139084 shutdown_connections 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.268+0000 7ff9c3c26980 1 -- 172.21.15.145:0/3174139084 wait complete. 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 1 Processor -- start 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 1 -- start start 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b127126780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55b127120450 con 0x55b12711f600 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b127126780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c1736640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b127126780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48852/0 (socket says 172.21.15.145:48852) 2024-09-11T11:01:24.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 learned_addr learned my addr 172.21.15.145:0/2604521988 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b127126cc0 con 0x55b12711f600 2024-09-11T11:01:24.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c1736640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b127126780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0dcbc0 tx=0x7ff9bc0dffa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff896ffd640 1 -- 172.21.15.145:0/2604521988 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0bee20 con 0x55b12711f600 2024-09-11T11:01:24.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b127126cc0 con 0x55b12711f600 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff896ffd640 1 -- 172.21.15.145:0/2604521988 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9bc0dce40 con 0x55b12711f600 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff896ffd640 1 -- 172.21.15.145:0/2604521988 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc0a97e0 con 0x55b12711f600 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b127127130 con 0x55b12711f600 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff896ffd640 1 -- 172.21.15.145:0/2604521988 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9bc111030 con 0x55b12711f600 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff896ffd640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff88c034650 0x7ff88c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff896ffd640 1 -- 172.21.15.145:0/2604521988 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff9bc10f070 con 0x55b12711f600 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff88c034650 0x7ff88c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b127131920 0x55b127133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127134530 con 0x55b127131920 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c1f37640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b127131920 0x55b127133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff88c034650 0x7ff88c036b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55b127101560 tx=0x7ff9b8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.272+0000 7ff9c1f37640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b127131920 0x55b127133de0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 realm 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127130d50 con 0x55b127131920 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127134fc0 con 0x55b127131920 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b127135da0 0x55b127138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127138820 con 0x55b127135da0 2024-09-11T11:01:24.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c1736640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b127135da0 0x55b127138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c1736640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b127135da0 0x55b127138190 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127139070 con 0x55b127135da0 2024-09-11T11:01:24.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 20 searching for the correct realm 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55b12713ade0 0x55b12713d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b12713ade0 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55b12713ade0 0x55b12713d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c0f35640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55b12713ade0 0x55b12713d1d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.276+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1736640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9bc0ec020 0x7ff9bc0d7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x7ff9bc0ec020 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9bc0ec020 0x7ff9bc0d7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9bc0ec020 0x7ff9bc0d7270 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b12713ade0 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x7ff9bc0ec020 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.280+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x7ff9bc0ec020 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b12713ade0 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b12713ade0 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b12713ade0 2024-09-11T11:01:24.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x7ff9bc0ec020 2024-09-11T11:01:24.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127131920 2024-09-11T11:01:24.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.284+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x7ff9bc0ec020 2024-09-11T11:01:24.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b12713ade0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x7ff9bc0ec020 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b12713ade0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55b12713d850 con 0x55b127135da0 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127139a20 con 0x55b127131920 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.288+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127139660 con 0x55b127135da0 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127139670 con 0x7ff9bc0ec020 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 zone default found 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 4 Realm: () 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:24.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 zonegroup default 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b12713a520 con 0x7ff9bc0ec020 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127140090 con 0x55b12713ade0 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127140430 con 0x55b12713ade0 2024-09-11T11:01:24.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 started sync module instance, tier type = 2024-09-11T11:01:24.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:24.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b12713f520 con 0x55b127135da0 2024-09-11T11:01:24.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94219353193072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b12713f520 con 0x55b127135da0 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.292+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127140e80 con 0x55b127131920 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.296+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.296+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94219353196944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127141720 con 0x55b127131920 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.296+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127142120 con 0x55b127135da0 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.296+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94219353193072] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.296+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94219353196944] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94219353199216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127141c30 con 0x55b127135da0 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1271429c0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94219353203984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127142de0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127143820 con 0x55b127135da0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94219353203984] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94219353199216] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94219353207536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127142930 con 0x55b127135da0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.300+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1271440c0 con 0x55b12713ade0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.304+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.304+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94219353209872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127142930 con 0x55b12713ade0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.304+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127144f30 con 0x55b12713ade0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.304+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94219353207536] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.304+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94219353209872] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94219353212000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127144a80 con 0x55b12713ade0 2024-09-11T11:01:24.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127145440 con 0x7ff9bc0ec020 2024-09-11T11:01:24.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94219353214864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127145860 con 0x7ff9bc0ec020 2024-09-11T11:01:24.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 20 add_watcher() i=0 2024-09-11T11:01:24.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 20 add_watcher() i=1 2024-09-11T11:01:24.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 20 add_watcher() i=2 2024-09-11T11:01:24.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 20 add_watcher() i=3 2024-09-11T11:01:24.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 20 add_watcher() i=4 2024-09-11T11:01:24.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 20 add_watcher() i=5 2024-09-11T11:01:24.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94219353212000] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.308+0000 7ff9c3c26980 20 add_watcher() i=6 2024-09-11T11:01:24.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94219353214864] v32'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 20 add_watcher() i=7 2024-09-11T11:01:24.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:24.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b127145860 con 0x55b127131920 2024-09-11T11:01:24.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94219353215920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1271457d0 con 0x55b127131920 2024-09-11T11:01:24.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94219353215920] v32'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff8777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 5 note: GC not initialized 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff8767e4640 20 reqs_thread_entry: start 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 20 Filter name: none 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff7e7fff640 20 reqs_thread_entry: start 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b12716bfb0 con 0x55b127131920 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 20 rados_obj.operate() r=0 bl.length=502 2024-09-11T11:01:24.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:24.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:24.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.312+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1271725b0 con 0x55b127131920 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c3c26980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c3c26980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c3c26980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94219353399328 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b12716dcc0 con 0x55b127135da0 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94219353207536 notify 137438953477 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b1271138a0 con 0x55b127135da0 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff8a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 94219353207536 notifier 4360 bl.length()=567 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff8a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff8a4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff8a4ff9640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff884003eb0 con 0x55b127135da0 2024-09-11T11:01:24.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94219353399328 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94219353399328 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b127113610 con 0x55b127135da0 2024-09-11T11:01:24.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b127172020 con 0x55b12713ade0 2024-09-11T11:01:24.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v32'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c3c26980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-11T11:01:24.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.316+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94219353399328 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55b12716d810 con 0x55b127135da0 2024-09-11T11:01:24.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.320+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 94219353199216 notify 137438953478 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b127113610 con 0x55b127135da0 2024-09-11T11:01:24.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.320+0000 7ff897fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94219353199216 notifier 4360 bl.length()=170 2024-09-11T11:01:24.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.320+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(67 notify.2 [notify cookie 94219353399328 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.320+0000 7ff897fff640 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7ff7f40032d0 con 0x55b127135da0 2024-09-11T11:01:24.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.320+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.320+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 94219353399328 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b1270f8360 con 0x55b127135da0 2024-09-11T11:01:24.323 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:24.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.320+0000 7ff8777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.320+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94219353215920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b12716dcc0 con 0x55b127131920 2024-09-11T11:01:24.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.324+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94219353215920] v32'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.324+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94219353193072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b12716dcc0 con 0x55b127135da0 2024-09-11T11:01:24.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.324+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94219353193072] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.324+0000 7ff9c3c26980 20 remove_watcher() i=0 2024-09-11T11:01:24.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.324+0000 7ff9c3c26980 2 removed watcher, disabling cache 2024-09-11T11:01:24.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.324+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94219353196944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b12716dc90 con 0x55b127131920 2024-09-11T11:01:24.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94219353196944] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x55b127131920 2024-09-11T11:01:24.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c3c26980 20 remove_watcher() i=1 2024-09-11T11:01:24.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94219353199216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1271453b0 con 0x55b127135da0 2024-09-11T11:01:24.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94219353199216] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c3c26980 20 remove_watcher() i=2 2024-09-11T11:01:24.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94219353203984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b12713fa70 con 0x7ff9bc0ec020 2024-09-11T11:01:24.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94219353203984] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c3c26980 20 remove_watcher() i=3 2024-09-11T11:01:24.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.328+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94219353207536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1271453b0 con 0x55b127135da0 2024-09-11T11:01:24.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c1736640 1 -- 172.21.15.145:0/2604521988 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94219353207536] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9bc0c8c60 con 0x55b127135da0 2024-09-11T11:01:24.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c3c26980 20 remove_watcher() i=4 2024-09-11T11:01:24.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94219353209872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b12713fa70 con 0x55b12713ade0 2024-09-11T11:01:24.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94219353209872] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c3c26980 20 remove_watcher() i=5 2024-09-11T11:01:24.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94219353212000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1271432f0 con 0x55b12713ade0 2024-09-11T11:01:24.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c0f35640 1 -- 172.21.15.145:0/2604521988 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94219353212000] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b8036040 con 0x55b12713ade0 2024-09-11T11:01:24.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c3c26980 20 remove_watcher() i=6 2024-09-11T11:01:24.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.332+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94219353214864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55b1271453b0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94219353214864] v32'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9b40083f0 con 0x7ff9bc0ec020 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 20 remove_watcher() i=7 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b127135da0 msgr2=0x55b127138190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b127135da0 0x55b127138190 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b127131920 msgr2=0x55b127133de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b127131920 0x55b127133de0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9bc0ec020 msgr2=0x7ff9bc0d7270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9bc0ec020 0x7ff9bc0d7270 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55b12713ade0 msgr2=0x55b12713d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55b12713ade0 0x55b12713d1d0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff88c034650 msgr2=0x7ff88c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff88c034650 0x7ff88c036b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55b127101560 tx=0x7ff9b8011000 comp rx=0 tx=0).stop 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 msgr2=0x55b127126780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2604521988 reap_dead start 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b127126780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0dcbc0 tx=0x7ff9bc0dffa0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 shutdown_connections 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2604521988 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b12711f600 0x55b127126780 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 >> 172.21.15.145:0/2604521988 conn(0x55b12711b9e0 msgr2=0x55b127119ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 shutdown_connections 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2604521988 wait complete. 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/444803344 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff898034650 msgr2=0x7ff898036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/444803344 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff898034650 0x7ff898036b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x55b1270f94a0 tx=0x7ff9b8006000 comp rx=0 tx=0).stop 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/444803344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b127112cb0 msgr2=0x55b1271130d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/444803344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b127112cb0 0x55b1271130d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0e4ec0 tx=0x7ff9bc0be0f0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/444803344 shutdown_connections 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/444803344 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff898034650 0x7ff898036b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/444803344 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b127112cb0 0x55b1271130d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/444803344 >> 172.21.15.145:0/444803344 conn(0x55b127107e00 msgr2=0x55b12710a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/444803344 shutdown_connections 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/444803344 wait complete. 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b1270fd2e0 msgr2=0x55b1270ff6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55b1270fd2e0 0x55b1270ff6d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b126f777d0 msgr2=0x55b1270fbfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55b126f777d0 0x55b1270fbfb0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55b127102990 msgr2=0x55b127104d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55b127102990 0x55b127104d80 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 msgr2=0x7ff8a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 0x7ff8a8036b10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8001e20 tx=0x7ff9b80013a0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 msgr2=0x55b1270f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 --2- 172.21.15.145:0/2934587148 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55b126f773c0 0x55b1270f4eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc017ca0 tx=0x7ff9bc017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c1f37640 1 -- 172.21.15.145:0/2934587148 reap_dead start 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 shutdown_connections 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 >> 172.21.15.145:0/2934587148 conn(0x55b126ffc1c0 msgr2=0x55b1270e83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 shutdown_connections 2024-09-11T11:01:24.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.336+0000 7ff9c3c26980 1 -- 172.21.15.145:0/2934587148 wait complete. 2024-09-11T11:01:24.348 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:24.348 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-11T11:01:24.349 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-11T11:01:24.349 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-11T11:01:24.424 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:24.425 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:24.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4395bc980 1 Processor -- start 2024-09-11T11:01:24.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4395bc980 1 -- start start 2024-09-11T11:01:24.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4395bc980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55999bb6a2a0 0x55999bbf83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4395bc980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55999ba7dae0 con 0x55999bbf88f0 2024-09-11T11:01:24.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4395bc980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55999baa1e30 con 0x55999bb6a2a0 2024-09-11T11:01:24.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4370cc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55999bb6a2a0 0x55999bbf83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4370cc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55999bb6a2a0 0x55999bbf83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48856/0 (socket says 172.21.15.145:48856) 2024-09-11T11:01:24.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4368cb640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55999bbf88f0 0x55999bbface0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48674/0 (socket says 172.21.15.145:48674) 2024-09-11T11:01:24.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4370cc640 1 -- 172.21.15.145:0/1321856923 learned_addr learned my addr 172.21.15.145:0/1321856923 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4370cc640 1 -- 172.21.15.145:0/1321856923 >> v1:172.21.15.102:6789/0 conn(0x55999bbf88f0 legacy=0x55999bbface0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4370cc640 1 -- 172.21.15.145:0/1321856923 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999bb6a830 con 0x55999bb6a2a0 2024-09-11T11:01:24.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.424+0000 7fc4370cc640 1 --2- 172.21.15.145:0/1321856923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bbf83b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc42800a4e0 tx=0x7fc42801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b617f2d2e441ded server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4360ca640 1 -- 172.21.15.145:0/1321856923 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280aa540 con 0x55999bb6a2a0 2024-09-11T11:01:24.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4360ca640 1 -- 172.21.15.145:0/1321856923 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4280aa6e0 con 0x55999bb6a2a0 2024-09-11T11:01:24.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4360ca640 1 -- 172.21.15.145:0/1321856923 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280aaa40 con 0x55999bb6a2a0 2024-09-11T11:01:24.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4395bc980 1 -- 172.21.15.145:0/1321856923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 msgr2=0x55999bbf83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1321856923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bbf83b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc42800a4e0 tx=0x7fc42801b090 comp rx=0 tx=0).stop 2024-09-11T11:01:24.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4395bc980 1 -- 172.21.15.145:0/1321856923 shutdown_connections 2024-09-11T11:01:24.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1321856923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bbf83b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4395bc980 1 -- 172.21.15.145:0/1321856923 >> 172.21.15.145:0/1321856923 conn(0x55999bbf00a0 msgr2=0x55999bbf24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4395bc980 1 -- 172.21.15.145:0/1321856923 shutdown_connections 2024-09-11T11:01:24.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.428+0000 7fc4395bc980 1 -- 172.21.15.145:0/1321856923 wait complete. 2024-09-11T11:01:24.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4395bc980 1 Processor -- start 2024-09-11T11:01:24.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4395bc980 1 -- start start 2024-09-11T11:01:24.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4395bc980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4395bc980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55999baa3200 con 0x55999bb6a2a0 2024-09-11T11:01:24.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48872/0 (socket says 172.21.15.145:48872) 2024-09-11T11:01:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4370cc640 1 -- 172.21.15.145:0/2002172585 learned_addr learned my addr 172.21.15.145:0/2002172585 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4370cc640 1 -- 172.21.15.145:0/2002172585 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999bce0fe0 con 0x55999bb6a2a0 2024-09-11T11:01:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc4370cc640 1 --2- 172.21.15.145:0/2002172585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce0a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc428017ca0 tx=0x7fc4280033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6c3b6445ae57c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc32560a640 1 -- 172.21.15.145:0/2002172585 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280b9030 con 0x55999bb6a2a0 2024-09-11T11:01:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc32560a640 1 -- 172.21.15.145:0/2002172585 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4280aaac0 con 0x55999bb6a2a0 2024-09-11T11:01:24.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.440+0000 7fc32560a640 1 -- 172.21.15.145:0/2002172585 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280aada0 con 0x55999bb6a2a0 2024-09-11T11:01:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- 172.21.15.145:0/2002172585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 msgr2=0x55999bce0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 --2- 172.21.15.145:0/2002172585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce0a10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc428017ca0 tx=0x7fc4280033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- 172.21.15.145:0/2002172585 shutdown_connections 2024-09-11T11:01:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 --2- 172.21.15.145:0/2002172585 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce0a10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- 172.21.15.145:0/2002172585 >> 172.21.15.145:0/2002172585 conn(0x55999bbf00a0 msgr2=0x55999bcdc640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- 172.21.15.145:0/2002172585 shutdown_connections 2024-09-11T11:01:24.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- 172.21.15.145:0/2002172585 wait complete. 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 Processor -- start 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- start start 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55999bbfcf10 con 0x55999bb6a2a0 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48884/0 (socket says 172.21.15.145:48884) 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4370cc640 1 -- 172.21.15.145:0/1385890645 learned_addr learned my addr 172.21.15.145:0/1385890645 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4370cc640 1 -- 172.21.15.145:0/1385890645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999bce8160 con 0x55999bb6a2a0 2024-09-11T11:01:24.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4370cc640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce7c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc428005cc0 tx=0x7fc428017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc323e07640 1 -- 172.21.15.145:0/1385890645 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280b9030 con 0x55999bb6a2a0 2024-09-11T11:01:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc323e07640 1 -- 172.21.15.145:0/1385890645 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4280c3070 con 0x55999bb6a2a0 2024-09-11T11:01:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55999bce83f0 con 0x55999bb6a2a0 2024-09-11T11:01:24.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc323e07640 1 -- 172.21.15.145:0/1385890645 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280bf750 con 0x55999bb6a2a0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55999bceb0d0 con 0x55999bb6a2a0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc323e07640 1 -- 172.21.15.145:0/1385890645 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4280c5030 con 0x55999bb6a2a0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc323e07640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc31c034650 0x7fc31c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.444+0000 7fc323e07640 1 -- 172.21.15.145:0/1385890645 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc4280ba070 con 0x55999bb6a2a0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4368cb640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc31c034650 0x7fc31c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bbf88f0 0x55999bceebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bcef1d0 con 0x55999bbf88f0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4378cd640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bbf88f0 0x55999bceebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4368cb640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc31c034650 0x7fc31c036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc420000f70 tx=0x7fc420001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4378cd640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bbf88f0 0x55999bceebb0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4378cd640 1 -- 172.21.15.145:0/1385890645 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bbf88f0 2024-09-11T11:01:24.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bceffc0 0x55999bcf23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bcf29f0 con 0x55999bceffc0 2024-09-11T11:01:24.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4370cc640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bceffc0 0x55999bcf23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4370cc640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bceffc0 0x55999bcf23b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4370cc640 1 -- 172.21.15.145:0/1385890645 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bceffc0 2024-09-11T11:01:24.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bcf42a0 con 0x55999bceffc0 2024-09-11T11:01:24.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4370cc640 1 -- 172.21.15.145:0/1385890645 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bceffc0 2024-09-11T11:01:24.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bcf34d0 con 0x55999bceffc0 2024-09-11T11:01:24.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4370cc640 1 -- 172.21.15.145:0/1385890645 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bceffc0 2024-09-11T11:01:24.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55999bcf5650 0x55999bcf7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.448+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bcf7f80 con 0x55999bcf5650 2024-09-11T11:01:24.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4368cb640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55999bcf5650 0x55999bcf7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4368cb640 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55999bcf5650 0x55999bcf7a40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4368cb640 1 -- 172.21.15.145:0/1385890645 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc42000f6a0 con 0x55999bcf5650 2024-09-11T11:01:24.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4395bc980 1 Processor -- start 2024-09-11T11:01:24.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4395bc980 1 -- start start 2024-09-11T11:01:24.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4395bc980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bbf5d30 0x55999bbf43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4395bc980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55999bafc800 con 0x55999bbf5d30 2024-09-11T11:01:24.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bbf5d30 0x55999bbf43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bbf5d30 0x55999bbf43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48894/0 (socket says 172.21.15.145:48894) 2024-09-11T11:01:24.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4370cc640 1 -- 172.21.15.145:0/2070919336 learned_addr learned my addr 172.21.15.145:0/2070919336 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4370cc640 1 -- 172.21.15.145:0/2070919336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999bbf6150 con 0x55999bbf5d30 2024-09-11T11:01:24.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4370cc640 1 --2- 172.21.15.145:0/2070919336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bbf5d30 0x55999bbf43b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc4280e50c0 tx=0x7fc4280a9f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc321602640 1 -- 172.21.15.145:0/2070919336 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280c63c0 con 0x55999bbf5d30 2024-09-11T11:01:24.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4395bc980 1 -- 172.21.15.145:0/2070919336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55999bbf4950 con 0x55999bbf5d30 2024-09-11T11:01:24.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc321602640 1 -- 172.21.15.145:0/2070919336 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4280c6560 con 0x55999bbf5d30 2024-09-11T11:01:24.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc321602640 1 -- 172.21.15.145:0/2070919336 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280b4a20 con 0x55999bbf5d30 2024-09-11T11:01:24.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc4395bc980 1 -- 172.21.15.145:0/2070919336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55999bbf4950 con 0x55999bbf5d30 2024-09-11T11:01:24.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.452+0000 7fc321602640 1 -- 172.21.15.145:0/2070919336 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc4280df040 con 0x55999bbf5d30 2024-09-11T11:01:24.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc321602640 1 --2- 172.21.15.145:0/2070919336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc310034650 0x7fc310036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc321602640 1 -- 172.21.15.145:0/2070919336 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc4280d30b0 con 0x55999bbf5d30 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4368cb640 1 --2- 172.21.15.145:0/2070919336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc310034650 0x7fc310036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 Processor -- start 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- start start 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4368cb640 1 --2- 172.21.15.145:0/2070919336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc310034650 0x7fc310036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55999bcec210 tx=0x7fc42000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd146f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55999bce12a0 con 0x55999bd14310 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd146f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd146f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48906/0 (socket says 172.21.15.145:48906) 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 -- 172.21.15.145:0/1159060840 learned_addr learned my addr 172.21.15.145:0/1159060840 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 -- 172.21.15.145:0/1159060840 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999bd14cc0 con 0x55999bd14310 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 --2- 172.21.15.145:0/1159060840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd146f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc4280d13f0 tx=0x7fc4280eb490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3481194e3d453559 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc31affd640 1 -- 172.21.15.145:0/1159060840 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280fc070 con 0x55999bd14310 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc31affd640 1 -- 172.21.15.145:0/1159060840 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4280ec470 con 0x55999bd14310 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc31affd640 1 -- 172.21.15.145:0/1159060840 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280c7410 con 0x55999bd14310 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- 172.21.15.145:0/1159060840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 msgr2=0x55999bd146f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1159060840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd146f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc4280d13f0 tx=0x7fc4280eb490 comp rx=0 tx=0).stop 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- 172.21.15.145:0/1159060840 shutdown_connections 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1159060840 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd146f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- 172.21.15.145:0/1159060840 >> 172.21.15.145:0/1159060840 conn(0x55999bd106f0 msgr2=0x55999bd0e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- 172.21.15.145:0/1159060840 shutdown_connections 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- 172.21.15.145:0/1159060840 wait complete. 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 Processor -- start 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- start start 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd1b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4395bc980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55999bd15160 con 0x55999bd14310 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd1b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd1b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48914/0 (socket says 172.21.15.145:48914) 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 learned_addr learned my addr 172.21.15.145:0/3642648823 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.456+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55999bd1ba80 con 0x55999bd14310 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4370cc640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd1b540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc4280ec620 tx=0x7fc4280c2f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc3197fa640 1 -- 172.21.15.145:0/3642648823 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280e3a40 con 0x55999bd14310 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55999bd1ba80 con 0x55999bd14310 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc3197fa640 1 -- 172.21.15.145:0/3642648823 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4280e3c00 con 0x55999bd14310 2024-09-11T11:01:24.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55999bd1bef0 con 0x55999bd14310 2024-09-11T11:01:24.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc3197fa640 1 -- 172.21.15.145:0/3642648823 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4280e3db0 con 0x55999bd14310 2024-09-11T11:01:24.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc3197fa640 1 -- 172.21.15.145:0/3642648823 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc428111020 con 0x55999bd14310 2024-09-11T11:01:24.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc3197fa640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc300034650 0x7fc300036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc3197fa640 1 -- 172.21.15.145:0/3642648823 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc42810f020 con 0x55999bd14310 2024-09-11T11:01:24.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4368cb640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc300034650 0x7fc300036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bd265f0 0x55999bd28ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd29200 con 0x55999bd265f0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4378cd640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bd265f0 0x55999bd28ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4368cb640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc300034650 0x7fc300036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c010 tx=0x7fc420010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4378cd640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bd265f0 0x55999bd28ab0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 20 realm 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd25a20 con 0x55999bd265f0 2024-09-11T11:01:24.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd29cc0 con 0x55999bd265f0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bd2aaa0 0x55999bd2ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2d540 con 0x55999bd2aaa0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.460+0000 7fc4370cc640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bd2aaa0 0x55999bd2ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4370cc640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bd2aaa0 0x55999bd2ce90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4395bc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4395bc980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4395bc980 20 searching for the correct realm 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55999bd2fb00 0x55999bd31ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd32570 con 0x55999bd2fb00 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4368cb640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55999bd2fb00 0x55999bd31ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4368cb640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55999bd2fb00 0x55999bd31ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd32570 con 0x55999bd2aaa0 2024-09-11T11:01:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4370cc640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc4280b4bc0 0x7fc4280ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x7fc4280b4bc0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4378cd640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc4280b4bc0 0x7fc4280ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4378cd640 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc4280b4bc0 0x7fc4280ac0d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.464+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2fb00 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x7fc4280b4bc0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x7fc4280b4bc0 2024-09-11T11:01:24.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2fb00 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.468+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2fb00 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2fb00 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x7fc4280b4bc0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd265f0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x7fc4280b4bc0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2fb00 2024-09-11T11:01:24.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x7fc4280b4bc0 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2fb00 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.472+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2dd90 con 0x55999bd2aaa0 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2e5e0 con 0x55999bd265f0 2024-09-11T11:01:24.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2e9d0 con 0x55999bd2aaa0 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd2e9d0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 zone default found 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 4 Realm: () 2024-09-11T11:01:24.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 zonegroup default 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd329d0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd347b0 con 0x55999bd2fb00 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd34cd0 con 0x55999bd2fb00 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 started sync module instance, tier type = 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.476+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd33bf0 con 0x55999bd2aaa0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94118232670480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd33bf0 con 0x55999bd2aaa0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd35790 con 0x55999bd265f0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94118232674976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd356c0 con 0x55999bd265f0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd366e0 con 0x55999bd2aaa0 2024-09-11T11:01:24.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94118232670480] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94118232674976] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94118232677296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd366a0 con 0x55999bd2aaa0 2024-09-11T11:01:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.480+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd36f80 con 0x7fc4280b4bc0 2024-09-11T11:01:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94118232681168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd366a0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd37a70 con 0x55999bd2aaa0 2024-09-11T11:01:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94118232677296] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94118232681168] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94118232683936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd37a70 con 0x55999bd2aaa0 2024-09-11T11:01:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd37e60 con 0x55999bd2fb00 2024-09-11T11:01:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94118232682224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd38700 con 0x55999bd2fb00 2024-09-11T11:01:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.484+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd39100 con 0x55999bd2fb00 2024-09-11T11:01:24.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94118232683936] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94118232678864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd399a0 con 0x55999bd2fb00 2024-09-11T11:01:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd3a360 con 0x7fc4280b4bc0 2024-09-11T11:01:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94118232682224] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94118232687184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd3a360 con 0x7fc4280b4bc0 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 20 add_watcher() i=0 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 20 add_watcher() i=1 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 20 add_watcher() i=2 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 20 add_watcher() i=3 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 20 add_watcher() i=4 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.488+0000 7fc4395bc980 20 add_watcher() i=5 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94118232678864] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 20 add_watcher() i=6 2024-09-11T11:01:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94118232687184] v32'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 20 add_watcher() i=7 2024-09-11T11:01:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd3a360 con 0x55999bd265f0 2024-09-11T11:01:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94118232694448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd3a2d0 con 0x55999bd265f0 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94118232694448] v32'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc2edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 5 note: GC not initialized 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc2ecfe1640 20 reqs_thread_entry: start 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 20 Filter name: none 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc2667fc640 20 reqs_thread_entry: start 2024-09-11T11:01:24.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:24.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.492+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd60860 con 0x55999bd265f0 2024-09-11T11:01:24.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd612d0 con 0x55999bd265f0 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-11T11:01:24.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-11T11:01:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-11T11:01:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd66c80 con 0x55999bd265f0 2024-09-11T11:01:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v32'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:24.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94118232876784 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd622e0 con 0x55999bd2aaa0 2024-09-11T11:01:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94118232683936 notify 137438953479 ret 0) ==== 774+0+0 (crc 0 0 0) 0x55999bbf6150 con 0x55999bd2aaa0 2024-09-11T11:01:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc31affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94118232683936 notifier 4367 bl.length()=732 2024-09-11T11:01:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc31affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc31affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc31affd640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc2fc003eb0 con 0x55999bd2aaa0 2024-09-11T11:01:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(65 notify.4 [notify cookie 94118232876784 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94118232876784 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc4280d7070 con 0x55999bd2aaa0 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.496+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd666f0 con 0x55999bd265f0 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4395bc980 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4395bc980 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4395bc980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94118232876784 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55999bd5efc0 con 0x55999bd2aaa0 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 94118232670480 notify 137438953480 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7fc4280d7070 con 0x55999bd2aaa0 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc31a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 94118232670480 notifier 4367 bl.length()=166 2024-09-11T11:01:24.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc31a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-11T11:01:24.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc31a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-11T11:01:24.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc31a7fc640 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc26c003410 con 0x55999bd2aaa0 2024-09-11T11:01:24.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(68 notify.0 [notify cookie 94118232876784 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 94118232876784 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55999bceb0d0 con 0x55999bd2aaa0 2024-09-11T11:01:24.507 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"QoO0Z6YHyPdjDmawJaMsEVnSYe0XqKrXi74wefwu","active":true,"create_date":"2024-09-11T11:01:24.500198Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:24.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc2edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.500+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94118232694448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd5e690 con 0x55999bd265f0 2024-09-11T11:01:24.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.504+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94118232694448] v32'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.504+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94118232670480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd5e690 con 0x55999bd2aaa0 2024-09-11T11:01:24.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.504+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94118232670480] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.504+0000 7fc4395bc980 20 remove_watcher() i=0 2024-09-11T11:01:24.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.504+0000 7fc4395bc980 2 removed watcher, disabling cache 2024-09-11T11:01:24.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.504+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94118232674976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd5e690 con 0x55999bd265f0 2024-09-11T11:01:24.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94118232674976] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x55999bd265f0 2024-09-11T11:01:24.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4395bc980 20 remove_watcher() i=1 2024-09-11T11:01:24.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94118232677296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd352a0 con 0x55999bd2aaa0 2024-09-11T11:01:24.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94118232677296] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4395bc980 20 remove_watcher() i=2 2024-09-11T11:01:24.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94118232681168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd5e690 con 0x7fc4280b4bc0 2024-09-11T11:01:24.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94118232681168] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4395bc980 20 remove_watcher() i=3 2024-09-11T11:01:24.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.508+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94118232683936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd352a0 con 0x55999bd2aaa0 2024-09-11T11:01:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4370cc640 1 -- 172.21.15.145:0/3642648823 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94118232683936] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4280ce070 con 0x55999bd2aaa0 2024-09-11T11:01:24.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4395bc980 20 remove_watcher() i=4 2024-09-11T11:01:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94118232682224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd36ad0 con 0x55999bd2fb00 2024-09-11T11:01:24.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94118232682224] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4395bc980 20 remove_watcher() i=5 2024-09-11T11:01:24.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94118232678864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd36f80 con 0x55999bd2fb00 2024-09-11T11:01:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4368cb640 1 -- 172.21.15.145:0/3642648823 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94118232678864] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc420037040 con 0x55999bd2fb00 2024-09-11T11:01:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4395bc980 20 remove_watcher() i=6 2024-09-11T11:01:24.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.512+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94118232687184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55999bd5e690 con 0x7fc4280b4bc0 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94118232687184] v32'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4300083f0 con 0x7fc4280b4bc0 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 20 remove_watcher() i=7 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bd2aaa0 msgr2=0x55999bd2ce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bd2aaa0 0x55999bd2ce90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bd265f0 msgr2=0x55999bd28ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bd265f0 0x55999bd28ab0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc4280b4bc0 msgr2=0x7fc4280ac0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc4280b4bc0 0x7fc4280ac0d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55999bd2fb00 msgr2=0x55999bd31ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55999bd2fb00 0x55999bd31ef0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc300034650 msgr2=0x7fc300036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc300034650 0x7fc300036b10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc42000c010 tx=0x7fc420010000 comp rx=0 tx=0).stop 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 msgr2=0x55999bd1b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4378cd640 1 -- 172.21.15.145:0/3642648823 reap_dead start 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd1b540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc4280ec620 tx=0x7fc4280c2f50 comp rx=0 tx=0).stop 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 shutdown_connections 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/3642648823 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bd14310 0x55999bd1b540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 >> 172.21.15.145:0/3642648823 conn(0x55999bd106f0 msgr2=0x55999bd0e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 shutdown_connections 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/3642648823 wait complete. 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/2070919336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc310034650 msgr2=0x7fc310036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/2070919336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc310034650 0x7fc310036b10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x55999bcec210 tx=0x7fc42000f000 comp rx=0 tx=0).stop 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/2070919336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bbf5d30 msgr2=0x55999bbf43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/2070919336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bbf5d30 0x55999bbf43b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc4280e50c0 tx=0x7fc4280a9f70 comp rx=0 tx=0).stop 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/2070919336 shutdown_connections 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/2070919336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc310034650 0x7fc310036b10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/2070919336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bbf5d30 0x55999bbf43b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/2070919336 >> 172.21.15.145:0/2070919336 conn(0x55999bcfaa90 msgr2=0x55999bcfd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/2070919336 shutdown_connections 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/2070919336 wait complete. 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bceffc0 msgr2=0x55999bcf23b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55999bceffc0 0x55999bcf23b0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bbf88f0 msgr2=0x55999bceebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55999bbf88f0 0x55999bceebb0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55999bcf5650 msgr2=0x55999bcf7a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55999bcf5650 0x55999bcf7a40 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc31c034650 msgr2=0x7fc31c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc31c034650 0x7fc31c036b10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc420000f70 tx=0x7fc420001380 comp rx=0 tx=0).stop 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 msgr2=0x55999bce7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 --2- 172.21.15.145:0/1385890645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55999bb6a2a0 0x55999bce7c20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc428005cc0 tx=0x7fc428017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4378cd640 1 -- 172.21.15.145:0/1385890645 reap_dead start 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 shutdown_connections 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 >> 172.21.15.145:0/1385890645 conn(0x55999bbf00a0 msgr2=0x55999bcdb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 shutdown_connections 2024-09-11T11:01:24.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.516+0000 7fc4395bc980 1 -- 172.21.15.145:0/1385890645 wait complete. 2024-09-11T11:01:24.528 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'QoO0Z6YHyPdjDmawJaMsEVnSYe0XqKrXi74wefwu', 'active': True, 'create_date': '2024-09-11T11:01:24.500198Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:24.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-11T11:01:24.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-11T11:01:24.528 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-11T11:01:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:24.606 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:24.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7fabac05a980 1 Processor -- start 2024-09-11T11:01:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7fabac05a980 1 -- start start 2024-09-11T11:01:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7fabac05a980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5557d20a5230 0x5557d2133340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7fabac05a980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5557d1fb8ae0 con 0x5557d2133880 2024-09-11T11:01:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7fabac05a980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5557d1fdce30 con 0x5557d20a5230 2024-09-11T11:01:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7faba9b6a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5557d20a5230 0x5557d2133340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7faba9369640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x5557d2133880 0x5557d2135c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48686/0 (socket says 172.21.15.145:48686) 2024-09-11T11:01:24.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7faba9369640 1 -- 172.21.15.145:0/4123106036 learned_addr learned my addr 172.21.15.145:0/4123106036 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7faba9b6a640 1 -- 172.21.15.145:0/4123106036 >> v1:172.21.15.102:6789/0 conn(0x5557d2133880 legacy=0x5557d2135c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.604+0000 7faba9b6a640 1 -- 172.21.15.145:0/4123106036 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d20a57c0 con 0x5557d20a5230 2024-09-11T11:01:24.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7faba9b6a640 1 --2- 172.21.15.145:0/4123106036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d2133340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00a420 tx=0x7fab9c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769204defeb89cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7faba8b68640 1 -- 172.21.15.145:0/4123106036 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0af070 con 0x5557d20a5230 2024-09-11T11:01:24.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7faba8b68640 1 -- 172.21.15.145:0/4123106036 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c0aa530 con 0x5557d20a5230 2024-09-11T11:01:24.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7faba8b68640 1 -- 172.21.15.145:0/4123106036 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0aa850 con 0x5557d20a5230 2024-09-11T11:01:24.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7fabac05a980 1 -- 172.21.15.145:0/4123106036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 msgr2=0x5557d2133340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7fabac05a980 1 --2- 172.21.15.145:0/4123106036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d2133340 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00a420 tx=0x7fab9c01afd0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7fabac05a980 1 -- 172.21.15.145:0/4123106036 shutdown_connections 2024-09-11T11:01:24.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7fabac05a980 1 --2- 172.21.15.145:0/4123106036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d2133340 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7fabac05a980 1 -- 172.21.15.145:0/4123106036 >> 172.21.15.145:0/4123106036 conn(0x5557d212b030 msgr2=0x5557d212d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7fabac05a980 1 -- 172.21.15.145:0/4123106036 shutdown_connections 2024-09-11T11:01:24.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.608+0000 7fabac05a980 1 -- 172.21.15.145:0/4123106036 wait complete. 2024-09-11T11:01:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.620+0000 7fabac05a980 1 Processor -- start 2024-09-11T11:01:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.620+0000 7fabac05a980 1 -- start start 2024-09-11T11:01:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.620+0000 7fabac05a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d221ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.620+0000 7fabac05a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d1fde200 con 0x5557d20a5230 2024-09-11T11:01:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d221ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d221ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48938/0 (socket says 172.21.15.145:48938) 2024-09-11T11:01:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 -- 172.21.15.145:0/1522141581 learned_addr learned my addr 172.21.15.145:0/1522141581 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 -- 172.21.15.145:0/1522141581 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d221c000 con 0x5557d20a5230 2024-09-11T11:01:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 --2- 172.21.15.145:0/1522141581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d221ba30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00a420 tx=0x7fab9c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b134bebd375524 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faa97e07640 1 -- 172.21.15.145:0/1522141581 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0af050 con 0x5557d20a5230 2024-09-11T11:01:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faa97e07640 1 -- 172.21.15.145:0/1522141581 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c0b0040 con 0x5557d20a5230 2024-09-11T11:01:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faa97e07640 1 -- 172.21.15.145:0/1522141581 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0aac60 con 0x5557d20a5230 2024-09-11T11:01:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 -- 172.21.15.145:0/1522141581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 msgr2=0x5557d221ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 --2- 172.21.15.145:0/1522141581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d221ba30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00a420 tx=0x7fab9c0033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 -- 172.21.15.145:0/1522141581 shutdown_connections 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 --2- 172.21.15.145:0/1522141581 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d221ba30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 -- 172.21.15.145:0/1522141581 >> 172.21.15.145:0/1522141581 conn(0x5557d212b030 msgr2=0x5557d2217660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 -- 172.21.15.145:0/1522141581 shutdown_connections 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 -- 172.21.15.145:0/1522141581 wait complete. 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 Processor -- start 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 -- start start 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d2130c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7fabac05a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d2137ea0 con 0x5557d20a5230 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d2130c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d2130c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48952/0 (socket says 172.21.15.145:48952) 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 -- 172.21.15.145:0/1811684903 learned_addr learned my addr 172.21.15.145:0/1811684903 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 -- 172.21.15.145:0/1811684903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d2131160 con 0x5557d20a5230 2024-09-11T11:01:24.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.624+0000 7faba9b6a640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d2130c20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fab9c01b870 tx=0x7fab9c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faa96604640 1 -- 172.21.15.145:0/1811684903 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0c5020 con 0x5557d20a5230 2024-09-11T11:01:24.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557d212f340 con 0x5557d20a5230 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faa96604640 1 -- 172.21.15.145:0/1811684903 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c0b6cb0 con 0x5557d20a5230 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faa96604640 1 -- 172.21.15.145:0/1811684903 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0c1480 con 0x5557d20a5230 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d212f890 con 0x5557d20a5230 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faa96604640 1 -- 172.21.15.145:0/1811684903 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab9c0c8070 con 0x5557d20a5230 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faa96604640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa90034650 0x7faa90036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faa96604640 1 -- 172.21.15.145:0/1811684903 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fab9c0bb070 con 0x5557d20a5230 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faba9369640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa90034650 0x7faa90036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabac05a980 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2133880 0x5557d222c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d222c640 con 0x5557d2133880 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabaa36b640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2133880 0x5557d222c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faba9369640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa90034650 0x7faa90036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab94000f70 tx=0x7fab940012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabaa36b640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2133880 0x5557d222c100 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabaa36b640 1 -- 172.21.15.145:0/1811684903 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2133880 2024-09-11T11:01:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabac05a980 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d222d3a0 0x5557d222f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d222fd60 con 0x5557d222d3a0 2024-09-11T11:01:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faba9b6a640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d222d3a0 0x5557d222f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.628+0000 7faba9b6a640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d222d3a0 0x5557d222f790 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9b6a640 1 -- 172.21.15.145:0/1811684903 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab9c0c7030 con 0x5557d222d3a0 2024-09-11T11:01:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2231610 con 0x5557d222d3a0 2024-09-11T11:01:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9b6a640 1 -- 172.21.15.145:0/1811684903 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fab9c0c7030 con 0x5557d222d3a0 2024-09-11T11:01:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2230780 con 0x5557d222d3a0 2024-09-11T11:01:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9b6a640 1 -- 172.21.15.145:0/1811684903 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab9c0c7030 con 0x5557d222d3a0 2024-09-11T11:01:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7fabac05a980 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d22329c0 0x5557d2234db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d22352f0 con 0x5557d22329c0 2024-09-11T11:01:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9369640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d22329c0 0x5557d2234db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9369640 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d22329c0 0x5557d2234db0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9369640 1 -- 172.21.15.145:0/1811684903 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fab9400e620 con 0x5557d22329c0 2024-09-11T11:01:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7fabac05a980 1 Processor -- start 2024-09-11T11:01:24.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7fabac05a980 1 -- start start 2024-09-11T11:01:24.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7fabac05a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d2242ca0 0x5557d22430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7fabac05a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d2037800 con 0x5557d2242ca0 2024-09-11T11:01:24.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d2242ca0 0x5557d22430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d2242ca0 0x5557d22430c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48964/0 (socket says 172.21.15.145:48964) 2024-09-11T11:01:24.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.632+0000 7faba9b6a640 1 -- 172.21.15.145:0/625216885 learned_addr learned my addr 172.21.15.145:0/625216885 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9b6a640 1 -- 172.21.15.145:0/625216885 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d2243600 con 0x5557d2242ca0 2024-09-11T11:01:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9b6a640 1 --2- 172.21.15.145:0/625216885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d2242ca0 0x5557d22430c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0e45e0 tx=0x7fab9c0a9de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faa8f7fe640 1 -- 172.21.15.145:0/625216885 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0052b0 con 0x5557d2242ca0 2024-09-11T11:01:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faa8f7fe640 1 -- 172.21.15.145:0/625216885 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c005450 con 0x5557d2242ca0 2024-09-11T11:01:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7fabac05a980 1 -- 172.21.15.145:0/625216885 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557d2243890 con 0x5557d2242ca0 2024-09-11T11:01:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faa8f7fe640 1 -- 172.21.15.145:0/625216885 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0c8aa0 con 0x5557d2242ca0 2024-09-11T11:01:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7fabac05a980 1 -- 172.21.15.145:0/625216885 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d2246510 con 0x5557d2242ca0 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faa8f7fe640 1 -- 172.21.15.145:0/625216885 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab9c0c8c40 con 0x5557d2242ca0 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faa8f7fe640 1 --2- 172.21.15.145:0/625216885 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa84034650 0x7faa84036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faa8f7fe640 1 -- 172.21.15.145:0/625216885 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fab9c0e5d00 con 0x5557d2242ca0 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9369640 1 --2- 172.21.15.145:0/625216885 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa84034650 0x7faa84036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7fabac05a980 1 Processor -- start 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7fabac05a980 1 -- start start 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9369640 1 --2- 172.21.15.145:0/625216885 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa84034650 0x7faa84036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab9400bf60 tx=0x7fab9400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7fabac05a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d224f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7fabac05a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d221c2c0 con 0x5557d224f5f0 2024-09-11T11:01:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d224f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d224f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48978/0 (socket says 172.21.15.145:48978) 2024-09-11T11:01:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9b6a640 1 -- 172.21.15.145:0/2263820199 learned_addr learned my addr 172.21.15.145:0/2263820199 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9b6a640 1 -- 172.21.15.145:0/2263820199 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d224ffa0 con 0x5557d224f5f0 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.636+0000 7faba9b6a640 1 --2- 172.21.15.145:0/2263820199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d224f9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b5c10 tx=0x7fab9c0b5640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55968cdcc7cced2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faa8d7fa640 1 -- 172.21.15.145:0/2263820199 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0dc1f0 con 0x5557d224f5f0 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faa8d7fa640 1 -- 172.21.15.145:0/2263820199 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c0e1460 con 0x5557d224f5f0 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faa8d7fa640 1 -- 172.21.15.145:0/2263820199 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0e69c0 con 0x5557d224f5f0 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- 172.21.15.145:0/2263820199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 msgr2=0x5557d224f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 --2- 172.21.15.145:0/2263820199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d224f9d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b5c10 tx=0x7fab9c0b5640 comp rx=0 tx=0).stop 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- 172.21.15.145:0/2263820199 shutdown_connections 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 --2- 172.21.15.145:0/2263820199 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d224f9d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- 172.21.15.145:0/2263820199 >> 172.21.15.145:0/2263820199 conn(0x5557d224b9d0 msgr2=0x5557d2249ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- 172.21.15.145:0/2263820199 shutdown_connections 2024-09-11T11:01:24.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- 172.21.15.145:0/2263820199 wait complete. 2024-09-11T11:01:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 Processor -- start 2024-09-11T11:01:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- start start 2024-09-11T11:01:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d22567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557d2250440 con 0x5557d224f5f0 2024-09-11T11:01:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d22567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faba9b6a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d22567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48984/0 (socket says 172.21.15.145:48984) 2024-09-11T11:01:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 learned_addr learned my addr 172.21.15.145:0/477801689 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557d2256d10 con 0x5557d224f5f0 2024-09-11T11:01:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faba9b6a640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d22567d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b4fb0 tx=0x7fab9c0e5fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faa7b7fe640 1 -- 172.21.15.145:0/477801689 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0c1620 con 0x5557d224f5f0 2024-09-11T11:01:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557d2256d10 con 0x5557d224f5f0 2024-09-11T11:01:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faa7b7fe640 1 -- 172.21.15.145:0/477801689 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab9c0c17c0 con 0x5557d224f5f0 2024-09-11T11:01:24.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faa7b7fe640 1 -- 172.21.15.145:0/477801689 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab9c0c1aa0 con 0x5557d224f5f0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557d2257180 con 0x5557d224f5f0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.640+0000 7faa7b7fe640 1 -- 172.21.15.145:0/477801689 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fab9c109030 con 0x5557d224f5f0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7faa7b7fe640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa74034650 0x7faa74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7faa7b7fe640 1 -- 172.21.15.145:0/477801689 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fab9c107070 con 0x5557d224f5f0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7faba9369640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa74034650 0x7faa74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2261920 0x5557d2263dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2264510 con 0x5557d2261920 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabaa36b640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2261920 0x5557d2263dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7faba9369640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa74034650 0x7faa74036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5557d212fb10 tx=0x7fab94010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabaa36b640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2261920 0x5557d2263dc0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 realm 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2260e10 con 0x5557d2261920 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2264fe0 con 0x5557d2261920 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d2265dc0 0x5557d22681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2268830 con 0x5557d2265dc0 2024-09-11T11:01:24.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7faba9b6a640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d2265dc0 0x5557d22681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7faba9b6a640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d2265dc0 0x5557d22681b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2269080 con 0x5557d2265dc0 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.644+0000 7fabac05a980 20 searching for the correct realm 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d226adf0 0x5557d226d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d226adf0 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9369640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d226adf0 0x5557d226d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9369640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d226adf0 0x5557d226d1e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9b6a640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fab9c0ca060 0x7fab9c0e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x7fab9c0ca060 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fab9c0ca060 0x7fab9c0e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fab9c0ca060 0x7fab9c0e6200 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d226adf0 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.648+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x7fab9c0ca060 2024-09-11T11:01:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x7fab9c0ca060 2024-09-11T11:01:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d226adf0 2024-09-11T11:01:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d226adf0 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d226adf0 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x7fab9c0ca060 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.652+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2261920 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x7fab9c0ca060 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d226adf0 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x7fab9c0ca060 2024-09-11T11:01:24.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d226adf0 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.656+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5557d226d860 con 0x5557d2265dc0 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2269a30 con 0x5557d2261920 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2269670 con 0x5557d2265dc0 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d226a350 con 0x7fab9c0ca060 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 zone default found 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 4 Realm: () 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:24.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 zonegroup default 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2269f50 con 0x7fab9c0ca060 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d22700a0 con 0x5557d226adf0 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2270440 con 0x5557d226adf0 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 started sync module instance, tier type = 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.660+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d226f530 con 0x5557d2265dc0 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93835676285520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d226f530 con 0x5557d2265dc0 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2270ea0 con 0x5557d2261920 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93835676289520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2271740 con 0x5557d2261920 2024-09-11T11:01:24.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2272180 con 0x5557d2265dc0 2024-09-11T11:01:24.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93835676289520] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93835676285520] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93835676294224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2271290 con 0x5557d2265dc0 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.664+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2272a20 con 0x7fab9c0ca060 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93835676296560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2271290 con 0x7fab9c0ca060 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d22734e0 con 0x5557d2265dc0 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93835676296560] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93835676294224] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93835676283008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d22734a0 con 0x5557d2265dc0 2024-09-11T11:01:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d22738d0 con 0x5557d226adf0 2024-09-11T11:01:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93835676297616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2274170 con 0x5557d226adf0 2024-09-11T11:01:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.668+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2274b30 con 0x5557d226adf0 2024-09-11T11:01:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93835676283008] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93835676297616] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93835676305024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2274f20 con 0x5557d226adf0 2024-09-11T11:01:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d22757d0 con 0x7fab9c0ca060 2024-09-11T11:01:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93835676307232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2275340 con 0x7fab9c0ca060 2024-09-11T11:01:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 20 add_watcher() i=0 2024-09-11T11:01:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 20 add_watcher() i=1 2024-09-11T11:01:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 20 add_watcher() i=2 2024-09-11T11:01:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 20 add_watcher() i=3 2024-09-11T11:01:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 20 add_watcher() i=4 2024-09-11T11:01:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 20 add_watcher() i=5 2024-09-11T11:01:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93835676305024] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 20 add_watcher() i=6 2024-09-11T11:01:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93835676307232] v32'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 20 add_watcher() i=7 2024-09-11T11:01:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d2272fb0 con 0x5557d2261920 2024-09-11T11:01:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.672+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93835676310384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2272fb0 con 0x5557d2261920 2024-09-11T11:01:24.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93835676310384] v32'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7faa5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:24.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 5 note: GC not initialized 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7faa5a7fc640 20 reqs_thread_entry: start 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 20 Filter name: none 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fa9cbfff640 20 reqs_thread_entry: start 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d229c3c0 con 0x5557d2261920 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 20 rados_obj.operate() r=0 bl.length=556 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d22a2af0 con 0x5557d2261920 2024-09-11T11:01:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.676+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93835676493152 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5557d229e1e0 con 0x5557d2265dc0 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 93835676283008 notify 137438953481 ret 0) ==== 774+0+0 (crc 0 0 0) 0x5557d2243890 con 0x5557d2265dc0 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faa8d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 93835676283008 notifier 4374 bl.length()=732 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faa8d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faa8d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faa8d7fa640 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7faa6c003eb0 con 0x5557d2265dc0 2024-09-11T11:01:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 93835676493152 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 93835676493152 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5557d2243600 con 0x5557d2265dc0 2024-09-11T11:01:24.683 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:24.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7faa5b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93835676310384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d229dd30 con 0x5557d2261920 2024-09-11T11:01:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.680+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93835676310384] v32'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.684+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93835676285520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d229e1e0 con 0x5557d2265dc0 2024-09-11T11:01:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.684+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93835676285520] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.684+0000 7fabac05a980 20 remove_watcher() i=0 2024-09-11T11:01:24.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.684+0000 7fabac05a980 2 removed watcher, disabling cache 2024-09-11T11:01:24.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.684+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93835676289520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d229e1e0 con 0x5557d2261920 2024-09-11T11:01:24.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.684+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93835676289520] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x5557d2261920 2024-09-11T11:01:24.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.684+0000 7fabac05a980 20 remove_watcher() i=1 2024-09-11T11:01:24.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.684+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93835676294224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d229e1e0 con 0x5557d2265dc0 2024-09-11T11:01:24.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93835676294224] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7fabac05a980 20 remove_watcher() i=2 2024-09-11T11:01:24.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93835676296560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d229e1e0 con 0x7fab9c0ca060 2024-09-11T11:01:24.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93835676296560] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7fabac05a980 20 remove_watcher() i=3 2024-09-11T11:01:24.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93835676283008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d229e1e0 con 0x5557d2265dc0 2024-09-11T11:01:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7faba9b6a640 1 -- 172.21.15.145:0/477801689 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93835676283008] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9c0eb070 con 0x5557d2265dc0 2024-09-11T11:01:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7fabac05a980 20 remove_watcher() i=4 2024-09-11T11:01:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.688+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93835676297616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d229e1e0 con 0x5557d226adf0 2024-09-11T11:01:24.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93835676297616] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 20 remove_watcher() i=5 2024-09-11T11:01:24.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93835676305024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d2272a20 con 0x5557d226adf0 2024-09-11T11:01:24.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7faba9369640 1 -- 172.21.15.145:0/477801689 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93835676305024] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fab9400e620 con 0x5557d226adf0 2024-09-11T11:01:24.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 20 remove_watcher() i=6 2024-09-11T11:01:24.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93835676307232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5557d229e1e0 con 0x7fab9c0ca060 2024-09-11T11:01:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93835676307232] v32'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faba40083f0 con 0x7fab9c0ca060 2024-09-11T11:01:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 20 remove_watcher() i=7 2024-09-11T11:01:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d2265dc0 msgr2=0x5557d22681b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d2265dc0 0x5557d22681b0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2261920 msgr2=0x5557d2263dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2261920 0x5557d2263dc0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fab9c0ca060 msgr2=0x7fab9c0e6200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fab9c0ca060 0x7fab9c0e6200 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d226adf0 msgr2=0x5557d226d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557d226adf0 0x5557d226d1e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa74034650 msgr2=0x7faa74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa74034650 0x7faa74036b10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x5557d212fb10 tx=0x7fab94010000 comp rx=0 tx=0).stop 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 msgr2=0x5557d22567d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/477801689 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d224f5f0 0x5557d22567d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b4fb0 tx=0x7fab9c0e5fa0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 reap_dead start 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabaa36b640 1 -- 172.21.15.145:0/477801689 reap_dead start 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 shutdown_connections 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 >> 172.21.15.145:0/477801689 conn(0x5557d224b9d0 msgr2=0x5557d2249aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 shutdown_connections 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/477801689 wait complete. 2024-09-11T11:01:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/625216885 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa84034650 msgr2=0x7faa84036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/625216885 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa84034650 0x7faa84036b10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fab9400bf60 tx=0x7fab9400f000 comp rx=0 tx=0).stop 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/625216885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d2242ca0 msgr2=0x5557d22430c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/625216885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d2242ca0 0x5557d22430c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0e45e0 tx=0x7fab9c0a9de0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/625216885 shutdown_connections 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/625216885 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa84034650 0x7faa84036b10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/625216885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d2242ca0 0x5557d22430c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/625216885 >> 172.21.15.145:0/625216885 conn(0x5557d2237df0 msgr2=0x5557d223a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/625216885 shutdown_connections 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/625216885 wait complete. 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d222d3a0 msgr2=0x5557d222f790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557d222d3a0 0x5557d222f790 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2133880 msgr2=0x5557d222c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557d2133880 0x5557d222c100 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d22329c0 msgr2=0x5557d2234db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557d22329c0 0x5557d2234db0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa90034650 msgr2=0x7faa90036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.692+0000 7fabac05a980 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7faa90034650 0x7faa90036b10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fab94000f70 tx=0x7fab940012c0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.696+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 msgr2=0x5557d2130c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.696+0000 7fabac05a980 1 --2- 172.21.15.145:0/1811684903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557d20a5230 0x5557d2130c20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fab9c01b870 tx=0x7fab9c019810 comp rx=0 tx=0).stop 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.696+0000 7fabaa36b640 1 -- 172.21.15.145:0/1811684903 reap_dead start 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.696+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 shutdown_connections 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.696+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 >> 172.21.15.145:0/1811684903 conn(0x5557d212b030 msgr2=0x5557d22161e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.696+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 shutdown_connections 2024-09-11T11:01:24.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.696+0000 7fabac05a980 1 -- 172.21.15.145:0/1811684903 wait complete. 2024-09-11T11:01:24.706 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:24.706 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:01:24.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:01:24.706 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:01:24.782 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:24.782 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:24.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d429f980 1 Processor -- start 2024-09-11T11:01:24.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d429f980 1 -- start start 2024-09-11T11:01:24.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d429f980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556b6d82ba80 0x556b6d82de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d429f980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b6d6afae0 con 0x556b6d79c2d0 2024-09-11T11:01:24.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d429f980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x556b6d6d3e30 con 0x556b6d82ba80 2024-09-11T11:01:24.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d15ae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556b6d82ba80 0x556b6d82de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d1daf640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x556b6d79c2d0 0x556b6d82a360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48696/0 (socket says 172.21.15.145:48696) 2024-09-11T11:01:24.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d1daf640 1 -- 172.21.15.145:0/189878392 learned_addr learned my addr 172.21.15.145:0/189878392 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:24.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d15ae640 1 -- 172.21.15.145:0/189878392 >> v1:172.21.15.102:6789/0 conn(0x556b6d79c2d0 legacy=0x556b6d82a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.780+0000 7f44d15ae640 1 -- 172.21.15.145:0/189878392 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6d82f3c0 con 0x556b6d82ba80 2024-09-11T11:01:24.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d15ae640 1 --2- 172.21.15.145:0/189878392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d82ba80 0x556b6d82de70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00a480 tx=0x7f44bc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f94808396b0b9ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d0dad640 1 -- 172.21.15.145:0/189878392 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0b0070 con 0x556b6d82ba80 2024-09-11T11:01:24.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d0dad640 1 -- 172.21.15.145:0/189878392 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44bc0ab540 con 0x556b6d82ba80 2024-09-11T11:01:24.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d0dad640 1 -- 172.21.15.145:0/189878392 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44bc0ab840 con 0x556b6d82ba80 2024-09-11T11:01:24.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d429f980 1 -- 172.21.15.145:0/189878392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d82ba80 msgr2=0x556b6d82de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d429f980 1 --2- 172.21.15.145:0/189878392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d82ba80 0x556b6d82de70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00a480 tx=0x7f44bc01b280 comp rx=0 tx=0).stop 2024-09-11T11:01:24.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d429f980 1 -- 172.21.15.145:0/189878392 shutdown_connections 2024-09-11T11:01:24.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d429f980 1 --2- 172.21.15.145:0/189878392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d82ba80 0x556b6d82de70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d429f980 1 -- 172.21.15.145:0/189878392 >> 172.21.15.145:0/189878392 conn(0x556b6d822090 msgr2=0x556b6d8244b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d429f980 1 -- 172.21.15.145:0/189878392 shutdown_connections 2024-09-11T11:01:24.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.784+0000 7f44d429f980 1 -- 172.21.15.145:0/189878392 wait complete. 2024-09-11T11:01:24.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 Processor -- start 2024-09-11T11:01:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- start start 2024-09-11T11:01:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d912a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556b6d6d5200 con 0x556b6d79c2d0 2024-09-11T11:01:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d912a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d912a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:48996/0 (socket says 172.21.15.145:48996) 2024-09-11T11:01:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d1daf640 1 -- 172.21.15.145:0/67437187 learned_addr learned my addr 172.21.15.145:0/67437187 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d1daf640 1 -- 172.21.15.145:0/67437187 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6d913040 con 0x556b6d79c2d0 2024-09-11T11:01:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d1daf640 1 --2- 172.21.15.145:0/67437187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d912a70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44c4001d90 tx=0x7f44c4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac47749c5d94da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f43bfe07640 1 -- 172.21.15.145:0/67437187 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4013030 con 0x556b6d79c2d0 2024-09-11T11:01:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f43bfe07640 1 -- 172.21.15.145:0/67437187 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c400e690 con 0x556b6d79c2d0 2024-09-11T11:01:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f43bfe07640 1 -- 172.21.15.145:0/67437187 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c400ea10 con 0x556b6d79c2d0 2024-09-11T11:01:24.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- 172.21.15.145:0/67437187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 msgr2=0x556b6d912a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 --2- 172.21.15.145:0/67437187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d912a70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f44c4001d90 tx=0x7f44c4001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:24.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- 172.21.15.145:0/67437187 shutdown_connections 2024-09-11T11:01:24.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 --2- 172.21.15.145:0/67437187 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d912a70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- 172.21.15.145:0/67437187 >> 172.21.15.145:0/67437187 conn(0x556b6d822090 msgr2=0x556b6d90e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- 172.21.15.145:0/67437187 shutdown_connections 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- 172.21.15.145:0/67437187 wait complete. 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 Processor -- start 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- start start 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d919da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d429f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556b6d82ee30 con 0x556b6d79c2d0 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d919da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d919da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49008/0 (socket says 172.21.15.145:49008) 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.800+0000 7f44d1daf640 1 -- 172.21.15.145:0/4079899103 learned_addr learned my addr 172.21.15.145:0/4079899103 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d1daf640 1 -- 172.21.15.145:0/4079899103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6d91a2e0 con 0x556b6d79c2d0 2024-09-11T11:01:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d1daf640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d919da0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x556b6d913c50 tx=0x7f44c4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f43be604640 1 -- 172.21.15.145:0/4079899103 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4027070 con 0x556b6d79c2d0 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f43be604640 1 -- 172.21.15.145:0/4079899103 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4019900 con 0x556b6d79c2d0 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b6d91a570 con 0x556b6d79c2d0 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f43be604640 1 -- 172.21.15.145:0/4079899103 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4019c20 con 0x556b6d79c2d0 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6d91d250 con 0x556b6d79c2d0 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f43be604640 1 -- 172.21.15.145:0/4079899103 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f44c402a070 con 0x556b6d79c2d0 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f43be604640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43b80346a0 0x7f43b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f43be604640 1 -- 172.21.15.145:0/4079899103 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f44c401f070 con 0x556b6d79c2d0 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d15ae640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43b80346a0 0x7f43b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d429f980 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d82ba80 0x556b6d920d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d921390 con 0x556b6d82ba80 2024-09-11T11:01:24.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d25b0640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d82ba80 0x556b6d920d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d15ae640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43b80346a0 0x7f43b8036b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0ad000 tx=0x7f44bc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d25b0640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d82ba80 0x556b6d920d50 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d25b0640 1 -- 172.21.15.145:0/4079899103 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d82ba80 2024-09-11T11:01:24.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d429f980 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d922160 0x556b6d924550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d924b90 con 0x556b6d922160 2024-09-11T11:01:24.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.804+0000 7f44d1daf640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d922160 0x556b6d924550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d1daf640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d922160 0x556b6d924550 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d1daf640 1 -- 172.21.15.145:0/4079899103 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f44c4029030 con 0x556b6d922160 2024-09-11T11:01:24.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d926440 con 0x556b6d922160 2024-09-11T11:01:24.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d1daf640 1 -- 172.21.15.145:0/4079899103 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f44c4029030 con 0x556b6d922160 2024-09-11T11:01:24.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9255b0 con 0x556b6d922160 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d1daf640 1 -- 172.21.15.145:0/4079899103 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f44c4029030 con 0x556b6d922160 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d429f980 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556b6d926020 0x556b6d929860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d929ff0 con 0x556b6d926020 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d15ae640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556b6d926020 0x556b6d929860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d15ae640 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556b6d926020 0x556b6d929860 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d15ae640 1 -- 172.21.15.145:0/4079899103 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f44bc0abd10 con 0x556b6d926020 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d429f980 1 Processor -- start 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d429f980 1 -- start start 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d429f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d937ac0 0x556b6d937ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.808+0000 7f44d429f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556b6d72e800 con 0x556b6d937ac0 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d937ac0 0x556b6d937ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d937ac0 0x556b6d937ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49014/0 (socket says 172.21.15.145:49014) 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 -- 172.21.15.145:0/3224278009 learned_addr learned my addr 172.21.15.145:0/3224278009 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 -- 172.21.15.145:0/3224278009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6d938420 con 0x556b6d937ac0 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 --2- 172.21.15.145:0/3224278009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d937ac0 0x556b6d937ee0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44c4048400 tx=0x7f44c4041e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f43b77fe640 1 -- 172.21.15.145:0/3224278009 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4032c70 con 0x556b6d937ac0 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f43b77fe640 1 -- 172.21.15.145:0/3224278009 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4032e10 con 0x556b6d937ac0 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d429f980 1 -- 172.21.15.145:0/3224278009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b6d9386b0 con 0x556b6d937ac0 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f43b77fe640 1 -- 172.21.15.145:0/3224278009 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c40412a0 con 0x556b6d937ac0 2024-09-11T11:01:24.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d429f980 1 -- 172.21.15.145:0/3224278009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6d93b330 con 0x556b6d937ac0 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f43b77fe640 1 -- 172.21.15.145:0/3224278009 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f44c4016070 con 0x556b6d937ac0 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f43b77fe640 1 --2- 172.21.15.145:0/3224278009 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43ac034650 0x7f43ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f43b77fe640 1 -- 172.21.15.145:0/3224278009 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f44c4044040 con 0x556b6d937ac0 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d15ae640 1 --2- 172.21.15.145:0/3224278009 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43ac034650 0x7f43ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d429f980 1 Processor -- start 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d429f980 1 -- start start 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d429f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d827930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d429f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556b6d9133c0 con 0x556b6d827550 2024-09-11T11:01:24.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d15ae640 1 --2- 172.21.15.145:0/3224278009 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43ac034650 0x7f43ac036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x556b6d91e390 tx=0x7f44bc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d827930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d827930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49030/0 (socket says 172.21.15.145:49030) 2024-09-11T11:01:24.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 -- 172.21.15.145:0/1175893311 learned_addr learned my addr 172.21.15.145:0/1175893311 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.812+0000 7f44d1daf640 1 -- 172.21.15.145:0/1175893311 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6d827f00 con 0x556b6d827550 2024-09-11T11:01:24.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d1daf640 1 --2- 172.21.15.145:0/1175893311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d827930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44c4019640 tx=0x7f44c40225f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b7c6cccfdbd045 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f43b57fa640 1 -- 172.21.15.145:0/1175893311 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4063070 con 0x556b6d827550 2024-09-11T11:01:24.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f43b57fa640 1 -- 172.21.15.145:0/1175893311 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c402aaa0 con 0x556b6d827550 2024-09-11T11:01:24.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f43b57fa640 1 -- 172.21.15.145:0/1175893311 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c402a580 con 0x556b6d827550 2024-09-11T11:01:24.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- 172.21.15.145:0/1175893311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 msgr2=0x556b6d827930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 --2- 172.21.15.145:0/1175893311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d827930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44c4019640 tx=0x7f44c40225f0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- 172.21.15.145:0/1175893311 shutdown_connections 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 --2- 172.21.15.145:0/1175893311 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d827930 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- 172.21.15.145:0/1175893311 >> 172.21.15.145:0/1175893311 conn(0x556b6d940890 msgr2=0x556b6d93e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- 172.21.15.145:0/1175893311 shutdown_connections 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- 172.21.15.145:0/1175893311 wait complete. 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 Processor -- start 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- start start 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d94d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556b6d826140 con 0x556b6d827550 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d94d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d1daf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d94d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49046/0 (socket says 172.21.15.145:49046) 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 learned_addr learned my addr 172.21.15.145:0/1746936858 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b6d94dd80 con 0x556b6d827550 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d1daf640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d94d840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44c4018b70 tx=0x7f44c403de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f43a37fe640 1 -- 172.21.15.145:0/1746936858 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c406e020 con 0x556b6d827550 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b6d94dd80 con 0x556b6d827550 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f43a37fe640 1 -- 172.21.15.145:0/1746936858 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44c4064040 con 0x556b6d827550 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f43a37fe640 1 -- 172.21.15.145:0/1746936858 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44c4063070 con 0x556b6d827550 2024-09-11T11:01:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b6d94e1f0 con 0x556b6d827550 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.816+0000 7f43a37fe640 1 -- 172.21.15.145:0/1746936858 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f44c4071020 con 0x556b6d827550 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f43a37fe640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f439c034600 0x7f439c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f43a37fe640 1 -- 172.21.15.145:0/1746936858 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f44c4014070 con 0x556b6d827550 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d15ae640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f439c034600 0x7f439c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d958960 0x556b6d95ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95b570 con 0x556b6d958960 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d25b0640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d958960 0x556b6d95ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d15ae640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f439c034600 0x7f439c036ac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0c2010 tx=0x7f44bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d25b0640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d958960 0x556b6d95ae20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 realm 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d957e10 con 0x556b6d958960 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95c030 con 0x556b6d958960 2024-09-11T11:01:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d95ce10 0x556b6d95f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d1daf640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d95ce10 0x556b6d95f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d1daf640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d95ce10 0x556b6d95f200 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d960100 con 0x556b6d95ce10 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 20 searching for the correct realm 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556b6d961950 0x556b6d963e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9644e0 con 0x556b6d961950 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.820+0000 7f44d15ae640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556b6d961950 0x556b6d963e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d15ae640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556b6d961950 0x556b6d963e10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9644e0 con 0x556b6d95ce10 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d1daf640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f44c4073020 0x7f44c406e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x7f44c4073020 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f44c4073020 0x7f44c406e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f44c4073020 0x7f44c406e1c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d961950 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.824+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x7f44c4073020 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x7f44c4073020 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d961950 2024-09-11T11:01:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d961950 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d961950 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.828+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x7f44c4073020 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d958960 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x7f44c4073020 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d961950 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x7f44c4073020 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d961950 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556b6d95f860 con 0x556b6d95ce10 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d960230 con 0x556b6d958960 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.832+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d960620 con 0x556b6d95ce10 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d960620 con 0x7f44c4073020 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 zone default found 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 4 Realm: () 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 zonegroup default 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d964960 con 0x7f44c4073020 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9666e0 con 0x556b6d961950 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d966a80 con 0x556b6d961950 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 started sync module instance, tier type = 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:24.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d965b80 con 0x556b6d95ce10 2024-09-11T11:01:24.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93919888433312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d965b80 con 0x556b6d95ce10 2024-09-11T11:01:24.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.836+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d967480 con 0x556b6d958960 2024-09-11T11:01:24.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93919888437136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9673b0 con 0x556b6d958960 2024-09-11T11:01:24.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d968340 con 0x556b6d95ce10 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93919888437136] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93919888433312] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93919888430800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d967e90 con 0x556b6d95ce10 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d968c10 con 0x7f44c4073020 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93919888443232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d967e90 con 0x7f44c4073020 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.840+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9696b0 con 0x556b6d95ce10 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93919888430800] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93919888443232] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93919888444288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d969670 con 0x556b6d95ce10 2024-09-11T11:01:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d969aa0 con 0x556b6d961950 2024-09-11T11:01:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93919888439408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96a340 con 0x556b6d961950 2024-09-11T11:01:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96ad00 con 0x556b6d961950 2024-09-11T11:01:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93919888444288] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93919888439408] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93919888451664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96b0f0 con 0x556b6d961950 2024-09-11T11:01:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.844+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96b940 con 0x7f44c4073020 2024-09-11T11:01:24.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93919888451664] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93919888454800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96b8b0 con 0x7f44c4073020 2024-09-11T11:01:24.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 add_watcher() i=0 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 add_watcher() i=1 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 add_watcher() i=2 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 add_watcher() i=3 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 add_watcher() i=4 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 add_watcher() i=5 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 add_watcher() i=6 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93919888454800] v32'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 add_watcher() i=7 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96f210 con 0x556b6d958960 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93919888456928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96c700 con 0x556b6d958960 2024-09-11T11:01:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93919888456928] v32'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f43837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.848+0000 7f44d429f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d429f980 5 note: GC not initialized 2024-09-11T11:01:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f43827fc640 20 reqs_thread_entry: start 2024-09-11T11:01:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d429f980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d429f980 20 Filter name: none 2024-09-11T11:01:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f42f3fff640 20 reqs_thread_entry: start 2024-09-11T11:01:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d429f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9923c0 con 0x556b6d958960 2024-09-11T11:01:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d429f980 20 rados_obj.operate() r=0 bl.length=556 2024-09-11T11:01:24.856 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f43837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93919888456928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d990f70 con 0x556b6d958960 2024-09-11T11:01:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93919888456928] v32'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.852+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93919888433312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96bce0 con 0x556b6d95ce10 2024-09-11T11:01:24.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.856+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93919888433312] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.856+0000 7f44d429f980 20 remove_watcher() i=0 2024-09-11T11:01:24.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.856+0000 7f44d429f980 2 removed watcher, disabling cache 2024-09-11T11:01:24.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.856+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93919888437136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9660a0 con 0x556b6d958960 2024-09-11T11:01:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.856+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93919888437136] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x556b6d958960 2024-09-11T11:01:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.856+0000 7f44d429f980 20 remove_watcher() i=1 2024-09-11T11:01:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.856+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93919888430800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9660a0 con 0x556b6d95ce10 2024-09-11T11:01:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93919888430800] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d429f980 20 remove_watcher() i=2 2024-09-11T11:01:24.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93919888443232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9656d0 con 0x7f44c4073020 2024-09-11T11:01:24.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93919888443232] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d429f980 20 remove_watcher() i=3 2024-09-11T11:01:24.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93919888444288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d968760 con 0x556b6d95ce10 2024-09-11T11:01:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d1daf640 1 -- 172.21.15.145:0/1746936858 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93919888444288] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44c405c070 con 0x556b6d95ce10 2024-09-11T11:01:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d429f980 20 remove_watcher() i=4 2024-09-11T11:01:24.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.860+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93919888439408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9656d0 con 0x556b6d961950 2024-09-11T11:01:24.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93919888439408] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 20 remove_watcher() i=5 2024-09-11T11:01:24.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93919888451664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d9656d0 con 0x556b6d961950 2024-09-11T11:01:24.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d15ae640 1 -- 172.21.15.145:0/1746936858 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93919888451664] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44bc0d9070 con 0x556b6d961950 2024-09-11T11:01:24.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 20 remove_watcher() i=6 2024-09-11T11:01:24.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93919888454800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556b6d96a850 con 0x7f44c4073020 2024-09-11T11:01:24.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93919888454800] v32'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f44cc00a4d0 con 0x7f44c4073020 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 20 remove_watcher() i=7 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d95ce10 msgr2=0x556b6d95f200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d95ce10 0x556b6d95f200 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d958960 msgr2=0x556b6d95ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d958960 0x556b6d95ae20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f44c4073020 msgr2=0x7f44c406e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f44c4073020 0x7f44c406e1c0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556b6d961950 msgr2=0x556b6d963e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556b6d961950 0x556b6d963e10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f439c034600 msgr2=0x7f439c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f439c034600 0x7f439c036ac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0c2010 tx=0x7f44bc0a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 msgr2=0x556b6d94d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/1746936858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d827550 0x556b6d94d840 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f44c4018b70 tx=0x7f44c403de90 comp rx=0 tx=0).stop 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 reap_dead start 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d25b0640 1 -- 172.21.15.145:0/1746936858 reap_dead start 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 shutdown_connections 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 >> 172.21.15.145:0/1746936858 conn(0x556b6d940890 msgr2=0x556b6d93e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 shutdown_connections 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/1746936858 wait complete. 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/3224278009 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43ac034650 msgr2=0x7f43ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/3224278009 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43ac034650 0x7f43ac036b10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x556b6d91e390 tx=0x7f44bc005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/3224278009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d937ac0 msgr2=0x556b6d937ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/3224278009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d937ac0 0x556b6d937ee0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f44c4048400 tx=0x7f44c4041e30 comp rx=0 tx=0).stop 2024-09-11T11:01:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/3224278009 shutdown_connections 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/3224278009 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43ac034650 0x7f43ac036b10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/3224278009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d937ac0 0x556b6d937ee0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/3224278009 >> 172.21.15.145:0/3224278009 conn(0x556b6d92cc10 msgr2=0x556b6d92f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/3224278009 shutdown_connections 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/3224278009 wait complete. 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d922160 msgr2=0x556b6d924550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556b6d922160 0x556b6d924550 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d82ba80 msgr2=0x556b6d920d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556b6d82ba80 0x556b6d920d50 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556b6d926020 msgr2=0x556b6d929860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556b6d926020 0x556b6d929860 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43b80346a0 msgr2=0x7f43b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f43b80346a0 0x7f43b8036b60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f44bc0ad000 tx=0x7f44bc0a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 msgr2=0x556b6d919da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 --2- 172.21.15.145:0/4079899103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556b6d79c2d0 0x556b6d919da0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x556b6d913c50 tx=0x7f44c4000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d25b0640 1 -- 172.21.15.145:0/4079899103 reap_dead start 2024-09-11T11:01:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 shutdown_connections 2024-09-11T11:01:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 >> 172.21.15.145:0/4079899103 conn(0x556b6d822090 msgr2=0x556b6d90d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 shutdown_connections 2024-09-11T11:01:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.864+0000 7f44d429f980 1 -- 172.21.15.145:0/4079899103 wait complete. 2024-09-11T11:01:24.878 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:24.878 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:01:24.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:01:24.878 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:01:24.953 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:24.953 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:24.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd19b83980 1 Processor -- start 2024-09-11T11:01:24.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd19b83980 1 -- start start 2024-09-11T11:01:24.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd19b83980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x563b06bddac0 0x563b06bdfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd19b83980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563b06a61ae0 con 0x563b06b4e290 2024-09-11T11:01:24.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd19b83980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x563b06a85e30 con 0x563b06bddac0 2024-09-11T11:01:24.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd16e92640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x563b06bddac0 0x563b06bdfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd17693640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x563b06b4e290 0x563b06bdc3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48706/0 (socket says 172.21.15.145:48706) 2024-09-11T11:01:24.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd17693640 1 -- 172.21.15.145:0/1744994858 learned_addr learned my addr 172.21.15.145:0/1744994858 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:24.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd16e92640 1 -- 172.21.15.145:0/1744994858 >> v1:172.21.15.102:6789/0 conn(0x563b06b4e290 legacy=0x563b06bdc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.952+0000 7fbd16e92640 1 -- 172.21.15.145:0/1744994858 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b06b4e820 con 0x563b06bddac0 2024-09-11T11:01:24.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd16e92640 1 --2- 172.21.15.145:0/1744994858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06bddac0 0x563b06bdfeb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000a420 tx=0x7fbd0001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4114fa368c57c40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd16691640 1 -- 172.21.15.145:0/1744994858 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd000af070 con 0x563b06bddac0 2024-09-11T11:01:24.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd16691640 1 -- 172.21.15.145:0/1744994858 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd000aa530 con 0x563b06bddac0 2024-09-11T11:01:24.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd16691640 1 -- 172.21.15.145:0/1744994858 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd000aa850 con 0x563b06bddac0 2024-09-11T11:01:24.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd19b83980 1 -- 172.21.15.145:0/1744994858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06bddac0 msgr2=0x563b06bdfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1744994858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06bddac0 0x563b06bdfeb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000a420 tx=0x7fbd0001afd0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd19b83980 1 -- 172.21.15.145:0/1744994858 shutdown_connections 2024-09-11T11:01:24.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1744994858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06bddac0 0x563b06bdfeb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd19b83980 1 -- 172.21.15.145:0/1744994858 >> 172.21.15.145:0/1744994858 conn(0x563b06bd4090 msgr2=0x563b06bd64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd19b83980 1 -- 172.21.15.145:0/1744994858 shutdown_connections 2024-09-11T11:01:24.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.956+0000 7fbd19b83980 1 -- 172.21.15.145:0/1744994858 wait complete. 2024-09-11T11:01:24.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.968+0000 7fbd19b83980 1 Processor -- start 2024-09-11T11:01:24.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.968+0000 7fbd19b83980 1 -- start start 2024-09-11T11:01:24.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.968+0000 7fbd19b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06cc4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.968+0000 7fbd19b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563b06a87200 con 0x563b06b4e290 2024-09-11T11:01:24.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.968+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06cc4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.968+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06cc4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49062/0 (socket says 172.21.15.145:49062) 2024-09-11T11:01:24.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.968+0000 7fbd17693640 1 -- 172.21.15.145:0/1376430277 learned_addr learned my addr 172.21.15.145:0/1376430277 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd17693640 1 -- 172.21.15.145:0/1376430277 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b06cc5130 con 0x563b06b4e290 2024-09-11T11:01:24.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd17693640 1 --2- 172.21.15.145:0/1376430277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06cc4b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd08001d90 tx=0x7fbd08001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fd769e86f80b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbc0560a640 1 -- 172.21.15.145:0/1376430277 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd08013030 con 0x563b06b4e290 2024-09-11T11:01:24.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbc0560a640 1 -- 172.21.15.145:0/1376430277 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0800e690 con 0x563b06b4e290 2024-09-11T11:01:24.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbc0560a640 1 -- 172.21.15.145:0/1376430277 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd0800ea10 con 0x563b06b4e290 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- 172.21.15.145:0/1376430277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 msgr2=0x563b06cc4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1376430277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06cc4b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd08001d90 tx=0x7fbd08001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- 172.21.15.145:0/1376430277 shutdown_connections 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1376430277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06cc4b60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- 172.21.15.145:0/1376430277 >> 172.21.15.145:0/1376430277 conn(0x563b06bd4090 msgr2=0x563b06cc06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- 172.21.15.145:0/1376430277 shutdown_connections 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- 172.21.15.145:0/1376430277 wait complete. 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 Processor -- start 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- start start 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06ccbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563b06be0f00 con 0x563b06b4e290 2024-09-11T11:01:24.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06ccbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06ccbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49068/0 (socket says 172.21.15.145:49068) 2024-09-11T11:01:24.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd17693640 1 -- 172.21.15.145:0/1283130071 learned_addr learned my addr 172.21.15.145:0/1283130071 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd17693640 1 -- 172.21.15.145:0/1283130071 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b06ccc3f0 con 0x563b06b4e290 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd17693640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06ccbeb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x563b06cc5d40 tx=0x7fbd08000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbc03e07640 1 -- 172.21.15.145:0/1283130071 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd08027070 con 0x563b06b4e290 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbc03e07640 1 -- 172.21.15.145:0/1283130071 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd08019900 con 0x563b06b4e290 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b06ccc680 con 0x563b06b4e290 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbc03e07640 1 -- 172.21.15.145:0/1283130071 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd08019c20 con 0x563b06b4e290 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.972+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b06ccf360 con 0x563b06b4e290 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbc03e07640 1 -- 172.21.15.145:0/1283130071 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbd0802a070 con 0x563b06b4e290 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbc03e07640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbfc0346a0 0x7fbbfc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbc03e07640 1 -- 172.21.15.145:0/1283130071 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fbd0801f070 con 0x563b06b4e290 2024-09-11T11:01:24.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd16e92640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbfc0346a0 0x7fbbfc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06cd0e30 0x563b06cd3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06cd38a0 con 0x563b06cd0e30 2024-09-11T11:01:24.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd17e94640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06cd0e30 0x563b06cd3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd16e92640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbfc0346a0 0x7fbbfc036b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd000ac000 tx=0x7fbd000a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd17e94640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06cd0e30 0x563b06cd3260 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd17e94640 1 -- 172.21.15.145:0/1283130071 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06cd0e30 2024-09-11T11:01:24.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06cd4690 0x563b06cd6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06cd70c0 con 0x563b06cd4690 2024-09-11T11:01:24.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd17693640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06cd4690 0x563b06cd6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd17693640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06cd4690 0x563b06cd6a80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd17693640 1 -- 172.21.15.145:0/1283130071 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd08029030 con 0x563b06cd4690 2024-09-11T11:01:24.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.976+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06cd8970 con 0x563b06cd4690 2024-09-11T11:01:24.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd17693640 1 -- 172.21.15.145:0/1283130071 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbd08029030 con 0x563b06cd4690 2024-09-11T11:01:24.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06cd7ba0 con 0x563b06cd4690 2024-09-11T11:01:24.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd17693640 1 -- 172.21.15.145:0/1283130071 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd08029030 con 0x563b06cd4690 2024-09-11T11:01:24.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563b06cd9d20 0x563b06cdc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06cdc650 con 0x563b06cd9d20 2024-09-11T11:01:24.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd16e92640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563b06cd9d20 0x563b06cdc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd16e92640 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563b06cd9d20 0x563b06cdc110 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd16e92640 1 -- 172.21.15.145:0/1283130071 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbd000b2070 con 0x563b06cd9d20 2024-09-11T11:01:24.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd19b83980 1 Processor -- start 2024-09-11T11:01:24.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd19b83980 1 -- start start 2024-09-11T11:01:24.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd19b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cea100 0x563b06cea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd19b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563b06ae0800 con 0x563b06cea100 2024-09-11T11:01:24.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cea100 0x563b06cea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cea100 0x563b06cea520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49078/0 (socket says 172.21.15.145:49078) 2024-09-11T11:01:24.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.980+0000 7fbd17693640 1 -- 172.21.15.145:0/439976923 learned_addr learned my addr 172.21.15.145:0/439976923 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd17693640 1 -- 172.21.15.145:0/439976923 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b06ceaa60 con 0x563b06cea100 2024-09-11T11:01:24.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd17693640 1 --2- 172.21.15.145:0/439976923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cea100 0x563b06cea520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd08048490 tx=0x7fbd0800c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbc01602640 1 -- 172.21.15.145:0/439976923 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd0802a790 con 0x563b06cea100 2024-09-11T11:01:24.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd19b83980 1 -- 172.21.15.145:0/439976923 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b06ceacf0 con 0x563b06cea100 2024-09-11T11:01:24.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbc01602640 1 -- 172.21.15.145:0/439976923 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0802a930 con 0x563b06cea100 2024-09-11T11:01:24.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbc01602640 1 -- 172.21.15.145:0/439976923 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd0802ac10 con 0x563b06cea100 2024-09-11T11:01:24.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd19b83980 1 -- 172.21.15.145:0/439976923 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b06ced970 con 0x563b06cea100 2024-09-11T11:01:24.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbc01602640 1 -- 172.21.15.145:0/439976923 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbd08016070 con 0x563b06cea100 2024-09-11T11:01:24.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbc01602640 1 --2- 172.21.15.145:0/439976923 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbf0034650 0x7fbbf0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbc01602640 1 -- 172.21.15.145:0/439976923 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fbd08014070 con 0x563b06cea100 2024-09-11T11:01:24.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd16e92640 1 --2- 172.21.15.145:0/439976923 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbf0034650 0x7fbbf0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd19b83980 1 Processor -- start 2024-09-11T11:01:24.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd19b83980 1 -- start start 2024-09-11T11:01:24.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd19b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cf6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd19b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563b06cc54b0 con 0x563b06cf6a30 2024-09-11T11:01:24.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd16e92640 1 --2- 172.21.15.145:0/439976923 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbf0034650 0x7fbbf0036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd08001400 tx=0x7fbd00005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cf6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cf6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49090/0 (socket says 172.21.15.145:49090) 2024-09-11T11:01:24.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd17693640 1 -- 172.21.15.145:0/1849727365 learned_addr learned my addr 172.21.15.145:0/1849727365 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd17693640 1 -- 172.21.15.145:0/1849727365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b06cf73e0 con 0x563b06cf6a30 2024-09-11T11:01:24.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.984+0000 7fbd17693640 1 --2- 172.21.15.145:0/1849727365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cf6e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd080214c0 tx=0x7fbd08047190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6df73a974ca9864 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbfaffd640 1 -- 172.21.15.145:0/1849727365 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd08041630 con 0x563b06cf6a30 2024-09-11T11:01:24.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbfaffd640 1 -- 172.21.15.145:0/1849727365 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd08063070 con 0x563b06cf6a30 2024-09-11T11:01:24.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbfaffd640 1 -- 172.21.15.145:0/1849727365 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd080417d0 con 0x563b06cf6a30 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- 172.21.15.145:0/1849727365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 msgr2=0x563b06cf6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1849727365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cf6e10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbd080214c0 tx=0x7fbd08047190 comp rx=0 tx=0).stop 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- 172.21.15.145:0/1849727365 shutdown_connections 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1849727365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cf6e10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- 172.21.15.145:0/1849727365 >> 172.21.15.145:0/1849727365 conn(0x563b06cf2e10 msgr2=0x563b06cf0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- 172.21.15.145:0/1849727365 shutdown_connections 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- 172.21.15.145:0/1849727365 wait complete. 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 Processor -- start 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- start start 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cfdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563b06cf7880 con 0x563b06cf6a30 2024-09-11T11:01:24.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cfdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd17693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cfdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49102/0 (socket says 172.21.15.145:49102) 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 learned_addr learned my addr 172.21.15.145:0/2346306673 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b06cfe150 con 0x563b06cf6a30 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd17693640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cfdc10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd080214c0 tx=0x7fbd0803bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbf97fa640 1 -- 172.21.15.145:0/2346306673 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd0802ba30 con 0x563b06cf6a30 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbf97fa640 1 -- 172.21.15.145:0/2346306673 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd0802bbd0 con 0x563b06cf6a30 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b06cfe150 con 0x563b06cf6a30 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbf97fa640 1 -- 172.21.15.145:0/2346306673 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd08021780 con 0x563b06cf6a30 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b06cfe150 con 0x563b06cf6a30 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbf97fa640 1 -- 172.21.15.145:0/2346306673 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbd0805c030 con 0x563b06cf6a30 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbf97fa640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbe0034650 0x7fbbe0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbbf97fa640 1 -- 172.21.15.145:0/2346306673 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fbd08005050 con 0x563b06cf6a30 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd16e92640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbe0034650 0x7fbbe0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06d08cf0 0x563b06d0b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.988+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0b8c0 con 0x563b06d08cf0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17e94640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06d08cf0 0x563b06d0b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd16e92640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbe0034650 0x7fbbe0036b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x563b06cdca30 tx=0x7fbd000a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17e94640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06d08cf0 0x563b06d0b170 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 realm 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d081e0 con 0x563b06d08cf0 2024-09-11T11:01:24.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0c380 con 0x563b06d08cf0 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06d0d160 0x563b06d0f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:24.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17693640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06d0d160 0x563b06d0f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17693640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06d0d160 0x563b06d0f550 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d10450 con 0x563b06d0d160 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 20 searching for the correct realm 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563b06d11c80 0x563b06d14140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d14810 con 0x563b06d11c80 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd16e92640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563b06d11c80 0x563b06d14140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.992+0000 7fbd16e92640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563b06d11c80 0x563b06d14140 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d14810 con 0x563b06d0d160 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17693640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbd0802c060 0x7fbd080467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x7fbd0802c060 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbd0802c060 0x7fbd080467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbd0802c060 0x7fbd080467a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d11c80 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:24.996+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x7fbd0802c060 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x7fbd0802c060 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d11c80 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d11c80 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d11c80 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x7fbd0802c060 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d08cf0 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.000+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x7fbd0802c060 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d11c80 2024-09-11T11:01:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x7fbd0802c060 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d11c80 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x563b06d0fbb0 con 0x563b06d0d160 2024-09-11T11:01:25.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d10580 con 0x563b06d08cf0 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.004+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d10970 con 0x563b06d0d160 2024-09-11T11:01:25.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d10970 con 0x7fbd0802c060 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 zone default found 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 4 Realm: () 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:25.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 zonegroup default 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d14c90 con 0x7fbd0802c060 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d16a10 con 0x563b06d11c80 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d16db0 con 0x563b06d11c80 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 started sync module instance, tier type = 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d15eb0 con 0x563b06d0d160 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94811517445120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d15eb0 con 0x563b06d0d160 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.008+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d177b0 con 0x563b06d08cf0 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.012+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.012+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94811517448896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d17b90 con 0x563b06d08cf0 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.012+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d18690 con 0x563b06d0d160 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.012+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94811517445120] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.012+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94811517448896] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94811517452672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d176e0 con 0x563b06d0d160 2024-09-11T11:01:25.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d18f60 con 0x7fbd0802c060 2024-09-11T11:01:25.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94811517455024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d176e0 con 0x7fbd0802c060 2024-09-11T11:01:25.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d199e0 con 0x563b06d0d160 2024-09-11T11:01:25.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94811517452672] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94811517455024] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94811517456080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d194f0 con 0x563b06d0d160 2024-09-11T11:01:25.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.016+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1a280 con 0x563b06d11c80 2024-09-11T11:01:25.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94811517459920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d194f0 con 0x563b06d11c80 2024-09-11T11:01:25.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1af80 con 0x563b06d11c80 2024-09-11T11:01:25.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94811517456080] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94811517459920] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94811517462048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1b3a0 con 0x563b06d11c80 2024-09-11T11:01:25.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1bbf0 con 0x7fbd0802c060 2024-09-11T11:01:25.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94811517462048] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94811517466432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1c010 con 0x7fbd0802c060 2024-09-11T11:01:25.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 20 add_watcher() i=0 2024-09-11T11:01:25.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 20 add_watcher() i=1 2024-09-11T11:01:25.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 20 add_watcher() i=2 2024-09-11T11:01:25.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 20 add_watcher() i=3 2024-09-11T11:01:25.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 20 add_watcher() i=4 2024-09-11T11:01:25.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 20 add_watcher() i=5 2024-09-11T11:01:25.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 20 add_watcher() i=6 2024-09-11T11:01:25.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94811517466432] v32'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 20 add_watcher() i=7 2024-09-11T11:01:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.020+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1f2d0 con 0x563b06d08cf0 2024-09-11T11:01:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94811517467856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1c5a0 con 0x563b06d08cf0 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94811517467856] v32'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbbcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 5 note: GC not initialized 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbbccfe1640 20 reqs_thread_entry: start 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 20 Filter name: none 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbb467fc640 20 reqs_thread_entry: start 2024-09-11T11:01:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x563b06d42510 con 0x563b06d08cf0 2024-09-11T11:01:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 20 rados_obj.operate() r=0 bl.length=556 2024-09-11T11:01:25.029 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbbcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.024+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94811517467856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d410c0 con 0x563b06d08cf0 2024-09-11T11:01:25.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.028+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94811517467856] v32'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.028+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94811517445120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1bcd0 con 0x563b06d0d160 2024-09-11T11:01:25.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.028+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94811517445120] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.028+0000 7fbd19b83980 20 remove_watcher() i=0 2024-09-11T11:01:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.028+0000 7fbd19b83980 2 removed watcher, disabling cache 2024-09-11T11:01:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.028+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94811517448896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1bcd0 con 0x563b06d08cf0 2024-09-11T11:01:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94811517448896] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x563b06d08cf0 2024-09-11T11:01:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd19b83980 20 remove_watcher() i=1 2024-09-11T11:01:25.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94811517452672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d172c0 con 0x563b06d0d160 2024-09-11T11:01:25.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94811517452672] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd19b83980 20 remove_watcher() i=2 2024-09-11T11:01:25.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94811517455024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1bcd0 con 0x7fbd0802c060 2024-09-11T11:01:25.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94811517455024] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd19b83980 20 remove_watcher() i=3 2024-09-11T11:01:25.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.032+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94811517456080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d172c0 con 0x563b06d0d160 2024-09-11T11:01:25.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd17693640 1 -- 172.21.15.145:0/2346306673 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94811517456080] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd08078020 con 0x563b06d0d160 2024-09-11T11:01:25.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd19b83980 20 remove_watcher() i=4 2024-09-11T11:01:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94811517459920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d1bcd0 con 0x563b06d11c80 2024-09-11T11:01:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94811517459920] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd19b83980 20 remove_watcher() i=5 2024-09-11T11:01:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94811517462048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d172c0 con 0x563b06d11c80 2024-09-11T11:01:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd16e92640 1 -- 172.21.15.145:0/2346306673 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94811517462048] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd000c9070 con 0x563b06d11c80 2024-09-11T11:01:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd19b83980 20 remove_watcher() i=6 2024-09-11T11:01:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.036+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94811517466432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x563b06d18f60 con 0x7fbd0802c060 2024-09-11T11:01:25.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94811517466432] v32'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd100083f0 con 0x7fbd0802c060 2024-09-11T11:01:25.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 20 remove_watcher() i=7 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06d0d160 msgr2=0x563b06d0f550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06d0d160 0x563b06d0f550 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06d08cf0 msgr2=0x563b06d0b170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06d08cf0 0x563b06d0b170 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbd0802c060 msgr2=0x7fbd080467a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbd0802c060 0x7fbd080467a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563b06d11c80 msgr2=0x563b06d14140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563b06d11c80 0x563b06d14140 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbe0034650 msgr2=0x7fbbe0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbe0034650 0x7fbbe0036b10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x563b06cdca30 tx=0x7fbd000a7000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 msgr2=0x563b06cfdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd17e94640 1 -- 172.21.15.145:0/2346306673 reap_dead start 2024-09-11T11:01:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cfdc10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbd080214c0 tx=0x7fbd0803bf90 comp rx=0 tx=0).stop 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 shutdown_connections 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/2346306673 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cf6a30 0x563b06cfdc10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 >> 172.21.15.145:0/2346306673 conn(0x563b06cf2e10 msgr2=0x563b06cf0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 shutdown_connections 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/2346306673 wait complete. 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/439976923 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbf0034650 msgr2=0x7fbbf0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/439976923 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbf0034650 0x7fbbf0036b10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd08001400 tx=0x7fbd00005d90 comp rx=0 tx=0).stop 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/439976923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cea100 msgr2=0x563b06cea520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/439976923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cea100 0x563b06cea520 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd08048490 tx=0x7fbd0800c370 comp rx=0 tx=0).stop 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/439976923 shutdown_connections 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/439976923 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbf0034650 0x7fbbf0036b10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/439976923 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06cea100 0x563b06cea520 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/439976923 >> 172.21.15.145:0/439976923 conn(0x563b06cdf250 msgr2=0x563b06ce1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/439976923 shutdown_connections 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/439976923 wait complete. 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06cd4690 msgr2=0x563b06cd6a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563b06cd4690 0x563b06cd6a80 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06cd0e30 msgr2=0x563b06cd3260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563b06cd0e30 0x563b06cd3260 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563b06cd9d20 msgr2=0x563b06cdc110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563b06cd9d20 0x563b06cdc110 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbfc0346a0 msgr2=0x7fbbfc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbbfc0346a0 0x7fbbfc036b60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbd000ac000 tx=0x7fbd000a5000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 msgr2=0x563b06ccbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 --2- 172.21.15.145:0/1283130071 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563b06b4e290 0x563b06ccbeb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x563b06cc5d40 tx=0x7fbd08000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd17e94640 1 -- 172.21.15.145:0/1283130071 reap_dead start 2024-09-11T11:01:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 shutdown_connections 2024-09-11T11:01:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 >> 172.21.15.145:0/1283130071 conn(0x563b06bd4090 msgr2=0x563b06cbf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 shutdown_connections 2024-09-11T11:01:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.040+0000 7fbd19b83980 1 -- 172.21.15.145:0/1283130071 wait complete. 2024-09-11T11:01:25.051 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:25.051 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-11T11:01:25.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-11T11:01:25.052 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-11T11:01:25.131 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:25.131 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:25.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f6348e6d980 1 Processor -- start 2024-09-11T11:01:25.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f6348e6d980 1 -- start start 2024-09-11T11:01:25.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f6348e6d980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8f1d9de30 0x55f8f1da0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f6348e6d980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8f1c1fae0 con 0x55f8f1d0ba60 2024-09-11T11:01:25.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f6348e6d980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55f8f1c43e30 con 0x55f8f1d9de30 2024-09-11T11:01:25.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f634617c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8f1d9de30 0x55f8f1da0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f634617c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8f1d9de30 0x55f8f1da0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49106/0 (socket says 172.21.15.145:49106) 2024-09-11T11:01:25.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f634617c640 1 -- 172.21.15.145:0/1787524529 learned_addr learned my addr 172.21.15.145:0/1787524529 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f634697d640 1 --1- 172.21.15.145:0/1787524529 >> v1:172.21.15.102:6789/0 conn(0x55f8f1d0ba60 0x55f8f1d9c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48714/0 (socket says 172.21.15.145:48714) 2024-09-11T11:01:25.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f634617c640 1 -- 172.21.15.145:0/1787524529 >> v1:172.21.15.102:6789/0 conn(0x55f8f1d0ba60 legacy=0x55f8f1d9c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.128+0000 7f634617c640 1 -- 172.21.15.145:0/1787524529 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f1d0be40 con 0x55f8f1d9de30 2024-09-11T11:01:25.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f634617c640 1 --2- 172.21.15.145:0/1787524529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d9de30 0x55f8f1da0220 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f633c00a5c0 tx=0x7f633c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd92fa1182b41d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f634597b640 1 -- 172.21.15.145:0/1787524529 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f633c0a6070 con 0x55f8f1d9de30 2024-09-11T11:01:25.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f634597b640 1 -- 172.21.15.145:0/1787524529 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c0af070 con 0x55f8f1d9de30 2024-09-11T11:01:25.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f634597b640 1 -- 172.21.15.145:0/1787524529 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f633c0aa5c0 con 0x55f8f1d9de30 2024-09-11T11:01:25.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f6348e6d980 1 -- 172.21.15.145:0/1787524529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d9de30 msgr2=0x55f8f1da0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1787524529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d9de30 0x55f8f1da0220 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f633c00a5c0 tx=0x7f633c01b340 comp rx=0 tx=0).stop 2024-09-11T11:01:25.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f6348e6d980 1 -- 172.21.15.145:0/1787524529 shutdown_connections 2024-09-11T11:01:25.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1787524529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d9de30 0x55f8f1da0220 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f6348e6d980 1 -- 172.21.15.145:0/1787524529 >> 172.21.15.145:0/1787524529 conn(0x55f8f1d92000 msgr2=0x55f8f1d94420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f6348e6d980 1 -- 172.21.15.145:0/1787524529 shutdown_connections 2024-09-11T11:01:25.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.132+0000 7f6348e6d980 1 -- 172.21.15.145:0/1787524529 wait complete. 2024-09-11T11:01:25.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 Processor -- start 2024-09-11T11:01:25.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- start start 2024-09-11T11:01:25.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e84c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8f1c45200 con 0x55f8f1d0ba60 2024-09-11T11:01:25.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e84c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e84c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49110/0 (socket says 172.21.15.145:49110) 2024-09-11T11:01:25.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f634697d640 1 -- 172.21.15.145:0/237333009 learned_addr learned my addr 172.21.15.145:0/237333009 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f634697d640 1 -- 172.21.15.145:0/237333009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f1e85250 con 0x55f8f1d0ba60 2024-09-11T11:01:25.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f634697d640 1 --2- 172.21.15.145:0/237333009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e84c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63400015f0 tx=0x7f6340001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3171cdd10738276e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6234e09640 1 -- 172.21.15.145:0/237333009 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6340013420 con 0x55f8f1d0ba60 2024-09-11T11:01:25.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6234e09640 1 -- 172.21.15.145:0/237333009 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63400135e0 con 0x55f8f1d0ba60 2024-09-11T11:01:25.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6234e09640 1 -- 172.21.15.145:0/237333009 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6340013940 con 0x55f8f1d0ba60 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- 172.21.15.145:0/237333009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 msgr2=0x55f8f1e84c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 --2- 172.21.15.145:0/237333009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e84c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63400015f0 tx=0x7f6340001ab0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- 172.21.15.145:0/237333009 shutdown_connections 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 --2- 172.21.15.145:0/237333009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e84c80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- 172.21.15.145:0/237333009 >> 172.21.15.145:0/237333009 conn(0x55f8f1d92000 msgr2=0x55f8f1e808b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- 172.21.15.145:0/237333009 shutdown_connections 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- 172.21.15.145:0/237333009 wait complete. 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 Processor -- start 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- start start 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e8c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f6348e6d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8f1da31f0 con 0x55f8f1d0ba60 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e8c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49120/0 (socket says 172.21.15.145:49120) 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.148+0000 7f634697d640 1 -- 172.21.15.145:0/476206816 learned_addr learned my addr 172.21.15.145:0/476206816 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f634697d640 1 -- 172.21.15.145:0/476206816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f1e8c5d0 con 0x55f8f1d0ba60 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f634697d640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e8c090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6340006640 tx=0x7f6340000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6233606640 1 -- 172.21.15.145:0/476206816 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6340022020 con 0x55f8f1d0ba60 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8f1e8c860 con 0x55f8f1d0ba60 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f1e8f540 con 0x55f8f1d0ba60 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6233606640 1 -- 172.21.15.145:0/476206816 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6340006320 con 0x55f8f1d0ba60 2024-09-11T11:01:25.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6233606640 1 -- 172.21.15.145:0/476206816 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6340004ab0 con 0x55f8f1d0ba60 2024-09-11T11:01:25.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6233606640 1 -- 172.21.15.145:0/476206816 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6340025020 con 0x55f8f1d0ba60 2024-09-11T11:01:25.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6233606640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f622c0346a0 0x7f622c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6233606640 1 -- 172.21.15.145:0/476206816 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6340018030 con 0x55f8f1d0ba60 2024-09-11T11:01:25.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f634617c640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f622c0346a0 0x7f622c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6348e6d980 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1d9de30 0x55f8f1e93080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1e936c0 con 0x55f8f1d9de30 2024-09-11T11:01:25.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f634717e640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1d9de30 0x55f8f1e93080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f634617c640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f622c0346a0 0x7f622c036b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f633c0ae000 tx=0x7f633c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f634717e640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1d9de30 0x55f8f1e93080 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f634717e640 1 -- 172.21.15.145:0/476206816 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1d9de30 2024-09-11T11:01:25.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6348e6d980 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1e944b0 0x55f8f1e968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1e96ed0 con 0x55f8f1e944b0 2024-09-11T11:01:25.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.152+0000 7f634697d640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1e944b0 0x55f8f1e968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634697d640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1e944b0 0x55f8f1e968a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634697d640 1 -- 172.21.15.145:0/476206816 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1e944b0 2024-09-11T11:01:25.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1e98780 con 0x55f8f1e944b0 2024-09-11T11:01:25.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634697d640 1 -- 172.21.15.145:0/476206816 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1e944b0 2024-09-11T11:01:25.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1e979b0 con 0x55f8f1e944b0 2024-09-11T11:01:25.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634697d640 1 -- 172.21.15.145:0/476206816 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1e944b0 2024-09-11T11:01:25.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f6348e6d980 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8f1e99b30 0x55f8f1e9bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1e9c460 con 0x55f8f1e99b30 2024-09-11T11:01:25.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634617c640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8f1e99b30 0x55f8f1e9bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634617c640 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8f1e99b30 0x55f8f1e9bf20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634617c640 1 -- 172.21.15.145:0/476206816 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1e99b30 2024-09-11T11:01:25.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f6348e6d980 1 Processor -- start 2024-09-11T11:01:25.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f6348e6d980 1 -- start start 2024-09-11T11:01:25.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f6348e6d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1ea9e60 0x55f8f1eaa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f6348e6d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8f1c9e800 con 0x55f8f1ea9e60 2024-09-11T11:01:25.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1ea9e60 0x55f8f1eaa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1ea9e60 0x55f8f1eaa280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49128/0 (socket says 172.21.15.145:49128) 2024-09-11T11:01:25.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.156+0000 7f634697d640 1 -- 172.21.15.145:0/218010332 learned_addr learned my addr 172.21.15.145:0/218010332 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f634697d640 1 -- 172.21.15.145:0/218010332 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f1eaa7c0 con 0x55f8f1ea9e60 2024-09-11T11:01:25.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f634697d640 1 --2- 172.21.15.145:0/218010332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1ea9e60 0x55f8f1eaa280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f63400480a0 tx=0x7f6340010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6230e01640 1 -- 172.21.15.145:0/218010332 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63400413e0 con 0x55f8f1ea9e60 2024-09-11T11:01:25.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6230e01640 1 -- 172.21.15.145:0/218010332 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6340049040 con 0x55f8f1ea9e60 2024-09-11T11:01:25.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6348e6d980 1 -- 172.21.15.145:0/218010332 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8f1eaaa50 con 0x55f8f1ea9e60 2024-09-11T11:01:25.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6230e01640 1 -- 172.21.15.145:0/218010332 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634001d890 con 0x55f8f1ea9e60 2024-09-11T11:01:25.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6348e6d980 1 -- 172.21.15.145:0/218010332 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f1ead6d0 con 0x55f8f1ea9e60 2024-09-11T11:01:25.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6230e01640 1 -- 172.21.15.145:0/218010332 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6340010070 con 0x55f8f1ea9e60 2024-09-11T11:01:25.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6230e01640 1 --2- 172.21.15.145:0/218010332 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f62200346a0 0x7f6220036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6230e01640 1 -- 172.21.15.145:0/218010332 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f634004b970 con 0x55f8f1ea9e60 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f634617c640 1 --2- 172.21.15.145:0/218010332 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f62200346a0 0x7f6220036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6348e6d980 1 Processor -- start 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6348e6d980 1 -- start start 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f634617c640 1 --2- 172.21.15.145:0/218010332 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f62200346a0 0x7f6220036b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f8f1e90680 tx=0x7f633c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6348e6d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1eb6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f6348e6d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8f1e855d0 con 0x55f8f1eb6750 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1eb6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1eb6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49134/0 (socket says 172.21.15.145:49134) 2024-09-11T11:01:25.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.160+0000 7f634697d640 1 -- 172.21.15.145:0/3525084793 learned_addr learned my addr 172.21.15.145:0/3525084793 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f634697d640 1 -- 172.21.15.145:0/3525084793 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f1eb7100 con 0x55f8f1eb6750 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f634697d640 1 --2- 172.21.15.145:0/3525084793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1eb6b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f634004b5f0 tx=0x7f6340012ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd7f4c136af3a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f622a7fc640 1 -- 172.21.15.145:0/3525084793 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634003b5d0 con 0x55f8f1eb6750 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f622a7fc640 1 -- 172.21.15.145:0/3525084793 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6340043e50 con 0x55f8f1eb6750 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f622a7fc640 1 -- 172.21.15.145:0/3525084793 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634001da30 con 0x55f8f1eb6750 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- 172.21.15.145:0/3525084793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 msgr2=0x55f8f1eb6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 --2- 172.21.15.145:0/3525084793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1eb6b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f634004b5f0 tx=0x7f6340012ab0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- 172.21.15.145:0/3525084793 shutdown_connections 2024-09-11T11:01:25.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 --2- 172.21.15.145:0/3525084793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1eb6b30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- 172.21.15.145:0/3525084793 >> 172.21.15.145:0/3525084793 conn(0x55f8f1eb2b30 msgr2=0x55f8f1eb0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- 172.21.15.145:0/3525084793 shutdown_connections 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- 172.21.15.145:0/3525084793 wait complete. 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 Processor -- start 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- start start 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1ebd970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8f1eb75a0 con 0x55f8f1eb6750 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1ebd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f634697d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1ebd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49148/0 (socket says 172.21.15.145:49148) 2024-09-11T11:01:25.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 learned_addr learned my addr 172.21.15.145:0/1004847266 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8f1ebdeb0 con 0x55f8f1eb6750 2024-09-11T11:01:25.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f634697d640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1ebd970 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f634001e7a0 tx=0x7f634004b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6228ff9640 1 -- 172.21.15.145:0/1004847266 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f634006c070 con 0x55f8f1eb6750 2024-09-11T11:01:25.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8f1ebdeb0 con 0x55f8f1eb6750 2024-09-11T11:01:25.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6228ff9640 1 -- 172.21.15.145:0/1004847266 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6340049710 con 0x55f8f1eb6750 2024-09-11T11:01:25.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6228ff9640 1 -- 172.21.15.145:0/1004847266 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63400491f0 con 0x55f8f1eb6750 2024-09-11T11:01:25.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.164+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8f1ebdeb0 con 0x55f8f1eb6750 2024-09-11T11:01:25.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6228ff9640 1 -- 172.21.15.145:0/1004847266 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6340065040 con 0x55f8f1eb6750 2024-09-11T11:01:25.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6228ff9640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6210034650 0x7f6210036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6228ff9640 1 -- 172.21.15.145:0/1004847266 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f63400080e0 con 0x55f8f1eb6750 2024-09-11T11:01:25.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634617c640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6210034650 0x7f6210036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1ec8ac0 0x55f8f1ecaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ecb6d0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634717e640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1ec8ac0 0x55f8f1ecaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634617c640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6210034650 0x7f6210036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c10 tx=0x7f633c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634717e640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1ec8ac0 0x55f8f1ecaf80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 realm 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ec7ef0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ecc190 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1eccf70 0x55f8f1ecf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ecfa10 con 0x55f8f1eccf70 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634697d640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1eccf70 0x55f8f1ecf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634697d640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1eccf70 0x55f8f1ecf360 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.168+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f6348e6d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f6348e6d980 20 searching for the correct realm 2024-09-11T11:01:25.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8f1ed1fd0 0x55f8f1ed43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed4a40 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634617c640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8f1ed1fd0 0x55f8f1ed43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634617c640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8f1ed1fd0 0x55f8f1ed43c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed4a40 con 0x55f8f1eccf70 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634697d640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6340068040 0x7f6340027400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x7f6340068040 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6340068040 0x7f6340027400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6340068040 0x7f6340027400 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.172+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x7f6340068040 2024-09-11T11:01:25.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x7f6340068040 2024-09-11T11:01:25.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.176+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x7f6340068040 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x7f6340068040 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x7f6340068040 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.180+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0260 con 0x55f8f1eccf70 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:25.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0ab0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0ea0 con 0x55f8f1eccf70 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed0ea0 con 0x7f6340068040 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:25.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 zone default found 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 4 Realm: () 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 zonegroup default 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed4ea0 con 0x7f6340068040 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed6c80 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed7110 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 started sync module instance, tier type = 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.184+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed60c0 con 0x55f8f1eccf70 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94527699117504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed60c0 con 0x55f8f1eccf70 2024-09-11T11:01:25.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed7bd0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94527699121888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed7b00 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed8af0 con 0x55f8f1eccf70 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94527699121888] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94527699117504] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94527699115024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed8ab0 con 0x55f8f1eccf70 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.188+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed9390 con 0x7f6340068040 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94527699128032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed8ab0 con 0x7f6340068040 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed9e10 con 0x55f8f1eccf70 2024-09-11T11:01:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94527699115024] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94527699128032] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94527699129088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed9920 con 0x55f8f1eccf70 2024-09-11T11:01:25.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1eda6b0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94527699132928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed9920 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.192+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1edb520 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94527699129088] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94527699125728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1edbd70 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1edc640 con 0x7f6340068040 2024-09-11T11:01:25.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94527699132928] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94527699125728] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94527699135056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1edbd70 con 0x7f6340068040 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 20 add_watcher() i=0 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 20 add_watcher() i=1 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 20 add_watcher() i=2 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 20 add_watcher() i=3 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 20 add_watcher() i=4 2024-09-11T11:01:25.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 20 add_watcher() i=5 2024-09-11T11:01:25.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 20 add_watcher() i=6 2024-09-11T11:01:25.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94527699135056] v32'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 20 add_watcher() i=7 2024-09-11T11:01:25.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:25.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1edbd70 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.196+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94527699138752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1edbd50 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94527699138752] v32'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f61fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 5 note: GC not initialized 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6177fff640 20 reqs_thread_entry: start 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 20 Filter name: none 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6175ffb640 20 reqs_thread_entry: start 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:25.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f02c70 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 20 rados_obj.operate() r=0 bl.length=556 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f03980 con 0x7f6340068040 2024-09-11T11:01:25.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f096e0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v32'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:25.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.200+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94527699325296 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f06270 con 0x55f8f1eccf70 2024-09-11T11:01:25.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94527699129088 notify 137438953482 ret 0) ==== 891+0+0 (crc 0 0 0) 0x55f8f1eaaa50 con 0x55f8f1eccf70 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f622a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 94527699129088 notifier 4395 bl.length()=849 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f622a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f622a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f622a7fc640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f620c003eb0 con 0x55f8f1eccf70 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(65 notify.4 [notify cookie 94527699325296 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94527699325296 notify 137438953482 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f8f1eaa7c0 con 0x55f8f1eccf70 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f09170 con 0x7f6340068040 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v32'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6348e6d980 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-11T11:01:25.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6348e6d980 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-11T11:01:25.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6348e6d980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-11T11:01:25.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94527699325296 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f03d50 con 0x55f8f1eccf70 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 94527699117504 notify 137438953483 ret 0) ==== 208+0+0 (crc 0 0 0) 0x55f8f1eaa7c0 con 0x55f8f1eccf70 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6229ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94527699117504 notifier 4395 bl.length()=166 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6229ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6229ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f6229ffb640 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f617c003410 con 0x55f8f1eccf70 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.204+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(68 notify.0 [notify cookie 94527699325296 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.208+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.208+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 94527699325296 notify 137438953483 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f8f1e8f540 con 0x55f8f1eccf70 2024-09-11T11:01:25.210 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-11T11:01:25.206338Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:25.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.208+0000 7f61fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.208+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94527699138752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f00a60 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.208+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94527699138752] v32'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.208+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94527699117504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f00a60 con 0x55f8f1eccf70 2024-09-11T11:01:25.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.212+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94527699117504] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.212+0000 7f6348e6d980 20 remove_watcher() i=0 2024-09-11T11:01:25.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.212+0000 7f6348e6d980 2 removed watcher, disabling cache 2024-09-11T11:01:25.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.212+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94527699121888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed65c0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.212+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94527699121888] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x55f8f1ec8ac0 2024-09-11T11:01:25.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.212+0000 7f6348e6d980 20 remove_watcher() i=1 2024-09-11T11:01:25.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.212+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94527699115024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f00a60 con 0x55f8f1eccf70 2024-09-11T11:01:25.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94527699115024] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f6348e6d980 20 remove_watcher() i=2 2024-09-11T11:01:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94527699128032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed76e0 con 0x7f6340068040 2024-09-11T11:01:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94527699128032] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f6348e6d980 20 remove_watcher() i=3 2024-09-11T11:01:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94527699129088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed65c0 con 0x55f8f1eccf70 2024-09-11T11:01:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f634697d640 1 -- 172.21.15.145:0/1004847266 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94527699129088] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f634001b070 con 0x55f8f1eccf70 2024-09-11T11:01:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f6348e6d980 20 remove_watcher() i=4 2024-09-11T11:01:25.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.216+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94527699132928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed5c10 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94527699132928] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 20 remove_watcher() i=5 2024-09-11T11:01:25.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94527699125728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1f00a60 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f634617c640 1 -- 172.21.15.145:0/1004847266 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94527699125728] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f633c0aaae0 con 0x55f8f1ed1fd0 2024-09-11T11:01:25.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 20 remove_watcher() i=6 2024-09-11T11:01:25.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94527699135056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8f1ed76e0 con 0x7f6340068040 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94527699135056] v32'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f63380083f0 con 0x7f6340068040 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 20 remove_watcher() i=7 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1eccf70 msgr2=0x55f8f1ecf360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1eccf70 0x55f8f1ecf360 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1ec8ac0 msgr2=0x55f8f1ecaf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1ec8ac0 0x55f8f1ecaf80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6340068040 msgr2=0x7f6340027400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6340068040 0x7f6340027400 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8f1ed1fd0 msgr2=0x55f8f1ed43c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8f1ed1fd0 0x55f8f1ed43c0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6210034650 msgr2=0x7f6210036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6210034650 0x7f6210036b10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c10 tx=0x7f633c0c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f634717e640 1 -- 172.21.15.145:0/1004847266 reap_dead start 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 msgr2=0x55f8f1ebd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1ebd970 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f634001e7a0 tx=0x7f634004b550 comp rx=0 tx=0).stop 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 shutdown_connections 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/1004847266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1eb6750 0x55f8f1ebd970 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 >> 172.21.15.145:0/1004847266 conn(0x55f8f1eb2b30 msgr2=0x55f8f1eb0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 shutdown_connections 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/1004847266 wait complete. 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/218010332 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f62200346a0 msgr2=0x7f6220036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/218010332 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f62200346a0 0x7f6220036b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55f8f1e90680 tx=0x7f633c005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/218010332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1ea9e60 msgr2=0x55f8f1eaa280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/218010332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1ea9e60 0x55f8f1eaa280 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f63400480a0 tx=0x7f6340010ab0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/218010332 shutdown_connections 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/218010332 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f62200346a0 0x7f6220036b60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/218010332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1ea9e60 0x55f8f1eaa280 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/218010332 >> 172.21.15.145:0/218010332 conn(0x55f8f1e9efb0 msgr2=0x55f8f1ea1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/218010332 shutdown_connections 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/218010332 wait complete. 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1e944b0 msgr2=0x55f8f1e968a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8f1e944b0 0x55f8f1e968a0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1d9de30 msgr2=0x55f8f1e93080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8f1d9de30 0x55f8f1e93080 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8f1e99b30 msgr2=0x55f8f1e9bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.220+0000 7f6348e6d980 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8f1e99b30 0x55f8f1e9bf20 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f622c0346a0 msgr2=0x7f622c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f6348e6d980 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f622c0346a0 0x7f622c036b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f633c0ae000 tx=0x7f633c0a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 msgr2=0x55f8f1e8c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f6348e6d980 1 --2- 172.21.15.145:0/476206816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8f1d0ba60 0x55f8f1e8c090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6340006640 tx=0x7f6340000f50 comp rx=0 tx=0).stop 2024-09-11T11:01:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f634717e640 1 -- 172.21.15.145:0/476206816 reap_dead start 2024-09-11T11:01:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 shutdown_connections 2024-09-11T11:01:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 >> 172.21.15.145:0/476206816 conn(0x55f8f1d92000 msgr2=0x55f8f1e7f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 shutdown_connections 2024-09-11T11:01:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.224+0000 7f6348e6d980 1 -- 172.21.15.145:0/476206816 wait complete. 2024-09-11T11:01:25.234 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-11T11:01:25.206338Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:25.234 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:01:25.234 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:01:25.234 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:01:25.306 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:25.307 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:25.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20caee1980 1 Processor -- start 2024-09-11T11:01:25.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20caee1980 1 -- start start 2024-09-11T11:01:25.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20caee1980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559c0ba462d0 0x559c0bad4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20caee1980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c0b959ae0 con 0x559c0bad48a0 2024-09-11T11:01:25.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20caee1980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x559c0b97de30 con 0x559c0ba462d0 2024-09-11T11:01:25.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20c89f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559c0ba462d0 0x559c0bad4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20c89f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559c0ba462d0 0x559c0bad4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49158/0 (socket says 172.21.15.145:49158) 2024-09-11T11:01:25.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20c89f1640 1 -- 172.21.15.145:0/1324819773 learned_addr learned my addr 172.21.15.145:0/1324819773 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20c89f1640 1 -- 172.21.15.145:0/1324819773 >> v1:172.21.15.102:6789/0 conn(0x559c0bad48a0 legacy=0x559c0bad6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.304+0000 7f20c89f1640 1 -- 172.21.15.145:0/1324819773 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0bad93c0 con 0x559c0ba462d0 2024-09-11T11:01:25.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20c89f1640 1 --2- 172.21.15.145:0/1324819773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0ba462d0 0x559c0bad4360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20b800a4e0 tx=0x7f20b801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223c05689c1eb01f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20c79ef640 1 -- 172.21.15.145:0/1324819773 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80aa540 con 0x559c0ba462d0 2024-09-11T11:01:25.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20c79ef640 1 -- 172.21.15.145:0/1324819773 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80aa6e0 con 0x559c0ba462d0 2024-09-11T11:01:25.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20c79ef640 1 -- 172.21.15.145:0/1324819773 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80aaa40 con 0x559c0ba462d0 2024-09-11T11:01:25.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20caee1980 1 -- 172.21.15.145:0/1324819773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0ba462d0 msgr2=0x559c0bad4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20caee1980 1 --2- 172.21.15.145:0/1324819773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0ba462d0 0x559c0bad4360 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20b800a4e0 tx=0x7f20b801b090 comp rx=0 tx=0).stop 2024-09-11T11:01:25.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20caee1980 1 -- 172.21.15.145:0/1324819773 shutdown_connections 2024-09-11T11:01:25.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20caee1980 1 --2- 172.21.15.145:0/1324819773 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0ba462d0 0x559c0bad4360 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20caee1980 1 -- 172.21.15.145:0/1324819773 >> 172.21.15.145:0/1324819773 conn(0x559c0bacc090 msgr2=0x559c0bace4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20caee1980 1 -- 172.21.15.145:0/1324819773 shutdown_connections 2024-09-11T11:01:25.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.308+0000 7f20caee1980 1 -- 172.21.15.145:0/1324819773 wait complete. 2024-09-11T11:01:25.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20caee1980 1 Processor -- start 2024-09-11T11:01:25.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20caee1980 1 -- start start 2024-09-11T11:01:25.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20caee1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bbbcb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20caee1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559c0b97f200 con 0x559c0bad48a0 2024-09-11T11:01:25.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bbbcb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bbbcb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49168/0 (socket says 172.21.15.145:49168) 2024-09-11T11:01:25.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20c89f1640 1 -- 172.21.15.145:0/1968824050 learned_addr learned my addr 172.21.15.145:0/1968824050 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20c89f1640 1 -- 172.21.15.145:0/1968824050 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0bbbd120 con 0x559c0bad48a0 2024-09-11T11:01:25.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f20c89f1640 1 --2- 172.21.15.145:0/1968824050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bbbcb50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20b8018cc0 tx=0x7f20b80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e38f1cc6033f874 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f1fb6e0d640 1 -- 172.21.15.145:0/1968824050 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80b9030 con 0x559c0bad48a0 2024-09-11T11:01:25.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f1fb6e0d640 1 -- 172.21.15.145:0/1968824050 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80aa9e0 con 0x559c0bad48a0 2024-09-11T11:01:25.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.324+0000 7f1fb6e0d640 1 -- 172.21.15.145:0/1968824050 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80aad00 con 0x559c0bad48a0 2024-09-11T11:01:25.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- 172.21.15.145:0/1968824050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 msgr2=0x559c0bbbcb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 --2- 172.21.15.145:0/1968824050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bbbcb50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20b8018cc0 tx=0x7f20b80033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- 172.21.15.145:0/1968824050 shutdown_connections 2024-09-11T11:01:25.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 --2- 172.21.15.145:0/1968824050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bbbcb50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- 172.21.15.145:0/1968824050 >> 172.21.15.145:0/1968824050 conn(0x559c0bacc090 msgr2=0x559c0bbb86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- 172.21.15.145:0/1968824050 shutdown_connections 2024-09-11T11:01:25.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- 172.21.15.145:0/1968824050 wait complete. 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 Processor -- start 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- start start 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bad1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559c0bad8e30 con 0x559c0bad48a0 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bad1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bad1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49182/0 (socket says 172.21.15.145:49182) 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20c89f1640 1 -- 172.21.15.145:0/2339741392 learned_addr learned my addr 172.21.15.145:0/2339741392 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20c89f1640 1 -- 172.21.15.145:0/2339741392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0bad0380 con 0x559c0bad48a0 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20c89f1640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bad1c60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f20b801b570 tx=0x7f20b8017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f1fb560a640 1 -- 172.21.15.145:0/2339741392 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80b9070 con 0x559c0bad48a0 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f1fb560a640 1 -- 172.21.15.145:0/2339741392 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80b58b0 con 0x559c0bad48a0 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c0bad0610 con 0x559c0bad48a0 2024-09-11T11:01:25.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f1fb560a640 1 -- 172.21.15.145:0/2339741392 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80b5b90 con 0x559c0bad48a0 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c0bad0b00 con 0x559c0bad48a0 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f1fb560a640 1 -- 172.21.15.145:0/2339741392 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20b80b3040 con 0x559c0bad48a0 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f1fb560a640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fb0034650 0x7f1fb0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.328+0000 7f1fb560a640 1 -- 172.21.15.145:0/2339741392 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f20b80ba070 con 0x559c0bad48a0 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c81f0640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fb0034650 0x7f1fb0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20caee1980 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bbcb140 0x559c0bbcd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bbcda70 con 0x559c0bbcb140 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c91f2640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bbcb140 0x559c0bbcd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c81f0640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fb0034650 0x7f1fb0036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f20b0000f70 tx=0x7f20b0001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c91f2640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bbcb140 0x559c0bbcd530 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c91f2640 1 -- 172.21.15.145:0/2339741392 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bbcb140 2024-09-11T11:01:25.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20caee1980 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bbce4e0 0x559c0bbd09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bbd1110 con 0x559c0bbce4e0 2024-09-11T11:01:25.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c89f1640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bbce4e0 0x559c0bbd09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c89f1640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bbce4e0 0x559c0bbd09a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c89f1640 1 -- 172.21.15.145:0/2339741392 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20b80cf070 con 0x559c0bbce4e0 2024-09-11T11:01:25.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bbd29c0 con 0x559c0bbce4e0 2024-09-11T11:01:25.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c89f1640 1 -- 172.21.15.145:0/2339741392 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20b80cf070 con 0x559c0bbce4e0 2024-09-11T11:01:25.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bbd1bf0 con 0x559c0bbce4e0 2024-09-11T11:01:25.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c89f1640 1 -- 172.21.15.145:0/2339741392 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20b80cf070 con 0x559c0bbce4e0 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20caee1980 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559c0bbd3d70 0x559c0bbd6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bbd66a0 con 0x559c0bbd3d70 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.332+0000 7f20c81f0640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559c0bbd3d70 0x559c0bbd6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20c81f0640 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559c0bbd3d70 0x559c0bbd6160 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20c81f0640 1 -- 172.21.15.145:0/2339741392 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20b000d040 con 0x559c0bbd3d70 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20caee1980 1 Processor -- start 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20caee1980 1 -- start start 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20caee1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbe4130 0x559c0bbe4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20caee1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559c0b9d8800 con 0x559c0bbe4130 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbe4130 0x559c0bbe4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbe4130 0x559c0bbe4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49192/0 (socket says 172.21.15.145:49192) 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20c89f1640 1 -- 172.21.15.145:0/1764337358 learned_addr learned my addr 172.21.15.145:0/1764337358 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20c89f1640 1 -- 172.21.15.145:0/1764337358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0bbe4a90 con 0x559c0bbe4130 2024-09-11T11:01:25.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20c89f1640 1 --2- 172.21.15.145:0/1764337358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbe4130 0x559c0bbe4550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f20b80b5d50 tx=0x7f20b80d73b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f1fae7fc640 1 -- 172.21.15.145:0/1764337358 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80c0170 con 0x559c0bbe4130 2024-09-11T11:01:25.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20caee1980 1 -- 172.21.15.145:0/1764337358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c0bbe4d20 con 0x559c0bbe4130 2024-09-11T11:01:25.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f1fae7fc640 1 -- 172.21.15.145:0/1764337358 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80e8020 con 0x559c0bbe4130 2024-09-11T11:01:25.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f1fae7fc640 1 -- 172.21.15.145:0/1764337358 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80a9740 con 0x559c0bbe4130 2024-09-11T11:01:25.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f20caee1980 1 -- 172.21.15.145:0/1764337358 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c0bbe4d20 con 0x559c0bbe4130 2024-09-11T11:01:25.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.336+0000 7f1fae7fc640 1 -- 172.21.15.145:0/1764337358 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20b80a98e0 con 0x559c0bbe4130 2024-09-11T11:01:25.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f1fae7fc640 1 --2- 172.21.15.145:0/1764337358 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fa0034650 0x7f1fa0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f1fae7fc640 1 -- 172.21.15.145:0/1764337358 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f20b80e9030 con 0x559c0bbe4130 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c81f0640 1 --2- 172.21.15.145:0/1764337358 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fa0034650 0x7f1fa0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 Processor -- start 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- start start 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c81f0640 1 --2- 172.21.15.145:0/1764337358 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fa0034650 0x7f1fa0036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x559c0bbd6aa0 tx=0x7f20b0006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559c0bbbd3e0 con 0x559c0bbf0920 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49202/0 (socket says 172.21.15.145:49202) 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 -- 172.21.15.145:0/207701104 learned_addr learned my addr 172.21.15.145:0/207701104 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 -- 172.21.15.145:0/207701104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0bbf12d0 con 0x559c0bbf0920 2024-09-11T11:01:25.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 --2- 172.21.15.145:0/207701104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf0d00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f20b80b4e60 tx=0x7f20b80d38e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7483f87a364e42ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f1f9ffff640 1 -- 172.21.15.145:0/207701104 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80fa030 con 0x559c0bbf0920 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f1f9ffff640 1 -- 172.21.15.145:0/207701104 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80b4720 con 0x559c0bbf0920 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f1f9ffff640 1 -- 172.21.15.145:0/207701104 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80d3c40 con 0x559c0bbf0920 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- 172.21.15.145:0/207701104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 msgr2=0x559c0bbf0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 --2- 172.21.15.145:0/207701104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf0d00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f20b80b4e60 tx=0x7f20b80d38e0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- 172.21.15.145:0/207701104 shutdown_connections 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 --2- 172.21.15.145:0/207701104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf0d00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- 172.21.15.145:0/207701104 >> 172.21.15.145:0/207701104 conn(0x559c0bbecd00 msgr2=0x559c0bbeae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- 172.21.15.145:0/207701104 shutdown_connections 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- 172.21.15.145:0/207701104 wait complete. 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 Processor -- start 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- start start 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20caee1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559c0bbf1770 con 0x559c0bbf0920 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49206/0 (socket says 172.21.15.145:49206) 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 learned_addr learned my addr 172.21.15.145:0/208248934 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.340+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c0bbf8040 con 0x559c0bbf0920 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c89f1640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf7b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f20b80e20c0 tx=0x7f20b80aef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f1f9e7fc640 1 -- 172.21.15.145:0/208248934 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80eca50 con 0x559c0bbf0920 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c0bbf8040 con 0x559c0bbf0920 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c0bbf8040 con 0x559c0bbf0920 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f1f9e7fc640 1 -- 172.21.15.145:0/208248934 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20b80ecbf0 con 0x559c0bbf0920 2024-09-11T11:01:25.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f1f9e7fc640 1 -- 172.21.15.145:0/208248934 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20b80e43f0 con 0x559c0bbf0920 2024-09-11T11:01:25.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f1f9e7fc640 1 -- 172.21.15.145:0/208248934 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20b810e070 con 0x559c0bbf0920 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f1f9e7fc640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f94034650 0x7f1f94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f1f9e7fc640 1 -- 172.21.15.145:0/208248934 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f20b80fe070 con 0x559c0bbf0920 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c81f0640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f94034650 0x7f1f94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bc029e0 0x559c0bc04e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc055d0 con 0x559c0bc029e0 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c91f2640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bc029e0 0x559c0bc04e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c81f0640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f94034650 0x7f1f94036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f20b0010fd0 tx=0x7f20b0011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c91f2640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bc029e0 0x559c0bc04e80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 20 realm 2024-09-11T11:01:25.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc01f20 con 0x559c0bc029e0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc060b0 con 0x559c0bc029e0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bc06e90 0x559c0bc09280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc098b0 con 0x559c0bc06e90 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.344+0000 7f20c89f1640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bc06e90 0x559c0bc09280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c89f1640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bc06e90 0x559c0bc09280 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20caee1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0a150 con 0x559c0bc06e90 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20caee1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20caee1980 20 searching for the correct realm 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559c0bc0bec0 0x559c0bc0e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc0bec0 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c81f0640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559c0bc0bec0 0x559c0bc0e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c81f0640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559c0bc0bec0 0x559c0bc0e2b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c89f1640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20b80bc3b0 0x7f20b80ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c91f2640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20b80bc3b0 0x7f20b80ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c91f2640 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20b80bc3b0 0x7f20b80ed870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.348+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc0bec0 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc0bec0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.352+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc0bec0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc0bec0 2024-09-11T11:01:25.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc029e0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc0bec0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.356+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc0bec0 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0e8c0 con 0x559c0bc06e90 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:25.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0ab00 con 0x559c0bc029e0 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0af80 con 0x559c0bc06e90 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0b3a0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 zone default found 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 4 Realm: () 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 zonegroup default 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc0ed40 con 0x7f20b80bc3b0 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc10f70 con 0x559c0bc0bec0 2024-09-11T11:01:25.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.360+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc11310 con 0x559c0bc0bec0 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20caee1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20caee1980 20 started sync module instance, tier type = 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20caee1980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc103b0 con 0x559c0bc06e90 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94128700459232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc103b0 con 0x559c0bc06e90 2024-09-11T11:01:25.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc11cd0 con 0x559c0bc029e0 2024-09-11T11:01:25.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94128700463136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc11c40 con 0x559c0bc029e0 2024-09-11T11:01:25.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.364+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc12c40 con 0x559c0bc06e90 2024-09-11T11:01:25.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94128700459232] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94128700463136] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94128700465344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc12c00 con 0x559c0bc06e90 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc134e0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94128700469296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc12c00 con 0x7f20b80bc3b0 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc13f90 con 0x559c0bc06e90 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94128700465344] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.368+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94128700469296] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94128700470352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc13f90 con 0x559c0bc06e90 2024-09-11T11:01:25.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc14380 con 0x559c0bc0bec0 2024-09-11T11:01:25.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94128700466960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc14bd0 con 0x559c0bc0bec0 2024-09-11T11:01:25.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc15590 con 0x559c0bc0bec0 2024-09-11T11:01:25.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94128700470352] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94128700471968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc15590 con 0x559c0bc0bec0 2024-09-11T11:01:25.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc15fd0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94128700466960] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94128700475168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc15fd0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 20 add_watcher() i=0 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 20 add_watcher() i=1 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 20 add_watcher() i=2 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 20 add_watcher() i=3 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 20 add_watcher() i=4 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 20 add_watcher() i=5 2024-09-11T11:01:25.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94128700471968] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.372+0000 7f20caee1980 20 add_watcher() i=6 2024-09-11T11:01:25.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94128700475168] v32'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 20 add_watcher() i=7 2024-09-11T11:01:25.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:25.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc150e0 con 0x559c0bc029e0 2024-09-11T11:01:25.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94128700480288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc150e0 con 0x559c0bc029e0 2024-09-11T11:01:25.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94128700480288] v32'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f1f7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:25.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 5 note: GC not initialized 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f1f7e7e4640 20 reqs_thread_entry: start 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 20 Filter name: none 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f1f777fe640 20 reqs_thread_entry: start 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.376+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc3bff0 con 0x559c0bc029e0 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.380+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.380+0000 7f20caee1980 20 rados_obj.operate() r=0 bl.length=673 2024-09-11T11:01:25.382 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-11T11:01:25.206338Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:25.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.380+0000 7f1f7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.380+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94128700480288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc3c530 con 0x559c0bc029e0 2024-09-11T11:01:25.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.380+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94128700480288] v32'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.380+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94128700459232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc15b20 con 0x559c0bc06e90 2024-09-11T11:01:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.384+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94128700459232] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.384+0000 7f20caee1980 20 remove_watcher() i=0 2024-09-11T11:01:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.384+0000 7f20caee1980 2 removed watcher, disabling cache 2024-09-11T11:01:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.384+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94128700463136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc15b20 con 0x559c0bc029e0 2024-09-11T11:01:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.384+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94128700463136] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x559c0bc029e0 2024-09-11T11:01:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.384+0000 7f20caee1980 20 remove_watcher() i=1 2024-09-11T11:01:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.384+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94128700465344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc11820 con 0x559c0bc06e90 2024-09-11T11:01:25.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94128700465344] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20caee1980 20 remove_watcher() i=2 2024-09-11T11:01:25.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94128700469296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc15b20 con 0x7f20b80bc3b0 2024-09-11T11:01:25.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94128700469296] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20caee1980 20 remove_watcher() i=3 2024-09-11T11:01:25.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94128700470352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc11820 con 0x559c0bc06e90 2024-09-11T11:01:25.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20c89f1640 1 -- 172.21.15.145:0/208248934 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94128700470352] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b8117020 con 0x559c0bc06e90 2024-09-11T11:01:25.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20caee1980 20 remove_watcher() i=4 2024-09-11T11:01:25.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94128700466960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc15b20 con 0x559c0bc0bec0 2024-09-11T11:01:25.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94128700466960] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20caee1980 20 remove_watcher() i=5 2024-09-11T11:01:25.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.388+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94128700471968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc11820 con 0x559c0bc0bec0 2024-09-11T11:01:25.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20c81f0640 1 -- 172.21.15.145:0/208248934 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94128700471968] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20b0036040 con 0x559c0bc0bec0 2024-09-11T11:01:25.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 20 remove_watcher() i=6 2024-09-11T11:01:25.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94128700475168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x559c0bc12710 con 0x7f20b80bc3b0 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94128700475168] v32'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20c00083f0 con 0x7f20b80bc3b0 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 20 remove_watcher() i=7 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bc06e90 msgr2=0x559c0bc09280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bc06e90 0x559c0bc09280 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bc029e0 msgr2=0x559c0bc04e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bc029e0 0x559c0bc04e80 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20b80bc3b0 msgr2=0x7f20b80ed870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20b80bc3b0 0x7f20b80ed870 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559c0bc0bec0 msgr2=0x559c0bc0e2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559c0bc0bec0 0x559c0bc0e2b0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f94034650 msgr2=0x7f1f94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f94034650 0x7f1f94036b10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f20b0010fd0 tx=0x7f20b0011000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 msgr2=0x559c0bbf7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20c91f2640 1 -- 172.21.15.145:0/208248934 reap_dead start 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf7b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f20b80e20c0 tx=0x7f20b80aef20 comp rx=0 tx=0).stop 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 shutdown_connections 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/208248934 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbf0920 0x559c0bbf7b00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 >> 172.21.15.145:0/208248934 conn(0x559c0bbecd00 msgr2=0x559c0bbeadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 shutdown_connections 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/208248934 wait complete. 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/1764337358 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fa0034650 msgr2=0x7f1fa0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/1764337358 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fa0034650 0x7f1fa0036b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x559c0bbd6aa0 tx=0x7f20b0006000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/1764337358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbe4130 msgr2=0x559c0bbe4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/1764337358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbe4130 0x559c0bbe4550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f20b80b5d50 tx=0x7f20b80d73b0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/1764337358 shutdown_connections 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/1764337358 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fa0034650 0x7f1fa0036b10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/1764337358 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bbe4130 0x559c0bbe4550 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/1764337358 >> 172.21.15.145:0/1764337358 conn(0x559c0bbd9280 msgr2=0x559c0bbdbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/1764337358 shutdown_connections 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/1764337358 wait complete. 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bbce4e0 msgr2=0x559c0bbd09a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559c0bbce4e0 0x559c0bbd09a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bbcb140 msgr2=0x559c0bbcd530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559c0bbcb140 0x559c0bbcd530 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559c0bbd3d70 msgr2=0x559c0bbd6160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559c0bbd3d70 0x559c0bbd6160 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fb0034650 msgr2=0x7f1fb0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1fb0034650 0x7f1fb0036b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f20b0000f70 tx=0x7f20b0001420 comp rx=0 tx=0).stop 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 msgr2=0x559c0bad1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 --2- 172.21.15.145:0/2339741392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559c0bad48a0 0x559c0bad1c60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f20b801b570 tx=0x7f20b8017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20c91f2640 1 -- 172.21.15.145:0/2339741392 reap_dead start 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 shutdown_connections 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 >> 172.21.15.145:0/2339741392 conn(0x559c0bacc090 msgr2=0x559c0bbb7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 shutdown_connections 2024-09-11T11:01:25.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.392+0000 7f20caee1980 1 -- 172.21.15.145:0/2339741392 wait complete. 2024-09-11T11:01:25.405 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-11T11:01:25.206338Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:25.405 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-11T11:01:25.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-11T11:01:25.405 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-11T11:01:25.479 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:25.479 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:25.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a7b19e980 1 Processor -- start 2024-09-11T11:01:25.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a7b19e980 1 -- start start 2024-09-11T11:01:25.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a7b19e980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ad685b9ba0 0x55ad685b8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a7b19e980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ad684cbae0 con 0x55ad685b9fb0 2024-09-11T11:01:25.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a7b19e980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55ad684efe30 con 0x55ad685b9ba0 2024-09-11T11:01:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a78cae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ad685b9ba0 0x55ad685b8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a78cae640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ad685b9ba0 0x55ad685b8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49218/0 (socket says 172.21.15.145:49218) 2024-09-11T11:01:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a78cae640 1 -- 172.21.15.145:0/3368430177 learned_addr learned my addr 172.21.15.145:0/3368430177 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a784ad640 1 --1- 172.21.15.145:0/3368430177 >> v1:172.21.15.102:6789/0 conn(0x55ad685b9fb0 0x55ad685b88a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48730/0 (socket says 172.21.15.145:48730) 2024-09-11T11:01:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a78cae640 1 -- 172.21.15.145:0/3368430177 >> v1:172.21.15.102:6789/0 conn(0x55ad685b9fb0 legacy=0x55ad685b88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.476+0000 7f6a78cae640 1 -- 172.21.15.145:0/3368430177 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad685b90d0 con 0x55ad685b9ba0 2024-09-11T11:01:25.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a78cae640 1 --2- 172.21.15.145:0/3368430177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad685b8360 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000a4e0 tx=0x7f6a7001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d7d14a487cafbb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a77cac640 1 -- 172.21.15.145:0/3368430177 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700aa540 con 0x55ad685b9ba0 2024-09-11T11:01:25.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a77cac640 1 -- 172.21.15.145:0/3368430177 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700aa6e0 con 0x55ad685b9ba0 2024-09-11T11:01:25.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a77cac640 1 -- 172.21.15.145:0/3368430177 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700aaa40 con 0x55ad685b9ba0 2024-09-11T11:01:25.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3368430177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 msgr2=0x55ad685b8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/3368430177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad685b8360 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6a7000a4e0 tx=0x7f6a7001b090 comp rx=0 tx=0).stop 2024-09-11T11:01:25.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3368430177 shutdown_connections 2024-09-11T11:01:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/3368430177 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad685b8360 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3368430177 >> 172.21.15.145:0/3368430177 conn(0x55ad6863f180 msgr2=0x55ad686415a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3368430177 shutdown_connections 2024-09-11T11:01:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.480+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3368430177 wait complete. 2024-09-11T11:01:25.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.492+0000 7f6a7b19e980 1 Processor -- start 2024-09-11T11:01:25.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.492+0000 7f6a7b19e980 1 -- start start 2024-09-11T11:01:25.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.492+0000 7f6a7b19e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68730b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.492+0000 7f6a7b19e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ad684f1200 con 0x55ad685b9ba0 2024-09-11T11:01:25.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68730b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68730b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49220/0 (socket says 172.21.15.145:49220) 2024-09-11T11:01:25.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 -- 172.21.15.145:0/3495039482 learned_addr learned my addr 172.21.15.145:0/3495039482 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 -- 172.21.15.145:0/3495039482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad68731160 con 0x55ad685b9ba0 2024-09-11T11:01:25.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 --2- 172.21.15.145:0/3495039482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68730b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a70017ca0 tx=0x7f6a700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c9657749268fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6966e0d640 1 -- 172.21.15.145:0/3495039482 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700b9070 con 0x55ad685b9ba0 2024-09-11T11:01:25.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6966e0d640 1 -- 172.21.15.145:0/3495039482 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700aab30 con 0x55ad685b9ba0 2024-09-11T11:01:25.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6966e0d640 1 -- 172.21.15.145:0/3495039482 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700aae10 con 0x55ad685b9ba0 2024-09-11T11:01:25.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3495039482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 msgr2=0x55ad68730b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/3495039482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68730b90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a70017ca0 tx=0x7f6a700033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3495039482 shutdown_connections 2024-09-11T11:01:25.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/3495039482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68730b90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3495039482 >> 172.21.15.145:0/3495039482 conn(0x55ad6863f180 msgr2=0x55ad6872c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3495039482 shutdown_connections 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 -- 172.21.15.145:0/3495039482 wait complete. 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 Processor -- start 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 -- start start 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68737dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ad6864f1d0 con 0x55ad685b9ba0 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68737dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68737dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49232/0 (socket says 172.21.15.145:49232) 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 -- 172.21.15.145:0/1222591413 learned_addr learned my addr 172.21.15.145:0/1222591413 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 -- 172.21.15.145:0/1222591413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad68738300 con 0x55ad685b9ba0 2024-09-11T11:01:25.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a78cae640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68737dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a70017ca0 tx=0x7f6a70017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f696560a640 1 -- 172.21.15.145:0/1222591413 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700b9070 con 0x55ad685b9ba0 2024-09-11T11:01:25.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad68738590 con 0x55ad685b9ba0 2024-09-11T11:01:25.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.496+0000 7f696560a640 1 -- 172.21.15.145:0/1222591413 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700b5e10 con 0x55ad685b9ba0 2024-09-11T11:01:25.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad6873b270 con 0x55ad685b9ba0 2024-09-11T11:01:25.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f696560a640 1 -- 172.21.15.145:0/1222591413 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700bd610 con 0x55ad685b9ba0 2024-09-11T11:01:25.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f696560a640 1 -- 172.21.15.145:0/1222591413 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a700b3040 con 0x55ad685b9ba0 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f696560a640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6960034650 0x7f6960036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f696560a640 1 -- 172.21.15.145:0/1222591413 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6a700c4070 con 0x55ad685b9ba0 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a784ad640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6960034650 0x7f6960036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad685b9fb0 0x55ad6873ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad6873f3b0 con 0x55ad685b9fb0 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a794af640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad685b9fb0 0x55ad6873ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a784ad640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6960034650 0x7f6960036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c001e50 tx=0x7f6a6c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a794af640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad685b9fb0 0x55ad6873ed70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a794af640 1 -- 172.21.15.145:0/1222591413 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad685b9fb0 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68740160 0x55ad68742550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad68742bb0 con 0x55ad68740160 2024-09-11T11:01:25.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a78cae640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68740160 0x55ad68742550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.500+0000 7f6a78cae640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68740160 0x55ad68742550 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a78cae640 1 -- 172.21.15.145:0/1222591413 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a700b6030 con 0x55ad68740160 2024-09-11T11:01:25.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad68744460 con 0x55ad68740160 2024-09-11T11:01:25.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a78cae640 1 -- 172.21.15.145:0/1222591413 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6a700b6030 con 0x55ad68740160 2024-09-11T11:01:25.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad687435d0 con 0x55ad68740160 2024-09-11T11:01:25.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a78cae640 1 -- 172.21.15.145:0/1222591413 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a700b6030 con 0x55ad68740160 2024-09-11T11:01:25.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ad68745810 0x55ad68747c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad68748140 con 0x55ad68745810 2024-09-11T11:01:25.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a784ad640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ad68745810 0x55ad68747c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a784ad640 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ad68745810 0x55ad68747c00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a784ad640 1 -- 172.21.15.145:0/1222591413 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6a6c00f700 con 0x55ad68745810 2024-09-11T11:01:25.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a7b19e980 1 Processor -- start 2024-09-11T11:01:25.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a7b19e980 1 -- start start 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a7b19e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad68755af0 0x55ad68755f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a7b19e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ad6854a800 con 0x55ad68755af0 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad68755af0 0x55ad68755f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad68755af0 0x55ad68755f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49246/0 (socket says 172.21.15.145:49246) 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a78cae640 1 -- 172.21.15.145:0/1620747409 learned_addr learned my addr 172.21.15.145:0/1620747409 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a78cae640 1 -- 172.21.15.145:0/1620747409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad68756450 con 0x55ad68755af0 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.504+0000 7f6a78cae640 1 --2- 172.21.15.145:0/1620747409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad68755af0 0x55ad68755f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a700e4c10 tx=0x7f6a700b3c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f695e7fc640 1 -- 172.21.15.145:0/1620747409 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700b3d90 con 0x55ad68755af0 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f695e7fc640 1 -- 172.21.15.145:0/1620747409 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700e4040 con 0x55ad68755af0 2024-09-11T11:01:25.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1620747409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad687566e0 con 0x55ad68755af0 2024-09-11T11:01:25.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f695e7fc640 1 -- 172.21.15.145:0/1620747409 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700c7540 con 0x55ad68755af0 2024-09-11T11:01:25.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1620747409 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad68759360 con 0x55ad68755af0 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f695e7fc640 1 -- 172.21.15.145:0/1620747409 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a700c76e0 con 0x55ad68755af0 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f695e7fc640 1 --2- 172.21.15.145:0/1620747409 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6950034650 0x7f6950036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f695e7fc640 1 -- 172.21.15.145:0/1620747409 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6a700eeb00 con 0x55ad68755af0 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a784ad640 1 --2- 172.21.15.145:0/1620747409 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6950034650 0x7f6950036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 Processor -- start 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- start start 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a784ad640 1 --2- 172.21.15.145:0/1620747409 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6950034650 0x7f6950036b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ad6873c3b0 tx=0x7f6a6c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad687627c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ad68731420 con 0x55ad687623e0 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad687627c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad687627c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49262/0 (socket says 172.21.15.145:49262) 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a78cae640 1 -- 172.21.15.145:0/1948614497 learned_addr learned my addr 172.21.15.145:0/1948614497 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a78cae640 1 -- 172.21.15.145:0/1948614497 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad68762d90 con 0x55ad687623e0 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a78cae640 1 --2- 172.21.15.145:0/1948614497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad687627c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6a700da3f0 tx=0x7f6a700ec3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adab877ef9f7a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f694ffff640 1 -- 172.21.15.145:0/1948614497 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700fb070 con 0x55ad687623e0 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f694ffff640 1 -- 172.21.15.145:0/1948614497 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a700dde10 con 0x55ad687623e0 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f694ffff640 1 -- 172.21.15.145:0/1948614497 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700bde00 con 0x55ad687623e0 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1948614497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 msgr2=0x55ad687627c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1948614497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad687627c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6a700da3f0 tx=0x7f6a700ec3e0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1948614497 shutdown_connections 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1948614497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad687627c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1948614497 >> 172.21.15.145:0/1948614497 conn(0x55ad6875e7c0 msgr2=0x55ad6875c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1948614497 shutdown_connections 2024-09-11T11:01:25.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.508+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1948614497 wait complete. 2024-09-11T11:01:25.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 1 Processor -- start 2024-09-11T11:01:25.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 1 -- start start 2024-09-11T11:01:25.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad68769620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ad68763230 con 0x55ad687623e0 2024-09-11T11:01:25.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad68769620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a78cae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad68769620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49266/0 (socket says 172.21.15.145:49266) 2024-09-11T11:01:25.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 learned_addr learned my addr 172.21.15.145:0/560757590 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad68769b60 con 0x55ad687623e0 2024-09-11T11:01:25.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a78cae640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad68769620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6a700c7fd0 tx=0x7f6a700cdef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f694e7fc640 1 -- 172.21.15.145:0/560757590 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a700bd8e0 con 0x55ad687623e0 2024-09-11T11:01:25.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ad68769b60 con 0x55ad687623e0 2024-09-11T11:01:25.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f694e7fc640 1 -- 172.21.15.145:0/560757590 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a7010d030 con 0x55ad687623e0 2024-09-11T11:01:25.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f694e7fc640 1 -- 172.21.15.145:0/560757590 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a70117060 con 0x55ad687623e0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad68769b60 con 0x55ad687623e0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f694e7fc640 1 -- 172.21.15.145:0/560757590 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6a700f1170 con 0x55ad687623e0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f694e7fc640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6944034650 0x7f6944036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f694e7fc640 1 -- 172.21.15.145:0/560757590 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6a700fe020 con 0x55ad687623e0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a784ad640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6944034650 0x7f6944036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad68774660 0x55ad68776b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad68777270 con 0x55ad68774660 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a794af640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad68774660 0x55ad68776b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a784ad640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6944034650 0x7f6944036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55ad687443a0 tx=0x7f6a6c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.512+0000 7f6a794af640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad68774660 0x55ad68776b20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 realm 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad68773b10 con 0x55ad68774660 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad68777d30 con 0x55ad68774660 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68778b10 0x55ad6877af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877b590 con 0x55ad68778b10 2024-09-11T11:01:25.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a78cae640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68778b10 0x55ad6877af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a78cae640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68778b10 0x55ad6877af00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 20 searching for the correct realm 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ad6877db50 0x55ad6877ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad687805c0 con 0x55ad6877db50 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a784ad640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ad6877db50 0x55ad6877ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a784ad640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ad6877db50 0x55ad6877ff40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.516+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad687805c0 con 0x55ad68778b10 2024-09-11T11:01:25.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a78cae640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a70118a20 0x7f6a700ec600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x7f6a70118a20 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a70118a20 0x7f6a700ec600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a70118a20 0x7f6a700ec600 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad6877db50 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x7f6a70118a20 2024-09-11T11:01:25.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.520+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x7f6a70118a20 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad6877db50 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad6877db50 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad6877db50 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x7f6a70118a20 2024-09-11T11:01:25.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68774660 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.524+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x7f6a70118a20 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad6877db50 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x7f6a70118a20 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad6877db50 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877bde0 con 0x55ad68778b10 2024-09-11T11:01:25.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a7b19e980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a7b19e980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a7b19e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a7b19e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a7b19e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a7b19e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.528+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877c630 con 0x55ad68774660 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877ca20 con 0x55ad68778b10 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877ca20 con 0x7f6a70118a20 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 zone default found 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 4 Realm: () 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:25.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 zonegroup default 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad68780a20 con 0x7f6a70118a20 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad6877cfc0 con 0x55ad6877db50 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad68782d60 con 0x55ad6877db50 2024-09-11T11:01:25.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 started sync module instance, tier type = 2024-09-11T11:01:25.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:25.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.532+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687820e0 con 0x55ad68778b10 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94203270407680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687820e0 con 0x55ad68778b10 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68783820 con 0x55ad68774660 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94203270411056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68783750 con 0x55ad68774660 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68784720 con 0x55ad68778b10 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94203270407680] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94203270411056] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94203270413328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68784230 con 0x55ad68778b10 2024-09-11T11:01:25.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.536+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68784fc0 con 0x7f6a70118a20 2024-09-11T11:01:25.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94203270417168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68784230 con 0x7f6a70118a20 2024-09-11T11:01:25.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68785a60 con 0x55ad68778b10 2024-09-11T11:01:25.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94203270413328] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94203270417168] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94203270418224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68785a20 con 0x55ad68778b10 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68785e50 con 0x55ad6877db50 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94203270405168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687866f0 con 0x55ad6877db50 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.540+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687870b0 con 0x55ad6877db50 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94203270418224] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94203270419792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68787950 con 0x55ad6877db50 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68788310 con 0x7f6a70118a20 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94203270405168] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94203270419792] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94203270427808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687878c0 con 0x7f6a70118a20 2024-09-11T11:01:25.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 20 add_watcher() i=0 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 20 add_watcher() i=1 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 20 add_watcher() i=2 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 20 add_watcher() i=3 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 20 add_watcher() i=4 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 20 add_watcher() i=5 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 20 add_watcher() i=6 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94203270427808] v32'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 20 add_watcher() i=7 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad6878b340 con 0x55ad68774660 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.544+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94203270430304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68788730 con 0x55ad68774660 2024-09-11T11:01:25.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94203270430304] v32'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f692efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:25.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:25.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 5 note: GC not initialized 2024-09-11T11:01:25.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f692dfe3640 20 reqs_thread_entry: start 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 20 Filter name: none 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f689f7fe640 20 reqs_thread_entry: start 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad687ae830 con 0x55ad68774660 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 20 rados_obj.operate() r=0 bl.length=673 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:25.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687b5420 con 0x55ad68774660 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v32'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94203270614672 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad687b0b70 con 0x55ad68778b10 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94203270418224 notify 137438953484 ret 0) ==== 800+0+0 (crc 0 0 0) 0x55ad687566e0 con 0x55ad68778b10 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f694ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94203270418224 notifier 4409 bl.length()=758 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94203270614672 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f694ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.548+0000 7f694ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f694ffff640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f693c003eb0 con 0x55ad68778b10 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== watch-notify(notify_complete (2) cookie 94203270614672 notify 137438953484 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ad68756450 con 0x55ad68778b10 2024-09-11T11:01:25.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687b4e90 con 0x55ad68774660 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 foo:foo1 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a7b19e980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94203270614672 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ad687b06c0 con 0x55ad68778b10 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 94203270407680 notify 137438953485 ret 0) ==== 201+0+0 (crc 0 0 0) 0x55ad68756450 con 0x55ad68778b10 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f694ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953485 cookie 94203270407680 notifier 4409 bl.length()=159 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f694ffff640 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f693c003eb0 con 0x55ad68778b10 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(67 notify.0 [notify cookie 94203270614672 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.552+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 94203270614672 notify 137438953485 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ad6873b270 con 0x55ad68778b10 2024-09-11T11:01:25.560 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-11T11:01:25.206338Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:25.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.556+0000 7f692efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.556+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94203270430304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687ac660 con 0x55ad68774660 2024-09-11T11:01:25.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.556+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94203270430304] v32'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.556+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94203270407680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687ac660 con 0x55ad68778b10 2024-09-11T11:01:25.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94203270407680] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 20 remove_watcher() i=0 2024-09-11T11:01:25.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 2 removed watcher, disabling cache 2024-09-11T11:01:25.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94203270411056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687ac660 con 0x55ad68774660 2024-09-11T11:01:25.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94203270411056] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x55ad68774660 2024-09-11T11:01:25.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 20 remove_watcher() i=1 2024-09-11T11:01:25.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94203270413328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68783330 con 0x55ad68778b10 2024-09-11T11:01:25.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94203270413328] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 20 remove_watcher() i=2 2024-09-11T11:01:25.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94203270417168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687ac660 con 0x7f6a70118a20 2024-09-11T11:01:25.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94203270417168] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 20 remove_watcher() i=3 2024-09-11T11:01:25.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.560+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94203270418224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68783c10 con 0x55ad68778b10 2024-09-11T11:01:25.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a78cae640 1 -- 172.21.15.145:0/560757590 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94203270418224] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a700f4070 con 0x55ad68778b10 2024-09-11T11:01:25.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a7b19e980 20 remove_watcher() i=4 2024-09-11T11:01:25.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94203270405168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68783330 con 0x55ad6877db50 2024-09-11T11:01:25.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94203270405168] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a7b19e980 20 remove_watcher() i=5 2024-09-11T11:01:25.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94203270419792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad687ac660 con 0x55ad6877db50 2024-09-11T11:01:25.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a784ad640 1 -- 172.21.15.145:0/560757590 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94203270419792] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a6c037040 con 0x55ad6877db50 2024-09-11T11:01:25.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a7b19e980 20 remove_watcher() i=6 2024-09-11T11:01:25.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.564+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94203270427808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ad68783c10 con 0x7f6a70118a20 2024-09-11T11:01:25.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94203270427808] v32'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6a680083f0 con 0x7f6a70118a20 2024-09-11T11:01:25.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 20 remove_watcher() i=7 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68778b10 msgr2=0x55ad6877af00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68778b10 0x55ad6877af00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad68774660 msgr2=0x55ad68776b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad68774660 0x55ad68776b20 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a70118a20 msgr2=0x7f6a700ec600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6a70118a20 0x7f6a700ec600 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ad6877db50 msgr2=0x55ad6877ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ad6877db50 0x55ad6877ff40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6944034650 msgr2=0x7f6944036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6944034650 0x7f6944036b10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55ad687443a0 tx=0x7f6a6c010000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 msgr2=0x55ad68769620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a794af640 1 -- 172.21.15.145:0/560757590 reap_dead start 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad68769620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6a700c7fd0 tx=0x7f6a700cdef0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 shutdown_connections 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/560757590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad687623e0 0x55ad68769620 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 >> 172.21.15.145:0/560757590 conn(0x55ad6875e7c0 msgr2=0x55ad6875c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 shutdown_connections 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/560757590 wait complete. 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1620747409 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6950034650 msgr2=0x7f6950036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1620747409 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6950034650 0x7f6950036b10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ad6873c3b0 tx=0x7f6a6c00f000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1620747409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad68755af0 msgr2=0x55ad68755f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1620747409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad68755af0 0x55ad68755f10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6a700e4c10 tx=0x7f6a700b3c60 comp rx=0 tx=0).stop 2024-09-11T11:01:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1620747409 shutdown_connections 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1620747409 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6950034650 0x7f6950036b10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1620747409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad68755af0 0x55ad68755f10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1620747409 >> 172.21.15.145:0/1620747409 conn(0x55ad6874ac40 msgr2=0x55ad6874d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1620747409 shutdown_connections 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1620747409 wait complete. 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68740160 msgr2=0x55ad68742550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ad68740160 0x55ad68742550 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad685b9fb0 msgr2=0x55ad6873ed70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ad685b9fb0 0x55ad6873ed70 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ad68745810 msgr2=0x55ad68747c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ad68745810 0x55ad68747c00 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6960034650 msgr2=0x7f6960036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6960034650 0x7f6960036b10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6a6c001e50 tx=0x7f6a6c0013b0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 msgr2=0x55ad68737dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 --2- 172.21.15.145:0/1222591413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ad685b9ba0 0x55ad68737dc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6a70017ca0 tx=0x7f6a70017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a794af640 1 -- 172.21.15.145:0/1222591413 reap_dead start 2024-09-11T11:01:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 shutdown_connections 2024-09-11T11:01:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 >> 172.21.15.145:0/1222591413 conn(0x55ad6863f180 msgr2=0x55ad6872b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 shutdown_connections 2024-09-11T11:01:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.568+0000 7f6a7b19e980 1 -- 172.21.15.145:0/1222591413 wait complete. 2024-09-11T11:01:25.581 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-11T11:01:25.206338Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:25.581 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-11T11:01:25.581 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-11T11:01:25.581 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-11T11:01:25.652 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:25.652 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:25.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8eb01980 1 Processor -- start 2024-09-11T11:01:25.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8eb01980 1 -- start start 2024-09-11T11:01:25.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8eb01980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56090fe44290 0x56090fed23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8eb01980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56090fd57ae0 con 0x56090fed28e0 2024-09-11T11:01:25.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8eb01980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x56090fd7be30 con 0x56090fe44290 2024-09-11T11:01:25.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8c611640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56090fe44290 0x56090fed23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8c611640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56090fe44290 0x56090fed23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49274/0 (socket says 172.21.15.145:49274) 2024-09-11T11:01:25.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8c611640 1 -- 172.21.15.145:0/711059008 learned_addr learned my addr 172.21.15.145:0/711059008 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8c611640 1 -- 172.21.15.145:0/711059008 >> v1:172.21.15.102:6789/0 conn(0x56090fed28e0 legacy=0x56090fed4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8c611640 1 -- 172.21.15.145:0/711059008 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090fe44820 con 0x56090fe44290 2024-09-11T11:01:25.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8c611640 1 --2- 172.21.15.145:0/711059008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fed23a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00a5c0 tx=0x7f3d7c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0cf2d47002a80e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8b60f640 1 -- 172.21.15.145:0/711059008 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0a6070 con 0x56090fe44290 2024-09-11T11:01:25.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.652+0000 7f3d8b60f640 1 -- 172.21.15.145:0/711059008 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0af070 con 0x56090fe44290 2024-09-11T11:01:25.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.656+0000 7f3d8b60f640 1 -- 172.21.15.145:0/711059008 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0aa5c0 con 0x56090fe44290 2024-09-11T11:01:25.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.656+0000 7f3d8eb01980 1 -- 172.21.15.145:0/711059008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 msgr2=0x56090fed23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.656+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/711059008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fed23a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00a5c0 tx=0x7f3d7c01b340 comp rx=0 tx=0).stop 2024-09-11T11:01:25.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.656+0000 7f3d8eb01980 1 -- 172.21.15.145:0/711059008 shutdown_connections 2024-09-11T11:01:25.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.656+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/711059008 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fed23a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.656+0000 7f3d8eb01980 1 -- 172.21.15.145:0/711059008 >> 172.21.15.145:0/711059008 conn(0x56090feca090 msgr2=0x56090fecc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.656+0000 7f3d8eb01980 1 -- 172.21.15.145:0/711059008 shutdown_connections 2024-09-11T11:01:25.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.656+0000 7f3d8eb01980 1 -- 172.21.15.145:0/711059008 wait complete. 2024-09-11T11:01:25.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 Processor -- start 2024-09-11T11:01:25.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 -- start start 2024-09-11T11:01:25.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fecfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56090fd7d200 con 0x56090fe44290 2024-09-11T11:01:25.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fecfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fecfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49288/0 (socket says 172.21.15.145:49288) 2024-09-11T11:01:25.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8c611640 1 -- 172.21.15.145:0/2183242526 learned_addr learned my addr 172.21.15.145:0/2183242526 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8c611640 1 -- 172.21.15.145:0/2183242526 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090fed00d0 con 0x56090fe44290 2024-09-11T11:01:25.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8c611640 1 --2- 172.21.15.145:0/2183242526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fecfb00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0199f0 tx=0x7f3d7c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646b1f39d7f3225e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3c7a60c640 1 -- 172.21.15.145:0/2183242526 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0aaa00 con 0x56090fe44290 2024-09-11T11:01:25.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3c7a60c640 1 -- 172.21.15.145:0/2183242526 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0aaba0 con 0x56090fe44290 2024-09-11T11:01:25.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3c7a60c640 1 -- 172.21.15.145:0/2183242526 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0bd3f0 con 0x56090fe44290 2024-09-11T11:01:25.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 -- 172.21.15.145:0/2183242526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 msgr2=0x56090fecfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/2183242526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fecfb00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0199f0 tx=0x7f3d7c003030 comp rx=0 tx=0).stop 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 -- 172.21.15.145:0/2183242526 shutdown_connections 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/2183242526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090fecfb00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 -- 172.21.15.145:0/2183242526 >> 172.21.15.145:0/2183242526 conn(0x56090feca090 msgr2=0x56090ffb6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 -- 172.21.15.145:0/2183242526 shutdown_connections 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.668+0000 7f3d8eb01980 1 -- 172.21.15.145:0/2183242526 wait complete. 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8eb01980 1 Processor -- start 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8eb01980 1 -- start start 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8eb01980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090ffc3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8eb01980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56090fed6f00 con 0x56090fe44290 2024-09-11T11:01:25.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090ffc3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090ffc3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49296/0 (socket says 172.21.15.145:49296) 2024-09-11T11:01:25.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8c611640 1 -- 172.21.15.145:0/4244436289 learned_addr learned my addr 172.21.15.145:0/4244436289 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8c611640 1 -- 172.21.15.145:0/4244436289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090ffc4350 con 0x56090fe44290 2024-09-11T11:01:25.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8c611640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090ffc3e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0199f0 tx=0x7f3d7c0180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3c78e09640 1 -- 172.21.15.145:0/4244436289 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0bd7c0 con 0x56090fe44290 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56090ffc45e0 con 0x56090fe44290 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3c78e09640 1 -- 172.21.15.145:0/4244436289 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0bd960 con 0x56090fe44290 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3c78e09640 1 -- 172.21.15.145:0/4244436289 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0bdc40 con 0x56090fe44290 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56090ffc72c0 con 0x56090fe44290 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3c78e09640 1 -- 172.21.15.145:0/4244436289 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3d7c0ce020 con 0x56090fe44290 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3c78e09640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c74034650 0x7f3c74036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3c78e09640 1 -- 172.21.15.145:0/4244436289 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f3d7c0cc020 con 0x56090fe44290 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8be10640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c74034650 0x7f3c74036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56090fed28e0 0x56090ffcaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56090ffcb490 con 0x56090fed28e0 2024-09-11T11:01:25.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8ce12640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56090fed28e0 0x56090ffcaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8be10640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c74034650 0x7f3c74036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3d80001e20 tx=0x7f3d800013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.672+0000 7f3d8ce12640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56090fed28e0 0x56090ffcaf10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8ce12640 1 -- 172.21.15.145:0/4244436289 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x56090fed28e0 2024-09-11T11:01:25.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56090ffcc2b0 0x56090ffce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56090ffcece0 con 0x56090ffcc2b0 2024-09-11T11:01:25.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8c611640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56090ffcc2b0 0x56090ffce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8c611640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56090ffcc2b0 0x56090ffce6a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8c611640 1 -- 172.21.15.145:0/4244436289 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d7c002030 con 0x56090ffcc2b0 2024-09-11T11:01:25.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56090ffd0590 con 0x56090ffcc2b0 2024-09-11T11:01:25.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8c611640 1 -- 172.21.15.145:0/4244436289 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3d7c002030 con 0x56090ffcc2b0 2024-09-11T11:01:25.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56090ffcf700 con 0x56090ffcc2b0 2024-09-11T11:01:25.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8c611640 1 -- 172.21.15.145:0/4244436289 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d7c002030 con 0x56090ffcc2b0 2024-09-11T11:01:25.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56090ffd1940 0x56090ffd3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56090ffd4270 con 0x56090ffd1940 2024-09-11T11:01:25.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8be10640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56090ffd1940 0x56090ffd3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8be10640 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56090ffd1940 0x56090ffd3d30 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.676+0000 7f3d8be10640 1 -- 172.21.15.145:0/4244436289 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3d8000d040 con 0x56090ffd1940 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 Processor -- start 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 -- start start 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffe1c20 0x56090ffe2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56090fdd6800 con 0x56090ffe1c20 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffe1c20 0x56090ffe2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffe1c20 0x56090ffe2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49300/0 (socket says 172.21.15.145:49300) 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8c611640 1 -- 172.21.15.145:0/3524651142 learned_addr learned my addr 172.21.15.145:0/3524651142 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8c611640 1 -- 172.21.15.145:0/3524651142 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090ffe2580 con 0x56090ffe1c20 2024-09-11T11:01:25.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8c611640 1 --2- 172.21.15.145:0/3524651142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffe1c20 0x56090ffe2040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0bc950 tx=0x7f3d7c0c5890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3c71ffb640 1 -- 172.21.15.145:0/3524651142 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0bcc90 con 0x56090ffe1c20 2024-09-11T11:01:25.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3c71ffb640 1 -- 172.21.15.145:0/3524651142 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0eb070 con 0x56090ffe1c20 2024-09-11T11:01:25.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3524651142 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56090ffe2810 con 0x56090ffe1c20 2024-09-11T11:01:25.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3c71ffb640 1 -- 172.21.15.145:0/3524651142 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0c6480 con 0x56090ffe1c20 2024-09-11T11:01:25.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3524651142 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56090ffe5490 con 0x56090ffe1c20 2024-09-11T11:01:25.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3c71ffb640 1 -- 172.21.15.145:0/3524651142 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3d7c0ed020 con 0x56090ffe1c20 2024-09-11T11:01:25.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3c71ffb640 1 --2- 172.21.15.145:0/3524651142 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c640346a0 0x7f3c64036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3c71ffb640 1 -- 172.21.15.145:0/3524651142 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f3d7c0a4100 con 0x56090ffe1c20 2024-09-11T11:01:25.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8be10640 1 --2- 172.21.15.145:0/3524651142 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c640346a0 0x7f3c64036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 Processor -- start 2024-09-11T11:01:25.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 -- start start 2024-09-11T11:01:25.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8be10640 1 --2- 172.21.15.145:0/3524651142 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c640346a0 0x7f3c64036b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x56090ffc8400 tx=0x7f3d80006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090ffee940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.680+0000 7f3d8eb01980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56090fece230 con 0x56090ffee540 2024-09-11T11:01:25.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090ffee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090ffee940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49312/0 (socket says 172.21.15.145:49312) 2024-09-11T11:01:25.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 -- 172.21.15.145:0/357954733 learned_addr learned my addr 172.21.15.145:0/357954733 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 -- 172.21.15.145:0/357954733 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090ffeef10 con 0x56090ffee540 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 --2- 172.21.15.145:0/357954733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090ffee940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0cb040 tx=0x7f3d7c0dff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a89ee914107c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3c6b7fe640 1 -- 172.21.15.145:0/357954733 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c108070 con 0x56090ffee540 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3c6b7fe640 1 -- 172.21.15.145:0/357954733 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c0c7ce0 con 0x56090ffee540 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3c6b7fe640 1 -- 172.21.15.145:0/357954733 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c0e30d0 con 0x56090ffee540 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- 172.21.15.145:0/357954733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 msgr2=0x56090ffee940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/357954733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090ffee940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0cb040 tx=0x7f3d7c0dff90 comp rx=0 tx=0).stop 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- 172.21.15.145:0/357954733 shutdown_connections 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/357954733 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090ffee940 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- 172.21.15.145:0/357954733 >> 172.21.15.145:0/357954733 conn(0x56090ffea970 msgr2=0x56090ffe8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- 172.21.15.145:0/357954733 shutdown_connections 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- 172.21.15.145:0/357954733 wait complete. 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 Processor -- start 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- start start 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090fff5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56090ffef3e0 con 0x56090ffee540 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090fff5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090fff5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49318/0 (socket says 172.21.15.145:49318) 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 learned_addr learned my addr 172.21.15.145:0/3300323538 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56090fff5cc0 con 0x56090ffee540 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8c611640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090fff5780 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c005160 tx=0x7f3d7c0f5f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3c69ffb640 1 -- 172.21.15.145:0/3300323538 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c113070 con 0x56090ffee540 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56090fff5cc0 con 0x56090ffee540 2024-09-11T11:01:25.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3c69ffb640 1 -- 172.21.15.145:0/3300323538 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c002550 con 0x56090ffee540 2024-09-11T11:01:25.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3c69ffb640 1 -- 172.21.15.145:0/3300323538 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d7c108040 con 0x56090ffee540 2024-09-11T11:01:25.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.684+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56090fff5cc0 con 0x56090ffee540 2024-09-11T11:01:25.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3c69ffb640 1 -- 172.21.15.145:0/3300323538 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3d7c116070 con 0x56090ffee540 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3c69ffb640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c5c034650 0x7f3c5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3c69ffb640 1 -- 172.21.15.145:0/3300323538 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f3d7c119b00 con 0x56090ffee540 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8be10640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c5c034650 0x7f3c5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560910000790 0x560910002c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609100033a0 con 0x560910000790 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8ce12640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560910000790 0x560910002c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8be10640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c5c034650 0x7f3c5c036b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x56090ffd04d0 tx=0x7f3d80011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8ce12640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560910000790 0x560910002c50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 realm 2024-09-11T11:01:25.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56090ffffc10 con 0x560910000790 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560910003e30 con 0x560910000790 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560910004c10 0x560910007000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560910007690 con 0x560910004c10 2024-09-11T11:01:25.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8c611640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560910004c10 0x560910007000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8c611640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560910004c10 0x560910007000 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.688+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560910007bd0 con 0x560910004c10 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8eb01980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8eb01980 20 searching for the correct realm 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609100093b0 0x56091000b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56091000bf40 con 0x5609100093b0 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8be10640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609100093b0 0x56091000b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8be10640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609100093b0 0x56091000b870 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56091000bf40 con 0x560910004c10 2024-09-11T11:01:25.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8c611640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3d7c118070 0x7f3d7c006390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x7f3d7c118070 2024-09-11T11:01:25.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3d7c118070 0x7f3d7c006390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3d7c118070 0x7f3d7c006390 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x5609100093b0 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.692+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910004c10 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910004c10 2024-09-11T11:01:25.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x7f3d7c118070 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x7f3d7c118070 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910004c10 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x5609100093b0 2024-09-11T11:01:25.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910004c10 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x5609100093b0 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.696+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x5609100093b0 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x7f3d7c118070 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910000790 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x7f3d7c118070 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x5609100093b0 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x7f3d7c118070 2024-09-11T11:01:25.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910004c10 2024-09-11T11:01:25.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910004c10 2024-09-11T11:01:25.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x5609100093b0 2024-09-11T11:01:25.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.700+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910004c10 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f3d7c103070 con 0x560910004c10 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609100077e0 con 0x560910000790 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560910007bd0 con 0x560910004c10 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560910007bd0 con 0x7f3d7c118070 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 zone default found 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 4 Realm: () 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:25.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 zonegroup default 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56091000c3c0 con 0x7f3d7c118070 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609100080b0 con 0x5609100093b0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56091000e750 con 0x5609100093b0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 started sync module instance, tier type = 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.704+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56091000da80 con 0x560910004c10 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94596923187104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56091000da80 con 0x560910004c10 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56091000f210 con 0x560910000790 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94596923190560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56091000f140 con 0x560910000790 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910010110 con 0x560910004c10 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94596923187104] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94596923190560] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.708+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94596923192832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56091000fc20 con 0x560910004c10 2024-09-11T11:01:25.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609100109b0 con 0x7f3d7c118070 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94596923196672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56091000fc20 con 0x7f3d7c118070 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910011450 con 0x560910004c10 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94596923196672] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94596923192832] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94596923184592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910011410 con 0x560910004c10 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910011840 con 0x5609100093b0 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94596923197728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609100120e0 con 0x5609100093b0 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.712+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910012aa0 con 0x5609100093b0 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94596923184592] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94596923197728] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94596923205104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609100120e0 con 0x5609100093b0 2024-09-11T11:01:25.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910013340 con 0x7f3d7c118070 2024-09-11T11:01:25.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94596923205104] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94596923202608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910012050 con 0x7f3d7c118070 2024-09-11T11:01:25.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 20 add_watcher() i=0 2024-09-11T11:01:25.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 20 add_watcher() i=1 2024-09-11T11:01:25.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 20 add_watcher() i=2 2024-09-11T11:01:25.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 20 add_watcher() i=3 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 20 add_watcher() i=4 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 20 add_watcher() i=5 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 20 add_watcher() i=6 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94596923202608] v32'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 20 add_watcher() i=7 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560910016460 con 0x560910000790 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.716+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94596923207312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910013980 con 0x560910000790 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94596923207312] v32'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3c427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 5 note: GC not initialized 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3c417e2640 20 reqs_thread_entry: start 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 20 Filter name: none 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3bb2ffd640 20 reqs_thread_entry: start 2024-09-11T11:01:25.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:25.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560910039ad0 con 0x560910000790 2024-09-11T11:01:25.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 20 rados_obj.operate() r=0 bl.length=582 2024-09-11T11:01:25.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:25.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:25.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.720+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910040130 con 0x560910000790 2024-09-11T11:01:25.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v32'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8eb01980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8eb01980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8eb01980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94596923390880 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56091003bad0 con 0x560910004c10 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94596923184592 notify 137438953486 ret 0) ==== 774+0+0 (crc 0 0 0) 0x56090ffe2810 con 0x560910004c10 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3c6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94596923184592 notifier 4416 bl.length()=732 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94596923390880 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3c6b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3c6b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3c6b7fe640 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f3c50003eb0 con 0x560910004c10 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94596923390880 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56090ffe2580 con 0x560910004c10 2024-09-11T11:01:25.728 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-11T11:01:25.206338Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:25.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3c427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.724+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94596923207312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910037900 con 0x560910000790 2024-09-11T11:01:25.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94596923207312] v32'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94596923187104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910037900 con 0x560910004c10 2024-09-11T11:01:25.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94596923187104] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8eb01980 20 remove_watcher() i=0 2024-09-11T11:01:25.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8eb01980 2 removed watcher, disabling cache 2024-09-11T11:01:25.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94596923190560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910037900 con 0x560910000790 2024-09-11T11:01:25.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94596923190560] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x560910000790 2024-09-11T11:01:25.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8eb01980 20 remove_watcher() i=1 2024-09-11T11:01:25.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.728+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94596923192832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910037900 con 0x560910004c10 2024-09-11T11:01:25.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.732+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94596923192832] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.732+0000 7f3d8eb01980 20 remove_watcher() i=2 2024-09-11T11:01:25.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.732+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94596923196672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910037900 con 0x7f3d7c118070 2024-09-11T11:01:25.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.732+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94596923196672] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.732+0000 7f3d8eb01980 20 remove_watcher() i=3 2024-09-11T11:01:25.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.732+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94596923184592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910037900 con 0x560910004c10 2024-09-11T11:01:25.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8c611640 1 -- 172.21.15.145:0/3300323538 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94596923184592] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d7c115030 con 0x560910004c10 2024-09-11T11:01:25.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 20 remove_watcher() i=4 2024-09-11T11:01:25.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94596923197728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56091000d5d0 con 0x5609100093b0 2024-09-11T11:01:25.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94596923197728] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 20 remove_watcher() i=5 2024-09-11T11:01:25.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94596923205104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560910037900 con 0x5609100093b0 2024-09-11T11:01:25.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8be10640 1 -- 172.21.15.145:0/3300323538 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94596923205104] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d80036040 con 0x5609100093b0 2024-09-11T11:01:25.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 20 remove_watcher() i=6 2024-09-11T11:01:25.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94596923202608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56091000d5d0 con 0x7f3d7c118070 2024-09-11T11:01:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94596923202608] v32'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3d8400a4d0 con 0x7f3d7c118070 2024-09-11T11:01:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 20 remove_watcher() i=7 2024-09-11T11:01:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560910004c10 msgr2=0x560910007000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560910004c10 0x560910007000 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560910000790 msgr2=0x560910002c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560910000790 0x560910002c50 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3d7c118070 msgr2=0x7f3d7c006390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3d7c118070 0x7f3d7c006390 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609100093b0 msgr2=0x56091000b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609100093b0 0x56091000b870 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.736+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c5c034650 msgr2=0x7f3c5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c5c034650 0x7f3c5c036b10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x56090ffd04d0 tx=0x7f3d80011000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 msgr2=0x56090fff5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3300323538 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffee540 0x56090fff5780 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c005160 tx=0x7f3d7c0f5f60 comp rx=0 tx=0).stop 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 reap_dead start 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8ce12640 1 -- 172.21.15.145:0/3300323538 reap_dead start 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 shutdown_connections 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 >> 172.21.15.145:0/3300323538 conn(0x56090ffea970 msgr2=0x56090ffe8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 shutdown_connections 2024-09-11T11:01:25.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3300323538 wait complete. 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3524651142 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c640346a0 msgr2=0x7f3c64036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3524651142 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c640346a0 0x7f3c64036b60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x56090ffc8400 tx=0x7f3d80006000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3524651142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffe1c20 msgr2=0x56090ffe2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3524651142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffe1c20 0x56090ffe2040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0bc950 tx=0x7f3d7c0c5890 comp rx=0 tx=0).stop 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3524651142 shutdown_connections 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3524651142 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c640346a0 0x7f3c64036b60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/3524651142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090ffe1c20 0x56090ffe2040 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3524651142 >> 172.21.15.145:0/3524651142 conn(0x56090ffd6d70 msgr2=0x56090ffd97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3524651142 shutdown_connections 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/3524651142 wait complete. 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56090ffcc2b0 msgr2=0x56090ffce6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56090ffcc2b0 0x56090ffce6a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56090fed28e0 msgr2=0x56090ffcaf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56090fed28e0 0x56090ffcaf10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56090ffd1940 msgr2=0x56090ffd3d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56090ffd1940 0x56090ffd3d30 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c74034650 msgr2=0x7f3c74036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3c74034650 0x7f3c74036b10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3d80001e20 tx=0x7f3d800013a0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 msgr2=0x56090ffc3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 --2- 172.21.15.145:0/4244436289 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56090fe44290 0x56090ffc3e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0199f0 tx=0x7f3d7c0180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8ce12640 1 -- 172.21.15.145:0/4244436289 reap_dead start 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 shutdown_connections 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 >> 172.21.15.145:0/4244436289 conn(0x56090feca090 msgr2=0x56090fece750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 shutdown_connections 2024-09-11T11:01:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.740+0000 7f3d8eb01980 1 -- 172.21.15.145:0/4244436289 wait complete. 2024-09-11T11:01:25.751 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-11T11:01:25.206338Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:25.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-11T11:01:25.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-11T11:01:25.752 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-11T11:01:25.824 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:25.824 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:25.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f2003dd5980 1 Processor -- start 2024-09-11T11:01:25.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f2003dd5980 1 -- start start 2024-09-11T11:01:25.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f2003dd5980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564b9f1a89b0 0x564b9f1aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f2003dd5980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564b9f02cae0 con 0x564b9f1a4630 2024-09-11T11:01:25.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f2003dd5980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x564b9f050e30 con 0x564b9f1a89b0 2024-09-11T11:01:25.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20010e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564b9f1a89b0 0x564b9f1aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20010e4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564b9f1a89b0 0x564b9f1aada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49330/0 (socket says 172.21.15.145:49330) 2024-09-11T11:01:25.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20010e4640 1 -- 172.21.15.145:0/2108772749 learned_addr learned my addr 172.21.15.145:0/2108772749 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20010e4640 1 -- 172.21.15.145:0/2108772749 >> v1:172.21.15.102:6789/0 conn(0x564b9f1a4630 legacy=0x564b9f1a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20010e4640 1 -- 172.21.15.145:0/2108772749 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9f1ac2f0 con 0x564b9f1a89b0 2024-09-11T11:01:25.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20010e4640 1 --2- 172.21.15.145:0/2108772749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 0x564b9f1aada0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800a5c0 tx=0x7f1ff801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef04079ea714169f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20008e3640 1 -- 172.21.15.145:0/2108772749 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff80a6070 con 0x564b9f1a89b0 2024-09-11T11:01:25.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20008e3640 1 -- 172.21.15.145:0/2108772749 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff80af070 con 0x564b9f1a89b0 2024-09-11T11:01:25.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.824+0000 7f20008e3640 1 -- 172.21.15.145:0/2108772749 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff80aa5c0 con 0x564b9f1a89b0 2024-09-11T11:01:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.828+0000 7f2003dd5980 1 -- 172.21.15.145:0/2108772749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 msgr2=0x564b9f1aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.828+0000 7f2003dd5980 1 --2- 172.21.15.145:0/2108772749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 0x564b9f1aada0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800a5c0 tx=0x7f1ff801b340 comp rx=0 tx=0).stop 2024-09-11T11:01:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.828+0000 7f2003dd5980 1 -- 172.21.15.145:0/2108772749 shutdown_connections 2024-09-11T11:01:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.828+0000 7f2003dd5980 1 --2- 172.21.15.145:0/2108772749 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 0x564b9f1aada0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.828+0000 7f2003dd5980 1 -- 172.21.15.145:0/2108772749 >> 172.21.15.145:0/2108772749 conn(0x564b9f1a0150 msgr2=0x564b9f1a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.828+0000 7f2003dd5980 1 -- 172.21.15.145:0/2108772749 shutdown_connections 2024-09-11T11:01:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.828+0000 7f2003dd5980 1 -- 172.21.15.145:0/2108772749 wait complete. 2024-09-11T11:01:25.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 Processor -- start 2024-09-11T11:01:25.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 -- start start 2024-09-11T11:01:25.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a4630 0x564b9f28f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564b9f052200 con 0x564b9f1a4630 2024-09-11T11:01:25.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a4630 0x564b9f28f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a4630 0x564b9f28f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49344/0 (socket says 172.21.15.145:49344) 2024-09-11T11:01:25.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f20018e5640 1 -- 172.21.15.145:0/3475041532 learned_addr learned my addr 172.21.15.145:0/3475041532 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f20018e5640 1 -- 172.21.15.145:0/3475041532 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9f28ff90 con 0x564b9f1a4630 2024-09-11T11:01:25.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f20018e5640 1 --2- 172.21.15.145:0/3475041532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a4630 0x564b9f28f9c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4001ea0 tx=0x7f1ff400b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7edc779181ad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f1eefe07640 1 -- 172.21.15.145:0/3475041532 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff400a040 con 0x564b9f1a4630 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f1eefe07640 1 -- 172.21.15.145:0/3475041532 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff400f620 con 0x564b9f1a4630 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f1eefe07640 1 -- 172.21.15.145:0/3475041532 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff400f890 con 0x564b9f1a4630 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 -- 172.21.15.145:0/3475041532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a4630 msgr2=0x564b9f28f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 --2- 172.21.15.145:0/3475041532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a4630 0x564b9f28f9c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4001ea0 tx=0x7f1ff400b680 comp rx=0 tx=0).stop 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 -- 172.21.15.145:0/3475041532 shutdown_connections 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 --2- 172.21.15.145:0/3475041532 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a4630 0x564b9f28f9c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 -- 172.21.15.145:0/3475041532 >> 172.21.15.145:0/3475041532 conn(0x564b9f1a0150 msgr2=0x564b9f28b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.840+0000 7f2003dd5980 1 -- 172.21.15.145:0/3475041532 shutdown_connections 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 -- 172.21.15.145:0/3475041532 wait complete. 2024-09-11T11:01:25.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 Processor -- start 2024-09-11T11:01:25.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 -- start start 2024-09-11T11:01:25.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 0x564b9f297020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564b9f1abdf0 con 0x564b9f1a89b0 2024-09-11T11:01:25.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 0x564b9f297020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 0x564b9f297020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49360/0 (socket says 172.21.15.145:49360) 2024-09-11T11:01:25.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f20018e5640 1 -- 172.21.15.145:0/249802452 learned_addr learned my addr 172.21.15.145:0/249802452 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f20018e5640 1 -- 172.21.15.145:0/249802452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9f297560 con 0x564b9f1a89b0 2024-09-11T11:01:25.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f20018e5640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 0x564b9f297020 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4001fd0 tx=0x7f1ff4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f1eee604640 1 -- 172.21.15.145:0/249802452 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4001520 con 0x564b9f1a89b0 2024-09-11T11:01:25.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b9f2977f0 con 0x564b9f1a89b0 2024-09-11T11:01:25.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f1eee604640 1 -- 172.21.15.145:0/249802452 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff401c970 con 0x564b9f1a89b0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f1eee604640 1 -- 172.21.15.145:0/249802452 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff401ccb0 con 0x564b9f1a89b0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9f29a4d0 con 0x564b9f1a89b0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f1eee604640 1 -- 172.21.15.145:0/249802452 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ff4017050 con 0x564b9f1a89b0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f1eee604640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ee8034650 0x7f1ee8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f1eee604640 1 -- 172.21.15.145:0/249802452 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f1ff4015020 con 0x564b9f1a89b0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f20010e4640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ee8034650 0x7f1ee8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f29c110 0x564b9f29e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f29ea40 con 0x564b9f29c110 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f20020e6640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f29c110 0x564b9f29e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.844+0000 7f20010e4640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ee8034650 0x7f1ee8036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80ae000 tx=0x7f1ff80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f20020e6640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f29c110 0x564b9f29e500 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f20020e6640 1 -- 172.21.15.145:0/249802452 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f29c110 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f2003dd5980 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f29f7d0 0x564b9f2a1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2a2200 con 0x564b9f29f7d0 2024-09-11T11:01:25.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f20018e5640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f29f7d0 0x564b9f2a1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f20018e5640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f29f7d0 0x564b9f2a1bc0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f20018e5640 1 -- 172.21.15.145:0/249802452 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ff402e070 con 0x564b9f29f7d0 2024-09-11T11:01:25.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2a3ab0 con 0x564b9f29f7d0 2024-09-11T11:01:25.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f20018e5640 1 -- 172.21.15.145:0/249802452 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ff402e070 con 0x564b9f29f7d0 2024-09-11T11:01:25.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2a2ce0 con 0x564b9f29f7d0 2024-09-11T11:01:25.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f20018e5640 1 -- 172.21.15.145:0/249802452 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ff402e070 con 0x564b9f29f7d0 2024-09-11T11:01:25.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f2003dd5980 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564b9f2a4e60 0x564b9f2a7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2a7790 con 0x564b9f2a4e60 2024-09-11T11:01:25.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.848+0000 7f20010e4640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564b9f2a4e60 0x564b9f2a7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f20010e4640 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564b9f2a4e60 0x564b9f2a7250 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f20010e4640 1 -- 172.21.15.145:0/249802452 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2a4e60 2024-09-11T11:01:25.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f2003dd5980 1 Processor -- start 2024-09-11T11:01:25.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f2003dd5980 1 -- start start 2024-09-11T11:01:25.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f2003dd5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2b5190 0x564b9f2b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f2003dd5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564b9f0ab800 con 0x564b9f2b5190 2024-09-11T11:01:25.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2b5190 0x564b9f2b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2b5190 0x564b9f2b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49370/0 (socket says 172.21.15.145:49370) 2024-09-11T11:01:25.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f20018e5640 1 -- 172.21.15.145:0/4068385201 learned_addr learned my addr 172.21.15.145:0/4068385201 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f20018e5640 1 -- 172.21.15.145:0/4068385201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9f2b5af0 con 0x564b9f2b5190 2024-09-11T11:01:25.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f20018e5640 1 --2- 172.21.15.145:0/4068385201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2b5190 0x564b9f2b55b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ff404a060 tx=0x7f1ff402f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f1ee77fe640 1 -- 172.21.15.145:0/4068385201 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff401a880 con 0x564b9f2b5190 2024-09-11T11:01:25.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f1ee77fe640 1 -- 172.21.15.145:0/4068385201 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff4013130 con 0x564b9f2b5190 2024-09-11T11:01:25.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f2003dd5980 1 -- 172.21.15.145:0/4068385201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b9f2b5d80 con 0x564b9f2b5190 2024-09-11T11:01:25.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f1ee77fe640 1 -- 172.21.15.145:0/4068385201 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4013410 con 0x564b9f2b5190 2024-09-11T11:01:25.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f2003dd5980 1 -- 172.21.15.145:0/4068385201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9f2b8a00 con 0x564b9f2b5190 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f1ee77fe640 1 -- 172.21.15.145:0/4068385201 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ff404f020 con 0x564b9f2b5190 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f1ee77fe640 1 --2- 172.21.15.145:0/4068385201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1edc034650 0x7f1edc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f1ee77fe640 1 -- 172.21.15.145:0/4068385201 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f1ff4038070 con 0x564b9f2b5190 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f20010e4640 1 --2- 172.21.15.145:0/4068385201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1edc034650 0x7f1edc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.852+0000 7f2003dd5980 1 Processor -- start 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- start start 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20010e4640 1 --2- 172.21.15.145:0/4068385201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1edc034650 0x7f1edc036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x564b9f29b610 tx=0x7f1ff8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564b9f290310 con 0x564b9f2c1b30 2024-09-11T11:01:25.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49382/0 (socket says 172.21.15.145:49382) 2024-09-11T11:01:25.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 -- 172.21.15.145:0/1432416879 learned_addr learned my addr 172.21.15.145:0/1432416879 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 -- 172.21.15.145:0/1432416879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9f2c24e0 con 0x564b9f2c1b30 2024-09-11T11:01:25.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 --2- 172.21.15.145:0/1432416879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c1f10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4017020 tx=0x7f1ff40139b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a693eb2bdac865 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f1ee57fa640 1 -- 172.21.15.145:0/1432416879 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4062070 con 0x564b9f2c1b30 2024-09-11T11:01:25.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f1ee57fa640 1 -- 172.21.15.145:0/1432416879 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff4041b20 con 0x564b9f2c1b30 2024-09-11T11:01:25.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f1ee57fa640 1 -- 172.21.15.145:0/1432416879 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4057040 con 0x564b9f2c1b30 2024-09-11T11:01:25.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- 172.21.15.145:0/1432416879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 msgr2=0x564b9f2c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1432416879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c1f10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4017020 tx=0x7f1ff40139b0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- 172.21.15.145:0/1432416879 shutdown_connections 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1432416879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c1f10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- 172.21.15.145:0/1432416879 >> 172.21.15.145:0/1432416879 conn(0x564b9f2bdf10 msgr2=0x564b9f2bc010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- 172.21.15.145:0/1432416879 shutdown_connections 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- 172.21.15.145:0/1432416879 wait complete. 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 Processor -- start 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- start start 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564b9f2c2980 con 0x564b9f2c1b30 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49384/0 (socket says 172.21.15.145:49384) 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 learned_addr learned my addr 172.21.15.145:0/1184401098 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9f2c91f0 con 0x564b9f2c1b30 2024-09-11T11:01:25.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f20018e5640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c8cb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4017020 tx=0x7f1ff4007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f1ed37fe640 1 -- 172.21.15.145:0/1184401098 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4062030 con 0x564b9f2c1b30 2024-09-11T11:01:25.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564b9f2c91f0 con 0x564b9f2c1b30 2024-09-11T11:01:25.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f1ed37fe640 1 -- 172.21.15.145:0/1184401098 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff4029e00 con 0x564b9f2c1b30 2024-09-11T11:01:25.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.856+0000 7f1ed37fe640 1 -- 172.21.15.145:0/1184401098 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ff4048700 con 0x564b9f2c1b30 2024-09-11T11:01:25.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9f2c91f0 con 0x564b9f2c1b30 2024-09-11T11:01:25.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f1ed37fe640 1 -- 172.21.15.145:0/1184401098 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ff4070020 con 0x564b9f2c1b30 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f1ed37fe640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ecc034600 0x7f1ecc036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f1ed37fe640 1 -- 172.21.15.145:0/1184401098 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f1ff406e020 con 0x564b9f2c1b30 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20010e4640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ecc034600 0x7f1ecc036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f2d3c80 0x564b9f2d6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2d6890 con 0x564b9f2d3c80 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20020e6640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f2d3c80 0x564b9f2d6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20010e4640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ecc034600 0x7f1ecc036ac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8000c10 tx=0x7f1ff80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20020e6640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f2d3c80 0x564b9f2d6140 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 20 realm 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2d3100 con 0x564b9f2d3c80 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2d7320 con 0x564b9f2d3c80 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f2d8100 0x564b9f2da4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2dab80 con 0x564b9f2d8100 2024-09-11T11:01:25.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20018e5640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f2d8100 0x564b9f2da4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.860+0000 7f20018e5640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f2d8100 0x564b9f2da4f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f2003dd5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2db0c0 con 0x564b9f2d8100 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f2003dd5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f2003dd5980 20 searching for the correct realm 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564b9f2dc8d0 0x564b9f2ded90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2df460 con 0x564b9f2dc8d0 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20010e4640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564b9f2dc8d0 0x564b9f2ded90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20010e4640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564b9f2dc8d0 0x564b9f2ded90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2df460 con 0x564b9f2d8100 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20018e5640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ff4041120 0x7f1ff4078a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x7f1ff4041120 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ff4041120 0x7f1ff4078a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ff4041120 0x7f1ff4078a20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2dc8d0 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.864+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d8100 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d8100 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x7f1ff4041120 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x7f1ff4041120 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d8100 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2dc8d0 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d8100 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2dc8d0 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.868+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2dc8d0 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x7f1ff4041120 2024-09-11T11:01:25.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d3c80 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x7f1ff4041120 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2dc8d0 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x7f1ff4041120 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d8100 2024-09-11T11:01:25.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d8100 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2dc8d0 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.872+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d8100 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f1ff407d040 con 0x564b9f2d8100 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:25.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2dad00 con 0x564b9f2d3c80 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2db0f0 con 0x564b9f2d8100 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2db0f0 con 0x7f1ff4041120 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 zone default found 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 4 Realm: () 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 zonegroup default 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2df8e0 con 0x7f1ff4041120 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e16c0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e1b50 con 0x564b9f2dc8d0 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 started sync module instance, tier type = 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.876+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e0b00 con 0x564b9f2d8100 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.880+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.880+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94882793132032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e0b00 con 0x564b9f2d8100 2024-09-11T11:01:25.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.880+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e0b00 con 0x564b9f2d3c80 2024-09-11T11:01:25.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.880+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.880+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94882793136416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e2b60 con 0x564b9f2d3c80 2024-09-11T11:01:25.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.880+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e3560 con 0x564b9f2d8100 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.880+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94882793136416] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.880+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94882793132032] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94882793129552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e3070 con 0x564b9f2d8100 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e3a30 con 0x7f1ff4041120 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94882793141632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e39a0 con 0x7f1ff4041120 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e4970 con 0x564b9f2d8100 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94882793129552] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94882793141632] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94882793143840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e4930 con 0x564b9f2d8100 2024-09-11T11:01:25.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.884+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e4d60 con 0x564b9f2dc8d0 2024-09-11T11:01:25.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94882793137840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e55b0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e5f70 con 0x564b9f2dc8d0 2024-09-11T11:01:25.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94882793143840] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94882793145408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e6810 con 0x564b9f2dc8d0 2024-09-11T11:01:25.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e71d0 con 0x7f1ff4041120 2024-09-11T11:01:25.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94882793137840] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94882793148672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e71d0 con 0x7f1ff4041120 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 20 add_watcher() i=0 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 20 add_watcher() i=1 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 20 add_watcher() i=2 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 20 add_watcher() i=3 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 20 add_watcher() i=4 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 20 add_watcher() i=5 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94882793145408] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 20 add_watcher() i=6 2024-09-11T11:01:25.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94882793148672] v32'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 20 add_watcher() i=7 2024-09-11T11:01:25.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:25.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e71d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.888+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94882793155872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e7140 con 0x564b9f2d3c80 2024-09-11T11:01:25.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94882793155872] v32'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f1eb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:25.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:25.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 5 note: GC not initialized 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f1eb27fc640 20 reqs_thread_entry: start 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 20 Filter name: none 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f1e23fff640 20 reqs_thread_entry: start 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f30d780 con 0x564b9f2d3c80 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 20 rados_obj.operate() r=0 bl.length=556 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:25.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.892+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f313e50 con 0x564b9f2d3c80 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v32'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f2003dd5980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f2003dd5980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f2003dd5980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94882793339136 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f30f600 con 0x564b9f2d8100 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94882793143840 notify 137438953487 ret 0) ==== 609+0+0 (crc 0 0 0) 0x564b9f2b5d80 con 0x564b9f2d8100 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f1ee57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 94882793143840 notifier 4423 bl.length()=567 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f1ee57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f1ee57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:25.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94882793339136 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f1ee57fa640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1ec4003eb0 con 0x564b9f2d8100 2024-09-11T11:01:25.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94882793339136 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b9f2b5af0 con 0x564b9f2d8100 2024-09-11T11:01:25.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f313900 con 0x7f1ff4041120 2024-09-11T11:01:25.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(66 foo:foo2 [delete] v32'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f2003dd5980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-11T11:01:25.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94882793339136 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564b9f30f150 con 0x564b9f2d8100 2024-09-11T11:01:25.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 94882793132032 notify 137438953488 ret 0) ==== 201+0+0 (crc 0 0 0) 0x564b9f2b5af0 con 0x564b9f2d8100 2024-09-11T11:01:25.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f1ee57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94882793132032 notifier 4423 bl.length()=159 2024-09-11T11:01:25.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f1ee57fa640 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f1ec4003eb0 con 0x564b9f2d8100 2024-09-11T11:01:25.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.896+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(67 notify.0 [notify cookie 94882793339136 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.900+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== watch-notify(notify_complete (2) cookie 94882793339136 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564b9f29a4d0 con 0x564b9f2d8100 2024-09-11T11:01:25.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.900+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.902 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:25.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.900+0000 7f1eb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:25.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.900+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94882793155872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f30f600 con 0x564b9f2d3c80 2024-09-11T11:01:25.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94882793155872] v32'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94882793132032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e6d20 con 0x564b9f2d8100 2024-09-11T11:01:25.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94882793132032] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f2003dd5980 20 remove_watcher() i=0 2024-09-11T11:01:25.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f2003dd5980 2 removed watcher, disabling cache 2024-09-11T11:01:25.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94882793136416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e1000 con 0x564b9f2d3c80 2024-09-11T11:01:25.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94882793136416] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x564b9f2d3c80 2024-09-11T11:01:25.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f2003dd5980 20 remove_watcher() i=1 2024-09-11T11:01:25.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.904+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94882793129552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e6d20 con 0x564b9f2d8100 2024-09-11T11:01:25.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.908+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94882793129552] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.908+0000 7f2003dd5980 20 remove_watcher() i=2 2024-09-11T11:01:25.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.908+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94882793141632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e1000 con 0x7f1ff4041120 2024-09-11T11:01:25.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.908+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94882793141632] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.908+0000 7f2003dd5980 20 remove_watcher() i=3 2024-09-11T11:01:25.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.908+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94882793143840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e0650 con 0x564b9f2d8100 2024-09-11T11:01:25.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f20018e5640 1 -- 172.21.15.145:0/1184401098 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94882793143840] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff405a040 con 0x564b9f2d8100 2024-09-11T11:01:25.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 20 remove_watcher() i=4 2024-09-11T11:01:25.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94882793137840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e6d20 con 0x564b9f2dc8d0 2024-09-11T11:01:25.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94882793137840] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 20 remove_watcher() i=5 2024-09-11T11:01:25.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94882793145408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e3580 con 0x564b9f2dc8d0 2024-09-11T11:01:25.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f20010e4640 1 -- 172.21.15.145:0/1184401098 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94882793145408] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ff80aaae0 con 0x564b9f2dc8d0 2024-09-11T11:01:25.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 20 remove_watcher() i=6 2024-09-11T11:01:25.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94882793148672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564b9f2e1000 con 0x7f1ff4041120 2024-09-11T11:01:25.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94882793148672] v32'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ffc00a4d0 con 0x7f1ff4041120 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 20 remove_watcher() i=7 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f2d8100 msgr2=0x564b9f2da4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f2d8100 0x564b9f2da4f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f2d3c80 msgr2=0x564b9f2d6140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f2d3c80 0x564b9f2d6140 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ff4041120 msgr2=0x7f1ff4078a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ff4041120 0x7f1ff4078a20 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564b9f2dc8d0 msgr2=0x564b9f2ded90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564b9f2dc8d0 0x564b9f2ded90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ecc034600 msgr2=0x7f1ecc036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ecc034600 0x7f1ecc036ac0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8000c10 tx=0x7f1ff80c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:25.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 msgr2=0x564b9f2c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f20020e6640 1 -- 172.21.15.145:0/1184401098 reap_dead start 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c8cb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4017020 tx=0x7f1ff4007f00 comp rx=0 tx=0).stop 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 shutdown_connections 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 --2- 172.21.15.145:0/1184401098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2c1b30 0x564b9f2c8cb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 >> 172.21.15.145:0/1184401098 conn(0x564b9f2bdf10 msgr2=0x564b9f2bbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 shutdown_connections 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.912+0000 7f2003dd5980 1 -- 172.21.15.145:0/1184401098 wait complete. 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/4068385201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1edc034650 msgr2=0x7f1edc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/4068385201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1edc034650 0x7f1edc036b10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x564b9f29b610 tx=0x7f1ff8005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/4068385201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2b5190 msgr2=0x564b9f2b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/4068385201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2b5190 0x564b9f2b55b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ff404a060 tx=0x7f1ff402f9a0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/4068385201 shutdown_connections 2024-09-11T11:01:25.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/4068385201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1edc034650 0x7f1edc036b10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/4068385201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f2b5190 0x564b9f2b55b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/4068385201 >> 172.21.15.145:0/4068385201 conn(0x564b9f2aa2e0 msgr2=0x564b9f2acd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/4068385201 shutdown_connections 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/4068385201 wait complete. 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f29f7d0 msgr2=0x564b9f2a1bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564b9f29f7d0 0x564b9f2a1bc0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f29c110 msgr2=0x564b9f29e500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564b9f29c110 0x564b9f29e500 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564b9f2a4e60 msgr2=0x564b9f2a7250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564b9f2a4e60 0x564b9f2a7250 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ee8034650 msgr2=0x7f1ee8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ee8034650 0x7f1ee8036b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80ae000 tx=0x7f1ff80a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 msgr2=0x564b9f297020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 --2- 172.21.15.145:0/249802452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564b9f1a89b0 0x564b9f297020 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4001fd0 tx=0x7f1ff4000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:25.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f20020e6640 1 -- 172.21.15.145:0/249802452 reap_dead start 2024-09-11T11:01:25.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 shutdown_connections 2024-09-11T11:01:25.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 >> 172.21.15.145:0/249802452 conn(0x564b9f1a0150 msgr2=0x564b9f28a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:25.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 shutdown_connections 2024-09-11T11:01:25.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.916+0000 7f2003dd5980 1 -- 172.21.15.145:0/249802452 wait complete. 2024-09-11T11:01:25.927 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:25.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-11T11:01:25.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-11T11:01:25.927 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-11T11:01:25.995 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:25.995 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:25.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.992+0000 7f8b4a2d1980 1 Processor -- start 2024-09-11T11:01:25.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.992+0000 7f8b4a2d1980 1 -- start start 2024-09-11T11:01:25.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.992+0000 7f8b4a2d1980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564ef4cad570 0x564ef4cad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:25.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.992+0000 7f8b4a2d1980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ef4b36ae0 con 0x564ef4cadec0 2024-09-11T11:01:25.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.992+0000 7f8b4a2d1980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x564ef4b5ae30 con 0x564ef4cad570 2024-09-11T11:01:25.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.992+0000 7f8b47de1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564ef4cad570 0x564ef4cad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:25.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.992+0000 7f8b47de1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564ef4cad570 0x564ef4cad950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49390/0 (socket says 172.21.15.145:49390) 2024-09-11T11:01:25.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.992+0000 7f8b47de1640 1 -- 172.21.15.145:0/2741510459 learned_addr learned my addr 172.21.15.145:0/2741510459 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:25.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.996+0000 7f8b47de1640 1 -- 172.21.15.145:0/2741510459 >> v1:172.21.15.102:6789/0 conn(0x564ef4cadec0 legacy=0x564ef4cb28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:25.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.996+0000 7f8b47de1640 1 -- 172.21.15.145:0/2741510459 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef4cb5140 con 0x564ef4cad570 2024-09-11T11:01:25.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:25.996+0000 7f8b47de1640 1 --2- 172.21.15.145:0/2741510459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4cad950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800a5c0 tx=0x7f8b3801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=726b75ed906a5cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b46ddf640 1 -- 172.21.15.145:0/2741510459 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380a6070 con 0x564ef4cad570 2024-09-11T11:01:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b46ddf640 1 -- 172.21.15.145:0/2741510459 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b380af070 con 0x564ef4cad570 2024-09-11T11:01:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b46ddf640 1 -- 172.21.15.145:0/2741510459 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380aa5c0 con 0x564ef4cad570 2024-09-11T11:01:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2741510459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 msgr2=0x564ef4cad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/2741510459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4cad950 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800a5c0 tx=0x7f8b3801b340 comp rx=0 tx=0).stop 2024-09-11T11:01:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2741510459 shutdown_connections 2024-09-11T11:01:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/2741510459 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4cad950 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2741510459 >> 172.21.15.145:0/2741510459 conn(0x564ef4ca9090 msgr2=0x564ef4cab4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2741510459 shutdown_connections 2024-09-11T11:01:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.000+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2741510459 wait complete. 2024-09-11T11:01:26.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 Processor -- start 2024-09-11T11:01:26.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- start start 2024-09-11T11:01:26.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d978a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564ef4b5c200 con 0x564ef4cad570 2024-09-11T11:01:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49394/0 (socket says 172.21.15.145:49394) 2024-09-11T11:01:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 -- 172.21.15.145:0/729432768 learned_addr learned my addr 172.21.15.145:0/729432768 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 -- 172.21.15.145:0/729432768 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef4d97e70 con 0x564ef4cad570 2024-09-11T11:01:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 --2- 172.21.15.145:0/729432768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d978a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800a5c0 tx=0x7f8b38003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b216489ae1b7470 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8a35e0b640 1 -- 172.21.15.145:0/729432768 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380aa9f0 con 0x564ef4cad570 2024-09-11T11:01:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8a35e0b640 1 -- 172.21.15.145:0/729432768 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b380aab90 con 0x564ef4cad570 2024-09-11T11:01:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8a35e0b640 1 -- 172.21.15.145:0/729432768 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380bd3f0 con 0x564ef4cad570 2024-09-11T11:01:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/729432768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 msgr2=0x564ef4d978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/729432768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d978a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800a5c0 tx=0x7f8b38003030 comp rx=0 tx=0).stop 2024-09-11T11:01:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/729432768 shutdown_connections 2024-09-11T11:01:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/729432768 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d978a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/729432768 >> 172.21.15.145:0/729432768 conn(0x564ef4ca9090 msgr2=0x564ef4d934d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/729432768 shutdown_connections 2024-09-11T11:01:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/729432768 wait complete. 2024-09-11T11:01:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 Processor -- start 2024-09-11T11:01:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- start start 2024-09-11T11:01:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d9ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b4a2d1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564ef4cb4b80 con 0x564ef4cad570 2024-09-11T11:01:26.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d9ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d9ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49396/0 (socket says 172.21.15.145:49396) 2024-09-11T11:01:26.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 -- 172.21.15.145:0/275311070 learned_addr learned my addr 172.21.15.145:0/275311070 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.016+0000 7f8b47de1640 1 -- 172.21.15.145:0/275311070 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef4d9efb0 con 0x564ef4cad570 2024-09-11T11:01:26.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b47de1640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d9ea70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800a5c0 tx=0x7f8b380180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8a2ffff640 1 -- 172.21.15.145:0/275311070 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380c6750 con 0x564ef4cad570 2024-09-11T11:01:26.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ef4d9f240 con 0x564ef4cad570 2024-09-11T11:01:26.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8a2ffff640 1 -- 172.21.15.145:0/275311070 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b380c68f0 con 0x564ef4cad570 2024-09-11T11:01:26.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8a2ffff640 1 -- 172.21.15.145:0/275311070 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380c6bd0 con 0x564ef4cad570 2024-09-11T11:01:26.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef4da1f20 con 0x564ef4cad570 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8a2ffff640 1 -- 172.21.15.145:0/275311070 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8b380ce020 con 0x564ef4cad570 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8a2ffff640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a30034650 0x7f8a30036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8a2ffff640 1 -- 172.21.15.145:0/275311070 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8b380cc020 con 0x564ef4cad570 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b475e0640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a30034650 0x7f8a30036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4cadec0 0x564ef4da5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4da60a0 con 0x564ef4cadec0 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b485e2640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4cadec0 0x564ef4da5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b475e0640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a30034650 0x7f8a30036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c001e20 tx=0x7f8b3c0013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b485e2640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4cadec0 0x564ef4da5a60 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b485e2640 1 -- 172.21.15.145:0/275311070 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4cadec0 2024-09-11T11:01:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4da6e70 0x564ef4da9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4da98c0 con 0x564ef4da6e70 2024-09-11T11:01:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b47de1640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4da6e70 0x564ef4da9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.020+0000 7f8b47de1640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4da6e70 0x564ef4da9260 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b47de1640 1 -- 172.21.15.145:0/275311070 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b380d0c60 con 0x564ef4da6e70 2024-09-11T11:01:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dab170 con 0x564ef4da6e70 2024-09-11T11:01:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b47de1640 1 -- 172.21.15.145:0/275311070 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b380d0c60 con 0x564ef4da6e70 2024-09-11T11:01:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4daa3a0 con 0x564ef4da6e70 2024-09-11T11:01:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b47de1640 1 -- 172.21.15.145:0/275311070 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b380d0c60 con 0x564ef4da6e70 2024-09-11T11:01:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564ef4dac520 0x564ef4dae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4daee50 con 0x564ef4dac520 2024-09-11T11:01:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b475e0640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564ef4dac520 0x564ef4dae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b475e0640 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564ef4dac520 0x564ef4dae910 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b475e0640 1 -- 172.21.15.145:0/275311070 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8b3c00d040 con 0x564ef4dac520 2024-09-11T11:01:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b4a2d1980 1 Processor -- start 2024-09-11T11:01:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b4a2d1980 1 -- start start 2024-09-11T11:01:26.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b4a2d1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dbc850 0x564ef4dbcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b4a2d1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564ef4bb5800 con 0x564ef4dbc850 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dbc850 0x564ef4dbcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dbc850 0x564ef4dbcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49398/0 (socket says 172.21.15.145:49398) 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.024+0000 7f8b47de1640 1 -- 172.21.15.145:0/2518428892 learned_addr learned my addr 172.21.15.145:0/2518428892 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b47de1640 1 -- 172.21.15.145:0/2518428892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef4dbd1b0 con 0x564ef4dbc850 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b47de1640 1 --2- 172.21.15.145:0/2518428892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dbc850 0x564ef4dbcc70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8b380e51f0 tx=0x7f8b380bc850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a2d7fa640 1 -- 172.21.15.145:0/2518428892 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380ed070 con 0x564ef4dbc850 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a2d7fa640 1 -- 172.21.15.145:0/2518428892 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b380e34e0 con 0x564ef4dbc850 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2518428892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ef4dbd440 con 0x564ef4dbc850 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a2d7fa640 1 -- 172.21.15.145:0/2518428892 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380cf990 con 0x564ef4dbc850 2024-09-11T11:01:26.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2518428892 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef4dc00c0 con 0x564ef4dbc850 2024-09-11T11:01:26.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a2d7fa640 1 -- 172.21.15.145:0/2518428892 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8b380f0070 con 0x564ef4dbc850 2024-09-11T11:01:26.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a2d7fa640 1 --2- 172.21.15.145:0/2518428892 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a20034650 0x7f8a20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a2d7fa640 1 -- 172.21.15.145:0/2518428892 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8b380f3af0 con 0x564ef4dbc850 2024-09-11T11:01:26.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b475e0640 1 --2- 172.21.15.145:0/2518428892 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a20034650 0x7f8a20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b4a2d1980 1 Processor -- start 2024-09-11T11:01:26.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b4a2d1980 1 -- start start 2024-09-11T11:01:26.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b475e0640 1 --2- 172.21.15.145:0/2518428892 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a20034650 0x7f8a20036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x564ef4da3060 tx=0x7f8b3c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b4a2d1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dc9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b4a2d1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564ef4d98130 con 0x564ef4dc9110 2024-09-11T11:01:26.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dc9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dc9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49412/0 (socket says 172.21.15.145:49412) 2024-09-11T11:01:26.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b47de1640 1 -- 172.21.15.145:0/176432755 learned_addr learned my addr 172.21.15.145:0/176432755 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b47de1640 1 -- 172.21.15.145:0/176432755 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef4dc9ae0 con 0x564ef4dc9110 2024-09-11T11:01:26.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8b47de1640 1 --2- 172.21.15.145:0/176432755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dc9510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8b380bca60 tx=0x7f8b380c5970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1875c03753ebab server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a26ffd640 1 -- 172.21.15.145:0/176432755 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380d2e20 con 0x564ef4dc9110 2024-09-11T11:01:26.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a26ffd640 1 -- 172.21.15.145:0/176432755 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b380d2bc0 con 0x564ef4dc9110 2024-09-11T11:01:26.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.028+0000 7f8a26ffd640 1 -- 172.21.15.145:0/176432755 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380c5d10 con 0x564ef4dc9110 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/176432755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 msgr2=0x564ef4dc9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/176432755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dc9510 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8b380bca60 tx=0x7f8b380c5970 comp rx=0 tx=0).stop 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/176432755 shutdown_connections 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/176432755 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dc9510 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/176432755 >> 172.21.15.145:0/176432755 conn(0x564ef4dc5540 msgr2=0x564ef4dc3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/176432755 shutdown_connections 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/176432755 wait complete. 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 Processor -- start 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- start start 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dd0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564ef4dc9fb0 con 0x564ef4dc9110 2024-09-11T11:01:26.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dd0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b47de1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dd0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49422/0 (socket says 172.21.15.145:49422) 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 learned_addr learned my addr 172.21.15.145:0/4160966152 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ef4dd08d0 con 0x564ef4dc9110 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b47de1640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dd0390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b380f3de0 tx=0x7f8b380eeed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8a257fa640 1 -- 172.21.15.145:0/4160966152 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b3810d070 con 0x564ef4dc9110 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ef4dd08d0 con 0x564ef4dc9110 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8a257fa640 1 -- 172.21.15.145:0/4160966152 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b380d2e20 con 0x564ef4dc9110 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8a257fa640 1 -- 172.21.15.145:0/4160966152 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b380d27e0 con 0x564ef4dc9110 2024-09-11T11:01:26.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ef4dd0d40 con 0x564ef4dc9110 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8a257fa640 1 -- 172.21.15.145:0/4160966152 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8b38110070 con 0x564ef4dc9110 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8a257fa640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a10034650 0x7f8a10036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8a257fa640 1 -- 172.21.15.145:0/4160966152 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f8b38113b00 con 0x564ef4dc9110 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b475e0640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a10034650 0x7f8a10036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4ddb330 0x564ef4ddd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dddf20 con 0x564ef4ddb330 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.032+0000 7f8b485e2640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4ddb330 0x564ef4ddd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b475e0640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a10034650 0x7f8a10036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x564ef4dab100 tx=0x7f8b3c011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b485e2640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4ddb330 0x564ef4ddd7d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 realm 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dda870 con 0x564ef4ddb330 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4ddea30 con 0x564ef4ddb330 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4ddf810 0x564ef4de1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de2260 con 0x564ef4ddf810 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b47de1640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4ddf810 0x564ef4de1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b47de1640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4ddf810 0x564ef4de1c00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de2b00 con 0x564ef4ddf810 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 20 searching for the correct realm 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564ef4de4870 0x564ef4de6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4de4870 2024-09-11T11:01:26.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b475e0640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564ef4de4870 0x564ef4de6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b475e0640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564ef4de4870 0x564ef4de6c60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.036+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b47de1640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8b38112070 0x7f8b380f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x7f8b38112070 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8b38112070 0x7f8b380f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8b38112070 0x7f8b380f3270 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4de4870 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x7f8b38112070 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.040+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x7f8b38112070 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4de4870 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4de4870 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4de4870 2024-09-11T11:01:26.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x7f8b38112070 2024-09-11T11:01:26.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddb330 2024-09-11T11:01:26.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.044+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x7f8b38112070 2024-09-11T11:01:26.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4de4870 2024-09-11T11:01:26.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x7f8b38112070 2024-09-11T11:01:26.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4de4870 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de7270 con 0x564ef4ddf810 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:26.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de34b0 con 0x564ef4ddb330 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.048+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de3930 con 0x564ef4ddf810 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de3d50 con 0x7f8b38112070 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 zone default found 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 4 Realm: () 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 zonegroup default 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de76d0 con 0x7f8b38112070 2024-09-11T11:01:26.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de9900 con 0x564ef4de4870 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de9ca0 con 0x564ef4de4870 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 started sync module instance, tier type = 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:26.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de8d40 con 0x564ef4ddf810 2024-09-11T11:01:26.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94897115665008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4de8d40 con 0x564ef4ddf810 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.052+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dea660 con 0x564ef4ddb330 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94897115668912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dea5d0 con 0x564ef4ddb330 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4deb590 con 0x564ef4ddf810 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94897115665008] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94897115668912] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94897115671120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4deb0a0 con 0x564ef4ddf810 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4debe60 con 0x7f8b38112070 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94897115675056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4deb0a0 con 0x7f8b38112070 2024-09-11T11:01:26.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.056+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dec920 con 0x564ef4ddf810 2024-09-11T11:01:26.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94897115671120] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94897115675056] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94897115676112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dec8e0 con 0x564ef4ddf810 2024-09-11T11:01:26.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4decd10 con 0x564ef4de4870 2024-09-11T11:01:26.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94897115662480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4ded560 con 0x564ef4de4870 2024-09-11T11:01:26.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dedf60 con 0x564ef4de4870 2024-09-11T11:01:26.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94897115676112] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94897115662480] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94897115677680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4ded0b0 con 0x564ef4de4870 2024-09-11T11:01:26.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.060+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4dee800 con 0x7f8b38112070 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94897115677680] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94897115683440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4ded0b0 con 0x7f8b38112070 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 20 add_watcher() i=0 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 20 add_watcher() i=1 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 20 add_watcher() i=2 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 20 add_watcher() i=3 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 20 add_watcher() i=4 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 20 add_watcher() i=5 2024-09-11T11:01:26.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 20 add_watcher() i=6 2024-09-11T11:01:26.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94897115683440] v32'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 20 add_watcher() i=7 2024-09-11T11:01:26.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:26.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4df18c0 con 0x564ef4ddb330 2024-09-11T11:01:26.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.064+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94897115685712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4deede0 con 0x564ef4ddb330 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94897115685712] v32'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f89fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 5 note: GC not initialized 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f89fcfe1640 20 reqs_thread_entry: start 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 20 Filter name: none 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f89767fc640 20 reqs_thread_entry: start 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e14a50 con 0x564ef4ddb330 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e15440 con 0x564ef4ddb330 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e16450 con 0x7f8b38112070 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f89fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:26.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.068+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94897115685712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x564ef4ddb330 2024-09-11T11:01:26.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94897115685712] v32'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94897115665008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x564ef4ddf810 2024-09-11T11:01:26.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94897115665008] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b4a2d1980 20 remove_watcher() i=0 2024-09-11T11:01:26.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b4a2d1980 2 removed watcher, disabling cache 2024-09-11T11:01:26.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94897115668912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x564ef4ddb330 2024-09-11T11:01:26.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94897115668912] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x564ef4ddb330 2024-09-11T11:01:26.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b4a2d1980 20 remove_watcher() i=1 2024-09-11T11:01:26.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.072+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94897115671120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x564ef4ddf810 2024-09-11T11:01:26.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.076+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94897115671120] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.076+0000 7f8b4a2d1980 20 remove_watcher() i=2 2024-09-11T11:01:26.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.076+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94897115675056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x7f8b38112070 2024-09-11T11:01:26.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.076+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94897115675056] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.076+0000 7f8b4a2d1980 20 remove_watcher() i=3 2024-09-11T11:01:26.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.076+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94897115676112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x564ef4ddf810 2024-09-11T11:01:26.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b47de1640 1 -- 172.21.15.145:0/4160966152 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94897115676112] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b38119070 con 0x564ef4ddf810 2024-09-11T11:01:26.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b4a2d1980 20 remove_watcher() i=4 2024-09-11T11:01:26.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94897115662480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x564ef4de4870 2024-09-11T11:01:26.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94897115662480] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b4a2d1980 20 remove_watcher() i=5 2024-09-11T11:01:26.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94897115677680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x564ef4de4870 2024-09-11T11:01:26.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b475e0640 1 -- 172.21.15.145:0/4160966152 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94897115677680] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b3c036040 con 0x564ef4de4870 2024-09-11T11:01:26.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b4a2d1980 20 remove_watcher() i=6 2024-09-11T11:01:26.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94897115683440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564ef4e12940 con 0x7f8b38112070 2024-09-11T11:01:26.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94897115683440] v32'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8b4000a4d0 con 0x7f8b38112070 2024-09-11T11:01:26.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.080+0000 7f8b4a2d1980 20 remove_watcher() i=7 2024-09-11T11:01:26.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4ddf810 msgr2=0x564ef4de1c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4ddf810 0x564ef4de1c00 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4ddb330 msgr2=0x564ef4ddd7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4ddb330 0x564ef4ddd7d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8b38112070 msgr2=0x7f8b380f3270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8b38112070 0x7f8b380f3270 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564ef4de4870 msgr2=0x564ef4de6c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564ef4de4870 0x564ef4de6c60 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a10034650 msgr2=0x7f8a10036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a10034650 0x7f8a10036b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x564ef4dab100 tx=0x7f8b3c011000 comp rx=0 tx=0).stop 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 msgr2=0x564ef4dd0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b485e2640 1 -- 172.21.15.145:0/4160966152 reap_dead start 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dd0390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f8b380f3de0 tx=0x7f8b380eeed0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 shutdown_connections 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/4160966152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dc9110 0x564ef4dd0390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 >> 172.21.15.145:0/4160966152 conn(0x564ef4dc5540 msgr2=0x564ef4dc3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 shutdown_connections 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/4160966152 wait complete. 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2518428892 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a20034650 msgr2=0x7f8a20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/2518428892 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a20034650 0x7f8a20036b10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x564ef4da3060 tx=0x7f8b3c006000 comp rx=0 tx=0).stop 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2518428892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dbc850 msgr2=0x564ef4dbcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/2518428892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dbc850 0x564ef4dbcc70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8b380e51f0 tx=0x7f8b380bc850 comp rx=0 tx=0).stop 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2518428892 shutdown_connections 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/2518428892 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a20034650 0x7f8a20036b10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/2518428892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4dbc850 0x564ef4dbcc70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2518428892 >> 172.21.15.145:0/2518428892 conn(0x564ef4db19a0 msgr2=0x564ef4db4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2518428892 shutdown_connections 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/2518428892 wait complete. 2024-09-11T11:01:26.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4da6e70 msgr2=0x564ef4da9260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564ef4da6e70 0x564ef4da9260 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4cadec0 msgr2=0x564ef4da5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564ef4cadec0 0x564ef4da5a60 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564ef4dac520 msgr2=0x564ef4dae910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564ef4dac520 0x564ef4dae910 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a30034650 msgr2=0x7f8a30036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8a30034650 0x7f8a30036b10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c001e20 tx=0x7f8b3c0013a0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 msgr2=0x564ef4d9ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 --2- 172.21.15.145:0/275311070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564ef4cad570 0x564ef4d9ea70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8b3800a5c0 tx=0x7f8b380180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b485e2640 1 -- 172.21.15.145:0/275311070 reap_dead start 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 shutdown_connections 2024-09-11T11:01:26.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 >> 172.21.15.145:0/275311070 conn(0x564ef4ca9090 msgr2=0x564ef4d92050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 shutdown_connections 2024-09-11T11:01:26.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.084+0000 7f8b4a2d1980 1 -- 172.21.15.145:0/275311070 wait complete. 2024-09-11T11:01:26.095 INFO:teuthology.orchestra.run.smithi145.stdout:[] 2024-09-11T11:01:26.096 DEBUG:tasks.util.rgw: json result: [] 2024-09-11T11:01:26.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-11T11:01:26.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-11T11:01:26.096 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-11T11:01:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae60ba5980 1 Processor -- start 2024-09-11T11:01:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae60ba5980 1 -- start start 2024-09-11T11:01:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae60ba5980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ae9e3e4a50 0x55ae9e3e6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae60ba5980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ae9e268ae0 con 0x55ae9e354b00 2024-09-11T11:01:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae60ba5980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55ae9e28ce30 con 0x55ae9e3e4a50 2024-09-11T11:01:26.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae5deb4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ae9e3e4a50 0x55ae9e3e6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae5e6b5640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55ae9e354b00 0x55ae9e3e3330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48768/0 (socket says 172.21.15.145:48768) 2024-09-11T11:01:26.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae5deb4640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ae9e3e4a50 0x55ae9e3e6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49434/0 (socket says 172.21.15.145:49434) 2024-09-11T11:01:26.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3126670017 learned_addr learned my addr 172.21.15.145:0/3126670017 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:26.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae5deb4640 1 -- 172.21.15.145:0/3126670017 >> v1:172.21.15.102:6789/0 conn(0x55ae9e354b00 legacy=0x55ae9e3e3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.168+0000 7fae5deb4640 1 -- 172.21.15.145:0/3126670017 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9e3e8390 con 0x55ae9e3e4a50 2024-09-11T11:01:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae5deb4640 1 --2- 172.21.15.145:0/3126670017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e3e4a50 0x55ae9e3e6e40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fae5400a480 tx=0x7fae5401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4524532e93122476 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae5d6b3640 1 -- 172.21.15.145:0/3126670017 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae540b0070 con 0x55ae9e3e4a50 2024-09-11T11:01:26.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae5d6b3640 1 -- 172.21.15.145:0/3126670017 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae540ab540 con 0x55ae9e3e4a50 2024-09-11T11:01:26.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae5d6b3640 1 -- 172.21.15.145:0/3126670017 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae540ab840 con 0x55ae9e3e4a50 2024-09-11T11:01:26.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae60ba5980 1 -- 172.21.15.145:0/3126670017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e3e4a50 msgr2=0x55ae9e3e6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3126670017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e3e4a50 0x55ae9e3e6e40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fae5400a480 tx=0x7fae5401b280 comp rx=0 tx=0).stop 2024-09-11T11:01:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae60ba5980 1 -- 172.21.15.145:0/3126670017 shutdown_connections 2024-09-11T11:01:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3126670017 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e3e4a50 0x55ae9e3e6e40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae60ba5980 1 -- 172.21.15.145:0/3126670017 >> 172.21.15.145:0/3126670017 conn(0x55ae9e3db060 msgr2=0x55ae9e3dd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae60ba5980 1 -- 172.21.15.145:0/3126670017 shutdown_connections 2024-09-11T11:01:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.172+0000 7fae60ba5980 1 -- 172.21.15.145:0/3126670017 wait complete. 2024-09-11T11:01:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 Processor -- start 2024-09-11T11:01:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- start start 2024-09-11T11:01:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ae9e28e200 con 0x55ae9e354b00 2024-09-11T11:01:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49442/0 (socket says 172.21.15.145:49442) 2024-09-11T11:01:26.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 -- 172.21.15.145:0/78988318 learned_addr learned my addr 172.21.15.145:0/78988318 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 -- 172.21.15.145:0/78988318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9e4cc070 con 0x55ae9e354b00 2024-09-11T11:01:26.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/78988318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4cbaa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fae50001e20 tx=0x7fae5000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304e1fc3f0d72f81 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fad4c608640 1 -- 172.21.15.145:0/78988318 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50012020 con 0x55ae9e354b00 2024-09-11T11:01:26.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fad4c608640 1 -- 172.21.15.145:0/78988318 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae5000e7c0 con 0x55ae9e354b00 2024-09-11T11:01:26.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fad4c608640 1 -- 172.21.15.145:0/78988318 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5000eb00 con 0x55ae9e354b00 2024-09-11T11:01:26.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- 172.21.15.145:0/78988318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 msgr2=0x55ae9e4cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 --2- 172.21.15.145:0/78988318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4cbaa0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fae50001e20 tx=0x7fae5000b790 comp rx=0 tx=0).stop 2024-09-11T11:01:26.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- 172.21.15.145:0/78988318 shutdown_connections 2024-09-11T11:01:26.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 --2- 172.21.15.145:0/78988318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4cbaa0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- 172.21.15.145:0/78988318 >> 172.21.15.145:0/78988318 conn(0x55ae9e3db060 msgr2=0x55ae9e4c76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- 172.21.15.145:0/78988318 shutdown_connections 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- 172.21.15.145:0/78988318 wait complete. 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 Processor -- start 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- start start 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4d2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae60ba5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ae9e3e7e30 con 0x55ae9e354b00 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4d2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4d2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49448/0 (socket says 172.21.15.145:49448) 2024-09-11T11:01:26.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 -- 172.21.15.145:0/91740152 learned_addr learned my addr 172.21.15.145:0/91740152 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.188+0000 7fae5e6b5640 1 -- 172.21.15.145:0/91740152 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9e4d3360 con 0x55ae9e354b00 2024-09-11T11:01:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4d2e20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fae50001e20 tx=0x7fae50000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fad4ae05640 1 -- 172.21.15.145:0/91740152 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50012030 con 0x55ae9e354b00 2024-09-11T11:01:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fad4ae05640 1 -- 172.21.15.145:0/91740152 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae50001480 con 0x55ae9e354b00 2024-09-11T11:01:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae9e4d35f0 con 0x55ae9e354b00 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fad4ae05640 1 -- 172.21.15.145:0/91740152 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5001a940 con 0x55ae9e354b00 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9e4d62d0 con 0x55ae9e354b00 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fad4ae05640 1 -- 172.21.15.145:0/91740152 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae50015020 con 0x55ae9e354b00 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fad4ae05640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad44034650 0x7fad44036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fad4ae05640 1 -- 172.21.15.145:0/91740152 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fae50020030 con 0x55ae9e354b00 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae5deb4640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad44034650 0x7fad44036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae60ba5980 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e3e4a50 0x55ae9e4d9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e4da420 con 0x55ae9e3e4a50 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae5eeb6640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e3e4a50 0x55ae9e4d9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae5deb4640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad44034650 0x7fad44036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae540ad000 tx=0x7fae540a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae5eeb6640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e3e4a50 0x55ae9e4d9db0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae5eeb6640 1 -- 172.21.15.145:0/91740152 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e3e4a50 2024-09-11T11:01:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae60ba5980 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e4db210 0x55ae9e4dd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e4ddc40 con 0x55ae9e4db210 2024-09-11T11:01:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e4db210 0x55ae9e4dd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.192+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e4db210 0x55ae9e4dd600 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5e6b5640 1 -- 172.21.15.145:0/91740152 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae50008030 con 0x55ae9e4db210 2024-09-11T11:01:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e4df4f0 con 0x55ae9e4db210 2024-09-11T11:01:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5e6b5640 1 -- 172.21.15.145:0/91740152 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fae50008030 con 0x55ae9e4db210 2024-09-11T11:01:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e4de720 con 0x55ae9e4db210 2024-09-11T11:01:26.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5e6b5640 1 -- 172.21.15.145:0/91740152 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae50008030 con 0x55ae9e4db210 2024-09-11T11:01:26.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae60ba5980 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ae9e4e08a0 0x55ae9e4e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e4e31d0 con 0x55ae9e4e08a0 2024-09-11T11:01:26.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5deb4640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ae9e4e08a0 0x55ae9e4e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5deb4640 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ae9e4e08a0 0x55ae9e4e2c90 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5deb4640 1 -- 172.21.15.145:0/91740152 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fae540b3040 con 0x55ae9e4e08a0 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae60ba5980 1 Processor -- start 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae60ba5980 1 -- start start 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae60ba5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4f0b90 0x55ae9e4f0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae60ba5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ae9e2e7800 con 0x55ae9e4f0b90 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4f0b90 0x55ae9e4f0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4f0b90 0x55ae9e4f0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49460/0 (socket says 172.21.15.145:49460) 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3319810767 learned_addr learned my addr 172.21.15.145:0/3319810767 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.196+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3319810767 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9e4f14f0 con 0x55ae9e4f0b90 2024-09-11T11:01:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/3319810767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4f0b90 0x55ae9e4f0fb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fae500484d0 tx=0x7fae50016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad43fff640 1 -- 172.21.15.145:0/3319810767 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae50017c50 con 0x55ae9e4f0b90 2024-09-11T11:01:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad43fff640 1 -- 172.21.15.145:0/3319810767 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae50017df0 con 0x55ae9e4f0b90 2024-09-11T11:01:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae60ba5980 1 -- 172.21.15.145:0/3319810767 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae9e4f1780 con 0x55ae9e4f0b90 2024-09-11T11:01:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad43fff640 1 -- 172.21.15.145:0/3319810767 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5000c580 con 0x55ae9e4f0b90 2024-09-11T11:01:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae60ba5980 1 -- 172.21.15.145:0/3319810767 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9e4f4400 con 0x55ae9e4f0b90 2024-09-11T11:01:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad43fff640 1 -- 172.21.15.145:0/3319810767 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae50009070 con 0x55ae9e4f0b90 2024-09-11T11:01:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad43fff640 1 --2- 172.21.15.145:0/3319810767 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad380346a0 0x7fad38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad43fff640 1 -- 172.21.15.145:0/3319810767 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fae50005050 con 0x55ae9e4f0b90 2024-09-11T11:01:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae5deb4640 1 --2- 172.21.15.145:0/3319810767 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad380346a0 0x7fad38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae60ba5980 1 Processor -- start 2024-09-11T11:01:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae60ba5980 1 -- start start 2024-09-11T11:01:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae5deb4640 1 --2- 172.21.15.145:0/3319810767 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad380346a0 0x7fad38036b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55ae9e4d7410 tx=0x7fae54005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae60ba5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e4fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae60ba5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ae9e4cc3f0 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e4fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e4fd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49466/0 (socket says 172.21.15.145:49466) 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae5e6b5640 1 -- 172.21.15.145:0/436270105 learned_addr learned my addr 172.21.15.145:0/436270105 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae5e6b5640 1 -- 172.21.15.145:0/436270105 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9e4fdf70 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/436270105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e4fd9a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fae50018740 tx=0x7fae50025be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe5e33b5bbc8aaa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad41ffb640 1 -- 172.21.15.145:0/436270105 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5000d760 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad41ffb640 1 -- 172.21.15.145:0/436270105 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae50025610 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.200+0000 7fad41ffb640 1 -- 172.21.15.145:0/436270105 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5000d900 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- 172.21.15.145:0/436270105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 msgr2=0x55ae9e4fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 --2- 172.21.15.145:0/436270105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e4fd9a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fae50018740 tx=0x7fae50025be0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- 172.21.15.145:0/436270105 shutdown_connections 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 --2- 172.21.15.145:0/436270105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e4fd9a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- 172.21.15.145:0/436270105 >> 172.21.15.145:0/436270105 conn(0x55ae9e4f98d0 msgr2=0x55ae9e4f79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- 172.21.15.145:0/436270105 shutdown_connections 2024-09-11T11:01:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- 172.21.15.145:0/436270105 wait complete. 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 Processor -- start 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- start start 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e504690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ae9e4fe2e0 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e504690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae5e6b5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e504690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49480/0 (socket says 172.21.15.145:49480) 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 learned_addr learned my addr 172.21.15.145:0/3070293429 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae9e504bd0 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e504690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fae50025ec0 tx=0x7fae5001ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fad2ffff640 1 -- 172.21.15.145:0/3070293429 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5006c070 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae9e504bd0 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fad2ffff640 1 -- 172.21.15.145:0/3070293429 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae5001ede0 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fad2ffff640 1 -- 172.21.15.145:0/3070293429 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae5000c890 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae9e504bd0 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fad2ffff640 1 -- 172.21.15.145:0/3070293429 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fae5006f070 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fad2ffff640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad28034650 0x7fad28036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fad2ffff640 1 -- 172.21.15.145:0/3070293429 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fae50064070 con 0x55ae9e4fd5a0 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae5deb4640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad28034650 0x7fad28036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e50f820 0x55ae9e511ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e512430 con 0x55ae9e50f820 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.204+0000 7fae5eeb6640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e50f820 0x55ae9e511ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5deb4640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad28034650 0x7fad28036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fae54000c10 tx=0x7fae540b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5eeb6640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e50f820 0x55ae9e511ce0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 realm 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e50ecd0 con 0x55ae9e50f820 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e512f00 con 0x55ae9e50f820 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e513ae0 0x55ae9e515fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e513ae0 0x55ae9e515fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e513ae0 0x55ae9e515fa0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516fb0 con 0x55ae9e513ae0 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 20 searching for the correct realm 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ae9e518820 0x55ae9e51ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51b3b0 con 0x55ae9e518820 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5deb4640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ae9e518820 0x55ae9e51ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5deb4640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ae9e518820 0x55ae9e51ace0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.208+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51b3b0 con 0x55ae9e513ae0 2024-09-11T11:01:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5e6b5640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fae50071060 0x7fae50036150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x7fae50071060 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fae50071060 0x7fae50036150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fae50071060 0x7fae50036150 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e518820 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x7fae50071060 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.212+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x7fae50071060 2024-09-11T11:01:26.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e518820 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e518820 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e518820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x7fae50071060 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e50f820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x7fae50071060 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.216+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e518820 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x7fae50071060 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e518820 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e516710 con 0x55ae9e513ae0 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e5170e0 con 0x55ae9e50f820 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e5174d0 con 0x55ae9e513ae0 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.220+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e5174d0 con 0x7fae50071060 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 zone default found 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 4 Realm: () 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 zonegroup default 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51b830 con 0x7fae50071060 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51d5b0 con 0x55ae9e518820 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51d950 con 0x55ae9e518820 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 started sync module instance, tier type = 2024-09-11T11:01:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:26.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51ca50 con 0x55ae9e513ae0 2024-09-11T11:01:26.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94208468831856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51ca50 con 0x55ae9e513ae0 2024-09-11T11:01:26.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.224+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51e220 con 0x55ae9e50f820 2024-09-11T11:01:26.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94208468835568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51e1e0 con 0x55ae9e50f820 2024-09-11T11:01:26.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51f150 con 0x55ae9e513ae0 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94208468831856] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94208468835568] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94208468837904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51f150 con 0x55ae9e513ae0 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51f5b0 con 0x7fae50071060 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94208468829600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51f570 con 0x7fae50071060 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.228+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e520470 con 0x55ae9e513ae0 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94208468829600] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94208468837904] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94208468839520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51ffc0 con 0x55ae9e513ae0 2024-09-11T11:01:26.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e520d10 con 0x55ae9e518820 2024-09-11T11:01:26.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94208468846688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e51ffc0 con 0x55ae9e518820 2024-09-11T11:01:26.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e521a70 con 0x55ae9e518820 2024-09-11T11:01:26.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94208468839520] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94208468846688] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94208468848816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e521e60 con 0x55ae9e518820 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.232+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e522710 con 0x7fae50071060 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94208468852320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e5222c0 con 0x7fae50071060 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 20 add_watcher() i=0 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 20 add_watcher() i=1 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 20 add_watcher() i=2 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 20 add_watcher() i=3 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 20 add_watcher() i=4 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 20 add_watcher() i=5 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94208468848816] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 20 add_watcher() i=6 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94208468852320] v32'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 20 add_watcher() i=7 2024-09-11T11:01:26.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:26.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e521500 con 0x55ae9e50f820 2024-09-11T11:01:26.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94208468849872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e5235a0 con 0x55ae9e50f820 2024-09-11T11:01:26.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94208468849872] v32'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.236+0000 7fad14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:26.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:26.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 5 note: GC not initialized 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fac8f7fe640 20 reqs_thread_entry: start 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 20 Filter name: none 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fac8d7fa640 20 reqs_thread_entry: start 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e548df0 con 0x55ae9e50f820 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e5497e0 con 0x55ae9e50f820 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:26.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e54a7f0 con 0x7fae50071060 2024-09-11T11:01:26.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fad14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:26.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.240+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94208468849872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e546cd0 con 0x55ae9e50f820 2024-09-11T11:01:26.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94208468849872] v32'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94208468831856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e546cd0 con 0x55ae9e513ae0 2024-09-11T11:01:26.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94208468831856] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae60ba5980 20 remove_watcher() i=0 2024-09-11T11:01:26.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae60ba5980 2 removed watcher, disabling cache 2024-09-11T11:01:26.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94208468835568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e546cd0 con 0x55ae9e50f820 2024-09-11T11:01:26.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94208468835568] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x55ae9e50f820 2024-09-11T11:01:26.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae60ba5980 20 remove_watcher() i=1 2024-09-11T11:01:26.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.244+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94208468837904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e546cd0 con 0x55ae9e513ae0 2024-09-11T11:01:26.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.248+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94208468837904] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.248+0000 7fae60ba5980 20 remove_watcher() i=2 2024-09-11T11:01:26.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.248+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94208468829600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e546cd0 con 0x7fae50071060 2024-09-11T11:01:26.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.248+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94208468829600] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.248+0000 7fae60ba5980 20 remove_watcher() i=3 2024-09-11T11:01:26.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.248+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94208468839520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e546cd0 con 0x55ae9e513ae0 2024-09-11T11:01:26.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae5e6b5640 1 -- 172.21.15.145:0/3070293429 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94208468839520] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5006e030 con 0x55ae9e513ae0 2024-09-11T11:01:26.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 20 remove_watcher() i=4 2024-09-11T11:01:26.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94208468846688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e546cd0 con 0x55ae9e518820 2024-09-11T11:01:26.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94208468846688] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 20 remove_watcher() i=5 2024-09-11T11:01:26.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94208468848816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e546cd0 con 0x55ae9e518820 2024-09-11T11:01:26.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae5deb4640 1 -- 172.21.15.145:0/3070293429 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94208468848816] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae540c9030 con 0x55ae9e518820 2024-09-11T11:01:26.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 20 remove_watcher() i=6 2024-09-11T11:01:26.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94208468852320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ae9e521560 con 0x7fae50071060 2024-09-11T11:01:26.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94208468852320] v32'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae5800a4d0 con 0x7fae50071060 2024-09-11T11:01:26.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 20 remove_watcher() i=7 2024-09-11T11:01:26.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e513ae0 msgr2=0x55ae9e515fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e513ae0 0x55ae9e515fa0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e50f820 msgr2=0x55ae9e511ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e50f820 0x55ae9e511ce0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fae50071060 msgr2=0x7fae50036150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fae50071060 0x7fae50036150 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ae9e518820 msgr2=0x55ae9e51ace0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ae9e518820 0x55ae9e51ace0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad28034650 msgr2=0x7fad28036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad28034650 0x7fad28036b10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fae54000c10 tx=0x7fae540b9040 comp rx=0 tx=0).stop 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 msgr2=0x55ae9e504690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e504690 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fae50025ec0 tx=0x7fae5001ced0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae5eeb6640 1 -- 172.21.15.145:0/3070293429 reap_dead start 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 shutdown_connections 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3070293429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4fd5a0 0x55ae9e504690 secure :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fae50025ec0 tx=0x7fae5001ced0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 >> 172.21.15.145:0/3070293429 conn(0x55ae9e4f98d0 msgr2=0x55ae9e4f79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 shutdown_connections 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.252+0000 7fae60ba5980 1 -- 172.21.15.145:0/3070293429 wait complete. 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/3319810767 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad380346a0 msgr2=0x7fad38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3319810767 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad380346a0 0x7fad38036b60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x55ae9e4d7410 tx=0x7fae54005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/3319810767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4f0b90 msgr2=0x55ae9e4f0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3319810767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4f0b90 0x55ae9e4f0fb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fae500484d0 tx=0x7fae50016b00 comp rx=0 tx=0).stop 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/3319810767 shutdown_connections 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3319810767 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad380346a0 0x7fad38036b60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/3319810767 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e4f0b90 0x55ae9e4f0fb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/3319810767 >> 172.21.15.145:0/3319810767 conn(0x55ae9e4e5ce0 msgr2=0x55ae9e4e8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/3319810767 shutdown_connections 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/3319810767 wait complete. 2024-09-11T11:01:26.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e4db210 msgr2=0x55ae9e4dd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ae9e4db210 0x55ae9e4dd600 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e3e4a50 msgr2=0x55ae9e4d9db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ae9e3e4a50 0x55ae9e4d9db0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ae9e4e08a0 msgr2=0x55ae9e4e2c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ae9e4e08a0 0x55ae9e4e2c90 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad44034650 msgr2=0x7fad44036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fad44034650 0x7fad44036b10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae540ad000 tx=0x7fae540a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 msgr2=0x55ae9e4d2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 --2- 172.21.15.145:0/91740152 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ae9e354b00 0x55ae9e4d2e20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fae50001e20 tx=0x7fae50000ee0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae5eeb6640 1 -- 172.21.15.145:0/91740152 reap_dead start 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 shutdown_connections 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 >> 172.21.15.145:0/91740152 conn(0x55ae9e3db060 msgr2=0x55ae9e4c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 shutdown_connections 2024-09-11T11:01:26.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.256+0000 7fae60ba5980 1 -- 172.21.15.145:0/91740152 wait complete. 2024-09-11T11:01:26.267 INFO:teuthology.orchestra.run.smithi145.stdout:[] 2024-09-11T11:01:26.267 DEBUG:tasks.util.rgw: json result: [] 2024-09-11T11:01:26.285 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:26.285 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-11T11:01:26.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-11T11:01:26.285 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-11T11:01:26.340 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:26.340 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:26.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.336+0000 7f257f810980 1 Processor -- start 2024-09-11T11:01:26.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257f810980 1 -- start start 2024-09-11T11:01:26.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257f810980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5609e1409290 0x5609e14997a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257f810980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609e131cae0 con 0x5609e1499ce0 2024-09-11T11:01:26.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257f810980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5609e1340e30 con 0x5609e1409290 2024-09-11T11:01:26.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257d320640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5609e1409290 0x5609e14997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257d320640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5609e1409290 0x5609e14997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49496/0 (socket says 172.21.15.145:49496) 2024-09-11T11:01:26.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257d320640 1 -- 172.21.15.145:0/4222463101 learned_addr learned my addr 172.21.15.145:0/4222463101 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257d320640 1 -- 172.21.15.145:0/4222463101 >> v1:172.21.15.102:6789/0 conn(0x5609e1499ce0 legacy=0x5609e149c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257d320640 1 -- 172.21.15.145:0/4222463101 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e1409670 con 0x5609e1409290 2024-09-11T11:01:26.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f256ffff640 1 -- 172.21.15.145:0/4222463101 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1782880801 0 0) 0x5609e131cae0 con 0x5609e1499ce0 2024-09-11T11:01:26.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f257d320640 1 --2- 172.21.15.145:0/4222463101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e14997a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f257800a4e0 tx=0x7f257801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d96a78e0577492 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f256ffff640 1 -- 172.21.15.145:0/4222463101 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780aa540 con 0x5609e1409290 2024-09-11T11:01:26.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f256ffff640 1 -- 172.21.15.145:0/4222463101 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25780aa6e0 con 0x5609e1409290 2024-09-11T11:01:26.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.340+0000 7f256ffff640 1 -- 172.21.15.145:0/4222463101 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780aaa00 con 0x5609e1409290 2024-09-11T11:01:26.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.344+0000 7f257f810980 1 -- 172.21.15.145:0/4222463101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 msgr2=0x5609e14997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.344+0000 7f257f810980 1 --2- 172.21.15.145:0/4222463101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e14997a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f257800a4e0 tx=0x7f257801b090 comp rx=0 tx=0).stop 2024-09-11T11:01:26.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.344+0000 7f257f810980 1 -- 172.21.15.145:0/4222463101 shutdown_connections 2024-09-11T11:01:26.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.344+0000 7f257f810980 1 --2- 172.21.15.145:0/4222463101 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e14997a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.344+0000 7f257f810980 1 -- 172.21.15.145:0/4222463101 >> 172.21.15.145:0/4222463101 conn(0x5609e148f090 msgr2=0x5609e14914b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.344+0000 7f257f810980 1 -- 172.21.15.145:0/4222463101 shutdown_connections 2024-09-11T11:01:26.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.344+0000 7f257f810980 1 -- 172.21.15.145:0/4222463101 wait complete. 2024-09-11T11:01:26.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257f810980 1 Processor -- start 2024-09-11T11:01:26.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257f810980 1 -- start start 2024-09-11T11:01:26.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257f810980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1581a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257f810980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5609e1342200 con 0x5609e1409290 2024-09-11T11:01:26.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1581a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1581a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49500/0 (socket says 172.21.15.145:49500) 2024-09-11T11:01:26.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257d320640 1 -- 172.21.15.145:0/3861302251 learned_addr learned my addr 172.21.15.145:0/3861302251 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257d320640 1 -- 172.21.15.145:0/3861302251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e1581fd0 con 0x5609e1409290 2024-09-11T11:01:26.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f257d320640 1 --2- 172.21.15.145:0/3861302251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1581a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f25780ac040 tx=0x7f25780033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e030ab6435c96f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f246b606640 1 -- 172.21.15.145:0/3861302251 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780b9030 con 0x5609e1409290 2024-09-11T11:01:26.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f246b606640 1 -- 172.21.15.145:0/3861302251 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25780aaa40 con 0x5609e1409290 2024-09-11T11:01:26.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.356+0000 7f246b606640 1 -- 172.21.15.145:0/3861302251 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780aad20 con 0x5609e1409290 2024-09-11T11:01:26.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- 172.21.15.145:0/3861302251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 msgr2=0x5609e1581a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 --2- 172.21.15.145:0/3861302251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1581a00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f25780ac040 tx=0x7f25780033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- 172.21.15.145:0/3861302251 shutdown_connections 2024-09-11T11:01:26.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 --2- 172.21.15.145:0/3861302251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1581a00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- 172.21.15.145:0/3861302251 >> 172.21.15.145:0/3861302251 conn(0x5609e148f090 msgr2=0x5609e157d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- 172.21.15.145:0/3861302251 shutdown_connections 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- 172.21.15.145:0/3861302251 wait complete. 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 Processor -- start 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- start start 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1588c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5609e14a0220 con 0x5609e1409290 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1588c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1588c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49502/0 (socket says 172.21.15.145:49502) 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257d320640 1 -- 172.21.15.145:0/3619483998 learned_addr learned my addr 172.21.15.145:0/3619483998 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257d320640 1 -- 172.21.15.145:0/3619483998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e1589190 con 0x5609e1409290 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257d320640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1588c50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2578005cc0 tx=0x7f2578017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f2469e03640 1 -- 172.21.15.145:0/3619483998 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780b9030 con 0x5609e1409290 2024-09-11T11:01:26.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f2469e03640 1 -- 172.21.15.145:0/3619483998 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25780c2070 con 0x5609e1409290 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f2469e03640 1 -- 172.21.15.145:0/3619483998 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780be610 con 0x5609e1409290 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609e1589420 con 0x5609e1409290 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.360+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e158c100 con 0x5609e1409290 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f2469e03640 1 -- 172.21.15.145:0/3619483998 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f25780c4030 con 0x5609e1409290 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f2469e03640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24640346a0 0x7f2464036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f2469e03640 1 -- 172.21.15.145:0/3619483998 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f25780ba070 con 0x5609e1409290 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257f810980 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e1499ce0 0x5609e158fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257cb1f640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24640346a0 0x7f2464036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e1590250 con 0x5609e1499ce0 2024-09-11T11:01:26.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257db21640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e1499ce0 0x5609e158fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257cb1f640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24640346a0 0x7f2464036b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2574000f70 tx=0x7f2574001400 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257db21640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e1499ce0 0x5609e158fbe0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257db21640 1 -- 172.21.15.145:0/3619483998 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e1499ce0 2024-09-11T11:01:26.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257f810980 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e1591090 0x5609e1593480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e1593a90 con 0x5609e1591090 2024-09-11T11:01:26.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257d320640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e1591090 0x5609e1593480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257d320640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e1591090 0x5609e1593480 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257d320640 1 -- 172.21.15.145:0/3619483998 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25780cd070 con 0x5609e1591090 2024-09-11T11:01:26.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.364+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15952f0 con 0x5609e1591090 2024-09-11T11:01:26.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257d320640 1 -- 172.21.15.145:0/3619483998 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25780cd070 con 0x5609e1591090 2024-09-11T11:01:26.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e1594520 con 0x5609e1591090 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257d320640 1 -- 172.21.15.145:0/3619483998 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25780cd070 con 0x5609e1591090 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5609e15966a0 0x5609e1598a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e1598fd0 con 0x5609e15966a0 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257cb1f640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5609e15966a0 0x5609e1598a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257cb1f640 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5609e15966a0 0x5609e1598a90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257cb1f640 1 -- 172.21.15.145:0/3619483998 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2574010690 con 0x5609e15966a0 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 Processor -- start 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 -- start start 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15a6a00 0x5609e15a6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5609e139b800 con 0x5609e15a6a00 2024-09-11T11:01:26.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15a6a00 0x5609e15a6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15a6a00 0x5609e15a6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49506/0 (socket says 172.21.15.145:49506) 2024-09-11T11:01:26.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257d320640 1 -- 172.21.15.145:0/476185258 learned_addr learned my addr 172.21.15.145:0/476185258 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257d320640 1 -- 172.21.15.145:0/476185258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e15a7360 con 0x5609e15a6a00 2024-09-11T11:01:26.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257d320640 1 --2- 172.21.15.145:0/476185258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15a6a00 0x5609e15a6e20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f25780b7010 tx=0x7f25780a9a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f2462ffd640 1 -- 172.21.15.145:0/476185258 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780b45b0 con 0x5609e15a6a00 2024-09-11T11:01:26.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 -- 172.21.15.145:0/476185258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609e15a75f0 con 0x5609e15a6a00 2024-09-11T11:01:26.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f2462ffd640 1 -- 172.21.15.145:0/476185258 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25780b4750 con 0x5609e15a6a00 2024-09-11T11:01:26.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f2462ffd640 1 -- 172.21.15.145:0/476185258 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780be8e0 con 0x5609e15a6a00 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.368+0000 7f257f810980 1 -- 172.21.15.145:0/476185258 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e15a75f0 con 0x5609e15a6a00 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f2462ffd640 1 -- 172.21.15.145:0/476185258 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f25780b3040 con 0x5609e15a6a00 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f2462ffd640 1 --2- 172.21.15.145:0/476185258 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24580346a0 0x7f2458036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f2462ffd640 1 -- 172.21.15.145:0/476185258 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f25780efaf0 con 0x5609e15a6a00 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257cb1f640 1 --2- 172.21.15.145:0/476185258 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24580346a0 0x7f2458036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 Processor -- start 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 -- start start 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257cb1f640 1 --2- 172.21.15.145:0/476185258 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24580346a0 0x7f2458036b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f257400c010 tx=0x7f2574006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5609e1582290 con 0x5609e15b31c0 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49518/0 (socket says 172.21.15.145:49518) 2024-09-11T11:01:26.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257d320640 1 -- 172.21.15.145:0/1015213951 learned_addr learned my addr 172.21.15.145:0/1015213951 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257d320640 1 -- 172.21.15.145:0/1015213951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e15b3b90 con 0x5609e15b31c0 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257d320640 1 --2- 172.21.15.145:0/1015213951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15b35c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f25780af010 tx=0x7f25780da770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2553c4f0aa00e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f2460ff9640 1 -- 172.21.15.145:0/1015213951 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780fc020 con 0x5609e15b31c0 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f2460ff9640 1 -- 172.21.15.145:0/1015213951 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25780c5700 con 0x5609e15b31c0 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f2460ff9640 1 -- 172.21.15.145:0/1015213951 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780da3f0 con 0x5609e15b31c0 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 -- 172.21.15.145:0/1015213951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 msgr2=0x5609e15b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 --2- 172.21.15.145:0/1015213951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15b35c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f25780af010 tx=0x7f25780da770 comp rx=0 tx=0).stop 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 -- 172.21.15.145:0/1015213951 shutdown_connections 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 --2- 172.21.15.145:0/1015213951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15b35c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 -- 172.21.15.145:0/1015213951 >> 172.21.15.145:0/1015213951 conn(0x5609e15af5a0 msgr2=0x5609e15ad6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 -- 172.21.15.145:0/1015213951 shutdown_connections 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 -- 172.21.15.145:0/1015213951 wait complete. 2024-09-11T11:01:26.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 Processor -- start 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.372+0000 7f257f810980 1 -- start start 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15ba3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5609e15b3fb0 con 0x5609e15b31c0 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15ba3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257d320640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15ba3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49532/0 (socket says 172.21.15.145:49532) 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 learned_addr learned my addr 172.21.15.145:0/1689301599 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e15ba8e0 con 0x5609e15b31c0 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257d320640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15ba3a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f25780da7b0 tx=0x7f25780b7fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f244effd640 1 -- 172.21.15.145:0/1689301599 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2578110070 con 0x5609e15b31c0 2024-09-11T11:01:26.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609e15ba8e0 con 0x5609e15b31c0 2024-09-11T11:01:26.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f244effd640 1 -- 172.21.15.145:0/1689301599 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25780e62d0 con 0x5609e15b31c0 2024-09-11T11:01:26.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e15ba8e0 con 0x5609e15b31c0 2024-09-11T11:01:26.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f244effd640 1 -- 172.21.15.145:0/1689301599 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25780e6480 con 0x5609e15b31c0 2024-09-11T11:01:26.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f244effd640 1 -- 172.21.15.145:0/1689301599 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2578113070 con 0x5609e15b31c0 2024-09-11T11:01:26.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f244effd640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2448034650 0x7f2448036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f244effd640 1 -- 172.21.15.145:0/1689301599 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f2578108070 con 0x5609e15b31c0 2024-09-11T11:01:26.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257cb1f640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2448034650 0x7f2448036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e15c5420 0x5609e15c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15c8010 con 0x5609e15c5420 2024-09-11T11:01:26.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257db21640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e15c5420 0x5609e15c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257cb1f640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2448034650 0x7f2448036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2574010fd0 tx=0x7f2574022040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257db21640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e15c5420 0x5609e15c78c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 20 realm 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15c4910 con 0x5609e15c5420 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.376+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15c8ae0 con 0x5609e15c5420 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e15c9690 0x5609e15cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15cc2c0 con 0x5609e15c9690 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257d320640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e15c9690 0x5609e15cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257d320640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e15c9690 0x5609e15cbb50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15ccb60 con 0x5609e15c9690 2024-09-11T11:01:26.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 20 searching for the correct realm 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609e15ce8d0 0x5609e15d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15ce8d0 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257cb1f640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609e15ce8d0 0x5609e15d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257cb1f640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609e15ce8d0 0x5609e15d0cc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257d320640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2578115060 0x7f25780c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x7f2578115060 2024-09-11T11:01:26.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.380+0000 7f257db21640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2578115060 0x7f25780c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2578115060 0x7f25780c65b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15ce8d0 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x7f2578115060 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x7f2578115060 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.384+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15ce8d0 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15ce8d0 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15ce8d0 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x7f2578115060 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c5420 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x7f2578115060 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15ce8d0 2024-09-11T11:01:26.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.388+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x7f2578115060 2024-09-11T11:01:26.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15ce8d0 2024-09-11T11:01:26.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d1340 con 0x5609e15c9690 2024-09-11T11:01:26.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:26.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:26.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15cd4e0 con 0x5609e15c5420 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.392+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15cd930 con 0x5609e15c9690 2024-09-11T11:01:26.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15cd930 con 0x7f2578115060 2024-09-11T11:01:26.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:26.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 zone default found 2024-09-11T11:01:26.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 4 Realm: () 2024-09-11T11:01:26.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:26.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:26.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:26.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 zonegroup default 2024-09-11T11:01:26.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d17f0 con 0x7f2578115060 2024-09-11T11:01:26.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d3600 con 0x5609e15ce8d0 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d3b00 con 0x5609e15ce8d0 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 started sync module instance, tier type = 2024-09-11T11:01:26.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:26.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d2a10 con 0x5609e15c9690 2024-09-11T11:01:26.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94600435674896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d2a10 con 0x5609e15c9690 2024-09-11T11:01:26.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.396+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d4640 con 0x5609e15c5420 2024-09-11T11:01:26.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94600435679568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d4af0 con 0x5609e15c5420 2024-09-11T11:01:26.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d5570 con 0x5609e15c9690 2024-09-11T11:01:26.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94600435679568] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94600435674896] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94600435683456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d4640 con 0x5609e15c9690 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d5e40 con 0x7f2578115060 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94600435685776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d4640 con 0x7f2578115060 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.400+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d6900 con 0x5609e15c9690 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94600435685776] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94600435683456] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94600435672416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d68c0 con 0x5609e15c9690 2024-09-11T11:01:26.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d6cf0 con 0x5609e15ce8d0 2024-09-11T11:01:26.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94600435686832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d7540 con 0x5609e15ce8d0 2024-09-11T11:01:26.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d7f40 con 0x5609e15ce8d0 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94600435672416] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94600435686832] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94600435691664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d7a50 con 0x5609e15ce8d0 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.404+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d8950 con 0x7f2578115060 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94600435691664] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94600435688400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d8950 con 0x7f2578115060 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 20 add_watcher() i=0 2024-09-11T11:01:26.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 20 add_watcher() i=1 2024-09-11T11:01:26.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 20 add_watcher() i=2 2024-09-11T11:01:26.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 20 add_watcher() i=3 2024-09-11T11:01:26.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 20 add_watcher() i=4 2024-09-11T11:01:26.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 20 add_watcher() i=5 2024-09-11T11:01:26.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 20 add_watcher() i=6 2024-09-11T11:01:26.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94600435688400] v32'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 20 add_watcher() i=7 2024-09-11T11:01:26.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15dbba0 con 0x5609e15c5420 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.408+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94600435697168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15d8ee0 con 0x5609e15c5420 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94600435697168] v32'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f24337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 5 note: GC not initialized 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f24327e4640 20 reqs_thread_entry: start 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:26.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 20 Filter name: none 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f23a3fff640 20 reqs_thread_entry: start 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15fed70 con 0x5609e15c5420 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e15ff760 con 0x5609e15c5420 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5609e1600770 con 0x7f2578115060 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f24337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:26.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.412+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94600435697168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15fcc70 con 0x5609e15c5420 2024-09-11T11:01:26.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.416+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94600435697168] v32'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.416+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94600435674896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15db690 con 0x5609e15c9690 2024-09-11T11:01:26.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.416+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94600435674896] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.416+0000 7f257f810980 20 remove_watcher() i=0 2024-09-11T11:01:26.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.416+0000 7f257f810980 2 removed watcher, disabling cache 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.416+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94600435679568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15db690 con 0x5609e15c5420 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94600435679568] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x5609e15c5420 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257f810980 20 remove_watcher() i=1 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94600435683456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15db690 con 0x5609e15c9690 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94600435683456] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257f810980 20 remove_watcher() i=2 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94600435685776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15db690 con 0x7f2578115060 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94600435685776] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257f810980 20 remove_watcher() i=3 2024-09-11T11:01:26.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.420+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94600435672416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15db690 con 0x5609e15c9690 2024-09-11T11:01:26.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257d320640 1 -- 172.21.15.145:0/1689301599 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94600435672416] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2578112030 con 0x5609e15c9690 2024-09-11T11:01:26.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257f810980 20 remove_watcher() i=4 2024-09-11T11:01:26.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94600435686832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15db690 con 0x5609e15ce8d0 2024-09-11T11:01:26.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94600435686832] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257f810980 20 remove_watcher() i=5 2024-09-11T11:01:26.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94600435691664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15db690 con 0x5609e15ce8d0 2024-09-11T11:01:26.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257cb1f640 1 -- 172.21.15.145:0/1689301599 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94600435691664] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2574036040 con 0x5609e15ce8d0 2024-09-11T11:01:26.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257f810980 20 remove_watcher() i=6 2024-09-11T11:01:26.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.424+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94600435688400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5609e15db690 con 0x7f2578115060 2024-09-11T11:01:26.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94600435688400] v32'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25700083f0 con 0x7f2578115060 2024-09-11T11:01:26.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 20 remove_watcher() i=7 2024-09-11T11:01:26.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e15c9690 msgr2=0x5609e15cbb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e15c9690 0x5609e15cbb50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e15c5420 msgr2=0x5609e15c78c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e15c5420 0x5609e15c78c0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2578115060 msgr2=0x7f25780c65b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2578115060 0x7f25780c65b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609e15ce8d0 msgr2=0x5609e15d0cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5609e15ce8d0 0x5609e15d0cc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2448034650 msgr2=0x7f2448036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2448034650 0x7f2448036b10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2574010fd0 tx=0x7f2574022040 comp rx=0 tx=0).stop 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 msgr2=0x5609e15ba3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/1689301599 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15b31c0 0x5609e15ba3a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f25780da7b0 tx=0x7f25780b7fc0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257db21640 1 -- 172.21.15.145:0/1689301599 reap_dead start 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 shutdown_connections 2024-09-11T11:01:26.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 >> 172.21.15.145:0/1689301599 conn(0x5609e15af5a0 msgr2=0x5609e15ad670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 shutdown_connections 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/1689301599 wait complete. 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/476185258 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24580346a0 msgr2=0x7f2458036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/476185258 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24580346a0 0x7f2458036b60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f257400c010 tx=0x7f2574006000 comp rx=0 tx=0).stop 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/476185258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15a6a00 msgr2=0x5609e15a6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/476185258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15a6a00 0x5609e15a6e20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f25780b7010 tx=0x7f25780a9a40 comp rx=0 tx=0).stop 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/476185258 shutdown_connections 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/476185258 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24580346a0 0x7f2458036b60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/476185258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e15a6a00 0x5609e15a6e20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/476185258 >> 172.21.15.145:0/476185258 conn(0x5609e159bb50 msgr2=0x5609e159e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/476185258 shutdown_connections 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/476185258 wait complete. 2024-09-11T11:01:26.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e1591090 msgr2=0x5609e1593480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5609e1591090 0x5609e1593480 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e1499ce0 msgr2=0x5609e158fbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5609e1499ce0 0x5609e158fbe0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5609e15966a0 msgr2=0x5609e1598a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5609e15966a0 0x5609e1598a90 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24640346a0 msgr2=0x7f2464036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f24640346a0 0x7f2464036b60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2574000f70 tx=0x7f2574001400 comp rx=0 tx=0).stop 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 msgr2=0x5609e1588c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 --2- 172.21.15.145:0/3619483998 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5609e1409290 0x5609e1588c50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2578005cc0 tx=0x7f2578017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257db21640 1 -- 172.21.15.145:0/3619483998 reap_dead start 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 shutdown_connections 2024-09-11T11:01:26.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 >> 172.21.15.145:0/3619483998 conn(0x5609e148f090 msgr2=0x5609e157c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 shutdown_connections 2024-09-11T11:01:26.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.428+0000 7f257f810980 1 -- 172.21.15.145:0/3619483998 wait complete. 2024-09-11T11:01:26.439 INFO:teuthology.orchestra.run.smithi145.stdout:["myfoo"] 2024-09-11T11:01:26.439 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-11T11:01:26.442 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:26.442 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-11T11:01:26.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-11T11:01:26.443 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-11T11:01:26.506 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:26.506 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:26.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe48a173980 1 Processor -- start 2024-09-11T11:01:26.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe48a173980 1 -- start start 2024-09-11T11:01:26.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe48a173980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562095003560 0x562095003940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe48a173980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562094e8cae0 con 0x562095003eb0 2024-09-11T11:01:26.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe48a173980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x562094eb0e30 con 0x562095003560 2024-09-11T11:01:26.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe487c83640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562095003560 0x562095003940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe487c83640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562095003560 0x562095003940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49538/0 (socket says 172.21.15.145:49538) 2024-09-11T11:01:26.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe487482640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x562095003eb0 0x5620950088e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:48792/0 (socket says 172.21.15.145:48792) 2024-09-11T11:01:26.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe487c83640 1 -- 172.21.15.145:0/3581181787 learned_addr learned my addr 172.21.15.145:0/3581181787 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe487c83640 1 -- 172.21.15.145:0/3581181787 >> v1:172.21.15.102:6789/0 conn(0x562095003eb0 legacy=0x5620950088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe486c81640 1 -- 172.21.15.145:0/3581181787 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705547720 0 0) 0x562094e8cae0 con 0x562095003eb0 2024-09-11T11:01:26.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.504+0000 7fe487c83640 1 -- 172.21.15.145:0/3581181787 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209500b130 con 0x562095003560 2024-09-11T11:01:26.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe487c83640 1 --2- 172.21.15.145:0/3581181787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x562095003940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe48000a4e0 tx=0x7fe48001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17826d37099710aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe486c81640 1 -- 172.21.15.145:0/3581181787 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800aa540 con 0x562095003560 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe486c81640 1 -- 172.21.15.145:0/3581181787 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800aa6e0 con 0x562095003560 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe486c81640 1 -- 172.21.15.145:0/3581181787 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800aaa00 con 0x562095003560 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe48a173980 1 -- 172.21.15.145:0/3581181787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 msgr2=0x562095003940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe48a173980 1 --2- 172.21.15.145:0/3581181787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x562095003940 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe48000a4e0 tx=0x7fe48001b090 comp rx=0 tx=0).stop 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe48a173980 1 -- 172.21.15.145:0/3581181787 shutdown_connections 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe48a173980 1 --2- 172.21.15.145:0/3581181787 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x562095003940 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe48a173980 1 -- 172.21.15.145:0/3581181787 >> 172.21.15.145:0/3581181787 conn(0x562094fff080 msgr2=0x5620950014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe48a173980 1 -- 172.21.15.145:0/3581181787 shutdown_connections 2024-09-11T11:01:26.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.508+0000 7fe48a173980 1 -- 172.21.15.145:0/3581181787 wait complete. 2024-09-11T11:01:26.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 Processor -- start 2024-09-11T11:01:26.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- start start 2024-09-11T11:01:26.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x5620950ee6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562094eb2200 con 0x562095003560 2024-09-11T11:01:26.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x5620950ee6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x5620950ee6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49698/0 (socket says 172.21.15.145:49698) 2024-09-11T11:01:26.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe487c83640 1 -- 172.21.15.145:0/1731923297 learned_addr learned my addr 172.21.15.145:0/1731923297 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe487c83640 1 -- 172.21.15.145:0/1731923297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620950eec80 con 0x562095003560 2024-09-11T11:01:26.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe487c83640 1 --2- 172.21.15.145:0/1731923297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x5620950ee6b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe480017ca0 tx=0x7fe4800033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90da831b304316ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe375e0b640 1 -- 172.21.15.145:0/1731923297 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800b9030 con 0x562095003560 2024-09-11T11:01:26.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe375e0b640 1 -- 172.21.15.145:0/1731923297 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800aaac0 con 0x562095003560 2024-09-11T11:01:26.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe375e0b640 1 -- 172.21.15.145:0/1731923297 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800aada0 con 0x562095003560 2024-09-11T11:01:26.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- 172.21.15.145:0/1731923297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 msgr2=0x5620950ee6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 --2- 172.21.15.145:0/1731923297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x5620950ee6b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe480017ca0 tx=0x7fe4800033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- 172.21.15.145:0/1731923297 shutdown_connections 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 --2- 172.21.15.145:0/1731923297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x5620950ee6b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- 172.21.15.145:0/1731923297 >> 172.21.15.145:0/1731923297 conn(0x562094fff080 msgr2=0x5620950ea2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- 172.21.15.145:0/1731923297 shutdown_connections 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- 172.21.15.145:0/1731923297 wait complete. 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 Processor -- start 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- start start 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x562094f793a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe48a173980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56209500ab70 con 0x562095003560 2024-09-11T11:01:26.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.524+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x562094f793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x562094f793a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49708/0 (socket says 172.21.15.145:49708) 2024-09-11T11:01:26.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe487c83640 1 -- 172.21.15.145:0/51324941 learned_addr learned my addr 172.21.15.145:0/51324941 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe487c83640 1 -- 172.21.15.145:0/51324941 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620950f97a0 con 0x562095003560 2024-09-11T11:01:26.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe487c83640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x562094f793a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe480005cc0 tx=0x7fe480017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe36ffff640 1 -- 172.21.15.145:0/51324941 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800b9030 con 0x562095003560 2024-09-11T11:01:26.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620950f9970 con 0x562095003560 2024-09-11T11:01:26.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe36ffff640 1 -- 172.21.15.145:0/51324941 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800c3070 con 0x562095003560 2024-09-11T11:01:26.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe36ffff640 1 -- 172.21.15.145:0/51324941 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800bf620 con 0x562095003560 2024-09-11T11:01:26.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620950f9da0 con 0x562095003560 2024-09-11T11:01:26.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe36ffff640 1 -- 172.21.15.145:0/51324941 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe4800c5030 con 0x562095003560 2024-09-11T11:01:26.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe36ffff640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe370034650 0x7fe370036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe36ffff640 1 -- 172.21.15.145:0/51324941 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe4800ba070 con 0x562095003560 2024-09-11T11:01:26.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe487482640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe370034650 0x7fe370036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe48a173980 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095003eb0 0x5620950fdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5620950fe070 con 0x562095003eb0 2024-09-11T11:01:26.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe488484640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095003eb0 0x5620950fdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe487482640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe370034650 0x7fe370036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe47c000c10 tx=0x7fe47c0013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe488484640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095003eb0 0x5620950fdaa0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe488484640 1 -- 172.21.15.145:0/51324941 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095003eb0 2024-09-11T11:01:26.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe48a173980 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5620950fedf0 0x5620951011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.528+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5620951017d0 con 0x5620950fedf0 2024-09-11T11:01:26.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe487c83640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5620950fedf0 0x5620951011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe487c83640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5620950fedf0 0x5620951011e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe487c83640 1 -- 172.21.15.145:0/51324941 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4800be410 con 0x5620950fedf0 2024-09-11T11:01:26.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095103080 con 0x5620950fedf0 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe487c83640 1 -- 172.21.15.145:0/51324941 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4800be410 con 0x5620950fedf0 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5620951022b0 con 0x5620950fedf0 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe487c83640 1 -- 172.21.15.145:0/51324941 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4800be410 con 0x5620950fedf0 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe48a173980 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562095104430 0x562095106820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095106d60 con 0x562095104430 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe487482640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562095104430 0x562095106820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe487482640 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562095104430 0x562095106820 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.532+0000 7fe487482640 1 -- 172.21.15.145:0/51324941 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe47c00f680 con 0x562095104430 2024-09-11T11:01:26.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 Processor -- start 2024-09-11T11:01:26.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 -- start start 2024-09-11T11:01:26.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620950f7120 0x5620950f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562094f0b800 con 0x5620950f7120 2024-09-11T11:01:26.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620950f7120 0x5620950f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620950f7120 0x5620950f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49710/0 (socket says 172.21.15.145:49710) 2024-09-11T11:01:26.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe487c83640 1 -- 172.21.15.145:0/3930558984 learned_addr learned my addr 172.21.15.145:0/3930558984 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.540 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe487c83640 1 -- 172.21.15.145:0/3930558984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620950f7540 con 0x5620950f7120 2024-09-11T11:01:26.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe487c83640 1 --2- 172.21.15.145:0/3930558984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620950f7120 0x5620950f57a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe4800a9b70 tx=0x7fe4800d62d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe36d7fa640 1 -- 172.21.15.145:0/3930558984 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800cc040 con 0x5620950f7120 2024-09-11T11:01:26.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe36d7fa640 1 -- 172.21.15.145:0/3930558984 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800e3b70 con 0x5620950f7120 2024-09-11T11:01:26.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 -- 172.21.15.145:0/3930558984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5620950f5d40 con 0x5620950f7120 2024-09-11T11:01:26.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe36d7fa640 1 -- 172.21.15.145:0/3930558984 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800e3e50 con 0x5620950f7120 2024-09-11T11:01:26.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 -- 172.21.15.145:0/3930558984 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620950f6210 con 0x5620950f7120 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe36d7fa640 1 -- 172.21.15.145:0/3930558984 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe4800b3040 con 0x5620950f7120 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe36d7fa640 1 --2- 172.21.15.145:0/3930558984 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3600345b0 0x7fe360036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe36d7fa640 1 -- 172.21.15.145:0/3930558984 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe4800e7ae0 con 0x5620950f7120 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe487482640 1 --2- 172.21.15.145:0/3930558984 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3600345b0 0x7fe360036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 Processor -- start 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 -- start start 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe487482640 1 --2- 172.21.15.145:0/3930558984 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3600345b0 0x7fe360036a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x562095107160 tx=0x7fe47c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x562095123740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.536+0000 7fe48a173980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5620950eef40 con 0x562095123340 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x562095123740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x562095123740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49712/0 (socket says 172.21.15.145:49712) 2024-09-11T11:01:26.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 -- 172.21.15.145:0/1003003454 learned_addr learned my addr 172.21.15.145:0/1003003454 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 -- 172.21.15.145:0/1003003454 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562095123d10 con 0x562095123340 2024-09-11T11:01:26.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 --2- 172.21.15.145:0/1003003454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x562095123740 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe4800d5f60 tx=0x7fe4800d2c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf0eb59c61385c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe366ffd640 1 -- 172.21.15.145:0/1003003454 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800e22b0 con 0x562095123340 2024-09-11T11:01:26.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe366ffd640 1 -- 172.21.15.145:0/1003003454 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800f5070 con 0x562095123340 2024-09-11T11:01:26.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe366ffd640 1 -- 172.21.15.145:0/1003003454 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800c6880 con 0x562095123340 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- 172.21.15.145:0/1003003454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 msgr2=0x562095123740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 --2- 172.21.15.145:0/1003003454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x562095123740 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe4800d5f60 tx=0x7fe4800d2c90 comp rx=0 tx=0).stop 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- 172.21.15.145:0/1003003454 shutdown_connections 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 --2- 172.21.15.145:0/1003003454 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x562095123740 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- 172.21.15.145:0/1003003454 >> 172.21.15.145:0/1003003454 conn(0x56209511f6c0 msgr2=0x56209511d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- 172.21.15.145:0/1003003454 shutdown_connections 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- 172.21.15.145:0/1003003454 wait complete. 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 Processor -- start 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- start start 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x56209512a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5620951240d0 con 0x562095123340 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x56209512a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x56209512a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49720/0 (socket says 172.21.15.145:49720) 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 learned_addr learned my addr 172.21.15.145:0/2575975357 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56209512aa20 con 0x562095123340 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe487c83640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x56209512a4e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe4800c77e0 tx=0x7fe4800d5ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe3657fa640 1 -- 172.21.15.145:0/2575975357 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe48010a070 con 0x562095123340 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56209512aa20 con 0x562095123340 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56209512aa20 con 0x562095123340 2024-09-11T11:01:26.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe3657fa640 1 -- 172.21.15.145:0/2575975357 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800c7410 con 0x562095123340 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.540+0000 7fe3657fa640 1 -- 172.21.15.145:0/2575975357 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800d7380 con 0x562095123340 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe3657fa640 1 -- 172.21.15.145:0/2575975357 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe48010d070 con 0x562095123340 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe3657fa640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3500346a0 0x7fe350036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe3657fa640 1 -- 172.21.15.145:0/2575975357 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe480106b20 con 0x562095123340 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe487482640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3500346a0 0x7fe350036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095135580 0x562095137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095138170 con 0x562095135580 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe488484640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095135580 0x562095137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe487482640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3500346a0 0x7fe350036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00ba80 tx=0x7fe47c023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe488484640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095135580 0x562095137a20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 realm 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095134a70 con 0x562095135580 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095138c30 con 0x562095135580 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562095139a10 0x56209513be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56209513c460 con 0x562095139a10 2024-09-11T11:01:26.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe487c83640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562095139a10 0x56209513be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe487c83640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562095139a10 0x56209513be00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.544+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe48a173980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe48a173980 20 searching for the correct realm 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56209513ea70 0x562095140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095141470 con 0x56209513ea70 2024-09-11T11:01:26.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487482640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56209513ea70 0x562095140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487482640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56209513ea70 0x562095140e60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095141470 con 0x562095139a10 2024-09-11T11:01:26.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487c83640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe48010f060 0x7fe4800cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x7fe48010f060 2024-09-11T11:01:26.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe48010f060 0x7fe4800cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe48010f060 0x7fe4800cb6a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x56209513ea70 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.548+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x7fe48010f060 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x7fe48010f060 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x56209513ea70 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.552+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x56209513ea70 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x56209513ea70 2024-09-11T11:01:26.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x7fe48010f060 2024-09-11T11:01:26.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x7fe48010f060 2024-09-11T11:01:26.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x56209513ea70 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x7fe48010f060 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.556+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x56209513ea70 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:26.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:26.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:26.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:26.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:26.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:26.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56209513d550 con 0x562095135580 2024-09-11T11:01:26.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56209513d940 con 0x562095139a10 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56209513d940 con 0x7fe48010f060 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 zone default found 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 4 Realm: () 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:26.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 zonegroup default 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x7fe48010f060 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x562095143650 con 0x56209513ea70 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.560+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5620951439f0 con 0x56209513ea70 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe48a173980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe48a173980 20 started sync module instance, tier type = 2024-09-11T11:01:26.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe48a173980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:26.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095142af0 con 0x562095139a10 2024-09-11T11:01:26.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94697940070464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095142af0 con 0x562095139a10 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095144480 con 0x562095135580 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94697940074320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095144440 con 0x562095135580 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.564+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5620951453e0 con 0x562095139a10 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94697940074320] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94697940070464] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94697940067904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5620951453e0 con 0x562095139a10 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095145810 con 0x7fe48010f060 2024-09-11T11:01:26.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94697940078272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5620951457d0 con 0x7fe48010f060 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5620951466f0 con 0x562095139a10 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94697940067904] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.568+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94697940078272] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.572+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.572+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94697940081664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5620951466f0 con 0x562095139a10 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.572+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095146ae0 con 0x56209513ea70 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.572+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.572+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94697940076656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095147330 con 0x56209513ea70 2024-09-11T11:01:26.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.572+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095147cf0 con 0x56209513ea70 2024-09-11T11:01:26.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.572+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94697940081664] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.572+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94697940076656] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94697940088896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5620951480e0 con 0x56209513ea70 2024-09-11T11:01:26.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095148930 con 0x7fe48010f060 2024-09-11T11:01:26.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94697940088896] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94697940091104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5620951489b0 con 0x7fe48010f060 2024-09-11T11:01:26.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 20 add_watcher() i=0 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 20 add_watcher() i=1 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 20 add_watcher() i=2 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 20 add_watcher() i=3 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 20 add_watcher() i=4 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 20 add_watcher() i=5 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 20 add_watcher() i=6 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94697940091104] v32'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 20 add_watcher() i=7 2024-09-11T11:01:26.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x56209514bc90 con 0x562095135580 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.576+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94697940092528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095148f40 con 0x562095135580 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94697940092528] v32'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe33dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe48a173980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe48a173980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe48a173980 5 note: GC not initialized 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe33cfe1640 20 reqs_thread_entry: start 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe48a173980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe48a173980 20 Filter name: none 2024-09-11T11:01:26.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe2b67fc640 20 reqs_thread_entry: start 2024-09-11T11:01:26.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209516ea40 con 0x56209513ea70 2024-09-11T11:01:26.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(62 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x562095147cf0 con 0x562095139a10 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(63 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095135580 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(64 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 [pgnls start_epoch 32 out=49b] v32'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x7fe48010f060 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(66 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.580+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095139a10 2024-09-11T11:01:26.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(68 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x56209513ea70 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(69 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x7fe48010f060 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(70 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095139a10 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(71 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(72 [pgnls start_epoch 32 out=127b] v32'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x56209513ea70 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(74 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x56209513ea70 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x7fe48010f060 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(76 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x56209513ea70 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(78 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.584+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095139a10 2024-09-11T11:01:26.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(79 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x7fe48010f060 2024-09-11T11:01:26.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(80 [pgnls start_epoch 32 out=70b] v32'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095139a10 2024-09-11T11:01:26.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(81 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(82 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x56209513ea70 2024-09-11T11:01:26.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(83 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x7fe48010f060 2024-09-11T11:01:26.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(84 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(85 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(86 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x56209513ea70 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 [pgnls start_epoch 32 out=49b] v32'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x56209513ea70 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x7fe48010f060 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(89 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095135580 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(90 [pgnls start_epoch 32 out=49b] v32'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.588+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x562095139a10 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(91 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x56209513ea70 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(92 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5620951418d0 con 0x7fe48010f060 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(93 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe48a173980 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe48a173980 20 RGWRados::pool_iterate: got myfoo 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe33dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:26.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94697940092528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095147cf0 con 0x562095135580 2024-09-11T11:01:26.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94697940092528] v32'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.592+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94697940070464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56209513cd00 con 0x562095139a10 2024-09-11T11:01:26.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.596+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94697940070464] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.596+0000 7fe48a173980 20 remove_watcher() i=0 2024-09-11T11:01:26.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.596+0000 7fe48a173980 2 removed watcher, disabling cache 2024-09-11T11:01:26.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.596+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94697940074320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095147cf0 con 0x562095135580 2024-09-11T11:01:26.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.596+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94697940074320] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x562095135580 2024-09-11T11:01:26.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.596+0000 7fe48a173980 20 remove_watcher() i=1 2024-09-11T11:01:26.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.596+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94697940067904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56209516ea90 con 0x562095139a10 2024-09-11T11:01:26.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.600+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94697940067904] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.600+0000 7fe48a173980 20 remove_watcher() i=2 2024-09-11T11:01:26.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.600+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94697940078272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095147cf0 con 0x7fe48010f060 2024-09-11T11:01:26.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.600+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94697940078272] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.600+0000 7fe48a173980 20 remove_watcher() i=3 2024-09-11T11:01:26.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.600+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94697940081664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56209516ea90 con 0x562095139a10 2024-09-11T11:01:26.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.600+0000 7fe487c83640 1 -- 172.21.15.145:0/2575975357 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94697940081664] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe48010c030 con 0x562095139a10 2024-09-11T11:01:26.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 20 remove_watcher() i=4 2024-09-11T11:01:26.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94697940076656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x562095147cf0 con 0x56209513ea70 2024-09-11T11:01:26.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94697940076656] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 20 remove_watcher() i=5 2024-09-11T11:01:26.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94697940088896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56209516ea90 con 0x56209513ea70 2024-09-11T11:01:26.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe487482640 1 -- 172.21.15.145:0/2575975357 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94697940088896] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe47c037040 con 0x56209513ea70 2024-09-11T11:01:26.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 20 remove_watcher() i=6 2024-09-11T11:01:26.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94697940091104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x56209516ea90 con 0x7fe48010f060 2024-09-11T11:01:26.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94697940091104] v32'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4780083f0 con 0x7fe48010f060 2024-09-11T11:01:26.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 20 remove_watcher() i=7 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562095139a10 msgr2=0x56209513be00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562095139a10 0x56209513be00 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095135580 msgr2=0x562095137a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095135580 0x562095137a20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe48010f060 msgr2=0x7fe4800cb6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe48010f060 0x7fe4800cb6a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56209513ea70 msgr2=0x562095140e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56209513ea70 0x562095140e60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3500346a0 msgr2=0x7fe350036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3500346a0 0x7fe350036b60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00ba80 tx=0x7fe47c023040 comp rx=0 tx=0).stop 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 msgr2=0x56209512a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x56209512a4e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe4800c77e0 tx=0x7fe4800d5ef0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe488484640 1 -- 172.21.15.145:0/2575975357 reap_dead start 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 shutdown_connections 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 --2- 172.21.15.145:0/2575975357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095123340 0x56209512a4e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 >> 172.21.15.145:0/2575975357 conn(0x56209511f6c0 msgr2=0x56209511d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 shutdown_connections 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.604+0000 7fe48a173980 1 -- 172.21.15.145:0/2575975357 wait complete. 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/3930558984 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3600345b0 msgr2=0x7fe360036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/3930558984 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3600345b0 0x7fe360036a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x562095107160 tx=0x7fe47c006000 comp rx=0 tx=0).stop 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/3930558984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620950f7120 msgr2=0x5620950f57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/3930558984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620950f7120 0x5620950f57a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe4800a9b70 tx=0x7fe4800d62d0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/3930558984 shutdown_connections 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/3930558984 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe3600345b0 0x7fe360036a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/3930558984 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5620950f7120 0x5620950f57a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/3930558984 >> 172.21.15.145:0/3930558984 conn(0x562095109940 msgr2=0x56209510c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/3930558984 shutdown_connections 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/3930558984 wait complete. 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5620950fedf0 msgr2=0x5620951011e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5620950fedf0 0x5620951011e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095003eb0 msgr2=0x5620950fdaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562095003eb0 0x5620950fdaa0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562095104430 msgr2=0x562095106820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562095104430 0x562095106820 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe370034650 msgr2=0x7fe370036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe370034650 0x7fe370036b10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe47c000c10 tx=0x7fe47c0013c0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 msgr2=0x562094f793a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 --2- 172.21.15.145:0/51324941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562095003560 0x562094f793a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe480005cc0 tx=0x7fe480017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:26.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe488484640 1 -- 172.21.15.145:0/51324941 reap_dead start 2024-09-11T11:01:26.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 shutdown_connections 2024-09-11T11:01:26.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 >> 172.21.15.145:0/51324941 conn(0x562094fff080 msgr2=0x5620950e8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 shutdown_connections 2024-09-11T11:01:26.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.608+0000 7fe48a173980 1 -- 172.21.15.145:0/51324941 wait complete. 2024-09-11T11:01:26.618 INFO:teuthology.orchestra.run.smithi145.stdout:["myfoo"] 2024-09-11T11:01:26.619 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-11T11:01:26.636 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:26.647 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:26.658 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:26.701 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-11T11:01:26.768 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:26.832 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:26.902 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:26.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-11T11:01:26.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-11T11:01:26.903 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-11T11:01:26.941 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:26.941 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35ce765980 1 Processor -- start 2024-09-11T11:01:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35ce765980 1 -- start start 2024-09-11T11:01:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35ce765980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558ab208fa90 0x558ab2091e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35ce765980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ab1f13ae0 con 0x558ab1fffac0 2024-09-11T11:01:26.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35ce765980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x558ab1f37e30 con 0x558ab208fa90 2024-09-11T11:01:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35cba74640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558ab208fa90 0x558ab2091e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35cc275640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x558ab1fffac0 0x558ab208e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54508/0 (socket says 172.21.15.145:54508) 2024-09-11T11:01:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35cba74640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558ab208fa90 0x558ab2091e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49724/0 (socket says 172.21.15.145:49724) 2024-09-11T11:01:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35cc275640 1 -- 172.21.15.145:0/3184117052 learned_addr learned my addr 172.21.15.145:0/3184117052 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35cba74640 1 -- 172.21.15.145:0/3184117052 >> v1:172.21.15.102:6789/0 conn(0x558ab1fffac0 legacy=0x558ab208e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.940+0000 7f35cba74640 1 -- 172.21.15.145:0/3184117052 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab20933d0 con 0x558ab208fa90 2024-09-11T11:01:26.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35cba74640 1 --2- 172.21.15.145:0/3184117052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab208fa90 0x558ab2091e80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f35b400a480 tx=0x7f35b401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ebd8099dbc12f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35cb273640 1 -- 172.21.15.145:0/3184117052 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35b40b0070 con 0x558ab208fa90 2024-09-11T11:01:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35cb273640 1 -- 172.21.15.145:0/3184117052 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b40ab540 con 0x558ab208fa90 2024-09-11T11:01:26.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35cb273640 1 -- 172.21.15.145:0/3184117052 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35b40ab840 con 0x558ab208fa90 2024-09-11T11:01:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35ce765980 1 -- 172.21.15.145:0/3184117052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab208fa90 msgr2=0x558ab2091e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35ce765980 1 --2- 172.21.15.145:0/3184117052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab208fa90 0x558ab2091e80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f35b400a480 tx=0x7f35b401b280 comp rx=0 tx=0).stop 2024-09-11T11:01:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35ce765980 1 -- 172.21.15.145:0/3184117052 shutdown_connections 2024-09-11T11:01:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35ce765980 1 --2- 172.21.15.145:0/3184117052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab208fa90 0x558ab2091e80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35ce765980 1 -- 172.21.15.145:0/3184117052 >> 172.21.15.145:0/3184117052 conn(0x558ab2086060 msgr2=0x558ab2088480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35ce765980 1 -- 172.21.15.145:0/3184117052 shutdown_connections 2024-09-11T11:01:26.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.944+0000 7f35ce765980 1 -- 172.21.15.145:0/3184117052 wait complete. 2024-09-11T11:01:26.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 Processor -- start 2024-09-11T11:01:26.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 -- start start 2024-09-11T11:01:26.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab2176a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ab1f39200 con 0x558ab1fffac0 2024-09-11T11:01:26.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab2176a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab2176a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49726/0 (socket says 172.21.15.145:49726) 2024-09-11T11:01:26.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35cc275640 1 -- 172.21.15.145:0/3541371338 learned_addr learned my addr 172.21.15.145:0/3541371338 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35cc275640 1 -- 172.21.15.145:0/3541371338 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab2177030 con 0x558ab1fffac0 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35cc275640 1 --2- 172.21.15.145:0/3541371338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab2176a60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f35bc001d90 tx=0x7f35bc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de59bef932ae5530 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f34ba60c640 1 -- 172.21.15.145:0/3541371338 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc013030 con 0x558ab1fffac0 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f34ba60c640 1 -- 172.21.15.145:0/3541371338 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc00e690 con 0x558ab1fffac0 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f34ba60c640 1 -- 172.21.15.145:0/3541371338 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc00ea10 con 0x558ab1fffac0 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 -- 172.21.15.145:0/3541371338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 msgr2=0x558ab2176a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 --2- 172.21.15.145:0/3541371338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab2176a60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f35bc001d90 tx=0x7f35bc001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 -- 172.21.15.145:0/3541371338 shutdown_connections 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 --2- 172.21.15.145:0/3541371338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab2176a60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.960+0000 7f35ce765980 1 -- 172.21.15.145:0/3541371338 >> 172.21.15.145:0/3541371338 conn(0x558ab2086060 msgr2=0x558ab2172690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 -- 172.21.15.145:0/3541371338 shutdown_connections 2024-09-11T11:01:26.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 -- 172.21.15.145:0/3541371338 wait complete. 2024-09-11T11:01:26.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 Processor -- start 2024-09-11T11:01:26.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 -- start start 2024-09-11T11:01:26.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab217ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ab2092e10 con 0x558ab1fffac0 2024-09-11T11:01:26.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab217ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab217ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49740/0 (socket says 172.21.15.145:49740) 2024-09-11T11:01:26.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35cc275640 1 -- 172.21.15.145:0/3425086002 learned_addr learned my addr 172.21.15.145:0/3425086002 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35cc275640 1 -- 172.21.15.145:0/3425086002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab217e330 con 0x558ab1fffac0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35cc275640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab217ddf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x558ab2177c40 tx=0x7f35bc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f34b8e09640 1 -- 172.21.15.145:0/3425086002 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc027070 con 0x558ab1fffac0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f34b8e09640 1 -- 172.21.15.145:0/3425086002 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc019900 con 0x558ab1fffac0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ab217e5c0 con 0x558ab1fffac0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f34b8e09640 1 -- 172.21.15.145:0/3425086002 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc019c20 con 0x558ab1fffac0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab21812a0 con 0x558ab1fffac0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f34b8e09640 1 -- 172.21.15.145:0/3425086002 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f35bc02a070 con 0x558ab1fffac0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f34b8e09640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34b4034650 0x7f34b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f34b8e09640 1 -- 172.21.15.145:0/3425086002 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f35bc01f070 con 0x558ab1fffac0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35cba74640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34b4034650 0x7f34b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab208fa90 0x558ab2184dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.964+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab2185430 con 0x558ab208fa90 2024-09-11T11:01:26.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35cca76640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab208fa90 0x558ab2184dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35cba74640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34b4034650 0x7f34b4036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35b40ad000 tx=0x7f35b40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35cca76640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab208fa90 0x558ab2184dc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35cca76640 1 -- 172.21.15.145:0/3425086002 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab208fa90 2024-09-11T11:01:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35ce765980 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab2186220 0x558ab2188610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab2188c40 con 0x558ab2186220 2024-09-11T11:01:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35cc275640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab2186220 0x558ab2188610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35cc275640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab2186220 0x558ab2188610 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35cc275640 1 -- 172.21.15.145:0/3425086002 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35bc029030 con 0x558ab2186220 2024-09-11T11:01:26.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab218a4f0 con 0x558ab2186220 2024-09-11T11:01:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35cc275640 1 -- 172.21.15.145:0/3425086002 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f35bc029030 con 0x558ab2186220 2024-09-11T11:01:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.968+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab2189720 con 0x558ab2186220 2024-09-11T11:01:26.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cc275640 1 -- 172.21.15.145:0/3425086002 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35bc029030 con 0x558ab2186220 2024-09-11T11:01:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35ce765980 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ab218b8a0 0x558ab218dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab218e1d0 con 0x558ab218b8a0 2024-09-11T11:01:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cba74640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ab218b8a0 0x558ab218dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cba74640 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ab218b8a0 0x558ab218dc90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cba74640 1 -- 172.21.15.145:0/3425086002 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f35b40b3040 con 0x558ab218b8a0 2024-09-11T11:01:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35ce765980 1 Processor -- start 2024-09-11T11:01:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35ce765980 1 -- start start 2024-09-11T11:01:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35ce765980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab219bca0 0x558ab219c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35ce765980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ab1f92800 con 0x558ab219bca0 2024-09-11T11:01:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab219bca0 0x558ab219c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab219bca0 0x558ab219c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49754/0 (socket says 172.21.15.145:49754) 2024-09-11T11:01:26.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cc275640 1 -- 172.21.15.145:0/4289003876 learned_addr learned my addr 172.21.15.145:0/4289003876 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cc275640 1 -- 172.21.15.145:0/4289003876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab219c600 con 0x558ab219bca0 2024-09-11T11:01:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35cc275640 1 --2- 172.21.15.145:0/4289003876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab219bca0 0x558ab219c0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f35bc048490 tx=0x7f35bc032350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f34b1ffb640 1 -- 172.21.15.145:0/4289003876 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc02a790 con 0x558ab219bca0 2024-09-11T11:01:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f34b1ffb640 1 -- 172.21.15.145:0/4289003876 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc02a930 con 0x558ab219bca0 2024-09-11T11:01:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35ce765980 1 -- 172.21.15.145:0/4289003876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ab219c890 con 0x558ab219bca0 2024-09-11T11:01:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f34b1ffb640 1 -- 172.21.15.145:0/4289003876 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc02ac50 con 0x558ab219bca0 2024-09-11T11:01:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.972+0000 7f35ce765980 1 -- 172.21.15.145:0/4289003876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab219f510 con 0x558ab219bca0 2024-09-11T11:01:26.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f34b1ffb640 1 -- 172.21.15.145:0/4289003876 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f35bc016070 con 0x558ab219bca0 2024-09-11T11:01:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f34b1ffb640 1 --2- 172.21.15.145:0/4289003876 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34a40346f0 0x7f34a4036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f34b1ffb640 1 -- 172.21.15.145:0/4289003876 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f35bc014070 con 0x558ab219bca0 2024-09-11T11:01:26.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35cba74640 1 --2- 172.21.15.145:0/4289003876 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34a40346f0 0x7f34a4036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 Processor -- start 2024-09-11T11:01:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 -- start start 2024-09-11T11:01:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35cba74640 1 --2- 172.21.15.145:0/4289003876 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34a40346f0 0x7f34a4036bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35bc001400 tx=0x7f35b4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ab21773b0 con 0x558ab21a8640 2024-09-11T11:01:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21a8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49770/0 (socket says 172.21.15.145:49770) 2024-09-11T11:01:26.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35cc275640 1 -- 172.21.15.145:0/3432333963 learned_addr learned my addr 172.21.15.145:0/3432333963 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35cc275640 1 -- 172.21.15.145:0/3432333963 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab21a9010 con 0x558ab21a8640 2024-09-11T11:01:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35cc275640 1 --2- 172.21.15.145:0/3432333963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21a8a40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f35bc04a000 tx=0x7f35bc0225f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6ac3bcf5066eefd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f34ab7fe640 1 -- 172.21.15.145:0/3432333963 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc00c5a0 con 0x558ab21a8640 2024-09-11T11:01:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f34ab7fe640 1 -- 172.21.15.145:0/3432333963 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc02c440 con 0x558ab21a8640 2024-09-11T11:01:26.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f34ab7fe640 1 -- 172.21.15.145:0/3432333963 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc02ba60 con 0x558ab21a8640 2024-09-11T11:01:26.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 -- 172.21.15.145:0/3432333963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 msgr2=0x558ab21a8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 --2- 172.21.15.145:0/3432333963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21a8a40 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f35bc04a000 tx=0x7f35bc0225f0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 -- 172.21.15.145:0/3432333963 shutdown_connections 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 --2- 172.21.15.145:0/3432333963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21a8a40 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 -- 172.21.15.145:0/3432333963 >> 172.21.15.145:0/3432333963 conn(0x558ab21a49c0 msgr2=0x558ab21a2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 -- 172.21.15.145:0/3432333963 shutdown_connections 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.976+0000 7f35ce765980 1 -- 172.21.15.145:0/3432333963 wait complete. 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 1 Processor -- start 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 1 -- start start 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ab21a93d0 con 0x558ab21a8640 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35cc275640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21af7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49774/0 (socket says 172.21.15.145:49774) 2024-09-11T11:01:26.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 learned_addr learned my addr 172.21.15.145:0/4233010183 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ab21afd20 con 0x558ab21a8640 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35cc275640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21af7e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00f800 tx=0x7f35bc039f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f34a9ffb640 1 -- 172.21.15.145:0/4233010183 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc0413d0 con 0x558ab21a8640 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f34a9ffb640 1 -- 172.21.15.145:0/4233010183 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc069030 con 0x558ab21a8640 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ab21afd20 con 0x558ab21a8640 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f34a9ffb640 1 -- 172.21.15.145:0/4233010183 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f35bc00f070 con 0x558ab21a8640 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ab21afd20 con 0x558ab21a8640 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f34a9ffb640 1 -- 172.21.15.145:0/4233010183 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f35bc009070 con 0x558ab21a8640 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f34a9ffb640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f349c034650 0x7f349c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f34a9ffb640 1 -- 172.21.15.145:0/4233010183 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f35bc05a030 con 0x558ab21a8640 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35cba74640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f349c034650 0x7f349c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab21ba8b0 0x558ab21bcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21bd4a0 con 0x558ab21ba8b0 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.980+0000 7f35cca76640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab21ba8b0 0x558ab21bcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cba74640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f349c034650 0x7f349c036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f35b4018eb0 tx=0x7f35b40b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cca76640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab21ba8b0 0x558ab21bcd50 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 realm 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21b9da0 con 0x558ab21ba8b0 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21bdf70 con 0x558ab21ba8b0 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab21beb20 0x558ab21c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c1750 con 0x558ab21beb20 2024-09-11T11:01:26.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cc275640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab21beb20 0x558ab21c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cc275640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab21beb20 0x558ab21c0fe0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f35bc04f070 con 0x558ab21beb20 2024-09-11T11:01:26.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21bdb60 con 0x558ab21beb20 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f35bc04f070 con 0x558ab21beb20 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 20 searching for the correct realm 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ab21c34c0 0x558ab21c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c6050 con 0x558ab21c34c0 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cba74640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ab21c34c0 0x558ab21c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.984+0000 7f35cba74640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ab21c34c0 0x558ab21c5980 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c6050 con 0x558ab21beb20 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f35bc04f070 con 0x558ab21beb20 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cc275640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f35bc078040 0x7f35bc06e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x7f35bc078040 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f35bc078040 0x7f35bc06e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f35bc078040 0x7f35bc06e8a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:26.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21c34c0 2024-09-11T11:01:26.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:26.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:26.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21beb20 2024-09-11T11:01:26.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc04f070 con 0x558ab21beb20 2024-09-11T11:01:26.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.988+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21beb20 2024-09-11T11:01:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc04f070 con 0x558ab21beb20 2024-09-11T11:01:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x7f35bc078040 2024-09-11T11:01:26.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x7f35bc078040 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21beb20 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21c34c0 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21beb20 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:26.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21c34c0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.992+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21c34c0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x7f35bc078040 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21ba8b0 2024-09-11T11:01:27.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x7f35bc078040 2024-09-11T11:01:27.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21c34c0 2024-09-11T11:01:27.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x7f35bc078040 2024-09-11T11:01:27.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21beb20 2024-09-11T11:01:27.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21beb20 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21c34c0 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:26.996+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21beb20 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7f35bc06d020 con 0x558ab21beb20 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:27.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:27.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c1de0 con 0x558ab21ba8b0 2024-09-11T11:01:27.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c21d0 con 0x558ab21beb20 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c21d0 con 0x7f35bc078040 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 zone default found 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 4 Realm: () 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 zonegroup default 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c64d0 con 0x7f35bc078040 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c8250 con 0x558ab21c34c0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.000+0000 7f35ce765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c85f0 con 0x558ab21c34c0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 20 started sync module instance, tier type = 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:27.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c76f0 con 0x558ab21beb20 2024-09-11T11:01:27.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94054182059072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c76f0 con 0x558ab21beb20 2024-09-11T11:01:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c8fb0 con 0x558ab21ba8b0 2024-09-11T11:01:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94054182062848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c8f20 con 0x558ab21ba8b0 2024-09-11T11:01:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.004+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c9ef0 con 0x558ab21beb20 2024-09-11T11:01:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.008+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94054182059072] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.008+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94054182062848] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.008+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.008+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94054182065056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c9eb0 con 0x558ab21beb20 2024-09-11T11:01:27.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.008+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21ca790 con 0x7f35bc078040 2024-09-11T11:01:27.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94054182068960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c9eb0 con 0x7f35bc078040 2024-09-11T11:01:27.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cb200 con 0x558ab21beb20 2024-09-11T11:01:27.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94054182065056] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94054182068960] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94054182070016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cad50 con 0x558ab21beb20 2024-09-11T11:01:27.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cbad0 con 0x558ab21c34c0 2024-09-11T11:01:27.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94054182073888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cad50 con 0x558ab21c34c0 2024-09-11T11:01:27.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.012+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cc940 con 0x558ab21c34c0 2024-09-11T11:01:27.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94054182070016] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94054182073888] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94054182077584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cbf80 con 0x558ab21c34c0 2024-09-11T11:01:27.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cd3d0 con 0x7f35bc078040 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94054182080160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cd390 con 0x7f35bc078040 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 20 add_watcher() i=0 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 20 add_watcher() i=1 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 20 add_watcher() i=2 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 20 add_watcher() i=3 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 20 add_watcher() i=4 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 20 add_watcher() i=5 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94054182077584] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.016+0000 7f35ce765980 20 add_watcher() i=6 2024-09-11T11:01:27.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94054182080160] v32'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 20 add_watcher() i=7 2024-09-11T11:01:27.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:27.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c99c0 con 0x558ab21ba8b0 2024-09-11T11:01:27.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94054182066624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21cdde0 con 0x558ab21ba8b0 2024-09-11T11:01:27.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94054182066624] v32'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f34827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:27.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:27.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 5 note: GC not initialized 2024-09-11T11:01:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f34817e2640 20 reqs_thread_entry: start 2024-09-11T11:01:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.020+0000 7f35ce765980 20 Filter name: none 2024-09-11T11:01:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f33f2ffd640 20 reqs_thread_entry: start 2024-09-11T11:01:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21f3f60 con 0x7f35bc078040 2024-09-11T11:01:27.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:27.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21f47f0 con 0x558ab21ba8b0 2024-09-11T11:01:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(63 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-11T11:01:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21f3300 con 0x7f35bc078040 2024-09-11T11:01:27.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f35c400a4d0 con 0x7f35bc078040 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21f5e00 con 0x558ab21ba8b0 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f35c400a4d0 con 0x558ab21ba8b0 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 4.27 4:e42effdc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21f7830 con 0x558ab21ba8b0 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 4.19 4:99091213:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21fa3b0 con 0x558ab21c34c0 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 4.10 4:0b9800c4:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21fcd10 con 0x558ab21c34c0 2024-09-11T11:01:27.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 4.34 4:2e421ecf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21ff750 con 0x7f35bc078040 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 4.32 4:4e8df1ce:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab22020f0 con 0x558ab21beb20 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 4.13 4:c86f3d50:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab2204ca0 con 0x7f35bc078040 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 4.e 4:71901f3b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab2207570 con 0x7f35bc078040 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35c403e060 con 0x558ab21ba8b0 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 4.6 4:610448dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab2207570 con 0x558ab21c34c0 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(69 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35c403e060 con 0x7f35bc078040 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:74 4.14 4:2b20de90:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab2204ca0 con 0x558ab21c34c0 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(67 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 4.4 4:215ab0bf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21f5a20 con 0x558ab21ba8b0 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(68 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 4.2e 4:7645baa1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x558ab21fa880 con 0x558ab21c34c0 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(71 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35c403e060 con 0x7f35bc078040 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(72 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35c403e060 con 0x7f35bc078040 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(70 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(74 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(75 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35c403e060 con 0x558ab21ba8b0 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(76 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.024+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(73 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.028+0000 7f34827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.028+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94054182066624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21e4670 con 0x558ab21ba8b0 2024-09-11T11:01:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.028+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94054182066624] v32'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f35c403e060 con 0x558ab21ba8b0 2024-09-11T11:01:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.028+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94054182059072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21e4670 con 0x558ab21beb20 2024-09-11T11:01:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.032+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94054182059072] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.032+0000 7f35ce765980 20 remove_watcher() i=0 2024-09-11T11:01:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.032+0000 7f35ce765980 2 removed watcher, disabling cache 2024-09-11T11:01:27.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.032+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94054182062848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c7c40 con 0x558ab21ba8b0 2024-09-11T11:01:27.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.032+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94054182062848] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c403e060 con 0x558ab21ba8b0 2024-09-11T11:01:27.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.032+0000 7f35ce765980 20 remove_watcher() i=1 2024-09-11T11:01:27.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.032+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94054182065056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21e4670 con 0x558ab21beb20 2024-09-11T11:01:27.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94054182065056] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35ce765980 20 remove_watcher() i=2 2024-09-11T11:01:27.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94054182068960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c7c40 con 0x7f35bc078040 2024-09-11T11:01:27.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94054182068960] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c403e060 con 0x7f35bc078040 2024-09-11T11:01:27.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35ce765980 20 remove_watcher() i=3 2024-09-11T11:01:27.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94054182070016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c93a0 con 0x558ab21beb20 2024-09-11T11:01:27.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35cc275640 1 -- 172.21.15.145:0/4233010183 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94054182070016] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35bc086040 con 0x558ab21beb20 2024-09-11T11:01:27.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35ce765980 20 remove_watcher() i=4 2024-09-11T11:01:27.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.036+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94054182073888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21e4670 con 0x558ab21c34c0 2024-09-11T11:01:27.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94054182073888] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 20 remove_watcher() i=5 2024-09-11T11:01:27.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94054182077584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c7c40 con 0x558ab21c34c0 2024-09-11T11:01:27.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35cba74640 1 -- 172.21.15.145:0/4233010183 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94054182077584] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35b40c9030 con 0x558ab21c34c0 2024-09-11T11:01:27.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 20 remove_watcher() i=6 2024-09-11T11:01:27.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94054182080160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x558ab21c93a0 con 0x7f35bc078040 2024-09-11T11:01:27.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94054182080160] v32'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f35c403e060 con 0x7f35bc078040 2024-09-11T11:01:27.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 20 remove_watcher() i=7 2024-09-11T11:01:27.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab21beb20 msgr2=0x558ab21c0fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab21beb20 0x558ab21c0fe0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab21ba8b0 msgr2=0x558ab21bcd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab21ba8b0 0x558ab21bcd50 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f35bc078040 msgr2=0x7f35bc06e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f35bc078040 0x7f35bc06e8a0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ab21c34c0 msgr2=0x558ab21c5980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ab21c34c0 0x558ab21c5980 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f349c034650 msgr2=0x7f349c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f349c034650 0x7f349c036b10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f35b4018eb0 tx=0x7f35b40b9040 comp rx=0 tx=0).stop 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 msgr2=0x558ab21af7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35cca76640 1 -- 172.21.15.145:0/4233010183 reap_dead start 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.040+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21af7e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f35bc00f800 tx=0x7f35bc039f30 comp rx=0 tx=0).stop 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 shutdown_connections 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/4233010183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab21a8640 0x558ab21af7e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 >> 172.21.15.145:0/4233010183 conn(0x558ab21a49c0 msgr2=0x558ab21a2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 shutdown_connections 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4233010183 wait complete. 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4289003876 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34a40346f0 msgr2=0x7f34a4036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/4289003876 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34a40346f0 0x7f34a4036bb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35bc001400 tx=0x7f35b4005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4289003876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab219bca0 msgr2=0x558ab219c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/4289003876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab219bca0 0x558ab219c0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f35bc048490 tx=0x7f35bc032350 comp rx=0 tx=0).stop 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4289003876 shutdown_connections 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/4289003876 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34a40346f0 0x7f34a4036bb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/4289003876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab219bca0 0x558ab219c0c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4289003876 >> 172.21.15.145:0/4289003876 conn(0x558ab2190df0 msgr2=0x558ab2193870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4289003876 shutdown_connections 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/4289003876 wait complete. 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab2186220 msgr2=0x558ab2188610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ab2186220 0x558ab2188610 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab208fa90 msgr2=0x558ab2184dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ab208fa90 0x558ab2184dc0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ab218b8a0 msgr2=0x558ab218dc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ab218b8a0 0x558ab218dc90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34b4034650 msgr2=0x7f34b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f34b4034650 0x7f34b4036b10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f35b40ad000 tx=0x7f35b40a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 msgr2=0x558ab217ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 --2- 172.21.15.145:0/3425086002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ab1fffac0 0x558ab217ddf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x558ab2177c40 tx=0x7f35bc000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35cca76640 1 -- 172.21.15.145:0/3425086002 reap_dead start 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 shutdown_connections 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 >> 172.21.15.145:0/3425086002 conn(0x558ab2086060 msgr2=0x558ab2171210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 shutdown_connections 2024-09-11T11:01:27.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.044+0000 7f35ce765980 1 -- 172.21.15.145:0/3425086002 wait complete. 2024-09-11T11:01:27.058 INFO:teuthology.orchestra.run.smithi145.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2267e615-29e0-4503-94c5-a003ba7e8ee3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","marker":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-11T11:01:26.281145Z","creation_time":"2024-09-11T11:01:26.276370Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-11T11:01:27.058 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-11T11:01:26.281145Z', 'creation_time': '2024-09-11T11:01:26.276370Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-11T11:01:27.058 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-11T11:01:27.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-11T11:01:27.059 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-11T11:01:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:27.137 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c41688980 1 Processor -- start 2024-09-11T11:01:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c41688980 1 -- start start 2024-09-11T11:01:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c41688980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555a0506fb00 0x555a050fe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c41688980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a04f83ae0 con 0x555a050fe870 2024-09-11T11:01:27.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c41688980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x555a04fa7e30 con 0x555a0506fb00 2024-09-11T11:01:27.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c3f198640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555a0506fb00 0x555a050fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c3f198640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555a0506fb00 0x555a050fe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49786/0 (socket says 172.21.15.145:49786) 2024-09-11T11:01:27.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c3f198640 1 -- 172.21.15.145:0/627771723 learned_addr learned my addr 172.21.15.145:0/627771723 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c3f198640 1 -- 172.21.15.145:0/627771723 >> v1:172.21.15.102:6789/0 conn(0x555a050fe870 legacy=0x555a05100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.136+0000 7f5c3f198640 1 -- 172.21.15.145:0/627771723 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a05103390 con 0x555a0506fb00 2024-09-11T11:01:27.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c3f198640 1 --2- 172.21.15.145:0/627771723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fe330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000a5c0 tx=0x7f5c3001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e8cea80b0e1bed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c3e196640 1 -- 172.21.15.145:0/627771723 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300a6070 con 0x555a0506fb00 2024-09-11T11:01:27.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c3e196640 1 -- 172.21.15.145:0/627771723 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300af070 con 0x555a0506fb00 2024-09-11T11:01:27.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c3e196640 1 -- 172.21.15.145:0/627771723 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300aa5c0 con 0x555a0506fb00 2024-09-11T11:01:27.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c41688980 1 -- 172.21.15.145:0/627771723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 msgr2=0x555a050fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c41688980 1 --2- 172.21.15.145:0/627771723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fe330 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000a5c0 tx=0x7f5c3001b340 comp rx=0 tx=0).stop 2024-09-11T11:01:27.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c41688980 1 -- 172.21.15.145:0/627771723 shutdown_connections 2024-09-11T11:01:27.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c41688980 1 --2- 172.21.15.145:0/627771723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fe330 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c41688980 1 -- 172.21.15.145:0/627771723 >> 172.21.15.145:0/627771723 conn(0x555a050f6060 msgr2=0x555a050f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c41688980 1 -- 172.21.15.145:0/627771723 shutdown_connections 2024-09-11T11:01:27.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.140+0000 7f5c41688980 1 -- 172.21.15.145:0/627771723 wait complete. 2024-09-11T11:01:27.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c41688980 1 Processor -- start 2024-09-11T11:01:27.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c41688980 1 -- start start 2024-09-11T11:01:27.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c41688980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c41688980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555a04fa9200 con 0x555a0506fb00 2024-09-11T11:01:27.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49790/0 (socket says 172.21.15.145:49790) 2024-09-11T11:01:27.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c3f198640 1 -- 172.21.15.145:0/3148840103 learned_addr learned my addr 172.21.15.145:0/3148840103 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c3f198640 1 -- 172.21.15.145:0/3148840103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a050fc060 con 0x555a0506fb00 2024-09-11T11:01:27.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5c3f198640 1 --2- 172.21.15.145:0/3148840103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fba90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000a5c0 tx=0x7f5c30003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcad2de328ae91b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5b2d60a640 1 -- 172.21.15.145:0/3148840103 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300aa9b0 con 0x555a0506fb00 2024-09-11T11:01:27.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5b2d60a640 1 -- 172.21.15.145:0/3148840103 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300aab50 con 0x555a0506fb00 2024-09-11T11:01:27.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.156+0000 7f5b2d60a640 1 -- 172.21.15.145:0/3148840103 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300aae50 con 0x555a0506fb00 2024-09-11T11:01:27.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- 172.21.15.145:0/3148840103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 msgr2=0x555a050fba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 --2- 172.21.15.145:0/3148840103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fba90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000a5c0 tx=0x7f5c30003030 comp rx=0 tx=0).stop 2024-09-11T11:01:27.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- 172.21.15.145:0/3148840103 shutdown_connections 2024-09-11T11:01:27.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 --2- 172.21.15.145:0/3148840103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a050fba90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- 172.21.15.145:0/3148840103 >> 172.21.15.145:0/3148840103 conn(0x555a050f6060 msgr2=0x555a051e2680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- 172.21.15.145:0/3148840103 shutdown_connections 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- 172.21.15.145:0/3148840103 wait complete. 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 Processor -- start 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- start start 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a051efe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555a05102e30 con 0x555a0506fb00 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a051efe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a051efe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49800/0 (socket says 172.21.15.145:49800) 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c3f198640 1 -- 172.21.15.145:0/3174563785 learned_addr learned my addr 172.21.15.145:0/3174563785 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c3f198640 1 -- 172.21.15.145:0/3174563785 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a051f03b0 con 0x555a0506fb00 2024-09-11T11:01:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c3f198640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a051efe70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5c3001bbe0 tx=0x7f5c300180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5b2be07640 1 -- 172.21.15.145:0/3174563785 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300c6750 con 0x555a0506fb00 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a051f0640 con 0x555a0506fb00 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5b2be07640 1 -- 172.21.15.145:0/3174563785 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300c68f0 con 0x555a0506fb00 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5b2be07640 1 -- 172.21.15.145:0/3174563785 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300c6c10 con 0x555a0506fb00 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.160+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a051f3320 con 0x555a0506fb00 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5b2be07640 1 -- 172.21.15.145:0/3174563785 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5c300ce020 con 0x555a0506fb00 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5b2be07640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b24034650 0x7f5b24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5b2be07640 1 -- 172.21.15.145:0/3174563785 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f5c300cc020 con 0x555a0506fb00 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c3e997640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b24034650 0x7f5b24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c41688980 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a050fe870 0x555a051f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a051f7480 con 0x555a050fe870 2024-09-11T11:01:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c3f999640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a050fe870 0x555a051f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c3e997640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b24034650 0x7f5b24036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5c34000f70 tx=0x7f5c34001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c3f999640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a050fe870 0x555a051f6e60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c3f999640 1 -- 172.21.15.145:0/3174563785 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a050fe870 2024-09-11T11:01:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c41688980 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a051f8270 0x555a051fa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a051facc0 con 0x555a051f8270 2024-09-11T11:01:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c3f198640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a051f8270 0x555a051fa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c3f198640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a051f8270 0x555a051fa660 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c3f198640 1 -- 172.21.15.145:0/3174563785 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c300cf370 con 0x555a051f8270 2024-09-11T11:01:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.164+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a051fc570 con 0x555a051f8270 2024-09-11T11:01:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3f198640 1 -- 172.21.15.145:0/3174563785 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5c300cf370 con 0x555a051f8270 2024-09-11T11:01:27.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a051fb6e0 con 0x555a051f8270 2024-09-11T11:01:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3f198640 1 -- 172.21.15.145:0/3174563785 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c300cf370 con 0x555a051f8270 2024-09-11T11:01:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c41688980 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555a051fd920 0x555a051ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05200250 con 0x555a051fd920 2024-09-11T11:01:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3e997640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555a051fd920 0x555a051ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3e997640 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555a051fd920 0x555a051ffd10 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3e997640 1 -- 172.21.15.145:0/3174563785 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5c3400d040 con 0x555a051fd920 2024-09-11T11:01:27.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c41688980 1 Processor -- start 2024-09-11T11:01:27.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c41688980 1 -- start start 2024-09-11T11:01:27.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c41688980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0520dc30 0x555a0520e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c41688980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555a05002800 con 0x555a0520dc30 2024-09-11T11:01:27.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0520dc30 0x555a0520e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0520dc30 0x555a0520e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49814/0 (socket says 172.21.15.145:49814) 2024-09-11T11:01:27.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3f198640 1 -- 172.21.15.145:0/2849266765 learned_addr learned my addr 172.21.15.145:0/2849266765 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3f198640 1 -- 172.21.15.145:0/2849266765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a0520e590 con 0x555a0520dc30 2024-09-11T11:01:27.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.168+0000 7f5c3f198640 1 --2- 172.21.15.145:0/2849266765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0520dc30 0x555a0520e050 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5c300bdfd0 tx=0x7f5c300bcdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b29602640 1 -- 172.21.15.145:0/2849266765 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300d0e60 con 0x555a0520dc30 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b29602640 1 -- 172.21.15.145:0/2849266765 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300e3860 con 0x555a0520dc30 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c41688980 1 -- 172.21.15.145:0/2849266765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a0520e820 con 0x555a0520dc30 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b29602640 1 -- 172.21.15.145:0/2849266765 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300e34c0 con 0x555a0520dc30 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c41688980 1 -- 172.21.15.145:0/2849266765 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a052114a0 con 0x555a0520dc30 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b29602640 1 -- 172.21.15.145:0/2849266765 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5c300d05f0 con 0x555a0520dc30 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b29602640 1 --2- 172.21.15.145:0/2849266765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b180346a0 0x7f5b18036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b29602640 1 -- 172.21.15.145:0/2849266765 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f5c300f1aa0 con 0x555a0520dc30 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c3e997640 1 --2- 172.21.15.145:0/2849266765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b180346a0 0x7f5b18036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c41688980 1 Processor -- start 2024-09-11T11:01:27.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c41688980 1 -- start start 2024-09-11T11:01:27.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c3e997640 1 --2- 172.21.15.145:0/2849266765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b180346a0 0x7f5b18036b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x555a051f4460 tx=0x7f5c34006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c41688980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a0521aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c41688980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555a050fa1c0 con 0x555a0521a6c0 2024-09-11T11:01:27.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a0521aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a0521aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49830/0 (socket says 172.21.15.145:49830) 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c3f198640 1 -- 172.21.15.145:0/1403048112 learned_addr learned my addr 172.21.15.145:0/1403048112 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c3f198640 1 -- 172.21.15.145:0/1403048112 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a0521b070 con 0x555a0521a6c0 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5c3f198640 1 --2- 172.21.15.145:0/1403048112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a0521aaa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5c300c6e90 tx=0x7f5c300a83f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49b21f6373c0d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b22ffd640 1 -- 172.21.15.145:0/1403048112 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300bc3a0 con 0x555a0521a6c0 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b22ffd640 1 -- 172.21.15.145:0/1403048112 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300cf970 con 0x555a0521a6c0 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.172+0000 7f5b22ffd640 1 -- 172.21.15.145:0/1403048112 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c300bc540 con 0x555a0521a6c0 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- 172.21.15.145:0/1403048112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 msgr2=0x555a0521aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 --2- 172.21.15.145:0/1403048112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a0521aaa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5c300c6e90 tx=0x7f5c300a83f0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- 172.21.15.145:0/1403048112 shutdown_connections 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 --2- 172.21.15.145:0/1403048112 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a0521aaa0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- 172.21.15.145:0/1403048112 >> 172.21.15.145:0/1403048112 conn(0x555a052169f0 msgr2=0x555a05214af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- 172.21.15.145:0/1403048112 shutdown_connections 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- 172.21.15.145:0/1403048112 wait complete. 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 Processor -- start 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- start start 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a052217a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555a0521b400 con 0x555a0521a6c0 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a052217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c3f198640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a052217a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49846/0 (socket says 172.21.15.145:49846) 2024-09-11T11:01:27.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 learned_addr learned my addr 172.21.15.145:0/2602068191 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a05221ce0 con 0x555a0521a6c0 2024-09-11T11:01:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c3f198640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a052217a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5c30000c10 tx=0x7f5c300bbfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5b217fa640 1 -- 172.21.15.145:0/2602068191 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c30113070 con 0x555a0521a6c0 2024-09-11T11:01:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5b217fa640 1 -- 172.21.15.145:0/2602068191 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c300bc3a0 con 0x555a0521a6c0 2024-09-11T11:01:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a05221ce0 con 0x555a0521a6c0 2024-09-11T11:01:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5b217fa640 1 -- 172.21.15.145:0/2602068191 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c30006e10 con 0x555a0521a6c0 2024-09-11T11:01:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a05221ce0 con 0x555a0521a6c0 2024-09-11T11:01:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5b217fa640 1 -- 172.21.15.145:0/2602068191 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5c30116070 con 0x555a0521a6c0 2024-09-11T11:01:27.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5b217fa640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b08034600 0x7f5b08036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.176+0000 7f5b217fa640 1 -- 172.21.15.145:0/2602068191 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f5c30101070 con 0x555a0521a6c0 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3e997640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b08034600 0x7f5b08036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a0522c890 0x555a0522ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0522f480 con 0x555a0522c890 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3f999640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a0522c890 0x555a0522ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3e997640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b08034600 0x7f5b08036ac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c34010fd0 tx=0x7f5c34011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3f999640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a0522c890 0x555a0522ed30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 realm 2024-09-11T11:01:27.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0522bd80 con 0x555a0522c890 2024-09-11T11:01:27.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0522ff40 con 0x555a0522c890 2024-09-11T11:01:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a05230d20 0x555a05233110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05233770 con 0x555a05230d20 2024-09-11T11:01:27.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3f198640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a05230d20 0x555a05233110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3f198640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a05230d20 0x555a05233110 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.180+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c41688980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c41688980 20 searching for the correct realm 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555a05235d80 0x555a05238170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05238780 con 0x555a05235d80 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3e997640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555a05235d80 0x555a05238170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3e997640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555a05235d80 0x555a05238170 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05238780 con 0x555a05230d20 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f198640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5c30118060 0x7f5c300f1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x7f5c30118060 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5c30118060 0x7f5c300f1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5c30118060 0x7f5c300f1270 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05235d80 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.184+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x7f5c30118060 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x7f5c30118060 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05235d80 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.188+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05235d80 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05235d80 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x7f5c30118060 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a0522c890 2024-09-11T11:01:27.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x7f5c30118060 2024-09-11T11:01:27.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05235d80 2024-09-11T11:01:27.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x7f5c30118060 2024-09-11T11:01:27.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.192+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05235d80 2024-09-11T11:01:27.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555a05234010 con 0x555a05230d20 2024-09-11T11:01:27.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:27.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05234860 con 0x555a0522c890 2024-09-11T11:01:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.196+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05234c50 con 0x555a05230d20 2024-09-11T11:01:27.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05234c50 con 0x7f5c30118060 2024-09-11T11:01:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 zone default found 2024-09-11T11:01:27.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 4 Realm: () 2024-09-11T11:01:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 zonegroup default 2024-09-11T11:01:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05238be0 con 0x7f5c30118060 2024-09-11T11:01:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0523a960 con 0x555a05235d80 2024-09-11T11:01:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0523ad00 con 0x555a05235d80 2024-09-11T11:01:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 started sync module instance, tier type = 2024-09-11T11:01:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.200+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a05239e00 con 0x555a05230d20 2024-09-11T11:01:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93845121639248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a05239e00 con 0x555a05230d20 2024-09-11T11:01:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523b7c0 con 0x555a0522c890 2024-09-11T11:01:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93845121643152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523b780 con 0x555a0522c890 2024-09-11T11:01:27.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523c720 con 0x555a05230d20 2024-09-11T11:01:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93845121639248] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93845121643152] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93845121645488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523c720 con 0x555a05230d20 2024-09-11T11:01:27.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.204+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523cb50 con 0x7f5c30118060 2024-09-11T11:01:27.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.208+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.208+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93845121647104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523cb10 con 0x7f5c30118060 2024-09-11T11:01:27.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.208+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523da30 con 0x555a05230d20 2024-09-11T11:01:27.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.208+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93845121645488] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.208+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93845121647104] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.208+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.208+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93845121650496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523da30 con 0x555a05230d20 2024-09-11T11:01:27.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.208+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523de20 con 0x555a05235d80 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93845121636688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523e670 con 0x555a05235d80 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523f030 con 0x555a05235d80 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93845121650496] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93845121636688] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93845121657728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523e670 con 0x555a05235d80 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523f8d0 con 0x7f5c30118060 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93845121659936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a0523fcf0 con 0x7f5c30118060 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 20 add_watcher() i=0 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 20 add_watcher() i=1 2024-09-11T11:01:27.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 20 add_watcher() i=2 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 20 add_watcher() i=3 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 20 add_watcher() i=4 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 20 add_watcher() i=5 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93845121657728] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.212+0000 7f5c41688980 20 add_watcher() i=6 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93845121659936] v32'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 20 add_watcher() i=7 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05242d20 con 0x555a0522c890 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93845121660992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a05240110 con 0x555a0522c890 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93845121660992] v32'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5af67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 5 note: GC not initialized 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5af57e2640 20 reqs_thread_entry: start 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 20 Filter name: none 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5aee7fc640 20 reqs_thread_entry: start 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.216+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05265bf0 con 0x555a0522c890 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:27.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a052665e0 con 0x555a0522c890 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a052675f0 con 0x7f5c30118060 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05264ea0 con 0x7f5c30118060 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a052675b0 con 0x555a0522c890 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 4.27 4:e42effdc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05267030 con 0x555a0522c890 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 4.19 4:99091213:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0526bed0 con 0x555a05235d80 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 4.10 4:0b9800c4:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0526e740 con 0x555a05235d80 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 4.34 4:2e421ecf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a052710b0 con 0x7f5c30118060 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 4.32 4:4e8df1ce:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05273980 con 0x555a05230d20 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 4.13 4:c86f3d50:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a052764c0 con 0x7f5c30118060 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 4.e 4:71901f3b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05279330 con 0x7f5c30118060 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:74 4.6 4:610448dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0527bd20 con 0x555a05235d80 2024-09-11T11:01:27.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 4.14 4:2b20de90:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a0527eb90 con 0x555a05235d80 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 4.4 4:215ab0bf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05281a20 con 0x555a0522c890 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 4.2e 4:7645baa1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555a05284370 con 0x555a05235d80 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(68 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(67 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(69 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(74 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(75 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(77 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(71 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(76 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(70 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(72 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.220+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(73 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.224+0000 7f5af67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.224+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93845121660992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052710b0 con 0x555a0522c890 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.224+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93845121660992] v32'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.224+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93845121639248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052568b0 con 0x555a05230d20 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93845121639248] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c41688980 20 remove_watcher() i=0 2024-09-11T11:01:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c41688980 2 removed watcher, disabling cache 2024-09-11T11:01:27.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93845121643152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052568b0 con 0x555a0522c890 2024-09-11T11:01:27.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93845121643152] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x555a0522c890 2024-09-11T11:01:27.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c41688980 20 remove_watcher() i=1 2024-09-11T11:01:27.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93845121645488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052568b0 con 0x555a05230d20 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93845121645488] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c41688980 20 remove_watcher() i=2 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.228+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93845121647104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052568b0 con 0x7f5c30118060 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.232+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93845121647104] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.232+0000 7f5c41688980 20 remove_watcher() i=3 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.232+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93845121650496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052568b0 con 0x555a05230d20 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.232+0000 7f5c3f198640 1 -- 172.21.15.145:0/2602068191 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93845121650496] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c30115030 con 0x555a05230d20 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.232+0000 7f5c41688980 20 remove_watcher() i=4 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.232+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93845121636688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052568b0 con 0x555a05235d80 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93845121636688] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 20 remove_watcher() i=5 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93845121657728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052568b0 con 0x555a05235d80 2024-09-11T11:01:27.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c3e997640 1 -- 172.21.15.145:0/2602068191 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93845121657728] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c34036040 con 0x555a05235d80 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 20 remove_watcher() i=6 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93845121659936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555a052568b0 con 0x7f5c30118060 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93845121659936] v32'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c3800a4d0 con 0x7f5c30118060 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 20 remove_watcher() i=7 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a05230d20 msgr2=0x555a05233110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a05230d20 0x555a05233110 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a0522c890 msgr2=0x555a0522ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a0522c890 0x555a0522ed30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5c30118060 msgr2=0x7f5c300f1270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5c30118060 0x7f5c300f1270 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555a05235d80 msgr2=0x555a05238170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555a05235d80 0x555a05238170 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b08034600 msgr2=0x7f5b08036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b08034600 0x7f5b08036ac0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5c34010fd0 tx=0x7f5c34011000 comp rx=0 tx=0).stop 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 msgr2=0x555a052217a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2602068191 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0521a6c0 0x555a052217a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5c30000c10 tx=0x7f5c300bbfe0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c3f999640 1 -- 172.21.15.145:0/2602068191 reap_dead start 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 shutdown_connections 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 >> 172.21.15.145:0/2602068191 conn(0x555a052169f0 msgr2=0x555a05214ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 shutdown_connections 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2602068191 wait complete. 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2849266765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b180346a0 msgr2=0x7f5b18036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2849266765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b180346a0 0x7f5b18036b60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x555a051f4460 tx=0x7f5c34006000 comp rx=0 tx=0).stop 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2849266765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0520dc30 msgr2=0x555a0520e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2849266765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0520dc30 0x555a0520e050 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5c300bdfd0 tx=0x7f5c300bcdc0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2849266765 shutdown_connections 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2849266765 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b180346a0 0x7f5b18036b60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 --2- 172.21.15.145:0/2849266765 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0520dc30 0x555a0520e050 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2849266765 >> 172.21.15.145:0/2849266765 conn(0x555a05202d80 msgr2=0x555a05205800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2849266765 shutdown_connections 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.236+0000 7f5c41688980 1 -- 172.21.15.145:0/2849266765 wait complete. 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a051f8270 msgr2=0x555a051fa660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555a051f8270 0x555a051fa660 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a050fe870 msgr2=0x555a051f6e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555a050fe870 0x555a051f6e60 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555a051fd920 msgr2=0x555a051ffd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555a051fd920 0x555a051ffd10 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b24034650 msgr2=0x7f5b24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5b24034650 0x7f5b24036b10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5c34000f70 tx=0x7f5c34001420 comp rx=0 tx=0).stop 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 msgr2=0x555a051efe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 --2- 172.21.15.145:0/3174563785 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555a0506fb00 0x555a051efe70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5c3001bbe0 tx=0x7f5c300180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c3f999640 1 -- 172.21.15.145:0/3174563785 reap_dead start 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 shutdown_connections 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 >> 172.21.15.145:0/3174563785 conn(0x555a050f6060 msgr2=0x555a050fa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 shutdown_connections 2024-09-11T11:01:27.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.240+0000 7f5c41688980 1 -- 172.21.15.145:0/3174563785 wait complete. 2024-09-11T11:01:27.252 INFO:teuthology.orchestra.run.smithi145.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2267e615-29e0-4503-94c5-a003ba7e8ee3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","marker":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-11T11:01:26.281145Z","creation_time":"2024-09-11T11:01:26.276370Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-09-11T11:01:27.252 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-11T11:01:26.281145Z', 'creation_time': '2024-09-11T11:01:26.276370Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-11T11:01:27.261 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-11T11:01:27.261 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-11T11:01:27.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-11T11:01:27.261 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-11T11:01:27.330 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:27.330 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:27.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513e64a980 1 Processor -- start 2024-09-11T11:01:27.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513e64a980 1 -- start start 2024-09-11T11:01:27.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513e64a980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556448bf0c60 0x556448bf3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513e64a980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556448a72ae0 con 0x556448bec8e0 2024-09-11T11:01:27.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513e64a980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x556448a96e30 con 0x556448bf0c60 2024-09-11T11:01:27.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513b959640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556448bf0c60 0x556448bf3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513b959640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556448bf0c60 0x556448bf3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49850/0 (socket says 172.21.15.145:49850) 2024-09-11T11:01:27.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513c15a640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x556448bec8e0 0x556448beccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54524/0 (socket says 172.21.15.145:54524) 2024-09-11T11:01:27.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513b959640 1 -- 172.21.15.145:0/3972458019 learned_addr learned my addr 172.21.15.145:0/3972458019 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513b959640 1 -- 172.21.15.145:0/3972458019 >> v1:172.21.15.102:6789/0 conn(0x556448bec8e0 legacy=0x556448beccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.328+0000 7f513b959640 1 -- 172.21.15.145:0/3972458019 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556448bf45a0 con 0x556448bf0c60 2024-09-11T11:01:27.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513b959640 1 --2- 172.21.15.145:0/3972458019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bf0c60 0x556448bf3050 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f512400a5c0 tx=0x7f512401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06f56ce799e8bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513b158640 1 -- 172.21.15.145:0/3972458019 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240a6070 con 0x556448bf0c60 2024-09-11T11:01:27.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513b158640 1 -- 172.21.15.145:0/3972458019 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51240af070 con 0x556448bf0c60 2024-09-11T11:01:27.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513b158640 1 -- 172.21.15.145:0/3972458019 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51240aa5c0 con 0x556448bf0c60 2024-09-11T11:01:27.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513e64a980 1 -- 172.21.15.145:0/3972458019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bf0c60 msgr2=0x556448bf3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513e64a980 1 --2- 172.21.15.145:0/3972458019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bf0c60 0x556448bf3050 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f512400a5c0 tx=0x7f512401b340 comp rx=0 tx=0).stop 2024-09-11T11:01:27.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513e64a980 1 -- 172.21.15.145:0/3972458019 shutdown_connections 2024-09-11T11:01:27.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513e64a980 1 --2- 172.21.15.145:0/3972458019 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bf0c60 0x556448bf3050 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513e64a980 1 -- 172.21.15.145:0/3972458019 >> 172.21.15.145:0/3972458019 conn(0x556448b60230 msgr2=0x556448b60640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513e64a980 1 -- 172.21.15.145:0/3972458019 shutdown_connections 2024-09-11T11:01:27.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.332+0000 7f513e64a980 1 -- 172.21.15.145:0/3972458019 wait complete. 2024-09-11T11:01:27.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.348+0000 7f513e64a980 1 Processor -- start 2024-09-11T11:01:27.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- start start 2024-09-11T11:01:27.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cd7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556448a98200 con 0x556448bec8e0 2024-09-11T11:01:27.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cd7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cd7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49862/0 (socket says 172.21.15.145:49862) 2024-09-11T11:01:27.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513c15a640 1 -- 172.21.15.145:0/88218386 learned_addr learned my addr 172.21.15.145:0/88218386 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513c15a640 1 -- 172.21.15.145:0/88218386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556448cd8200 con 0x556448bec8e0 2024-09-11T11:01:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513c15a640 1 --2- 172.21.15.145:0/88218386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cd7c30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f512c001e50 tx=0x7f512c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12e5535ed02068b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f502a60c640 1 -- 172.21.15.145:0/88218386 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c00e5d0 con 0x556448bec8e0 2024-09-11T11:01:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f502a60c640 1 -- 172.21.15.145:0/88218386 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c00e770 con 0x556448bec8e0 2024-09-11T11:01:27.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f502a60c640 1 -- 172.21.15.145:0/88218386 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c00eab0 con 0x556448bec8e0 2024-09-11T11:01:27.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- 172.21.15.145:0/88218386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 msgr2=0x556448cd7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 --2- 172.21.15.145:0/88218386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cd7c30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f512c001e50 tx=0x7f512c001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:27.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- 172.21.15.145:0/88218386 shutdown_connections 2024-09-11T11:01:27.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 --2- 172.21.15.145:0/88218386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cd7c30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- 172.21.15.145:0/88218386 >> 172.21.15.145:0/88218386 conn(0x556448b60230 msgr2=0x556448cd3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- 172.21.15.145:0/88218386 shutdown_connections 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- 172.21.15.145:0/88218386 wait complete. 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 Processor -- start 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- start start 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cdefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513e64a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556448bf40a0 con 0x556448bec8e0 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cdefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cdefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49876/0 (socket says 172.21.15.145:49876) 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.352+0000 7f513c15a640 1 -- 172.21.15.145:0/331113260 learned_addr learned my addr 172.21.15.145:0/331113260 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513c15a640 1 -- 172.21.15.145:0/331113260 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556448cdf4e0 con 0x556448bec8e0 2024-09-11T11:01:27.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513c15a640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cdefa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x556448cd8e10 tx=0x7f512c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f5028e09640 1 -- 172.21.15.145:0/331113260 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c001260 con 0x556448bec8e0 2024-09-11T11:01:27.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556448cdf770 con 0x556448bec8e0 2024-09-11T11:01:27.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f5028e09640 1 -- 172.21.15.145:0/331113260 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c00fa40 con 0x556448bec8e0 2024-09-11T11:01:27.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f5028e09640 1 -- 172.21.15.145:0/331113260 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c00fd80 con 0x556448bec8e0 2024-09-11T11:01:27.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556448ce2450 con 0x556448bec8e0 2024-09-11T11:01:27.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f5028e09640 1 -- 172.21.15.145:0/331113260 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f512c017070 con 0x556448bec8e0 2024-09-11T11:01:27.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f5028e09640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50240345e0 0x7f5024036aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f5028e09640 1 -- 172.21.15.145:0/331113260 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f512c015020 con 0x556448bec8e0 2024-09-11T11:01:27.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513b959640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50240345e0 0x7f5024036aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513e64a980 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448bf0c60 0x556448ce5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448ce6600 con 0x556448bf0c60 2024-09-11T11:01:27.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513c95b640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448bf0c60 0x556448ce5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513b959640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50240345e0 0x7f5024036aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f51240ae000 tx=0x7f51240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513c95b640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448bf0c60 0x556448ce5f90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513c95b640 1 -- 172.21.15.145:0/331113260 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x556448bf0c60 2024-09-11T11:01:27.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513e64a980 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448ce73f0 0x556448ce97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448ce9e10 con 0x556448ce73f0 2024-09-11T11:01:27.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.356+0000 7f513c15a640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448ce73f0 0x556448ce97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513c15a640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448ce73f0 0x556448ce97e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513c15a640 1 -- 172.21.15.145:0/331113260 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f512c02e070 con 0x556448ce73f0 2024-09-11T11:01:27.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448ceb6c0 con 0x556448ce73f0 2024-09-11T11:01:27.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513c15a640 1 -- 172.21.15.145:0/331113260 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f512c02e070 con 0x556448ce73f0 2024-09-11T11:01:27.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448cea8f0 con 0x556448ce73f0 2024-09-11T11:01:27.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513c15a640 1 -- 172.21.15.145:0/331113260 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f512c02e070 con 0x556448ce73f0 2024-09-11T11:01:27.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513e64a980 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556448ceca70 0x556448ceee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448cef3a0 con 0x556448ceca70 2024-09-11T11:01:27.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513b959640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556448ceca70 0x556448ceee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513b959640 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556448ceca70 0x556448ceee60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.360+0000 7f513b959640 1 -- 172.21.15.145:0/331113260 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51240aaae0 con 0x556448ceca70 2024-09-11T11:01:27.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513e64a980 1 Processor -- start 2024-09-11T11:01:27.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513e64a980 1 -- start start 2024-09-11T11:01:27.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513e64a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448cfcda0 0x556448cfd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513e64a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556448af1800 con 0x556448cfcda0 2024-09-11T11:01:27.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448cfcda0 0x556448cfd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448cfcda0 0x556448cfd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49890/0 (socket says 172.21.15.145:49890) 2024-09-11T11:01:27.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513c15a640 1 -- 172.21.15.145:0/2515278836 learned_addr learned my addr 172.21.15.145:0/2515278836 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513c15a640 1 -- 172.21.15.145:0/2515278836 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556448cfd700 con 0x556448cfcda0 2024-09-11T11:01:27.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513c15a640 1 --2- 172.21.15.145:0/2515278836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448cfcda0 0x556448cfd1c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f512c01cfd0 tx=0x7f512c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f5021ffb640 1 -- 172.21.15.145:0/2515278836 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c027d00 con 0x556448cfcda0 2024-09-11T11:01:27.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f5021ffb640 1 -- 172.21.15.145:0/2515278836 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c042120 con 0x556448cfcda0 2024-09-11T11:01:27.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513e64a980 1 -- 172.21.15.145:0/2515278836 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556448cfd990 con 0x556448cfcda0 2024-09-11T11:01:27.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f5021ffb640 1 -- 172.21.15.145:0/2515278836 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c027430 con 0x556448cfcda0 2024-09-11T11:01:27.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513e64a980 1 -- 172.21.15.145:0/2515278836 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556448cfd990 con 0x556448cfcda0 2024-09-11T11:01:27.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f5021ffb640 1 -- 172.21.15.145:0/2515278836 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f512c0275f0 con 0x556448cfcda0 2024-09-11T11:01:27.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f5021ffb640 1 --2- 172.21.15.145:0/2515278836 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50140346a0 0x7f5014036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f5021ffb640 1 -- 172.21.15.145:0/2515278836 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f512c037070 con 0x556448cfcda0 2024-09-11T11:01:27.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.364+0000 7f513b959640 1 --2- 172.21.15.145:0/2515278836 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50140346a0 0x7f5014036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 Processor -- start 2024-09-11T11:01:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- start start 2024-09-11T11:01:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513b959640 1 --2- 172.21.15.145:0/2515278836 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50140346a0 0x7f5014036b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x556448ce3590 tx=0x7f5124005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556448cd8580 con 0x556448d094c0 2024-09-11T11:01:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d098c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49896/0 (socket says 172.21.15.145:49896) 2024-09-11T11:01:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513c15a640 1 -- 172.21.15.145:0/3667158252 learned_addr learned my addr 172.21.15.145:0/3667158252 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513c15a640 1 -- 172.21.15.145:0/3667158252 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556448d09e90 con 0x556448d094c0 2024-09-11T11:01:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513c15a640 1 --2- 172.21.15.145:0/3667158252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d098c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f512c027960 tx=0x7f512c031a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87bc0944754c4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f501b7fe640 1 -- 172.21.15.145:0/3667158252 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c063070 con 0x556448d094c0 2024-09-11T11:01:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f501b7fe640 1 -- 172.21.15.145:0/3667158252 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c01dc80 con 0x556448d094c0 2024-09-11T11:01:27.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f501b7fe640 1 -- 172.21.15.145:0/3667158252 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c031af0 con 0x556448d094c0 2024-09-11T11:01:27.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- 172.21.15.145:0/3667158252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 msgr2=0x556448d098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 --2- 172.21.15.145:0/3667158252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d098c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f512c027960 tx=0x7f512c031a00 comp rx=0 tx=0).stop 2024-09-11T11:01:27.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- 172.21.15.145:0/3667158252 shutdown_connections 2024-09-11T11:01:27.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 --2- 172.21.15.145:0/3667158252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d098c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- 172.21.15.145:0/3667158252 >> 172.21.15.145:0/3667158252 conn(0x556448d058f0 msgr2=0x556448d039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- 172.21.15.145:0/3667158252 shutdown_connections 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- 172.21.15.145:0/3667158252 wait complete. 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 Processor -- start 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- start start 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d106f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513e64a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556448d0a360 con 0x556448d094c0 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d106f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513c15a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d106f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49908/0 (socket says 172.21.15.145:49908) 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.368+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 learned_addr learned my addr 172.21.15.145:0/2691650853 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556448d10c30 con 0x556448d094c0 2024-09-11T11:01:27.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513c15a640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d106f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f512c00f6b0 tx=0x7f512c01df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f5019ffb640 1 -- 172.21.15.145:0/2691650853 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c063040 con 0x556448d094c0 2024-09-11T11:01:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556448d10c30 con 0x556448d094c0 2024-09-11T11:01:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f5019ffb640 1 -- 172.21.15.145:0/2691650853 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f512c06c070 con 0x556448d094c0 2024-09-11T11:01:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f5019ffb640 1 -- 172.21.15.145:0/2691650853 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f512c031450 con 0x556448d094c0 2024-09-11T11:01:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556448d10c30 con 0x556448d094c0 2024-09-11T11:01:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f5019ffb640 1 -- 172.21.15.145:0/2691650853 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f512c066070 con 0x556448d094c0 2024-09-11T11:01:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f5019ffb640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f500c034650 0x7f500c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f5019ffb640 1 -- 172.21.15.145:0/2691650853 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f512c03a040 con 0x556448d094c0 2024-09-11T11:01:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513b959640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f500c034650 0x7f500c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448d1b810 0x556448d1dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d1e400 con 0x556448d1b810 2024-09-11T11:01:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513c95b640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448d1b810 0x556448d1dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513b959640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f500c034650 0x7f500c036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5124000c10 tx=0x7f51240c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513c95b640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448d1b810 0x556448d1dcb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 20 realm 2024-09-11T11:01:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d1ad00 con 0x556448d1b810 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d1eed0 con 0x556448d1b810 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448d1fab0 0x556448d21f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.372+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d226e0 con 0x556448d1fab0 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513c15a640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448d1fab0 0x556448d21f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513c15a640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448d1fab0 0x556448d21f70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513e64a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d22f80 con 0x556448d1fab0 2024-09-11T11:01:27.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513e64a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513e64a980 20 searching for the correct realm 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556448d24cf0 0x556448d270e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d24cf0 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513b959640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556448d24cf0 0x556448d270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513b959640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556448d24cf0 0x556448d270e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.376+0000 7f513c15a640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f512c03e070 0x7f512c0628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x7f512c03e070 2024-09-11T11:01:27.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f512c03e070 0x7f512c0628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f512c03e070 0x7f512c0628d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d24cf0 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x7f512c03e070 2024-09-11T11:01:27.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.380+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x7f512c03e070 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d24cf0 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d24cf0 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.384+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d24cf0 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x7f512c03e070 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1b810 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x7f512c03e070 2024-09-11T11:01:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d24cf0 2024-09-11T11:01:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x7f512c03e070 2024-09-11T11:01:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d24cf0 2024-09-11T11:01:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.388+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556448d276f0 con 0x556448d1fab0 2024-09-11T11:01:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:27.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d23900 con 0x556448d1b810 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d23d80 con 0x556448d1fab0 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d241e0 con 0x7f512c03e070 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 zone default found 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 4 Realm: () 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 zonegroup default 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d23550 con 0x7f512c03e070 2024-09-11T11:01:27.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d29f30 con 0x556448d24cf0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d2a2d0 con 0x556448d24cf0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 started sync module instance, tier type = 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:27.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.392+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d293c0 con 0x556448d1fab0 2024-09-11T11:01:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.396+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.396+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93889206851824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d293c0 con 0x556448d1fab0 2024-09-11T11:01:27.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.396+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2ad40 con 0x556448d1b810 2024-09-11T11:01:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.396+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.396+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93889206855728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2b5e0 con 0x556448d1b810 2024-09-11T11:01:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.396+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2bfe0 con 0x556448d1fab0 2024-09-11T11:01:27.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.396+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93889206851824] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93889206855728] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93889206849296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2b130 con 0x556448d1fab0 2024-09-11T11:01:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2c880 con 0x7f512c03e070 2024-09-11T11:01:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93889206862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2b130 con 0x7f512c03e070 2024-09-11T11:01:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2d350 con 0x556448d1fab0 2024-09-11T11:01:27.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93889206849296] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.400+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93889206862800] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93889206863856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2d310 con 0x556448d1fab0 2024-09-11T11:01:27.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2d740 con 0x556448d24cf0 2024-09-11T11:01:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93889206860528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2dfe0 con 0x556448d24cf0 2024-09-11T11:01:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2e9a0 con 0x556448d24cf0 2024-09-11T11:01:27.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93889206863856] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93889206860528] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93889206871280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2ed90 con 0x556448d24cf0 2024-09-11T11:01:27.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.404+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2f640 con 0x7f512c03e070 2024-09-11T11:01:27.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93889206871280] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93889206865472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2f240 con 0x7f512c03e070 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 20 add_watcher() i=0 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 20 add_watcher() i=1 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 20 add_watcher() i=2 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 20 add_watcher() i=3 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 20 add_watcher() i=4 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 20 add_watcher() i=5 2024-09-11T11:01:27.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 20 add_watcher() i=6 2024-09-11T11:01:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93889206865472] v32'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 20 add_watcher() i=7 2024-09-11T11:01:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d32ac0 con 0x556448d1b810 2024-09-11T11:01:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.408+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93889206873952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2ffe0 con 0x556448d1b810 2024-09-11T11:01:27.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93889206873952] v32'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f4ff27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:27.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:27.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 5 note: GC not initialized 2024-09-11T11:01:27.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f4ff17e2640 20 reqs_thread_entry: start 2024-09-11T11:01:27.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:27.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 Filter name: none 2024-09-11T11:01:27.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f4f62ffd640 20 reqs_thread_entry: start 2024-09-11T11:01:27.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d561a0 con 0x7f512c03e070 2024-09-11T11:01:27.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d56a30 con 0x556448d1b810 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(63 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d55540 con 0x7f512c03e070 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f513400a4d0 con 0x7f512c03e070 2024-09-11T11:01:27.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d58040 con 0x556448d1b810 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f513400a4d0 con 0x556448d1b810 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 4.27 4:e42effdc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d59a90 con 0x556448d1b810 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 4.19 4:99091213:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d5c590 con 0x556448d24cf0 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 4.10 4:0b9800c4:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d5eef0 con 0x556448d24cf0 2024-09-11T11:01:27.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 4.34 4:2e421ecf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d619e0 con 0x7f512c03e070 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 4.32 4:4e8df1ce:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d64250 con 0x556448d1fab0 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 4.13 4:c86f3d50:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d66ac0 con 0x7f512c03e070 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 4.e 4:71901f3b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d69370 con 0x7f512c03e070 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 4.6 4:610448dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d6c210 con 0x556448d24cf0 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:74 4.14 4:2b20de90:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d6ec40 con 0x556448d24cf0 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 4.4 4:215ab0bf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d71570 con 0x556448d1b810 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f513403e060 con 0x556448d1b810 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 4.2e 4:7645baa1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556448d589c0 con 0x556448d24cf0 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(69 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f513403e060 con 0x7f512c03e070 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(72 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f513403e060 con 0x7f512c03e070 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(67 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(68 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.412+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(74 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.416+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(70 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.416+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(71 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f513403e060 con 0x7f512c03e070 2024-09-11T11:01:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.416+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(75 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f513403e060 con 0x556448d1b810 2024-09-11T11:01:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.416+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(76 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.416+0000 7f4ff27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.416+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93889206873952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d32960 con 0x556448d1b810 2024-09-11T11:01:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.416+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93889206873952] v32'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f513403e060 con 0x556448d1b810 2024-09-11T11:01:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.416+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93889206851824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d32960 con 0x556448d1fab0 2024-09-11T11:01:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.420+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93889206851824] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.420+0000 7f513e64a980 20 remove_watcher() i=0 2024-09-11T11:01:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.420+0000 7f513e64a980 2 removed watcher, disabling cache 2024-09-11T11:01:27.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.420+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93889206855728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d32960 con 0x556448d1b810 2024-09-11T11:01:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.420+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93889206855728] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513403e060 con 0x556448d1b810 2024-09-11T11:01:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.420+0000 7f513e64a980 20 remove_watcher() i=1 2024-09-11T11:01:27.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.420+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93889206849296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d32960 con 0x556448d1fab0 2024-09-11T11:01:27.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93889206849296] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513e64a980 20 remove_watcher() i=2 2024-09-11T11:01:27.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93889206862800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d32960 con 0x7f512c03e070 2024-09-11T11:01:27.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93889206862800] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513403e060 con 0x7f512c03e070 2024-09-11T11:01:27.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513e64a980 20 remove_watcher() i=3 2024-09-11T11:01:27.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93889206863856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d32960 con 0x556448d1fab0 2024-09-11T11:01:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513c15a640 1 -- 172.21.15.145:0/2691650853 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93889206863856] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f512c02e070 con 0x556448d1fab0 2024-09-11T11:01:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513e64a980 20 remove_watcher() i=4 2024-09-11T11:01:27.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.424+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93889206860528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d32960 con 0x556448d24cf0 2024-09-11T11:01:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93889206860528] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 20 remove_watcher() i=5 2024-09-11T11:01:27.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93889206871280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d32960 con 0x556448d24cf0 2024-09-11T11:01:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513b959640 1 -- 172.21.15.145:0/2691650853 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93889206871280] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51240aaae0 con 0x556448d24cf0 2024-09-11T11:01:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 20 remove_watcher() i=6 2024-09-11T11:01:27.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93889206865472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556448d2e4f0 con 0x7f512c03e070 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93889206865472] v32'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f513403e060 con 0x7f512c03e070 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 20 remove_watcher() i=7 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448d1fab0 msgr2=0x556448d21f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448d1fab0 0x556448d21f70 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448d1b810 msgr2=0x556448d1dcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448d1b810 0x556448d1dcb0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f512c03e070 msgr2=0x7f512c0628d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f512c03e070 0x7f512c0628d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556448d24cf0 msgr2=0x556448d270e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556448d24cf0 0x556448d270e0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f500c034650 msgr2=0x7f500c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f500c034650 0x7f500c036b10 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5124000c10 tx=0x7f51240c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 msgr2=0x556448d106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513c95b640 1 -- 172.21.15.145:0/2691650853 reap_dead start 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d106f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f512c00f6b0 tx=0x7f512c01df20 comp rx=0 tx=0).stop 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 shutdown_connections 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 --2- 172.21.15.145:0/2691650853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448d094c0 0x556448d106f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 >> 172.21.15.145:0/2691650853 conn(0x556448d058f0 msgr2=0x556448d039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 shutdown_connections 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2691650853 wait complete. 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.428+0000 7f513e64a980 1 -- 172.21.15.145:0/2515278836 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50140346a0 msgr2=0x7f5014036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/2515278836 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50140346a0 0x7f5014036b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x556448ce3590 tx=0x7f5124005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/2515278836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448cfcda0 msgr2=0x556448cfd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/2515278836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448cfcda0 0x556448cfd1c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f512c01cfd0 tx=0x7f512c019790 comp rx=0 tx=0).stop 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/2515278836 shutdown_connections 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/2515278836 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50140346a0 0x7f5014036b60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/2515278836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448cfcda0 0x556448cfd1c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/2515278836 >> 172.21.15.145:0/2515278836 conn(0x556448cf1ef0 msgr2=0x556448cf4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/2515278836 shutdown_connections 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/2515278836 wait complete. 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448ce73f0 msgr2=0x556448ce97e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556448ce73f0 0x556448ce97e0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448bf0c60 msgr2=0x556448ce5f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556448bf0c60 0x556448ce5f90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556448ceca70 msgr2=0x556448ceee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556448ceca70 0x556448ceee60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50240345e0 msgr2=0x7f5024036aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50240345e0 0x7f5024036aa0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f51240ae000 tx=0x7f51240a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 msgr2=0x556448cdefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 --2- 172.21.15.145:0/331113260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556448bec8e0 0x556448cdefa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x556448cd8e10 tx=0x7f512c000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513c95b640 1 -- 172.21.15.145:0/331113260 reap_dead start 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 shutdown_connections 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 >> 172.21.15.145:0/331113260 conn(0x556448b60230 msgr2=0x556448cd23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 shutdown_connections 2024-09-11T11:01:27.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.432+0000 7f513e64a980 1 -- 172.21.15.145:0/331113260 wait complete. 2024-09-11T11:01:27.445 INFO:teuthology.orchestra.run.smithi145.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2267e615-29e0-4503-94c5-a003ba7e8ee3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","marker":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-11T11:01:26.281145Z","creation_time":"2024-09-11T11:01:26.276370Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-11T11:01:27.445 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-11T11:01:26.281145Z', 'creation_time': '2024-09-11T11:01:26.276370Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-11T11:01:27.445 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-11T11:01:27.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-11T11:01:27.445 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-11T11:01:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:27.525 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725a97b980 1 Processor -- start 2024-09-11T11:01:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725a97b980 1 -- start start 2024-09-11T11:01:27.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725a97b980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555c0a992ad0 0x555c0aa21380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725a97b980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555c0a8a6ae0 con 0x555c0aa218c0 2024-09-11T11:01:27.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725a97b980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x555c0a8cae30 con 0x555c0a992ad0 2024-09-11T11:01:27.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725848b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555c0a992ad0 0x555c0aa21380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725848b640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555c0a992ad0 0x555c0aa21380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49920/0 (socket says 172.21.15.145:49920) 2024-09-11T11:01:27.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725848b640 1 -- 172.21.15.145:0/1897614724 learned_addr learned my addr 172.21.15.145:0/1897614724 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f7257c8a640 1 --1- 172.21.15.145:0/1897614724 >> v1:172.21.15.102:6789/0 conn(0x555c0aa218c0 0x555c0aa23cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54538/0 (socket says 172.21.15.145:54538) 2024-09-11T11:01:27.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725848b640 1 -- 172.21.15.145:0/1897614724 >> v1:172.21.15.102:6789/0 conn(0x555c0aa218c0 legacy=0x555c0aa23cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.524+0000 7f725848b640 1 -- 172.21.15.145:0/1897614724 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0aa263e0 con 0x555c0a992ad0 2024-09-11T11:01:27.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f725848b640 1 --2- 172.21.15.145:0/1897614724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0aa21380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f724800a5c0 tx=0x7f724801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a1c3fcbe0e7b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f7257489640 1 -- 172.21.15.145:0/1897614724 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480a6070 con 0x555c0a992ad0 2024-09-11T11:01:27.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f7257489640 1 -- 172.21.15.145:0/1897614724 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480af070 con 0x555c0a992ad0 2024-09-11T11:01:27.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f7257489640 1 -- 172.21.15.145:0/1897614724 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480aa5c0 con 0x555c0a992ad0 2024-09-11T11:01:27.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f725a97b980 1 -- 172.21.15.145:0/1897614724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 msgr2=0x555c0aa21380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f725a97b980 1 --2- 172.21.15.145:0/1897614724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0aa21380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f724800a5c0 tx=0x7f724801b340 comp rx=0 tx=0).stop 2024-09-11T11:01:27.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f725a97b980 1 -- 172.21.15.145:0/1897614724 shutdown_connections 2024-09-11T11:01:27.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f725a97b980 1 --2- 172.21.15.145:0/1897614724 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0aa21380 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f725a97b980 1 -- 172.21.15.145:0/1897614724 >> 172.21.15.145:0/1897614724 conn(0x555c0aa19070 msgr2=0x555c0aa1b490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f725a97b980 1 -- 172.21.15.145:0/1897614724 shutdown_connections 2024-09-11T11:01:27.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.528+0000 7f725a97b980 1 -- 172.21.15.145:0/1897614724 wait complete. 2024-09-11T11:01:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.544+0000 7f725a97b980 1 Processor -- start 2024-09-11T11:01:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.544+0000 7f725a97b980 1 -- start start 2024-09-11T11:01:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.544+0000 7f725a97b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0ab09a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.544+0000 7f725a97b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555c0a8cc200 con 0x555c0a992ad0 2024-09-11T11:01:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.544+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0ab09a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.544+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0ab09a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49928/0 (socket says 172.21.15.145:49928) 2024-09-11T11:01:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.544+0000 7f725848b640 1 -- 172.21.15.145:0/3523637987 learned_addr learned my addr 172.21.15.145:0/3523637987 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.544+0000 7f725848b640 1 -- 172.21.15.145:0/3523637987 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0ab0a030 con 0x555c0a992ad0 2024-09-11T11:01:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725848b640 1 --2- 172.21.15.145:0/3523637987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0ab09a60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f72480199f0 tx=0x7f7248003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dca3053b32d64e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f714660c640 1 -- 172.21.15.145:0/3523637987 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480aaa00 con 0x555c0a992ad0 2024-09-11T11:01:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f714660c640 1 -- 172.21.15.145:0/3523637987 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480aaba0 con 0x555c0a992ad0 2024-09-11T11:01:27.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f714660c640 1 -- 172.21.15.145:0/3523637987 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480bd3f0 con 0x555c0a992ad0 2024-09-11T11:01:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- 172.21.15.145:0/3523637987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 msgr2=0x555c0ab09a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 --2- 172.21.15.145:0/3523637987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0ab09a60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f72480199f0 tx=0x7f7248003030 comp rx=0 tx=0).stop 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- 172.21.15.145:0/3523637987 shutdown_connections 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 --2- 172.21.15.145:0/3523637987 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0ab09a60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- 172.21.15.145:0/3523637987 >> 172.21.15.145:0/3523637987 conn(0x555c0aa19070 msgr2=0x555c0ab05690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- 172.21.15.145:0/3523637987 shutdown_connections 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- 172.21.15.145:0/3523637987 wait complete. 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 Processor -- start 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- start start 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0aa1ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555c0aa25e20 con 0x555c0a992ad0 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0aa1ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0aa1ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49938/0 (socket says 172.21.15.145:49938) 2024-09-11T11:01:27.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725848b640 1 -- 172.21.15.145:0/3395945169 learned_addr learned my addr 172.21.15.145:0/3395945169 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725848b640 1 -- 172.21.15.145:0/3395945169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0aa1d3a0 con 0x555c0a992ad0 2024-09-11T11:01:27.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725848b640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0aa1ec80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f72480199f0 tx=0x7f72480180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f7144e09640 1 -- 172.21.15.145:0/3395945169 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480bd7c0 con 0x555c0a992ad0 2024-09-11T11:01:27.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c0aa1d630 con 0x555c0a992ad0 2024-09-11T11:01:27.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f7144e09640 1 -- 172.21.15.145:0/3395945169 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480bd960 con 0x555c0a992ad0 2024-09-11T11:01:27.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f7144e09640 1 -- 172.21.15.145:0/3395945169 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480bdc40 con 0x555c0a992ad0 2024-09-11T11:01:27.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.548+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c0aa1db20 con 0x555c0a992ad0 2024-09-11T11:01:27.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f7144e09640 1 -- 172.21.15.145:0/3395945169 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f72480ce020 con 0x555c0a992ad0 2024-09-11T11:01:27.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f7144e09640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71400346a0 0x7f7140036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f7144e09640 1 -- 172.21.15.145:0/3395945169 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f72480cc020 con 0x555c0a992ad0 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f7257c8a640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71400346a0 0x7f7140036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f725a97b980 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0aa218c0 0x555c0ab1a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab1a610 con 0x555c0aa218c0 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f7258c8c640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0aa218c0 0x555c0ab1a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f7257c8a640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71400346a0 0x7f7140036b60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7240000f70 tx=0x7f7240001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f7258c8c640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0aa218c0 0x555c0ab1a0d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f7258c8c640 1 -- 172.21.15.145:0/3395945169 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0aa218c0 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f725a97b980 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab1b0c0 0x555c0ab1d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab1dcf0 con 0x555c0ab1b0c0 2024-09-11T11:01:27.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f725848b640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab1b0c0 0x555c0ab1d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.552+0000 7f725848b640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab1b0c0 0x555c0ab1d580 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725848b640 1 -- 172.21.15.145:0/3395945169 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72480c53e0 con 0x555c0ab1b0c0 2024-09-11T11:01:27.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab1f5a0 con 0x555c0ab1b0c0 2024-09-11T11:01:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725848b640 1 -- 172.21.15.145:0/3395945169 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f72480c53e0 con 0x555c0ab1b0c0 2024-09-11T11:01:27.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab1e710 con 0x555c0ab1b0c0 2024-09-11T11:01:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725848b640 1 -- 172.21.15.145:0/3395945169 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72480c53e0 con 0x555c0ab1b0c0 2024-09-11T11:01:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725a97b980 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555c0ab20950 0x555c0ab22d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab23280 con 0x555c0ab20950 2024-09-11T11:01:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f7257c8a640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555c0ab20950 0x555c0ab22d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f7257c8a640 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555c0ab20950 0x555c0ab22d40 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f7257c8a640 1 -- 172.21.15.145:0/3395945169 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f724000f6a0 con 0x555c0ab20950 2024-09-11T11:01:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725a97b980 1 Processor -- start 2024-09-11T11:01:27.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725a97b980 1 -- start start 2024-09-11T11:01:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725a97b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab30c30 0x555c0ab31050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725a97b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555c0a925800 con 0x555c0ab30c30 2024-09-11T11:01:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab30c30 0x555c0ab31050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab30c30 0x555c0ab31050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49946/0 (socket says 172.21.15.145:49946) 2024-09-11T11:01:27.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.556+0000 7f725848b640 1 -- 172.21.15.145:0/2673255793 learned_addr learned my addr 172.21.15.145:0/2673255793 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725848b640 1 -- 172.21.15.145:0/2673255793 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0ab31590 con 0x555c0ab30c30 2024-09-11T11:01:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725848b640 1 --2- 172.21.15.145:0/2673255793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab30c30 0x555c0ab31050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f72480c8fd0 tx=0x7f72480c5730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f713dffb640 1 -- 172.21.15.145:0/2673255793 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480cf990 con 0x555c0ab30c30 2024-09-11T11:01:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f713dffb640 1 -- 172.21.15.145:0/2673255793 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480cfb30 con 0x555c0ab30c30 2024-09-11T11:01:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725a97b980 1 -- 172.21.15.145:0/2673255793 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c0ab31820 con 0x555c0ab30c30 2024-09-11T11:01:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f713dffb640 1 -- 172.21.15.145:0/2673255793 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480cfe10 con 0x555c0ab30c30 2024-09-11T11:01:27.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725a97b980 1 -- 172.21.15.145:0/2673255793 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c0ab344a0 con 0x555c0ab30c30 2024-09-11T11:01:27.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f713dffb640 1 -- 172.21.15.145:0/2673255793 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f72480c6480 con 0x555c0ab30c30 2024-09-11T11:01:27.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f713dffb640 1 --2- 172.21.15.145:0/2673255793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7130034600 0x7f7130036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f713dffb640 1 -- 172.21.15.145:0/2673255793 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f72480c0120 con 0x555c0ab30c30 2024-09-11T11:01:27.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f7257c8a640 1 --2- 172.21.15.145:0/2673255793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7130034600 0x7f7130036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725a97b980 1 Processor -- start 2024-09-11T11:01:27.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725a97b980 1 -- start start 2024-09-11T11:01:27.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f7257c8a640 1 --2- 172.21.15.145:0/2673255793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7130034600 0x7f7130036ac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x555c0aa1e380 tx=0x7f724000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725a97b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab3d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725a97b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555c0ab0a2f0 con 0x555c0ab3d5f0 2024-09-11T11:01:27.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab3d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab3d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49948/0 (socket says 172.21.15.145:49948) 2024-09-11T11:01:27.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725848b640 1 -- 172.21.15.145:0/3725157154 learned_addr learned my addr 172.21.15.145:0/3725157154 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.560+0000 7f725848b640 1 -- 172.21.15.145:0/3725157154 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0ab3dfc0 con 0x555c0ab3d5f0 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725848b640 1 --2- 172.21.15.145:0/3725157154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab3d9f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f72480cf490 tx=0x7f72480eeb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12c8c6962bd03dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f71377fe640 1 -- 172.21.15.145:0/3725157154 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7248106070 con 0x555c0ab3d5f0 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f71377fe640 1 -- 172.21.15.145:0/3725157154 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480e3a80 con 0x555c0ab3d5f0 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f71377fe640 1 -- 172.21.15.145:0/3725157154 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480c9de0 con 0x555c0ab3d5f0 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- 172.21.15.145:0/3725157154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 msgr2=0x555c0ab3d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 --2- 172.21.15.145:0/3725157154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab3d9f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f72480cf490 tx=0x7f72480eeb20 comp rx=0 tx=0).stop 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- 172.21.15.145:0/3725157154 shutdown_connections 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 --2- 172.21.15.145:0/3725157154 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab3d9f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- 172.21.15.145:0/3725157154 >> 172.21.15.145:0/3725157154 conn(0x555c0ab399d0 msgr2=0x555c0ab37ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- 172.21.15.145:0/3725157154 shutdown_connections 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- 172.21.15.145:0/3725157154 wait complete. 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 Processor -- start 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- start start 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555c0ab3e3e0 con 0x555c0ab3d5f0 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725848b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab446f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49964/0 (socket says 172.21.15.145:49964) 2024-09-11T11:01:27.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 learned_addr learned my addr 172.21.15.145:0/1139155106 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c0ab44c30 con 0x555c0ab3d5f0 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725848b640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab446f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f72480c2010 tx=0x7f72480f2eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f7135ffb640 1 -- 172.21.15.145:0/1139155106 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7248106040 con 0x555c0ab3d5f0 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c0ab44c30 con 0x555c0ab3d5f0 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f7135ffb640 1 -- 172.21.15.145:0/1139155106 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72480de500 con 0x555c0ab3d5f0 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c0ab44c30 con 0x555c0ab3d5f0 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.564+0000 7f7135ffb640 1 -- 172.21.15.145:0/1139155106 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72480de6b0 con 0x555c0ab3d5f0 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7135ffb640 1 -- 172.21.15.145:0/1139155106 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f72480de850 con 0x555c0ab3d5f0 2024-09-11T11:01:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7135ffb640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7128034650 0x7f7128036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7135ffb640 1 -- 172.21.15.145:0/1139155106 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f724811eaa0 con 0x555c0ab3d5f0 2024-09-11T11:01:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7257c8a640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7128034650 0x7f7128036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0ab4f890 0x555c0ab51d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab524a0 con 0x555c0ab4f890 2024-09-11T11:01:27.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7258c8c640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0ab4f890 0x555c0ab51d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7257c8a640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7128034650 0x7f7128036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f724000c010 tx=0x7f7240010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7258c8c640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0ab4f890 0x555c0ab51d50 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 realm 2024-09-11T11:01:27.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab4ed00 con 0x555c0ab4f890 2024-09-11T11:01:27.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab52f60 con 0x555c0ab4f890 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab53d40 0x555c0ab56130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725848b640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab53d40 0x555c0ab56130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725848b640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab53d40 0x555c0ab56130 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.568+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab57030 con 0x555c0ab53d40 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f725a97b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f725a97b980 20 searching for the correct realm 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555c0ab58860 0x555c0ab5ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5b3f0 con 0x555c0ab58860 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7257c8a640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555c0ab58860 0x555c0ab5ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7257c8a640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555c0ab58860 0x555c0ab5ad20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5b3f0 con 0x555c0ab53d40 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f725848b640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f72480c95f0 0x7f72480bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x7f72480c95f0 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7258c8c640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f72480c95f0 0x7f72480bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7258c8c640 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f72480c95f0 0x7f72480bf0d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.572+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab58860 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x7f72480c95f0 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x7f72480c95f0 2024-09-11T11:01:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab58860 2024-09-11T11:01:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.576+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab58860 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab58860 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x7f72480c95f0 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab4f890 2024-09-11T11:01:27.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x7f72480c95f0 2024-09-11T11:01:27.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab58860 2024-09-11T11:01:27.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x7f72480c95f0 2024-09-11T11:01:27.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.580+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab58860 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab56790 con 0x555c0ab53d40 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:27.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab57160 con 0x555c0ab4f890 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab57550 con 0x555c0ab53d40 2024-09-11T11:01:27.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab57550 con 0x7f72480c95f0 2024-09-11T11:01:27.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:27.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 zone default found 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 4 Realm: () 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 zonegroup default 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.584+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5b870 con 0x7f72480c95f0 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5d5f0 con 0x555c0ab58860 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5d990 con 0x555c0ab58860 2024-09-11T11:01:27.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 20 started sync module instance, tier type = 2024-09-11T11:01:27.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:27.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5ca90 con 0x555c0ab53d40 2024-09-11T11:01:27.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93853805039504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5ca90 con 0x555c0ab53d40 2024-09-11T11:01:27.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.588+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5e3a0 con 0x555c0ab4f890 2024-09-11T11:01:27.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93853805043440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5e310 con 0x555c0ab4f890 2024-09-11T11:01:27.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5f300 con 0x555c0ab53d40 2024-09-11T11:01:27.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93853805039504] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93853805043440] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93853805045648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5f300 con 0x555c0ab53d40 2024-09-11T11:01:27.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5f770 con 0x7f72480c95f0 2024-09-11T11:01:27.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93853805047264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5f730 con 0x7f72480c95f0 2024-09-11T11:01:27.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.592+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab60630 con 0x555c0ab53d40 2024-09-11T11:01:27.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93853805047264] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93853805045648] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93853805037024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab60180 con 0x555c0ab53d40 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab609d0 con 0x555c0ab58860 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93853805052592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab61270 con 0x555c0ab58860 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab61c30 con 0x555c0ab58860 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.596+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93853805037024] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93853805052592] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93853805057920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab62020 con 0x555c0ab58860 2024-09-11T11:01:27.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab62870 con 0x7f72480c95f0 2024-09-11T11:01:27.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93853805060640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab62ca0 con 0x7f72480c95f0 2024-09-11T11:01:27.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 20 add_watcher() i=0 2024-09-11T11:01:27.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 20 add_watcher() i=1 2024-09-11T11:01:27.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 20 add_watcher() i=2 2024-09-11T11:01:27.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 20 add_watcher() i=3 2024-09-11T11:01:27.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 20 add_watcher() i=4 2024-09-11T11:01:27.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 20 add_watcher() i=5 2024-09-11T11:01:27.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93853805057920] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 20 add_watcher() i=6 2024-09-11T11:01:27.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93853805060640] v32'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 20 add_watcher() i=7 2024-09-11T11:01:27.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:27.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5fb60 con 0x555c0ab4f890 2024-09-11T11:01:27.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.600+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93853805061856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5fb60 con 0x555c0ab4f890 2024-09-11T11:01:27.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93853805061856] v32'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f710e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:27.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:27.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 5 note: GC not initialized 2024-09-11T11:01:27.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f710d7e2640 20 reqs_thread_entry: start 2024-09-11T11:01:27.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:27.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 20 Filter name: none 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f707effd640 20 reqs_thread_entry: start 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab88ee0 con 0x555c0ab4f890 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab8a430 con 0x7f72480c95f0 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.604+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab8a430 con 0x555c0ab4f890 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 4.27 4:e42effdc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab8bf20 con 0x555c0ab4f890 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:66 4.19 4:99091213:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab8ebb0 con 0x555c0ab58860 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 4.10 4:0b9800c4:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab915d0 con 0x555c0ab58860 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 4.34 4:2e421ecf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab94210 con 0x7f72480c95f0 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 4.32 4:4e8df1ce:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab915d0 con 0x555c0ab53d40 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 4.13 4:c86f3d50:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab99260 con 0x7f72480c95f0 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 4.e 4:71901f3b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab9bc50 con 0x7f72480c95f0 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 4.6 4:610448dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab99260 con 0x555c0ab58860 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 4.14 4:2b20de90:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba0a80 con 0x555c0ab58860 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:74 4.4 4:215ab0bf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba3790 con 0x555c0ab4f890 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 4.2e 4:7645baa1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x555c0ab58860 2024-09-11T11:01:27.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(66 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(69 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(68 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(72 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(71 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(73 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(70 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5 [call out=124b] v0'0 uv3 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(75 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(74 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x7f72480c95f0 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(76 foo.buckets [call] v32'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.608+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x7f72480c95f0 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(77 foo.buckets [call] v32'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f725a97b980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x555c0ab4f890 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f725a97b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x7f72480c95f0 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f710e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.612+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93853805061856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x555c0ab4f890 2024-09-11T11:01:27.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 93853805061856] v32'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93853805039504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x555c0ab53d40 2024-09-11T11:01:27.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 93853805039504] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f725a97b980 20 remove_watcher() i=0 2024-09-11T11:01:27.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f725a97b980 2 removed watcher, disabling cache 2024-09-11T11:01:27.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93853805043440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x555c0ab4f890 2024-09-11T11:01:27.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 93853805043440] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x555c0ab4f890 2024-09-11T11:01:27.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f725a97b980 20 remove_watcher() i=1 2024-09-11T11:01:27.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.616+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93853805045648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x555c0ab53d40 2024-09-11T11:01:27.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.620+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 93853805045648] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.620+0000 7f725a97b980 20 remove_watcher() i=2 2024-09-11T11:01:27.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.620+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93853805047264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0aba64c0 con 0x7f72480c95f0 2024-09-11T11:01:27.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.620+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 93853805047264] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.620+0000 7f725a97b980 20 remove_watcher() i=3 2024-09-11T11:01:27.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.620+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93853805037024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5ede0 con 0x555c0ab53d40 2024-09-11T11:01:27.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f725848b640 1 -- 172.21.15.145:0/1139155106 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 93853805037024] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724811a020 con 0x555c0ab53d40 2024-09-11T11:01:27.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f725a97b980 20 remove_watcher() i=4 2024-09-11T11:01:27.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93853805052592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5ede0 con 0x555c0ab58860 2024-09-11T11:01:27.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 93853805052592] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f725a97b980 20 remove_watcher() i=5 2024-09-11T11:01:27.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93853805057920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab602b0 con 0x555c0ab58860 2024-09-11T11:01:27.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f7257c8a640 1 -- 172.21.15.145:0/1139155106 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 93853805057920] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7240037040 con 0x555c0ab58860 2024-09-11T11:01:27.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f725a97b980 20 remove_watcher() i=6 2024-09-11T11:01:27.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.624+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93853805060640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555c0ab5ede0 con 0x7f72480c95f0 2024-09-11T11:01:27.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 93853805060640] v32'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725000a4d0 con 0x7f72480c95f0 2024-09-11T11:01:27.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 20 remove_watcher() i=7 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab53d40 msgr2=0x555c0ab56130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab53d40 0x555c0ab56130 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0ab4f890 msgr2=0x555c0ab51d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0ab4f890 0x555c0ab51d50 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f72480c95f0 msgr2=0x7f72480bf0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f72480c95f0 0x7f72480bf0d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555c0ab58860 msgr2=0x555c0ab5ad20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555c0ab58860 0x555c0ab5ad20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7128034650 msgr2=0x7f7128036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7128034650 0x7f7128036b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f724000c010 tx=0x7f7240010000 comp rx=0 tx=0).stop 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 msgr2=0x555c0ab446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/1139155106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab3d5f0 0x555c0ab446f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f72480c2010 tx=0x7f72480f2eb0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 reap_dead start 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f7258c8c640 1 -- 172.21.15.145:0/1139155106 reap_dead start 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 shutdown_connections 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 >> 172.21.15.145:0/1139155106 conn(0x555c0ab399d0 msgr2=0x555c0ab37aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 shutdown_connections 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/1139155106 wait complete. 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/2673255793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7130034600 msgr2=0x7f7130036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/2673255793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7130034600 0x7f7130036ac0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x555c0aa1e380 tx=0x7f724000f000 comp rx=0 tx=0).stop 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/2673255793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab30c30 msgr2=0x555c0ab31050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/2673255793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab30c30 0x555c0ab31050 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f72480c8fd0 tx=0x7f72480c5730 comp rx=0 tx=0).stop 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/2673255793 shutdown_connections 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/2673255793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7130034600 0x7f7130036ac0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/2673255793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0ab30c30 0x555c0ab31050 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/2673255793 >> 172.21.15.145:0/2673255793 conn(0x555c0ab25d80 msgr2=0x555c0ab28800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/2673255793 shutdown_connections 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/2673255793 wait complete. 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab1b0c0 msgr2=0x555c0ab1d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555c0ab1b0c0 0x555c0ab1d580 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0aa218c0 msgr2=0x555c0ab1a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555c0aa218c0 0x555c0ab1a0d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555c0ab20950 msgr2=0x555c0ab22d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555c0ab20950 0x555c0ab22d40 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71400346a0 msgr2=0x7f7140036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71400346a0 0x7f7140036b60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7240000f70 tx=0x7f7240001380 comp rx=0 tx=0).stop 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 msgr2=0x555c0aa1ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 --2- 172.21.15.145:0/3395945169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555c0a992ad0 0x555c0aa1ec80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f72480199f0 tx=0x7f72480180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f7258c8c640 1 -- 172.21.15.145:0/3395945169 reap_dead start 2024-09-11T11:01:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 shutdown_connections 2024-09-11T11:01:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 >> 172.21.15.145:0/3395945169 conn(0x555c0aa19070 msgr2=0x555c0ab04210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 shutdown_connections 2024-09-11T11:01:27.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.628+0000 7f725a97b980 1 -- 172.21.15.145:0/3395945169 wait complete. 2024-09-11T11:01:27.642 INFO:teuthology.orchestra.run.smithi145.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-11T11:01:27.614577Z","last_stats_update":"2024-09-11T11:01:27.613115Z"} 2024-09-11T11:01:27.642 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-11T11:01:27.614577Z', 'last_stats_update': '2024-09-11T11:01:27.613115Z'} 2024-09-11T11:01:27.648 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:27.648 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-11T11:01:27.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-11T11:01:27.649 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-11T11:01:27.723 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:27.723 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:27.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.720+0000 7f5748299980 1 Processor -- start 2024-09-11T11:01:27.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.720+0000 7f5748299980 1 -- start start 2024-09-11T11:01:27.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.720+0000 7f5748299980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564c713caa60 0x564c713cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.720+0000 7f5748299980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564c7124eae0 con 0x564c7133ab10 2024-09-11T11:01:27.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.720+0000 7f5748299980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x564c71272e30 con 0x564c713caa60 2024-09-11T11:01:27.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.720+0000 7f57455a8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564c713caa60 0x564c713cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.720+0000 7f5745da9640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x564c7133ab10 0x564c713c9340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54554/0 (socket says 172.21.15.145:54554) 2024-09-11T11:01:27.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.720+0000 7f5745da9640 1 -- 172.21.15.145:0/3202234927 learned_addr learned my addr 172.21.15.145:0/3202234927 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:27.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f57455a8640 1 -- 172.21.15.145:0/3202234927 >> v1:172.21.15.102:6789/0 conn(0x564c7133ab10 legacy=0x564c713c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f57455a8640 1 -- 172.21.15.145:0/3202234927 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c713ce3a0 con 0x564c713caa60 2024-09-11T11:01:27.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f57455a8640 1 --2- 172.21.15.145:0/3202234927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c713caa60 0x564c713cce50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f573000a420 tx=0x7f573001ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150f8af88a9bac96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5744da7640 1 -- 172.21.15.145:0/3202234927 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57300b0070 con 0x564c713caa60 2024-09-11T11:01:27.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5744da7640 1 -- 172.21.15.145:0/3202234927 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57300a3ce0 con 0x564c713caa60 2024-09-11T11:01:27.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5744da7640 1 -- 172.21.15.145:0/3202234927 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57300ab440 con 0x564c713caa60 2024-09-11T11:01:27.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5748299980 1 -- 172.21.15.145:0/3202234927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c713caa60 msgr2=0x564c713cce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5748299980 1 --2- 172.21.15.145:0/3202234927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c713caa60 0x564c713cce50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f573000a420 tx=0x7f573001ae60 comp rx=0 tx=0).stop 2024-09-11T11:01:27.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5748299980 1 -- 172.21.15.145:0/3202234927 shutdown_connections 2024-09-11T11:01:27.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5748299980 1 --2- 172.21.15.145:0/3202234927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c713caa60 0x564c713cce50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5748299980 1 -- 172.21.15.145:0/3202234927 >> 172.21.15.145:0/3202234927 conn(0x564c713c1070 msgr2=0x564c713c3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5748299980 1 -- 172.21.15.145:0/3202234927 shutdown_connections 2024-09-11T11:01:27.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.724+0000 7f5748299980 1 -- 172.21.15.145:0/3202234927 wait complete. 2024-09-11T11:01:27.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.740+0000 7f5748299980 1 Processor -- start 2024-09-11T11:01:27.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.740+0000 7f5748299980 1 -- start start 2024-09-11T11:01:27.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.740+0000 7f5748299980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.740+0000 7f5748299980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564c71274200 con 0x564c7133ab10 2024-09-11T11:01:27.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.740+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.740+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49976/0 (socket says 172.21.15.145:49976) 2024-09-11T11:01:27.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.740+0000 7f5745da9640 1 -- 172.21.15.145:0/962856859 learned_addr learned my addr 172.21.15.145:0/962856859 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5745da9640 1 -- 172.21.15.145:0/962856859 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c714b21e0 con 0x564c7133ab10 2024-09-11T11:01:27.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5745da9640 1 --2- 172.21.15.145:0/962856859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b1c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f573800b3e0 tx=0x7f573800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a310eb00ceede6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5633e07640 1 -- 172.21.15.145:0/962856859 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573800d700 con 0x564c7133ab10 2024-09-11T11:01:27.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5633e07640 1 -- 172.21.15.145:0/962856859 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5738008070 con 0x564c7133ab10 2024-09-11T11:01:27.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5633e07640 1 -- 172.21.15.145:0/962856859 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573800da10 con 0x564c7133ab10 2024-09-11T11:01:27.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 -- 172.21.15.145:0/962856859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 msgr2=0x564c714b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 --2- 172.21.15.145:0/962856859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b1c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f573800b3e0 tx=0x7f573800b8a0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 -- 172.21.15.145:0/962856859 shutdown_connections 2024-09-11T11:01:27.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 --2- 172.21.15.145:0/962856859 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b1c10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 -- 172.21.15.145:0/962856859 >> 172.21.15.145:0/962856859 conn(0x564c713c1070 msgr2=0x564c714ad7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 -- 172.21.15.145:0/962856859 shutdown_connections 2024-09-11T11:01:27.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 -- 172.21.15.145:0/962856859 wait complete. 2024-09-11T11:01:27.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 Processor -- start 2024-09-11T11:01:27.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 -- start start 2024-09-11T11:01:27.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5748299980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564c713cde40 con 0x564c7133ab10 2024-09-11T11:01:27.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49988/0 (socket says 172.21.15.145:49988) 2024-09-11T11:01:27.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5745da9640 1 -- 172.21.15.145:0/3519211917 learned_addr learned my addr 172.21.15.145:0/3519211917 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5745da9640 1 -- 172.21.15.145:0/3519211917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c714b9590 con 0x564c7133ab10 2024-09-11T11:01:27.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.744+0000 7f5745da9640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b9050 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5738000fc0 tx=0x7f5738000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5632604640 1 -- 172.21.15.145:0/3519211917 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573801a7c0 con 0x564c7133ab10 2024-09-11T11:01:27.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5632604640 1 -- 172.21.15.145:0/3519211917 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573801a960 con 0x564c7133ab10 2024-09-11T11:01:27.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5632604640 1 -- 172.21.15.145:0/3519211917 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573801ac80 con 0x564c7133ab10 2024-09-11T11:01:27.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c714b9820 con 0x564c7133ab10 2024-09-11T11:01:27.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c714bc500 con 0x564c7133ab10 2024-09-11T11:01:27.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5632604640 1 -- 172.21.15.145:0/3519211917 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5738017070 con 0x564c7133ab10 2024-09-11T11:01:27.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5632604640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f562c034650 0x7f562c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5632604640 1 -- 172.21.15.145:0/3519211917 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f5738015020 con 0x564c7133ab10 2024-09-11T11:01:27.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f57455a8640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f562c034650 0x7f562c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5748299980 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714bdfd0 0x564c714c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714c0a10 con 0x564c714bdfd0 2024-09-11T11:01:27.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f57465aa640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714bdfd0 0x564c714c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f57455a8640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f562c034650 0x7f562c036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f57300ad000 tx=0x7f57300a5070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f57465aa640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714bdfd0 0x564c714c03c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f57465aa640 1 -- 172.21.15.145:0/3519211917 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714bdfd0 2024-09-11T11:01:27.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5748299980 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714c17e0 0x564c714c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714c4200 con 0x564c714c17e0 2024-09-11T11:01:27.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5745da9640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714c17e0 0x564c714c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.748+0000 7f5745da9640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714c17e0 0x564c714c3bd0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f5745da9640 1 -- 172.21.15.145:0/3519211917 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f573802e070 con 0x564c714c17e0 2024-09-11T11:01:27.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714c5ab0 con 0x564c714c17e0 2024-09-11T11:01:27.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f5745da9640 1 -- 172.21.15.145:0/3519211917 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f573802e070 con 0x564c714c17e0 2024-09-11T11:01:27.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714c4ce0 con 0x564c714c17e0 2024-09-11T11:01:27.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f5745da9640 1 -- 172.21.15.145:0/3519211917 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f573802e070 con 0x564c714c17e0 2024-09-11T11:01:27.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f5748299980 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564c714c6e60 0x564c714c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714c9790 con 0x564c714c6e60 2024-09-11T11:01:27.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f57455a8640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564c714c6e60 0x564c714c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f57455a8640 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564c714c6e60 0x564c714c9250 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f57455a8640 1 -- 172.21.15.145:0/3519211917 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f57300ac970 con 0x564c714c6e60 2024-09-11T11:01:27.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.752+0000 7f5748299980 1 Processor -- start 2024-09-11T11:01:27.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5748299980 1 -- start start 2024-09-11T11:01:27.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5748299980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714d7150 0x564c714d7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5748299980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564c712cd800 con 0x564c714d7150 2024-09-11T11:01:27.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714d7150 0x564c714d7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714d7150 0x564c714d7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:49992/0 (socket says 172.21.15.145:49992) 2024-09-11T11:01:27.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5745da9640 1 -- 172.21.15.145:0/178897638 learned_addr learned my addr 172.21.15.145:0/178897638 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5745da9640 1 -- 172.21.15.145:0/178897638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c714d7ab0 con 0x564c714d7150 2024-09-11T11:01:27.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5745da9640 1 --2- 172.21.15.145:0/178897638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714d7150 0x564c714d7570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f573801cfd0 tx=0x7f57380194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f562b7fe640 1 -- 172.21.15.145:0/178897638 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5738042080 con 0x564c714d7150 2024-09-11T11:01:27.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f562b7fe640 1 -- 172.21.15.145:0/178897638 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5738042240 con 0x564c714d7150 2024-09-11T11:01:27.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f562b7fe640 1 -- 172.21.15.145:0/178897638 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573804a660 con 0x564c714d7150 2024-09-11T11:01:27.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5748299980 1 -- 172.21.15.145:0/178897638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c714d7d40 con 0x564c714d7150 2024-09-11T11:01:27.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5748299980 1 -- 172.21.15.145:0/178897638 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c714da9c0 con 0x564c714d7150 2024-09-11T11:01:27.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f562b7fe640 1 -- 172.21.15.145:0/178897638 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f573803d040 con 0x564c714d7150 2024-09-11T11:01:27.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f562b7fe640 1 --2- 172.21.15.145:0/178897638 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5620034650 0x7f5620036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f562b7fe640 1 -- 172.21.15.145:0/178897638 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f573803a040 con 0x564c714d7150 2024-09-11T11:01:27.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f57455a8640 1 --2- 172.21.15.145:0/178897638 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5620034650 0x7f5620036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5748299980 1 Processor -- start 2024-09-11T11:01:27.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.756+0000 7f5748299980 1 -- start start 2024-09-11T11:01:27.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f57455a8640 1 --2- 172.21.15.145:0/178897638 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5620034650 0x7f5620036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x564c714bd640 tx=0x7f5730005d90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564c714b2560 con 0x564c714e3aa0 2024-09-11T11:01:27.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714e3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50008/0 (socket says 172.21.15.145:50008) 2024-09-11T11:01:27.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 -- 172.21.15.145:0/1241355580 learned_addr learned my addr 172.21.15.145:0/1241355580 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 -- 172.21.15.145:0/1241355580 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c714e4450 con 0x564c714e3aa0 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 --2- 172.21.15.145:0/1241355580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714e3e80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f573803a010 tx=0x7f5738047830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1098a1fb6702d7e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f56297fa640 1 -- 172.21.15.145:0/1241355580 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5738047970 con 0x564c714e3aa0 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f56297fa640 1 -- 172.21.15.145:0/1241355580 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57380137e0 con 0x564c714e3aa0 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f56297fa640 1 -- 172.21.15.145:0/1241355580 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57380450c0 con 0x564c714e3aa0 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 -- 172.21.15.145:0/1241355580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 msgr2=0x564c714e3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 --2- 172.21.15.145:0/1241355580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714e3e80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f573803a010 tx=0x7f5738047830 comp rx=0 tx=0).stop 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 -- 172.21.15.145:0/1241355580 shutdown_connections 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 --2- 172.21.15.145:0/1241355580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714e3e80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 -- 172.21.15.145:0/1241355580 >> 172.21.15.145:0/1241355580 conn(0x564c714dfe80 msgr2=0x564c714ddf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 -- 172.21.15.145:0/1241355580 shutdown_connections 2024-09-11T11:01:27.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 -- 172.21.15.145:0/1241355580 wait complete. 2024-09-11T11:01:27.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 Processor -- start 2024-09-11T11:01:27.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 -- start start 2024-09-11T11:01:27.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5748299980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564c714e48f0 con 0x564c714e3aa0 2024-09-11T11:01:27.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714eac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50010/0 (socket says 172.21.15.145:50010) 2024-09-11T11:01:27.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 learned_addr learned my addr 172.21.15.145:0/871938144 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.760+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c714eb1c0 con 0x564c714e3aa0 2024-09-11T11:01:27.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5745da9640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714eac80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5738047900 tx=0x7f573803df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f56177fe640 1 -- 172.21.15.145:0/871938144 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5738013130 con 0x564c714e3aa0 2024-09-11T11:01:27.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f56177fe640 1 -- 172.21.15.145:0/871938144 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5738033490 con 0x564c714e3aa0 2024-09-11T11:01:27.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564c714eb1c0 con 0x564c714e3aa0 2024-09-11T11:01:27.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f56177fe640 1 -- 172.21.15.145:0/871938144 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f573800fc80 con 0x564c714e3aa0 2024-09-11T11:01:27.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c714eb1c0 con 0x564c714e3aa0 2024-09-11T11:01:27.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f56177fe640 1 -- 172.21.15.145:0/871938144 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f573800e9a0 con 0x564c714e3aa0 2024-09-11T11:01:27.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f56177fe640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5610034600 0x7f5610036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f56177fe640 1 -- 172.21.15.145:0/871938144 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f573805a030 con 0x564c714e3aa0 2024-09-11T11:01:27.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f57455a8640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5610034600 0x7f5610036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714f5d20 0x564c714f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714f8930 con 0x564c714f5d20 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f57465aa640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714f5d20 0x564c714f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f57455a8640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5610034600 0x7f5610036ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f573000a420 tx=0x7f57300b2000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f57465aa640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714f5d20 0x564c714f81e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 20 realm 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714f5150 con 0x564c714f5d20 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714f93c0 con 0x564c714f5d20 2024-09-11T11:01:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714fa1a0 0x564c714fc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.764+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714fcc20 con 0x564c714fa1a0 2024-09-11T11:01:27.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5745da9640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714fa1a0 0x564c714fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5745da9640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714fa1a0 0x564c714fc590 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5738074070 con 0x564c714fa1a0 2024-09-11T11:01:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5748299980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714fd470 con 0x564c714fa1a0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5738074070 con 0x564c714fa1a0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5748299980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5748299980 20 searching for the correct realm 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564c714ff1e0 0x564c715015d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714ff1e0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f57455a8640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564c714ff1e0 0x564c715015d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f57455a8640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564c714ff1e0 0x564c715015d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5738074070 con 0x564c714fa1a0 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5745da9640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5738019800 0x7f5738033940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x7f5738019800 2024-09-11T11:01:27.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.768+0000 7f57465aa640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5738019800 0x7f5738033940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5738019800 0x7f5738033940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714ff1e0 2024-09-11T11:01:27.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5738074070 con 0x564c714fa1a0 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5738074070 con 0x564c714fa1a0 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x7f5738019800 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.772+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x7f5738019800 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714ff1e0 2024-09-11T11:01:27.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714ff1e0 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714ff1e0 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x7f5738019800 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.776+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714f5d20 2024-09-11T11:01:27.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x7f5738019800 2024-09-11T11:01:27.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714ff1e0 2024-09-11T11:01:27.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x7f5738019800 2024-09-11T11:01:27.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714ff1e0 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564c71501c50 con 0x564c714fa1a0 2024-09-11T11:01:27.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5748299980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:27.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5748299980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:27.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5748299980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:27.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5748299980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:27.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5748299980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:27.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5748299980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:27.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.780+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714fddf0 con 0x564c714f5d20 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714fe690 con 0x564c714fa1a0 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c714fda30 con 0x7f5738019800 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 zone default found 2024-09-11T11:01:27.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 4 Realm: () 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 zonegroup default 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c71502580 con 0x7f5738019800 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c71504830 con 0x564c714ff1e0 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c71504bd0 con 0x564c714ff1e0 2024-09-11T11:01:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 started sync module instance, tier type = 2024-09-11T11:01:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:27.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.784+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71503cc0 con 0x564c714fa1a0 2024-09-11T11:01:27.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94886318588400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71503cc0 con 0x564c714fa1a0 2024-09-11T11:01:27.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71505590 con 0x564c714f5d20 2024-09-11T11:01:27.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94886318592224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71505500 con 0x564c714f5d20 2024-09-11T11:01:27.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71506490 con 0x564c714fa1a0 2024-09-11T11:01:27.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94886318588400] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94886318592224] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.788+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94886318594432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71505fa0 con 0x564c714fa1a0 2024-09-11T11:01:27.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71506960 con 0x7f5738019800 2024-09-11T11:01:27.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94886318597296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c715068d0 con 0x7f5738019800 2024-09-11T11:01:27.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c715078a0 con 0x564c714fa1a0 2024-09-11T11:01:27.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94886318597296] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94886318594432] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94886318585872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71507860 con 0x564c714fa1a0 2024-09-11T11:01:27.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.792+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71507c90 con 0x564c714ff1e0 2024-09-11T11:01:27.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94886318599504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71508530 con 0x564c714ff1e0 2024-09-11T11:01:27.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71508ef0 con 0x564c714ff1e0 2024-09-11T11:01:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94886318585872] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94886318599504] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94886318604416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c715092e0 con 0x564c714ff1e0 2024-09-11T11:01:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71509b30 con 0x7f5738019800 2024-09-11T11:01:27.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94886318604416] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94886318610048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71509aa0 con 0x7f5738019800 2024-09-11T11:01:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 20 add_watcher() i=0 2024-09-11T11:01:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 20 add_watcher() i=1 2024-09-11T11:01:27.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 20 add_watcher() i=2 2024-09-11T11:01:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 20 add_watcher() i=3 2024-09-11T11:01:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 20 add_watcher() i=4 2024-09-11T11:01:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 20 add_watcher() i=5 2024-09-11T11:01:27.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.796+0000 7f5748299980 20 add_watcher() i=6 2024-09-11T11:01:27.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94886318610048] v32'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f5748299980 20 add_watcher() i=7 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f5748299980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c7150d400 con 0x564c714f5d20 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94886318612176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c7150a8b0 con 0x564c714f5d20 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94886318612176] v32'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f55f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f5748299980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.800+0000 7f5748299980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 5 note: GC not initialized 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f55f67fc640 20 reqs_thread_entry: start 2024-09-11T11:01:27.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 Filter name: none 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5567fff640 20 reqs_thread_entry: start 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c71530ab0 con 0x564c714f5d20 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c71530590 con 0x7f5738019800 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c715342a0 con 0x564c714f5d20 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:27.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c715357f0 con 0x7f5738019800 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(65 foo.buckets [call] v32'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c71535340 con 0x7f5738019800 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.804+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:27.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:27.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c7153b820 con 0x7f5738019800 2024-09-11T11:01:27.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-11T11:01:27.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:27.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-11T11:01:27.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94886318797616 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564c71538cd0 con 0x564c714ff1e0 2024-09-11T11:01:27.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== watch-notify(notify (1) cookie 94886318604416 notify 137438953473 ret 0) ==== 380+0+0 (crc 0 0 0) 0x7f57300bc040 con 0x564c714ff1e0 2024-09-11T11:01:27.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(68 notify.6 [notify cookie 94886318797616 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f56297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953473 cookie 94886318604416 notifier 4486 bl.length()=338 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f56297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f56297fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f56297fa640 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5608003eb0 con 0x564c714ff1e0 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== watch-notify(notify_complete (2) cookie 94886318797616 notify 137438953473 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564c713ce3a0 con 0x564c714ff1e0 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f55f77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.808+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94886318612176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c7152e8e0 con 0x564c714f5d20 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.812+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94886318612176] v32'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.812+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94886318588400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c7152e8e0 con 0x564c714fa1a0 2024-09-11T11:01:27.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.812+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94886318588400] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.812+0000 7f5748299980 20 remove_watcher() i=0 2024-09-11T11:01:27.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.812+0000 7f5748299980 2 removed watcher, disabling cache 2024-09-11T11:01:27.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.812+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94886318592224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c715041f0 con 0x564c714f5d20 2024-09-11T11:01:27.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.816+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94886318592224] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x564c714f5d20 2024-09-11T11:01:27.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.816+0000 7f5748299980 20 remove_watcher() i=1 2024-09-11T11:01:27.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.816+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94886318594432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c7152e8e0 con 0x564c714fa1a0 2024-09-11T11:01:27.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.816+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94886318594432] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.816+0000 7f5748299980 20 remove_watcher() i=2 2024-09-11T11:01:27.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.816+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94886318597296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c715050e0 con 0x7f5738019800 2024-09-11T11:01:27.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94886318597296] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f5748299980 20 remove_watcher() i=3 2024-09-11T11:01:27.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94886318585872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c71505980 con 0x564c714fa1a0 2024-09-11T11:01:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f5745da9640 1 -- 172.21.15.145:0/871938144 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94886318585872] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5738086040 con 0x564c714fa1a0 2024-09-11T11:01:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f5748299980 20 remove_watcher() i=4 2024-09-11T11:01:27.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94886318599504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c7152e8e0 con 0x564c714ff1e0 2024-09-11T11:01:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94886318599504] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f5748299980 20 remove_watcher() i=5 2024-09-11T11:01:27.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.820+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94886318604416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c715064b0 con 0x564c714ff1e0 2024-09-11T11:01:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f57455a8640 1 -- 172.21.15.145:0/871938144 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94886318604416] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57300c9070 con 0x564c714ff1e0 2024-09-11T11:01:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 20 remove_watcher() i=6 2024-09-11T11:01:27.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94886318610048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564c715050e0 con 0x7f5738019800 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94886318610048] v32'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f57400083f0 con 0x7f5738019800 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 20 remove_watcher() i=7 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714fa1a0 msgr2=0x564c714fc590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714fa1a0 0x564c714fc590 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714f5d20 msgr2=0x564c714f81e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714f5d20 0x564c714f81e0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5738019800 msgr2=0x7f5738033940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5738019800 0x7f5738033940 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564c714ff1e0 msgr2=0x564c715015d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564c714ff1e0 0x564c715015d0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5610034600 msgr2=0x7f5610036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5610034600 0x7f5610036ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f573000a420 tx=0x7f57300b2000 comp rx=0 tx=0).stop 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f57465aa640 1 -- 172.21.15.145:0/871938144 reap_dead start 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 msgr2=0x564c714eac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714eac80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5738047900 tx=0x7f573803df90 comp rx=0 tx=0).stop 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 shutdown_connections 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/871938144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714e3aa0 0x564c714eac80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 >> 172.21.15.145:0/871938144 conn(0x564c714dfe80 msgr2=0x564c714ddf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 shutdown_connections 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/871938144 wait complete. 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/178897638 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5620034650 msgr2=0x7f5620036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/178897638 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5620034650 0x7f5620036b10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x564c714bd640 tx=0x7f5730005d90 comp rx=0 tx=0).stop 2024-09-11T11:01:27.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/178897638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714d7150 msgr2=0x564c714d7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/178897638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714d7150 0x564c714d7570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f573801cfd0 tx=0x7f57380194a0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/178897638 shutdown_connections 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/178897638 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5620034650 0x7f5620036b10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/178897638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c714d7150 0x564c714d7570 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/178897638 >> 172.21.15.145:0/178897638 conn(0x564c714cc2a0 msgr2=0x564c714ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/178897638 shutdown_connections 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/178897638 wait complete. 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714c17e0 msgr2=0x564c714c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564c714c17e0 0x564c714c3bd0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714bdfd0 msgr2=0x564c714c03c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564c714bdfd0 0x564c714c03c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564c714c6e60 msgr2=0x564c714c9250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.824+0000 7f5748299980 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564c714c6e60 0x564c714c9250 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f562c034650 msgr2=0x7f562c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f5748299980 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f562c034650 0x7f562c036b10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f57300ad000 tx=0x7f57300a5070 comp rx=0 tx=0).stop 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 msgr2=0x564c714b9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f5748299980 1 --2- 172.21.15.145:0/3519211917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564c7133ab10 0x564c714b9050 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5738000fc0 tx=0x7f5738000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f57465aa640 1 -- 172.21.15.145:0/3519211917 reap_dead start 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 shutdown_connections 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 >> 172.21.15.145:0/3519211917 conn(0x564c713c1070 msgr2=0x564c714ac320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 shutdown_connections 2024-09-11T11:01:27.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.828+0000 7f5748299980 1 -- 172.21.15.145:0/3519211917 wait complete. 2024-09-11T11:01:27.840 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-11T11:01:27.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-11T11:01:27.840 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-11T11:01:27.920 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:27.920 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:27.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a5c74e980 1 Processor -- start 2024-09-11T11:01:27.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a5c74e980 1 -- start start 2024-09-11T11:01:27.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a5c74e980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x560dc666d800 0x560dc666c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a5c74e980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560dc657eae0 con 0x560dc666d3f0 2024-09-11T11:01:27.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a5c74e980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x560dc65a2e30 con 0x560dc666d800 2024-09-11T11:01:27.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a59a5d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x560dc666d800 0x560dc666c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a5a25e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x560dc666d3f0 0x560dc666bbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54564/0 (socket says 172.21.15.145:54564) 2024-09-11T11:01:27.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a5a25e640 1 -- 172.21.15.145:0/4116465460 learned_addr learned my addr 172.21.15.145:0/4116465460 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:27.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a59a5d640 1 -- 172.21.15.145:0/4116465460 >> v1:172.21.15.102:6789/0 conn(0x560dc666d3f0 legacy=0x560dc666bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a59a5d640 1 -- 172.21.15.145:0/4116465460 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc666c920 con 0x560dc666d800 2024-09-11T11:01:27.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a5925c640 1 -- 172.21.15.145:0/4116465460 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3235997425 0 0) 0x560dc657eae0 con 0x560dc666d3f0 2024-09-11T11:01:27.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.920+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/4116465460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d800 0x560dc666c2c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000a480 tx=0x7f7a5001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c4ce2c6a661006 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5925c640 1 -- 172.21.15.145:0/4116465460 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a500b0070 con 0x560dc666d800 2024-09-11T11:01:27.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5925c640 1 -- 172.21.15.145:0/4116465460 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a500ab540 con 0x560dc666d800 2024-09-11T11:01:27.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5925c640 1 -- 172.21.15.145:0/4116465460 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a500ab840 con 0x560dc666d800 2024-09-11T11:01:27.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5c74e980 1 -- 172.21.15.145:0/4116465460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d800 msgr2=0x560dc666c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/4116465460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d800 0x560dc666c2c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7a5000a480 tx=0x7f7a5001b280 comp rx=0 tx=0).stop 2024-09-11T11:01:27.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5c74e980 1 -- 172.21.15.145:0/4116465460 shutdown_connections 2024-09-11T11:01:27.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/4116465460 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d800 0x560dc666c2c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5c74e980 1 -- 172.21.15.145:0/4116465460 >> 172.21.15.145:0/4116465460 conn(0x560dc66f21f0 msgr2=0x560dc66f4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5c74e980 1 -- 172.21.15.145:0/4116465460 shutdown_connections 2024-09-11T11:01:27.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.924+0000 7f7a5c74e980 1 -- 172.21.15.145:0/4116465460 wait complete. 2024-09-11T11:01:27.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.936+0000 7f7a5c74e980 1 Processor -- start 2024-09-11T11:01:27.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.936+0000 7f7a5c74e980 1 -- start start 2024-09-11T11:01:27.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.936+0000 7f7a5c74e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67e3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.936+0000 7f7a5c74e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x560dc65a4200 con 0x560dc666d3f0 2024-09-11T11:01:27.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67e3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67e3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50030/0 (socket says 172.21.15.145:50030) 2024-09-11T11:01:27.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5a25e640 1 -- 172.21.15.145:0/2497916666 learned_addr learned my addr 172.21.15.145:0/2497916666 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5a25e640 1 -- 172.21.15.145:0/2497916666 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc67e4040 con 0x560dc666d3f0 2024-09-11T11:01:27.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/2497916666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67e3a70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00b250 tx=0x7f7a4c00b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3a8b4dd4389fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7948608640 1 -- 172.21.15.145:0/2497916666 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c00d640 con 0x560dc666d3f0 2024-09-11T11:01:27.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7948608640 1 -- 172.21.15.145:0/2497916666 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c008070 con 0x560dc666d3f0 2024-09-11T11:01:27.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7948608640 1 -- 172.21.15.145:0/2497916666 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c00d990 con 0x560dc666d3f0 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 -- 172.21.15.145:0/2497916666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 msgr2=0x560dc67e3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/2497916666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67e3a70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00b250 tx=0x7f7a4c00b710 comp rx=0 tx=0).stop 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 -- 172.21.15.145:0/2497916666 shutdown_connections 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/2497916666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67e3a70 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 -- 172.21.15.145:0/2497916666 >> 172.21.15.145:0/2497916666 conn(0x560dc66f21f0 msgr2=0x560dc67df6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 -- 172.21.15.145:0/2497916666 shutdown_connections 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 -- 172.21.15.145:0/2497916666 wait complete. 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 Processor -- start 2024-09-11T11:01:27.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 -- start start 2024-09-11T11:01:27.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67eae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5c74e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x560dc6702240 con 0x560dc666d3f0 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67eae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67eae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50044/0 (socket says 172.21.15.145:50044) 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.940+0000 7f7a5a25e640 1 -- 172.21.15.145:0/795101412 learned_addr learned my addr 172.21.15.145:0/795101412 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5a25e640 1 -- 172.21.15.145:0/795101412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc67eb3b0 con 0x560dc666d3f0 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67eae70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x560dc67e4c50 tx=0x7f7a4c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7946e05640 1 -- 172.21.15.145:0/795101412 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c01a690 con 0x560dc666d3f0 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dc67eb640 con 0x560dc666d3f0 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7946e05640 1 -- 172.21.15.145:0/795101412 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c01a830 con 0x560dc666d3f0 2024-09-11T11:01:27.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7946e05640 1 -- 172.21.15.145:0/795101412 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c01ab50 con 0x560dc666d3f0 2024-09-11T11:01:27.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dc67ee320 con 0x560dc666d3f0 2024-09-11T11:01:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7946e05640 1 -- 172.21.15.145:0/795101412 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7a4c017070 con 0x560dc666d3f0 2024-09-11T11:01:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7946e05640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7940034650 0x7f7940036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7946e05640 1 -- 172.21.15.145:0/795101412 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f7a4c015020 con 0x560dc666d3f0 2024-09-11T11:01:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7940034650 0x7f7940036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc666d800 0x560dc67f1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc67f24a0 con 0x560dc666d800 2024-09-11T11:01:27.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5aa5f640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc666d800 0x560dc67f1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7940034650 0x7f7940036b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a500ad000 tx=0x7f7a500a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5aa5f640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc666d800 0x560dc67f1e60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/795101412 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc666d800 2024-09-11T11:01:27.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc67f3270 0x560dc67f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc67f5ca0 con 0x560dc67f3270 2024-09-11T11:01:27.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.944+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc67f3270 0x560dc67f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc67f3270 0x560dc67f5660 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5a25e640 1 -- 172.21.15.145:0/795101412 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a4c02e070 con 0x560dc67f3270 2024-09-11T11:01:27.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc67f7550 con 0x560dc67f3270 2024-09-11T11:01:27.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5a25e640 1 -- 172.21.15.145:0/795101412 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7a4c02e070 con 0x560dc67f3270 2024-09-11T11:01:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc67f6780 con 0x560dc67f3270 2024-09-11T11:01:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5a25e640 1 -- 172.21.15.145:0/795101412 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a4c02e070 con 0x560dc67f3270 2024-09-11T11:01:27.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x560dc67f8900 0x560dc67facf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc67fb230 con 0x560dc67f8900 2024-09-11T11:01:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x560dc67f8900 0x560dc67facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x560dc67f8900 0x560dc67facf0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a59a5d640 1 -- 172.21.15.145:0/795101412 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7a500b3040 con 0x560dc67f8900 2024-09-11T11:01:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5c74e980 1 Processor -- start 2024-09-11T11:01:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5c74e980 1 -- start start 2024-09-11T11:01:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5c74e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc6808c20 0x560dc6809040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.948+0000 7f7a5c74e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x560dc65fd800 con 0x560dc6808c20 2024-09-11T11:01:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc6808c20 0x560dc6809040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc6808c20 0x560dc6809040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50058/0 (socket says 172.21.15.145:50058) 2024-09-11T11:01:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5a25e640 1 -- 172.21.15.145:0/173463452 learned_addr learned my addr 172.21.15.145:0/173463452 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5a25e640 1 -- 172.21.15.145:0/173463452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc6809580 con 0x560dc6808c20 2024-09-11T11:01:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/173463452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc6808c20 0x560dc6809040 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c048d30 tx=0x7f7a4c01aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f793ffff640 1 -- 172.21.15.145:0/173463452 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c04a0b0 con 0x560dc6808c20 2024-09-11T11:01:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f793ffff640 1 -- 172.21.15.145:0/173463452 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c04a250 con 0x560dc6808c20 2024-09-11T11:01:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5c74e980 1 -- 172.21.15.145:0/173463452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dc6809810 con 0x560dc6808c20 2024-09-11T11:01:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f793ffff640 1 -- 172.21.15.145:0/173463452 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c04a530 con 0x560dc6808c20 2024-09-11T11:01:27.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5c74e980 1 -- 172.21.15.145:0/173463452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dc680c490 con 0x560dc6808c20 2024-09-11T11:01:27.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f793ffff640 1 -- 172.21.15.145:0/173463452 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7a4c0120d0 con 0x560dc6808c20 2024-09-11T11:01:27.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f793ffff640 1 --2- 172.21.15.145:0/173463452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7934034600 0x7f7934036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f793ffff640 1 -- 172.21.15.145:0/173463452 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f7a4c03d040 con 0x560dc6808c20 2024-09-11T11:01:27.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/173463452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7934034600 0x7f7934036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5c74e980 1 Processor -- start 2024-09-11T11:01:27.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5c74e980 1 -- start start 2024-09-11T11:01:27.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/173463452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7934034600 0x7f7934036ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x560dc67f6b20 tx=0x7f7a50005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5c74e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc68159e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5c74e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x560dc67e43c0 con 0x560dc68155e0 2024-09-11T11:01:27.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc68159e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc68159e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50072/0 (socket says 172.21.15.145:50072) 2024-09-11T11:01:27.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.952+0000 7f7a5a25e640 1 -- 172.21.15.145:0/1679154747 learned_addr learned my addr 172.21.15.145:0/1679154747 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5a25e640 1 -- 172.21.15.145:0/1679154747 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc6815fb0 con 0x560dc68155e0 2024-09-11T11:01:27.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/1679154747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc68159e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00dfd0 tx=0x7f7a4c034aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972aae6e099b1c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f793dffb640 1 -- 172.21.15.145:0/1679154747 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c034500 con 0x560dc68155e0 2024-09-11T11:01:27.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f793dffb640 1 -- 172.21.15.145:0/1679154747 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c039e70 con 0x560dc68155e0 2024-09-11T11:01:27.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f793dffb640 1 -- 172.21.15.145:0/1679154747 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c00e5d0 con 0x560dc68155e0 2024-09-11T11:01:27.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- 172.21.15.145:0/1679154747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 msgr2=0x560dc68159e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:27.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/1679154747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc68159e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00dfd0 tx=0x7f7a4c034aa0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- 172.21.15.145:0/1679154747 shutdown_connections 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/1679154747 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc68159e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- 172.21.15.145:0/1679154747 >> 172.21.15.145:0/1679154747 conn(0x560dc6811910 msgr2=0x560dc680fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- 172.21.15.145:0/1679154747 shutdown_connections 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- 172.21.15.145:0/1679154747 wait complete. 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 Processor -- start 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- start start 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc681c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x560dc68164a0 con 0x560dc68155e0 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc681c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5a25e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc681c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50074/0 (socket says 172.21.15.145:50074) 2024-09-11T11:01:27.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 learned_addr learned my addr 172.21.15.145:0/190315533 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:27.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dc681cbd0 con 0x560dc68155e0 2024-09-11T11:01:27.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc681c690 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c012fd0 tx=0x7f7a4c04c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f792bfff640 1 -- 172.21.15.145:0/190315533 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c06d070 con 0x560dc68155e0 2024-09-11T11:01:27.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f792bfff640 1 -- 172.21.15.145:0/190315533 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c042360 con 0x560dc68155e0 2024-09-11T11:01:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560dc681cbd0 con 0x560dc68155e0 2024-09-11T11:01:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f792bfff640 1 -- 172.21.15.145:0/190315533 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7a4c034ca0 con 0x560dc68155e0 2024-09-11T11:01:27.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.956+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dc681cbd0 con 0x560dc68155e0 2024-09-11T11:01:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f792bfff640 1 -- 172.21.15.145:0/190315533 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7a4c070070 con 0x560dc68155e0 2024-09-11T11:01:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f792bfff640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7924034650 0x7f7924036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f792bfff640 1 -- 172.21.15.145:0/190315533 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f7a4c064040 con 0x560dc68155e0 2024-09-11T11:01:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7924034650 0x7f7924036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc6827820 0x560dc6829ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc682a430 con 0x560dc6827820 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5aa5f640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc6827820 0x560dc6829ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7924034650 0x7f7924036b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a500ae040 tx=0x7f7a500a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5aa5f640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc6827820 0x560dc6829ce0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 20 realm 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc6826cd0 con 0x560dc6827820 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:27.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc682aef0 con 0x560dc6827820 2024-09-11T11:01:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc682bcd0 0x560dc682e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc682e750 con 0x560dc682bcd0 2024-09-11T11:01:27.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc682bcd0 0x560dc682e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.960+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc682bcd0 0x560dc682e0c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5c74e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc682efa0 con 0x560dc682bcd0 2024-09-11T11:01:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5c74e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:27.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5c74e980 20 searching for the correct realm 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x560dc6830d10 0x560dc6833100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6830d10 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x560dc6830d10 0x560dc6833100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a59a5d640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x560dc6830d10 0x560dc6833100 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5a25e640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7a4c072070 0x7f7a4c031450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x7f7a4c072070 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5aa5f640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7a4c072070 0x7f7a4c031450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5aa5f640 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7a4c072070 0x7f7a4c031450 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:27.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.964+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6830d10 2024-09-11T11:01:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x7f7a4c072070 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x7f7a4c072070 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6830d10 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.968+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6830d10 2024-09-11T11:01:27.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6830d10 2024-09-11T11:01:27.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x7f7a4c072070 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6827820 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x7f7a4c072070 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6830d10 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x7f7a4c072070 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.972+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc6830d10 2024-09-11T11:01:27.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x560dc6833780 con 0x560dc682bcd0 2024-09-11T11:01:27.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:27.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:27.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:27.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:27.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc682f8f0 con 0x560dc6827820 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc682f500 con 0x560dc682bcd0 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc682f550 con 0x7f7a4c072070 2024-09-11T11:01:27.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 zone default found 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 4 Realm: () 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 zonegroup default 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc68303f0 con 0x7f7a4c072070 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.976+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc6835f70 con 0x560dc6830d10 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc6836310 con 0x560dc6830d10 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 20 started sync module instance, tier type = 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:27.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc68353b0 con 0x560dc682bcd0 2024-09-11T11:01:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94617165060304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc68353b0 con 0x560dc682bcd0 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.980+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6836cd0 con 0x560dc6827820 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94617165064224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc68370f0 con 0x560dc6827820 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6837ba0 con 0x560dc682bcd0 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94617165060304] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94617165064224] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94617165057792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6836c40 con 0x560dc682bcd0 2024-09-11T11:01:27.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6838440 con 0x7f7a4c072070 2024-09-11T11:01:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94617165070224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6836c40 con 0x7f7a4c072070 2024-09-11T11:01:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.984+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6838ee0 con 0x560dc682bcd0 2024-09-11T11:01:27.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.988+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94617165070224] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.988+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94617165057792] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.988+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.988+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94617165072848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6838ea0 con 0x560dc682bcd0 2024-09-11T11:01:27.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.988+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc68392d0 con 0x560dc6830d10 2024-09-11T11:01:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.988+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.988+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94617165067904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6839b70 con 0x560dc6830d10 2024-09-11T11:01:27.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.988+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc683a530 con 0x560dc6830d10 2024-09-11T11:01:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94617165067904] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94617165072848] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94617165078656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc683a920 con 0x560dc6830d10 2024-09-11T11:01:27.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc683b170 con 0x7f7a4c072070 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94617165078656] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94617165080992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc683b270 con 0x7f7a4c072070 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 20 add_watcher() i=0 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 20 add_watcher() i=1 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 20 add_watcher() i=2 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 20 add_watcher() i=3 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 20 add_watcher() i=4 2024-09-11T11:01:27.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 20 add_watcher() i=5 2024-09-11T11:01:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 20 add_watcher() i=6 2024-09-11T11:01:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94617165080992] v32'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 20 add_watcher() i=7 2024-09-11T11:01:27.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc683e670 con 0x560dc6827820 2024-09-11T11:01:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:27.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.992+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94617165082512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc683bb90 con 0x560dc6827820 2024-09-11T11:01:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94617165082512] v32'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7910fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 5 note: GC not initialized 2024-09-11T11:01:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f788b7fe640 20 reqs_thread_entry: start 2024-09-11T11:01:28.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 20 Filter name: none 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f78897fa640 20 reqs_thread_entry: start 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc6861d50 con 0x7f7a4c072070 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc68604f0 con 0x560dc6830d10 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:28.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-11T11:01:28.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:28.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-11T11:01:28.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-11T11:01:28.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:27.996+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6860de0 con 0x7f7a4c072070 2024-09-11T11:01:28.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v32'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94617165236528 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc68657f0 con 0x560dc6830d10 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== watch-notify(notify (1) cookie 94617165067904 notify 137438953474 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7f7a500bf1f0 con 0x560dc6830d10 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f793dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953474 cookie 94617165067904 notifier 4493 bl.length()=556 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f793dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f793dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:28.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(65 notify.5 [notify cookie 94617165236528 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f793dffb640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7920003eb0 con 0x560dc6830d10 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== watch-notify(notify_complete (2) cookie 94617165236528 notify 137438953474 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dc666c920 con 0x560dc6830d10 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6860930 con 0x560dc6830d10 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.000+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94617165251376 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x560dc6865c10 con 0x560dc682bcd0 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94617165057792 notify 137438953490 ret 0) ==== 219+0+0 (crc 0 0 0) 0x560dc6809810 con 0x560dc682bcd0 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f793dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94617165057792 notifier 4493 bl.length()=177 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f793dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-11T11:01:28.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f793dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f793dffb640 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f7920003eb0 con 0x560dc682bcd0 2024-09-11T11:01:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [notify cookie 94617165251376 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:28.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94617165251376 notify 137438953490 ret 0) ==== 42+0+48 (crc 0 0 0) 0x560dc6809580 con 0x560dc682bcd0 2024-09-11T11:01:28.011 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-11T11:01:28.002884Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:28.002865Z","tags":[],"group_ids":[]} 2024-09-11T11:01:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f7910fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.004+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94617165082512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc685faf0 con 0x560dc6827820 2024-09-11T11:01:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.008+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94617165082512] v32'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:28.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.008+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94617165060304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc685faf0 con 0x560dc682bcd0 2024-09-11T11:01:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.008+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94617165060304] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.008+0000 7f7a5c74e980 20 remove_watcher() i=0 2024-09-11T11:01:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.008+0000 7f7a5c74e980 2 removed watcher, disabling cache 2024-09-11T11:01:28.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.008+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94617165064224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc685faf0 con 0x560dc6827820 2024-09-11T11:01:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94617165064224] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x560dc6827820 2024-09-11T11:01:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5c74e980 20 remove_watcher() i=1 2024-09-11T11:01:28.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94617165057792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc685faf0 con 0x560dc682bcd0 2024-09-11T11:01:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94617165057792] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:28.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5c74e980 20 remove_watcher() i=2 2024-09-11T11:01:28.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94617165070224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6834f00 con 0x7f7a4c072070 2024-09-11T11:01:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94617165070224] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5c74e980 20 remove_watcher() i=3 2024-09-11T11:01:28.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.012+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94617165072848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc685faf0 con 0x560dc682bcd0 2024-09-11T11:01:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.016+0000 7f7a5a25e640 1 -- 172.21.15.145:0/190315533 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94617165072848] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a4c079070 con 0x560dc682bcd0 2024-09-11T11:01:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.016+0000 7f7a5c74e980 20 remove_watcher() i=4 2024-09-11T11:01:28.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.016+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94617165067904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6837f90 con 0x560dc6830d10 2024-09-11T11:01:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.016+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94617165067904] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.016+0000 7f7a5c74e980 20 remove_watcher() i=5 2024-09-11T11:01:28.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.016+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94617165078656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc6834f00 con 0x560dc6830d10 2024-09-11T11:01:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a59a5d640 1 -- 172.21.15.145:0/190315533 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94617165078656] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a500cb070 con 0x560dc6830d10 2024-09-11T11:01:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 20 remove_watcher() i=6 2024-09-11T11:01:28.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94617165080992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x560dc68389d0 con 0x7f7a4c072070 2024-09-11T11:01:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94617165080992] v32'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7a5400a4d0 con 0x7f7a4c072070 2024-09-11T11:01:28.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 20 remove_watcher() i=7 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc682bcd0 msgr2=0x560dc682e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc682bcd0 0x560dc682e0c0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc6827820 msgr2=0x560dc6829ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc6827820 0x560dc6829ce0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7a4c072070 msgr2=0x7f7a4c031450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7a4c072070 0x7f7a4c031450 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x560dc6830d10 msgr2=0x560dc6833100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x560dc6830d10 0x560dc6833100 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7924034650 msgr2=0x7f7924036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7924034650 0x7f7924036b10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7a500ae040 tx=0x7f7a500a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:28.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 msgr2=0x560dc681c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/190315533 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc68155e0 0x560dc681c690 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c012fd0 tx=0x7f7a4c04c170 comp rx=0 tx=0).stop 2024-09-11T11:01:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/190315533 reap_dead start 2024-09-11T11:01:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 shutdown_connections 2024-09-11T11:01:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 >> 172.21.15.145:0/190315533 conn(0x560dc6811910 msgr2=0x560dc680f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 shutdown_connections 2024-09-11T11:01:28.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/190315533 wait complete. 2024-09-11T11:01:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/173463452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7934034600 msgr2=0x7f7934036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/173463452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7934034600 0x7f7934036ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x560dc67f6b20 tx=0x7f7a50005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/173463452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc6808c20 msgr2=0x560dc6809040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/173463452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc6808c20 0x560dc6809040 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c048d30 tx=0x7f7a4c01aea0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/173463452 shutdown_connections 2024-09-11T11:01:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/173463452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7934034600 0x7f7934036ac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/173463452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc6808c20 0x560dc6809040 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/173463452 >> 172.21.15.145:0/173463452 conn(0x560dc67fdd70 msgr2=0x560dc68007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/173463452 shutdown_connections 2024-09-11T11:01:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/173463452 wait complete. 2024-09-11T11:01:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc67f3270 msgr2=0x560dc67f5660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560dc67f3270 0x560dc67f5660 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc666d800 msgr2=0x560dc67f1e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560dc666d800 0x560dc67f1e60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x560dc67f8900 msgr2=0x560dc67facf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x560dc67f8900 0x560dc67facf0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7940034650 msgr2=0x7f7940036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7940034650 0x7f7940036b10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a500ad000 tx=0x7f7a500a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 msgr2=0x560dc67eae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 --2- 172.21.15.145:0/795101412 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560dc666d3f0 0x560dc67eae70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x560dc67e4c50 tx=0x7f7a4c000ee0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5aa5f640 1 -- 172.21.15.145:0/795101412 reap_dead start 2024-09-11T11:01:28.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 shutdown_connections 2024-09-11T11:01:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 >> 172.21.15.145:0/795101412 conn(0x560dc66f21f0 msgr2=0x560dc67de220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 shutdown_connections 2024-09-11T11:01:28.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.020+0000 7f7a5c74e980 1 -- 172.21.15.145:0/795101412 wait complete. 2024-09-11T11:01:28.035 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-11T11:01:28.002884Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:28.002865Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:28.043 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-11T11:01:28.049 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:28.049 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-11T11:01:28.049 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-11T11:01:28.050 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-11T11:01:28.107 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:28.107 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:28.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a9d0d980 1 Processor -- start 2024-09-11T11:01:28.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a9d0d980 1 -- start start 2024-09-11T11:01:28.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a9d0d980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5594dc08f570 0x5594dc08f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a9d0d980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594dbf18ae0 con 0x5594dc08fec0 2024-09-11T11:01:28.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a9d0d980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5594dbf3ce30 con 0x5594dc08f570 2024-09-11T11:01:28.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a781d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5594dc08f570 0x5594dc08f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a781d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5594dc08f570 0x5594dc08f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50088/0 (socket says 172.21.15.145:50088) 2024-09-11T11:01:28.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a781d640 1 -- 172.21.15.145:0/1358947198 learned_addr learned my addr 172.21.15.145:0/1358947198 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.104+0000 7ff9a701c640 1 --1- 172.21.15.145:0/1358947198 >> v1:172.21.15.102:6789/0 conn(0x5594dc08fec0 0x5594dc0948f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54576/0 (socket says 172.21.15.145:54576) 2024-09-11T11:01:28.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a781d640 1 -- 172.21.15.145:0/1358947198 >> v1:172.21.15.102:6789/0 conn(0x5594dc08fec0 legacy=0x5594dc0948f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a781d640 1 -- 172.21.15.145:0/1358947198 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594dc097140 con 0x5594dc08f570 2024-09-11T11:01:28.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a781d640 1 --2- 172.21.15.145:0/1358947198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc08f950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000a4e0 tx=0x7ff9a001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8ac04d9e86f656 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a681b640 1 -- 172.21.15.145:0/1358947198 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00aa540 con 0x5594dc08f570 2024-09-11T11:01:28.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a681b640 1 -- 172.21.15.145:0/1358947198 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a00aa6e0 con 0x5594dc08f570 2024-09-11T11:01:28.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a681b640 1 -- 172.21.15.145:0/1358947198 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00aaa40 con 0x5594dc08f570 2024-09-11T11:01:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1358947198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 msgr2=0x5594dc08f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/1358947198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc08f950 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000a4e0 tx=0x7ff9a001b090 comp rx=0 tx=0).stop 2024-09-11T11:01:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1358947198 shutdown_connections 2024-09-11T11:01:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/1358947198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc08f950 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1358947198 >> 172.21.15.145:0/1358947198 conn(0x5594dc08b090 msgr2=0x5594dc08d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1358947198 shutdown_connections 2024-09-11T11:01:28.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.108+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1358947198 wait complete. 2024-09-11T11:01:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a9d0d980 1 Processor -- start 2024-09-11T11:01:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a9d0d980 1 -- start start 2024-09-11T11:01:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a9d0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc17a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a9d0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5594dbf3e200 con 0x5594dc08f570 2024-09-11T11:01:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc17a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc17a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50098/0 (socket says 172.21.15.145:50098) 2024-09-11T11:01:28.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a781d640 1 -- 172.21.15.145:0/1219681432 learned_addr learned my addr 172.21.15.145:0/1219681432 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a781d640 1 -- 172.21.15.145:0/1219681432 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594dc17af30 con 0x5594dc08f570 2024-09-11T11:01:28.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.124+0000 7ff9a781d640 1 --2- 172.21.15.145:0/1219681432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc17a960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0017ca0 tx=0x7ff9a00033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706df63ec4cd26c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff895e0b640 1 -- 172.21.15.145:0/1219681432 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00c1070 con 0x5594dc08f570 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff895e0b640 1 -- 172.21.15.145:0/1219681432 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a00aaa40 con 0x5594dc08f570 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff895e0b640 1 -- 172.21.15.145:0/1219681432 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00aad20 con 0x5594dc08f570 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1219681432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 msgr2=0x5594dc17a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/1219681432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc17a960 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0017ca0 tx=0x7ff9a00033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1219681432 shutdown_connections 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/1219681432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc17a960 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1219681432 >> 172.21.15.145:0/1219681432 conn(0x5594dc08b090 msgr2=0x5594dc176590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1219681432 shutdown_connections 2024-09-11T11:01:28.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/1219681432 wait complete. 2024-09-11T11:01:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 Processor -- start 2024-09-11T11:01:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- start start 2024-09-11T11:01:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc180ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5594dc096b80 con 0x5594dc08f570 2024-09-11T11:01:28.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc180ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc180ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50110/0 (socket says 172.21.15.145:50110) 2024-09-11T11:01:28.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a781d640 1 -- 172.21.15.145:0/4260659215 learned_addr learned my addr 172.21.15.145:0/4260659215 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a781d640 1 -- 172.21.15.145:0/4260659215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594dc181010 con 0x5594dc08f570 2024-09-11T11:01:28.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a781d640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc180ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff9a001b0d0 tx=0x7ff9a0017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff88ffff640 1 -- 172.21.15.145:0/4260659215 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00c1050 con 0x5594dc08f570 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594dc1812a0 con 0x5594dc08f570 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff88ffff640 1 -- 172.21.15.145:0/4260659215 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a00c2040 con 0x5594dc08f570 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff88ffff640 1 -- 172.21.15.145:0/4260659215 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00b1570 con 0x5594dc08f570 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.128+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594dc183f80 con 0x5594dc08f570 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff88ffff640 1 -- 172.21.15.145:0/4260659215 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9a00b1710 con 0x5594dc08f570 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff88ffff640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8900346a0 0x7ff890036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff88ffff640 1 -- 172.21.15.145:0/4260659215 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff9a00b8030 con 0x5594dc08f570 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a701c640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8900346a0 0x7ff890036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc08fec0 0x5594dc187aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc188110 con 0x5594dc08fec0 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a801e640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc08fec0 0x5594dc187aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a701c640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8900346a0 0x7ff890036b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff99c000f70 tx=0x7ff99c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a801e640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc08fec0 0x5594dc187aa0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a801e640 1 -- 172.21.15.145:0/4260659215 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc08fec0 2024-09-11T11:01:28.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc188f00 0x5594dc18b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc18b920 con 0x5594dc188f00 2024-09-11T11:01:28.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a781d640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc188f00 0x5594dc18b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a781d640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc188f00 0x5594dc18b2f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a781d640 1 -- 172.21.15.145:0/4260659215 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9a00cc020 con 0x5594dc188f00 2024-09-11T11:01:28.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.132+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc18d1d0 con 0x5594dc188f00 2024-09-11T11:01:28.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a781d640 1 -- 172.21.15.145:0/4260659215 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff9a00cc020 con 0x5594dc188f00 2024-09-11T11:01:28.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc18c400 con 0x5594dc188f00 2024-09-11T11:01:28.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a781d640 1 -- 172.21.15.145:0/4260659215 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9a00cc020 con 0x5594dc188f00 2024-09-11T11:01:28.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5594dc18e580 0x5594dc190970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc190eb0 con 0x5594dc18e580 2024-09-11T11:01:28.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a701c640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5594dc18e580 0x5594dc190970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a701c640 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5594dc18e580 0x5594dc190970 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a701c640 1 -- 172.21.15.145:0/4260659215 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff99c00f6a0 con 0x5594dc18e580 2024-09-11T11:01:28.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 Processor -- start 2024-09-11T11:01:28.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 -- start start 2024-09-11T11:01:28.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1a2c20 0x5594dc1a3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5594dbf97800 con 0x5594dc1a2c20 2024-09-11T11:01:28.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1a2c20 0x5594dc1a3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1a2c20 0x5594dc1a3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50124/0 (socket says 172.21.15.145:50124) 2024-09-11T11:01:28.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a781d640 1 -- 172.21.15.145:0/2001347024 learned_addr learned my addr 172.21.15.145:0/2001347024 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a781d640 1 -- 172.21.15.145:0/2001347024 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594dc1a3580 con 0x5594dc1a2c20 2024-09-11T11:01:28.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a781d640 1 --2- 172.21.15.145:0/2001347024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1a2c20 0x5594dc1a3040 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0006fc0 tx=0x7ff9a00df320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff88d7fa640 1 -- 172.21.15.145:0/2001347024 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00f0070 con 0x5594dc1a2c20 2024-09-11T11:01:28.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff88d7fa640 1 -- 172.21.15.145:0/2001347024 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a00b1aa0 con 0x5594dc1a2c20 2024-09-11T11:01:28.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2001347024 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594dc1a37b0 con 0x5594dc1a2c20 2024-09-11T11:01:28.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff88d7fa640 1 -- 172.21.15.145:0/2001347024 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00b1da0 con 0x5594dc1a2c20 2024-09-11T11:01:28.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.136+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2001347024 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594dc1a37b0 con 0x5594dc1a2c20 2024-09-11T11:01:28.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff88d7fa640 1 -- 172.21.15.145:0/2001347024 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9a00f3070 con 0x5594dc1a2c20 2024-09-11T11:01:28.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff88d7fa640 1 --2- 172.21.15.145:0/2001347024 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff880034650 0x7ff880036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff88d7fa640 1 -- 172.21.15.145:0/2001347024 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff9a00f6af0 con 0x5594dc1a2c20 2024-09-11T11:01:28.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a701c640 1 --2- 172.21.15.145:0/2001347024 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff880034650 0x7ff880036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 Processor -- start 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 -- start start 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a701c640 1 --2- 172.21.15.145:0/2001347024 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff880034650 0x7ff880036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5594dc1850c0 tx=0x7ff99c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1af690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5594dc17b220 con 0x5594dc1af2b0 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50126/0 (socket says 172.21.15.145:50126) 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a781d640 1 -- 172.21.15.145:0/3493472576 learned_addr learned my addr 172.21.15.145:0/3493472576 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a781d640 1 -- 172.21.15.145:0/3493472576 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594dc1afc60 con 0x5594dc1af2b0 2024-09-11T11:01:28.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a781d640 1 --2- 172.21.15.145:0/3493472576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1af690 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00bcc50 tx=0x7ff9a00da6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b8d7ccdfde99f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff886ffd640 1 -- 172.21.15.145:0/3493472576 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a0104070 con 0x5594dc1af2b0 2024-09-11T11:01:28.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff886ffd640 1 -- 172.21.15.145:0/3493472576 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a00dfe20 con 0x5594dc1af2b0 2024-09-11T11:01:28.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff886ffd640 1 -- 172.21.15.145:0/3493472576 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00ddd00 con 0x5594dc1af2b0 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/3493472576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 msgr2=0x5594dc1af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/3493472576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1af690 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00bcc50 tx=0x7ff9a00da6b0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/3493472576 shutdown_connections 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/3493472576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1af690 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/3493472576 >> 172.21.15.145:0/3493472576 conn(0x5594dc1ab5e0 msgr2=0x5594dc1a96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/3493472576 shutdown_connections 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.140+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/3493472576 wait complete. 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 1 Processor -- start 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 1 -- start start 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5594dc1b0170 con 0x5594dc1af2b0 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a781d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1b63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50136/0 (socket says 172.21.15.145:50136) 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 learned_addr learned my addr 172.21.15.145:0/2745144564 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594dc1b6900 con 0x5594dc1af2b0 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a781d640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1b63c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00c5b80 tx=0x7ff9a00e5f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff8857fa640 1 -- 172.21.15.145:0/2745144564 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a0119070 con 0x5594dc1af2b0 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594dc1b6900 con 0x5594dc1af2b0 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff8857fa640 1 -- 172.21.15.145:0/2745144564 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a00bb600 con 0x5594dc1af2b0 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff8857fa640 1 -- 172.21.15.145:0/2745144564 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9a00e5d50 con 0x5594dc1af2b0 2024-09-11T11:01:28.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594dc1b6d70 con 0x5594dc1af2b0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff8857fa640 1 -- 172.21.15.145:0/2745144564 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9a011c070 con 0x5594dc1af2b0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff8857fa640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8700345b0 0x7ff870036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff8857fa640 1 -- 172.21.15.145:0/2745144564 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff9a0110030 con 0x5594dc1af2b0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a701c640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8700345b0 0x7ff870036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc1c14a0 0x5594dc1c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c4090 con 0x5594dc1c14a0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a801e640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc1c14a0 0x5594dc1c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a701c640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8700345b0 0x7ff870036a70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00c010 tx=0x7ff99c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.144+0000 7ff9a801e640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc1c14a0 0x5594dc1c3940 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 realm 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c0990 con 0x5594dc1c14a0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c4b20 con 0x5594dc1c14a0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc1c5900 0x5594dc1c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a781d640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc1c5900 0x5594dc1c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a781d640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc1c5900 0x5594dc1c7cf0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8bc0 con 0x5594dc1c5900 2024-09-11T11:01:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 20 searching for the correct realm 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5594dc1ca410 0x5594dc1cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1ccfa0 con 0x5594dc1ca410 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a701c640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5594dc1ca410 0x5594dc1cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a701c640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5594dc1ca410 0x5594dc1cc8d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.148+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1ccfa0 con 0x5594dc1c5900 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a781d640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9a011e060 0x7ff9a00f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x7ff9a011e060 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9a011e060 0x7ff9a00f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9a011e060 0x7ff9a00f64a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1ca410 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.152+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x7ff9a011e060 2024-09-11T11:01:28.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x7ff9a011e060 2024-09-11T11:01:28.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1ca410 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1ca410 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.156+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1ca410 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x7ff9a011e060 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c14a0 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x7ff9a011e060 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1ca410 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x7ff9a011e060 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1ca410 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.160+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8320 con 0x5594dc1c5900 2024-09-11T11:01:28.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:28.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:28.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:28.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:28.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:28.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c8cf0 con 0x5594dc1c14a0 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c90e0 con 0x5594dc1c5900 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1c90e0 con 0x7ff9a011e060 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 zone default found 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 4 Realm: () 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 zonegroup default 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1cd420 con 0x7ff9a011e060 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1cf1a0 con 0x5594dc1ca410 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1cf540 con 0x5594dc1ca410 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 started sync module instance, tier type = 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:28.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.164+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1ce640 con 0x5594dc1c5900 2024-09-11T11:01:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.168+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.168+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94097836403520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1ce640 con 0x5594dc1c5900 2024-09-11T11:01:28.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.168+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1cffb0 con 0x5594dc1c14a0 2024-09-11T11:01:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.168+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.168+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94097836407488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1cfee0 con 0x5594dc1c14a0 2024-09-11T11:01:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.168+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d0eb0 con 0x5594dc1c5900 2024-09-11T11:01:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.168+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94097836403520] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94097836407488] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94097836409760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d09c0 con 0x5594dc1c5900 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d1750 con 0x7ff9a011e060 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94097836413600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d09c0 con 0x7ff9a011e060 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d21f0 con 0x5594dc1c5900 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94097836409760] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94097836413600] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.172+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94097836414656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d21b0 con 0x5594dc1c5900 2024-09-11T11:01:28.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d25e0 con 0x5594dc1ca410 2024-09-11T11:01:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94097836401040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d2e80 con 0x5594dc1ca410 2024-09-11T11:01:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d3840 con 0x5594dc1ca410 2024-09-11T11:01:28.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94097836414656] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94097836401040] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94097836422032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d3c30 con 0x5594dc1ca410 2024-09-11T11:01:28.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d44c0 con 0x7ff9a011e060 2024-09-11T11:01:28.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.176+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94097836422032] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94097836416224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d40e0 con 0x7ff9a011e060 2024-09-11T11:01:28.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 20 add_watcher() i=0 2024-09-11T11:01:28.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 20 add_watcher() i=1 2024-09-11T11:01:28.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 20 add_watcher() i=2 2024-09-11T11:01:28.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 20 add_watcher() i=3 2024-09-11T11:01:28.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 20 add_watcher() i=4 2024-09-11T11:01:28.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 20 add_watcher() i=5 2024-09-11T11:01:28.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 20 add_watcher() i=6 2024-09-11T11:01:28.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94097836416224] v32'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 20 add_watcher() i=7 2024-09-11T11:01:28.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:28.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d79a0 con 0x5594dc1c14a0 2024-09-11T11:01:28.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94097836424704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1d4ec0 con 0x5594dc1c14a0 2024-09-11T11:01:28.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.180+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94097836424704] v32'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff85dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 5 note: GC not initialized 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff85cfe1640 20 reqs_thread_entry: start 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 20 Filter name: none 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff7d67fc640 20 reqs_thread_entry: start 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1faae0 con 0x7ff9a011e060 2024-09-11T11:01:28.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:28.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff85dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.184+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94097836424704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x5594dc1c14a0 2024-09-11T11:01:28.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94097836424704] v32'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94097836403520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x5594dc1c5900 2024-09-11T11:01:28.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94097836403520] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a9d0d980 20 remove_watcher() i=0 2024-09-11T11:01:28.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a9d0d980 2 removed watcher, disabling cache 2024-09-11T11:01:28.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94097836407488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x5594dc1c14a0 2024-09-11T11:01:28.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94097836407488] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x5594dc1c14a0 2024-09-11T11:01:28.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a9d0d980 20 remove_watcher() i=1 2024-09-11T11:01:28.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.188+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94097836409760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x5594dc1c5900 2024-09-11T11:01:28.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.192+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94097836409760] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.192+0000 7ff9a9d0d980 20 remove_watcher() i=2 2024-09-11T11:01:28.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.192+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94097836413600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x7ff9a011e060 2024-09-11T11:01:28.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.192+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94097836413600] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.192+0000 7ff9a9d0d980 20 remove_watcher() i=3 2024-09-11T11:01:28.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.192+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94097836414656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x5594dc1c5900 2024-09-11T11:01:28.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.200+0000 7ff9a781d640 1 -- 172.21.15.145:0/2745144564 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94097836414656] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9a011b030 con 0x5594dc1c5900 2024-09-11T11:01:28.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.200+0000 7ff9a9d0d980 20 remove_watcher() i=4 2024-09-11T11:01:28.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.200+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94097836401040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x5594dc1ca410 2024-09-11T11:01:28.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94097836401040] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 20 remove_watcher() i=5 2024-09-11T11:01:28.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94097836422032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x5594dc1ca410 2024-09-11T11:01:28.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a701c640 1 -- 172.21.15.145:0/2745144564 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94097836422032] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff99c037040 con 0x5594dc1ca410 2024-09-11T11:01:28.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 20 remove_watcher() i=6 2024-09-11T11:01:28.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94097836416224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x5594dc1f8a50 con 0x7ff9a011e060 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94097836416224] v32'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9980083f0 con 0x7ff9a011e060 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 20 remove_watcher() i=7 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc1c5900 msgr2=0x5594dc1c7cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc1c5900 0x5594dc1c7cf0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc1c14a0 msgr2=0x5594dc1c3940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc1c14a0 0x5594dc1c3940 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9a011e060 msgr2=0x7ff9a00f64a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff9a011e060 0x7ff9a00f64a0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5594dc1ca410 msgr2=0x5594dc1cc8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5594dc1ca410 0x5594dc1cc8d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8700345b0 msgr2=0x7ff870036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8700345b0 0x7ff870036a70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00c010 tx=0x7ff99c010000 comp rx=0 tx=0).stop 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 msgr2=0x5594dc1b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2745144564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1af2b0 0x5594dc1b63c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00c5b80 tx=0x7ff9a00e5f50 comp rx=0 tx=0).stop 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 reap_dead start 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a801e640 1 -- 172.21.15.145:0/2745144564 reap_dead start 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 shutdown_connections 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 >> 172.21.15.145:0/2745144564 conn(0x5594dc1ab5e0 msgr2=0x5594dc1a96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 shutdown_connections 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2745144564 wait complete. 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2001347024 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff880034650 msgr2=0x7ff880036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2001347024 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff880034650 0x7ff880036b10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5594dc1850c0 tx=0x7ff99c00f000 comp rx=0 tx=0).stop 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2001347024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1a2c20 msgr2=0x5594dc1a3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2001347024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1a2c20 0x5594dc1a3040 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0006fc0 tx=0x7ff9a00df320 comp rx=0 tx=0).stop 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2001347024 shutdown_connections 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2001347024 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff880034650 0x7ff880036b10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/2001347024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc1a2c20 0x5594dc1a3040 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.204+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2001347024 >> 172.21.15.145:0/2001347024 conn(0x5594dc193960 msgr2=0x5594dc1963e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2001347024 shutdown_connections 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/2001347024 wait complete. 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc188f00 msgr2=0x5594dc18b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5594dc188f00 0x5594dc18b2f0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc08fec0 msgr2=0x5594dc187aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5594dc08fec0 0x5594dc187aa0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5594dc18e580 msgr2=0x5594dc190970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5594dc18e580 0x5594dc190970 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8900346a0 msgr2=0x7ff890036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8900346a0 0x7ff890036b60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff99c000f70 tx=0x7ff99c001380 comp rx=0 tx=0).stop 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 msgr2=0x5594dc180ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 --2- 172.21.15.145:0/4260659215 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5594dc08f570 0x5594dc180ad0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff9a001b0d0 tx=0x7ff9a0017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a801e640 1 -- 172.21.15.145:0/4260659215 reap_dead start 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 shutdown_connections 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 >> 172.21.15.145:0/4260659215 conn(0x5594dc08b090 msgr2=0x5594dc175110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 shutdown_connections 2024-09-11T11:01:28.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.208+0000 7ff9a9d0d980 1 -- 172.21.15.145:0/4260659215 wait complete. 2024-09-11T11:01:28.220 INFO:teuthology.orchestra.run.smithi145.stdout:{"key":"bucket:myfoo","ver":{"tag":"_LO3lXw8-HsatszQGDNVlkCJ","ver":2},"mtime":"2024-09-11T11:01:27.811781Z","data":{"bucket":{"name":"myfoo","marker":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","bucket_id":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-11T11:01:26.276370Z","linked":false,"has_bucket_info":false}} 2024-09-11T11:01:28.220 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_LO3lXw8-HsatszQGDNVlkCJ', 'ver': 2}, 'mtime': '2024-09-11T11:01:27.811781Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'bucket_id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-11T11:01:26.276370Z', 'linked': False, 'has_bucket_info': False}} 2024-09-11T11:01:28.220 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '27698d38-fc40-410e-96d8-191ffc71147c.4235.1'] 2024-09-11T11:01:28.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '27698d38-fc40-410e-96d8-191ffc71147c.4235.1'] 2024-09-11T11:01:28.221 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:28.297 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:28.297 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:28.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdaf43f980 1 Processor -- start 2024-09-11T11:01:28.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdaf43f980 1 -- start start 2024-09-11T11:01:28.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdaf43f980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55a7ed9c3760 0x55a7ed9c2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdaf43f980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a7ed8d4ae0 con 0x55a7ed9c3350 2024-09-11T11:01:28.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdaf43f980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55a7ed8f8e30 con 0x55a7ed9c3760 2024-09-11T11:01:28.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdac74e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55a7ed9c3760 0x55a7ed9c2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdacf4f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55a7ed9c3350 0x55a7ed9c1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54592/0 (socket says 172.21.15.145:54592) 2024-09-11T11:01:28.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4181635183 learned_addr learned my addr 172.21.15.145:0/4181635183 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:28.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdabf4d640 1 -- 172.21.15.145:0/4181635183 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121502695 0 0) 0x55a7ed8d4ae0 con 0x55a7ed9c3350 2024-09-11T11:01:28.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdabf4d640 1 -- 172.21.15.145:0/4181635183 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd94001e20 con 0x55a7ed9c3350 2024-09-11T11:01:28.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdac74e640 1 -- 172.21.15.145:0/4181635183 >> v1:172.21.15.102:6789/0 conn(0x55a7ed9c3350 legacy=0x55a7ed9c1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.296+0000 7fbdac74e640 1 -- 172.21.15.145:0/4181635183 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7ed9c2880 con 0x55a7ed9c3760 2024-09-11T11:01:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdac74e640 1 --2- 172.21.15.145:0/4181635183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3760 0x55a7ed9c2220 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbda000a480 tx=0x7fbda001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c043df544eee7db server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdabf4d640 1 -- 172.21.15.145:0/4181635183 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda00b0070 con 0x55a7ed9c3760 2024-09-11T11:01:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdabf4d640 1 -- 172.21.15.145:0/4181635183 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda00ab540 con 0x55a7ed9c3760 2024-09-11T11:01:28.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdabf4d640 1 -- 172.21.15.145:0/4181635183 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda00ab820 con 0x55a7ed9c3760 2024-09-11T11:01:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4181635183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3760 msgr2=0x55a7ed9c2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4181635183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3760 0x55a7ed9c2220 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fbda000a480 tx=0x7fbda001b280 comp rx=0 tx=0).stop 2024-09-11T11:01:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4181635183 shutdown_connections 2024-09-11T11:01:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4181635183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3760 0x55a7ed9c2220 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4181635183 >> 172.21.15.145:0/4181635183 conn(0x55a7eda48150 msgr2=0x55a7eda4a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4181635183 shutdown_connections 2024-09-11T11:01:28.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.300+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4181635183 wait complete. 2024-09-11T11:01:28.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 Processor -- start 2024-09-11T11:01:28.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- start start 2024-09-11T11:01:28.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb39a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a7ed8fa200 con 0x55a7ed9c3350 2024-09-11T11:01:28.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb39a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb39a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50164/0 (socket says 172.21.15.145:50164) 2024-09-11T11:01:28.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdacf4f640 1 -- 172.21.15.145:0/899198439 learned_addr learned my addr 172.21.15.145:0/899198439 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdacf4f640 1 -- 172.21.15.145:0/899198439 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7edb39fd0 con 0x55a7ed9c3350 2024-09-11T11:01:28.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/899198439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb39a00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbda4006fc0 tx=0x7fbda4001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225e773a4651cb51 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbc9ae0d640 1 -- 172.21.15.145:0/899198439 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda4004530 con 0x55a7ed9c3350 2024-09-11T11:01:28.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbc9ae0d640 1 -- 172.21.15.145:0/899198439 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda40046d0 con 0x55a7ed9c3350 2024-09-11T11:01:28.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbc9ae0d640 1 -- 172.21.15.145:0/899198439 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda4004a70 con 0x55a7ed9c3350 2024-09-11T11:01:28.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- 172.21.15.145:0/899198439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 msgr2=0x55a7edb39a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/899198439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb39a00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbda4006fc0 tx=0x7fbda4001af0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- 172.21.15.145:0/899198439 shutdown_connections 2024-09-11T11:01:28.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/899198439 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb39a00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- 172.21.15.145:0/899198439 >> 172.21.15.145:0/899198439 conn(0x55a7eda48150 msgr2=0x55a7edb35630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- 172.21.15.145:0/899198439 shutdown_connections 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- 172.21.15.145:0/899198439 wait complete. 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 Processor -- start 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- start start 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb40e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.316+0000 7fbdaf43f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a7eda581a0 con 0x55a7ed9c3350 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb40e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb40e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50170/0 (socket says 172.21.15.145:50170) 2024-09-11T11:01:28.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdacf4f640 1 -- 172.21.15.145:0/2944039776 learned_addr learned my addr 172.21.15.145:0/2944039776 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdacf4f640 1 -- 172.21.15.145:0/2944039776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7edb41350 con 0x55a7ed9c3350 2024-09-11T11:01:28.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb40e10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbda4002260 tx=0x7fbda4000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbc9960a640 1 -- 172.21.15.145:0/2944039776 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda4013760 con 0x55a7ed9c3350 2024-09-11T11:01:28.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbc9960a640 1 -- 172.21.15.145:0/2944039776 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda4013900 con 0x55a7ed9c3350 2024-09-11T11:01:28.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7edb415e0 con 0x55a7ed9c3350 2024-09-11T11:01:28.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbc9960a640 1 -- 172.21.15.145:0/2944039776 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda4013c00 con 0x55a7ed9c3350 2024-09-11T11:01:28.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7edb442c0 con 0x55a7ed9c3350 2024-09-11T11:01:28.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbc9960a640 1 -- 172.21.15.145:0/2944039776 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbda4010070 con 0x55a7ed9c3350 2024-09-11T11:01:28.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbc9960a640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc94034650 0x7fbc94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbc9960a640 1 -- 172.21.15.145:0/2944039776 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fbda4018070 con 0x55a7ed9c3350 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdac74e640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc94034650 0x7fbc94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7ed9c3760 0x55a7edb47da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb483f0 con 0x55a7ed9c3760 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdad750640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7ed9c3760 0x55a7edb47da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdac74e640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc94034650 0x7fbc94036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbda00ad000 tx=0x7fbda00a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.320+0000 7fbdad750640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7ed9c3760 0x55a7edb47da0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdad750640 1 -- 172.21.15.145:0/2944039776 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7ed9c3760 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb491c0 0x55a7edb4b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb4bbf0 con 0x55a7edb491c0 2024-09-11T11:01:28.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb491c0 0x55a7edb4b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb491c0 0x55a7edb4b5b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdacf4f640 1 -- 172.21.15.145:0/2944039776 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbda401b030 con 0x55a7edb491c0 2024-09-11T11:01:28.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb4d4a0 con 0x55a7edb491c0 2024-09-11T11:01:28.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdacf4f640 1 -- 172.21.15.145:0/2944039776 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbda401b030 con 0x55a7edb491c0 2024-09-11T11:01:28.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb4c6d0 con 0x55a7edb491c0 2024-09-11T11:01:28.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdacf4f640 1 -- 172.21.15.145:0/2944039776 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbda401b030 con 0x55a7edb491c0 2024-09-11T11:01:28.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a7edb4e850 0x55a7edb50c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb51180 con 0x55a7edb4e850 2024-09-11T11:01:28.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdac74e640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a7edb4e850 0x55a7edb50c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdac74e640 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a7edb4e850 0x55a7edb50c40 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.324+0000 7fbdac74e640 1 -- 172.21.15.145:0/2944039776 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbda00b3040 con 0x55a7edb4e850 2024-09-11T11:01:28.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 Processor -- start 2024-09-11T11:01:28.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 -- start start 2024-09-11T11:01:28.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb5ec10 0x55a7edb5f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a7ed953800 con 0x55a7edb5ec10 2024-09-11T11:01:28.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb5ec10 0x55a7edb5f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb5ec10 0x55a7edb5f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50184/0 (socket says 172.21.15.145:50184) 2024-09-11T11:01:28.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdacf4f640 1 -- 172.21.15.145:0/499628156 learned_addr learned my addr 172.21.15.145:0/499628156 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdacf4f640 1 -- 172.21.15.145:0/499628156 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7edb5f570 con 0x55a7edb5ec10 2024-09-11T11:01:28.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/499628156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb5ec10 0x55a7edb5f030 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbda40484a0 tx=0x7fbda4010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbc927fc640 1 -- 172.21.15.145:0/499628156 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda40128f0 con 0x55a7edb5ec10 2024-09-11T11:01:28.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbc927fc640 1 -- 172.21.15.145:0/499628156 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda4029470 con 0x55a7edb5ec10 2024-09-11T11:01:28.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbc927fc640 1 -- 172.21.15.145:0/499628156 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda4029770 con 0x55a7edb5ec10 2024-09-11T11:01:28.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 -- 172.21.15.145:0/499628156 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7edb5f7a0 con 0x55a7edb5ec10 2024-09-11T11:01:28.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 -- 172.21.15.145:0/499628156 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7edb62420 con 0x55a7edb5ec10 2024-09-11T11:01:28.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbc927fc640 1 -- 172.21.15.145:0/499628156 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbda4051060 con 0x55a7edb5ec10 2024-09-11T11:01:28.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbc927fc640 1 --2- 172.21.15.145:0/499628156 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc84034600 0x7fbc84036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbc927fc640 1 -- 172.21.15.145:0/499628156 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fbda404f070 con 0x55a7edb5ec10 2024-09-11T11:01:28.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdac74e640 1 --2- 172.21.15.145:0/499628156 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc84034600 0x7fbc84036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 Processor -- start 2024-09-11T11:01:28.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 -- start start 2024-09-11T11:01:28.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdac74e640 1 --2- 172.21.15.145:0/499628156 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc84034600 0x7fbc84036ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbda001b2c0 tx=0x7fbda0005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.328+0000 7fbdaf43f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb6b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a7edb3a350 con 0x55a7edb6b4f0 2024-09-11T11:01:28.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb6b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb6b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50190/0 (socket says 172.21.15.145:50190) 2024-09-11T11:01:28.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 -- 172.21.15.145:0/2606220123 learned_addr learned my addr 172.21.15.145:0/2606220123 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 -- 172.21.15.145:0/2606220123 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7edb6bea0 con 0x55a7edb6b4f0 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/2606220123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb6b8d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbda403fb60 tx=0x7fbda4020e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11444ae7f012b26d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbc83fff640 1 -- 172.21.15.145:0/2606220123 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda4063070 con 0x55a7edb6b4f0 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbc83fff640 1 -- 172.21.15.145:0/2606220123 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda4033d30 con 0x55a7edb6b4f0 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbc83fff640 1 -- 172.21.15.145:0/2606220123 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda404e070 con 0x55a7edb6b4f0 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2606220123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 msgr2=0x55a7edb6b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2606220123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb6b8d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbda403fb60 tx=0x7fbda4020e10 comp rx=0 tx=0).stop 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2606220123 shutdown_connections 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2606220123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb6b8d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2606220123 >> 172.21.15.145:0/2606220123 conn(0x55a7edb678d0 msgr2=0x55a7edb659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2606220123 shutdown_connections 2024-09-11T11:01:28.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2606220123 wait complete. 2024-09-11T11:01:28.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 Processor -- start 2024-09-11T11:01:28.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- start start 2024-09-11T11:01:28.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb72750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a7edb6c340 con 0x55a7edb6b4f0 2024-09-11T11:01:28.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb72750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb72750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50202/0 (socket says 172.21.15.145:50202) 2024-09-11T11:01:28.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 learned_addr learned my addr 172.21.15.145:0/4165076850 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7edb72c90 con 0x55a7edb6b4f0 2024-09-11T11:01:28.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb72750 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbda40472c0 tx=0x7fbda4025f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbc827fc640 1 -- 172.21.15.145:0/4165076850 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda406d070 con 0x55a7edb6b4f0 2024-09-11T11:01:28.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a7edb72c90 con 0x55a7edb6b4f0 2024-09-11T11:01:28.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbc827fc640 1 -- 172.21.15.145:0/4165076850 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda40115d0 con 0x55a7edb6b4f0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.332+0000 7fbc827fc640 1 -- 172.21.15.145:0/4165076850 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbda4063040 con 0x55a7edb6b4f0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7edb72c90 con 0x55a7edb6b4f0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbc827fc640 1 -- 172.21.15.145:0/4165076850 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbda4070070 con 0x55a7edb6b4f0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbc827fc640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc78034650 0x7fbc78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbc827fc640 1 -- 172.21.15.145:0/4165076850 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fbda4059030 con 0x55a7edb6b4f0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdac74e640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc78034650 0x7fbc78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7edb7d6d0 0x55a7edb7fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb802e0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdad750640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7edb7d6d0 0x55a7edb7fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdac74e640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc78034650 0x7fbc78036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbda0018eb0 tx=0x7fbda00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdad750640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7edb7d6d0 0x55a7edb7fb90 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 20 realm 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb7cb50 con 0x55a7edb7d6d0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb80d70 con 0x55a7edb7d6d0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb81b50 0x55a7edb83f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb845d0 con 0x55a7edb81b50 2024-09-11T11:01:28.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb81b50 0x55a7edb83f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.336+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb81b50 0x55a7edb83f40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdaf43f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdaf43f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdaf43f980 20 searching for the correct realm 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a7edb86b90 0x55a7edb88f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb89600 con 0x55a7edb86b90 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdac74e640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a7edb86b90 0x55a7edb88f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdac74e640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a7edb86b90 0x55a7edb88f80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb89600 con 0x55a7edb81b50 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdacf4f640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbda4072070 0x7fbda4041050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x7fbda4072070 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdad750640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbda4072070 0x7fbda4041050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdad750640 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbda4072070 0x7fbda4041050 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.340+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb86b90 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x7fbda4072070 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x7fbda4072070 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb86b90 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.344+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb86b90 2024-09-11T11:01:28.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb86b90 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x7fbda4072070 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb7d6d0 2024-09-11T11:01:28.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x7fbda4072070 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb86b90 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x7fbda4072070 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb86b90 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.348+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb84e20 con 0x55a7edb81b50 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:28.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb85670 con 0x55a7edb7d6d0 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb85a60 con 0x55a7edb81b50 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb85a60 con 0x7fbda4072070 2024-09-11T11:01:28.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 zone default found 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 4 Realm: () 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 zonegroup default 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb89a60 con 0x7fbda4072070 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8b870 con 0x55a7edb86b90 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8bd00 con 0x55a7edb86b90 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 started sync module instance, tier type = 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.352+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8ac80 con 0x55a7edb81b50 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.356+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.356+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94179736203728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8ac80 con 0x55a7edb81b50 2024-09-11T11:01:28.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.356+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8c7c0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.356+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.356+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94179736208080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8c6f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.356+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8d6c0 con 0x55a7edb81b50 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.356+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94179736203728] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.356+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94179736208080] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94179736210352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8d1d0 con 0x55a7edb81b50 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8df60 con 0x7fbda4072070 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94179736214192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8d1d0 con 0x7fbda4072070 2024-09-11T11:01:28.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8ea20 con 0x55a7edb81b50 2024-09-11T11:01:28.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94179736214192] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94179736210352] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94179736201168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8e9e0 con 0x55a7edb81b50 2024-09-11T11:01:28.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.360+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8ee10 con 0x55a7edb86b90 2024-09-11T11:01:28.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94179736215248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8f660 con 0x55a7edb86b90 2024-09-11T11:01:28.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb90060 con 0x55a7edb86b90 2024-09-11T11:01:28.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94179736215248] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94179736220080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb90900 con 0x55a7edb86b90 2024-09-11T11:01:28.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb91190 con 0x7fbda4072070 2024-09-11T11:01:28.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94179736201168] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94179736220080] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94179736216816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb91580 con 0x7fbda4072070 2024-09-11T11:01:28.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 20 add_watcher() i=0 2024-09-11T11:01:28.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 20 add_watcher() i=1 2024-09-11T11:01:28.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 20 add_watcher() i=2 2024-09-11T11:01:28.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 20 add_watcher() i=3 2024-09-11T11:01:28.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 20 add_watcher() i=4 2024-09-11T11:01:28.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 20 add_watcher() i=5 2024-09-11T11:01:28.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.364+0000 7fbdaf43f980 20 add_watcher() i=6 2024-09-11T11:01:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94179736216816] v32'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 20 add_watcher() i=7 2024-09-11T11:01:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb90480 con 0x55a7edb7d6d0 2024-09-11T11:01:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94179736226976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb90480 con 0x55a7edb7d6d0 2024-09-11T11:01:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94179736226976] v32'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbc62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 5 note: GC not initialized 2024-09-11T11:01:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbc61fe3640 20 reqs_thread_entry: start 2024-09-11T11:01:28.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 20 Filter name: none 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbbd37fe640 20 reqs_thread_entry: start 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbb7c20 con 0x7fbda4072070 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.368+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbb7740 con 0x7fbda4072070 2024-09-11T11:01:28.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbbb4e0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(64 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:28.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-11T11:01:28.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbbfa40 con 0x7fbda4072070 2024-09-11T11:01:28.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(65 foo.buckets [call] v32'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbc59c0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(66 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:28.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1, ofs0, ns] 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94179736399248 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbbfe70 con 0x55a7edb81b50 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94179736201168 notify 137438953491 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55a7edb5f7a0 con 0x55a7edb81b50 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.372+0000 7fbc83fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953491 cookie 94179736201168 notifier 4507 bl.length()=752 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbc83fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbc83fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbc83fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbc83fff640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbc70003eb0 con 0x55a7edb81b50 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.4 [notify cookie 94179736399248 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94179736399248 notify 137438953491 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a7edb5f570 con 0x55a7edb81b50 2024-09-11T11:01:28.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_sources= new_sources= 2024-09-11T11:01:28.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential sources added=[] removed=[] 2024-09-11T11:01:28.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_dests= new_dests= 2024-09-11T11:01:28.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential dests added=[] removed=[] 2024-09-11T11:01:28.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbc4160 con 0x55a7edb7d6d0 2024-09-11T11:01:28.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(69 fud.buckets [call] v32'3 uv3 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbc5170 con 0x7fbda4072070 2024-09-11T11:01:28.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-11T11:01:28.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-11T11:01:28.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94179736437088 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbc4580 con 0x55a7edb86b90 2024-09-11T11:01:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== watch-notify(notify (1) cookie 94179736220080 notify 137438953475 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7fbda00b6510 con 0x55a7edb86b90 2024-09-11T11:01:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbc837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953475 cookie 94179736220080 notifier 4507 bl.length()=314 2024-09-11T11:01:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbc837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-11T11:01:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbc837fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbc837fe640 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fbbe0003410 con 0x55a7edb86b90 2024-09-11T11:01:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.376+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(71 notify.6 [notify cookie 94179736437088 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.380+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.380+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== watch-notify(notify_complete (2) cookie 94179736437088 notify 137438953475 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbda00b67b0 con 0x55a7edb86b90 2024-09-11T11:01:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.380+0000 7fbc62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.380+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94179736226976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbb5a50 con 0x55a7edb7d6d0 2024-09-11T11:01:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.380+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94179736226976] v32'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.380+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94179736203728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbb5a50 con 0x55a7edb81b50 2024-09-11T11:01:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.384+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94179736203728] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.384+0000 7fbdaf43f980 20 remove_watcher() i=0 2024-09-11T11:01:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.384+0000 7fbdaf43f980 2 removed watcher, disabling cache 2024-09-11T11:01:28.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.384+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94179736208080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbb5a50 con 0x55a7edb7d6d0 2024-09-11T11:01:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.384+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94179736208080] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x55a7edb7d6d0 2024-09-11T11:01:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.384+0000 7fbdaf43f980 20 remove_watcher() i=1 2024-09-11T11:01:28.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.384+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94179736210352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8c2d0 con 0x55a7edb81b50 2024-09-11T11:01:28.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94179736210352] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdaf43f980 20 remove_watcher() i=2 2024-09-11T11:01:28.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94179736214192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbb5a50 con 0x7fbda4072070 2024-09-11T11:01:28.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94179736214192] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdaf43f980 20 remove_watcher() i=3 2024-09-11T11:01:28.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94179736201168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8cbb0 con 0x55a7edb81b50 2024-09-11T11:01:28.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdacf4f640 1 -- 172.21.15.145:0/4165076850 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94179736201168] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda4079070 con 0x55a7edb81b50 2024-09-11T11:01:28.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdaf43f980 20 remove_watcher() i=4 2024-09-11T11:01:28.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.388+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94179736215248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8c2d0 con 0x55a7edb86b90 2024-09-11T11:01:28.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94179736215248] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 20 remove_watcher() i=5 2024-09-11T11:01:28.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94179736220080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edbb5a50 con 0x55a7edb86b90 2024-09-11T11:01:28.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdac74e640 1 -- 172.21.15.145:0/4165076850 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94179736220080] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbda00d8070 con 0x55a7edb86b90 2024-09-11T11:01:28.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 20 remove_watcher() i=6 2024-09-11T11:01:28.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94179736216816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55a7edb8cbb0 con 0x7fbda4072070 2024-09-11T11:01:28.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94179736216816] v32'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbd9c0083f0 con 0x7fbda4072070 2024-09-11T11:01:28.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 20 remove_watcher() i=7 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb81b50 msgr2=0x55a7edb83f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb81b50 0x55a7edb83f40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7edb7d6d0 msgr2=0x55a7edb7fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7edb7d6d0 0x55a7edb7fb90 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbda4072070 msgr2=0x7fbda4041050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbda4072070 0x7fbda4041050 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a7edb86b90 msgr2=0x55a7edb88f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a7edb86b90 0x55a7edb88f80 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc78034650 msgr2=0x7fbc78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc78034650 0x7fbc78036b10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbda0018eb0 tx=0x7fbda00a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:28.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdad750640 1 -- 172.21.15.145:0/4165076850 reap_dead start 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 msgr2=0x55a7edb72750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb72750 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbda40472c0 tx=0x7fbda4025f20 comp rx=0 tx=0).stop 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 shutdown_connections 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/4165076850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb6b4f0 0x55a7edb72750 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 >> 172.21.15.145:0/4165076850 conn(0x55a7edb678d0 msgr2=0x55a7edb659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 shutdown_connections 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/4165076850 wait complete. 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/499628156 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc84034600 msgr2=0x7fbc84036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/499628156 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc84034600 0x7fbc84036ac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbda001b2c0 tx=0x7fbda0005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/499628156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb5ec10 msgr2=0x55a7edb5f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/499628156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb5ec10 0x55a7edb5f030 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbda40484a0 tx=0x7fbda4010d50 comp rx=0 tx=0).stop 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/499628156 shutdown_connections 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/499628156 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc84034600 0x7fbc84036ac0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/499628156 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7edb5ec10 0x55a7edb5f030 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/499628156 >> 172.21.15.145:0/499628156 conn(0x55a7edb53d60 msgr2=0x55a7edb567e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/499628156 shutdown_connections 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/499628156 wait complete. 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb491c0 msgr2=0x55a7edb4b5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a7edb491c0 0x55a7edb4b5b0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7ed9c3760 msgr2=0x55a7edb47da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a7ed9c3760 0x55a7edb47da0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a7edb4e850 msgr2=0x55a7edb50c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a7edb4e850 0x55a7edb50c40 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc94034650 msgr2=0x7fbc94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbc94034650 0x7fbc94036b10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbda00ad000 tx=0x7fbda00a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 msgr2=0x55a7edb40e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 --2- 172.21.15.145:0/2944039776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a7ed9c3350 0x55a7edb40e10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbda4002260 tx=0x7fbda4000f50 comp rx=0 tx=0).stop 2024-09-11T11:01:28.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdad750640 1 -- 172.21.15.145:0/2944039776 reap_dead start 2024-09-11T11:01:28.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 shutdown_connections 2024-09-11T11:01:28.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 >> 172.21.15.145:0/2944039776 conn(0x55a7eda48150 msgr2=0x55a7edb341b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 shutdown_connections 2024-09-11T11:01:28.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.392+0000 7fbdaf43f980 1 -- 172.21.15.145:0/2944039776 wait complete. 2024-09-11T11:01:28.406 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-11T11:01:28.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-11T11:01:28.406 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-11T11:01:28.481 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:28.482 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:28.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dd1221980 1 Processor -- start 2024-09-11T11:01:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dd1221980 1 -- start start 2024-09-11T11:01:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dd1221980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564a387a5ac0 0x564a387a7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dd1221980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564a38629ae0 con 0x564a38716290 2024-09-11T11:01:28.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dd1221980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x564a3864de30 con 0x564a387a5ac0 2024-09-11T11:01:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dce530640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564a387a5ac0 0x564a387a7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dced31640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x564a38716290 0x564a387a43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54604/0 (socket says 172.21.15.145:54604) 2024-09-11T11:01:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dced31640 1 -- 172.21.15.145:0/1101159976 learned_addr learned my addr 172.21.15.145:0/1101159976 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dcdd2f640 1 -- 172.21.15.145:0/1101159976 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495083672 0 0) 0x564a38629ae0 con 0x564a38716290 2024-09-11T11:01:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dcdd2f640 1 -- 172.21.15.145:0/1101159976 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6db8001e20 con 0x564a38716290 2024-09-11T11:01:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dce530640 1 -- 172.21.15.145:0/1101159976 >> v1:172.21.15.102:6789/0 conn(0x564a38716290 legacy=0x564a387a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.480+0000 7f6dce530640 1 -- 172.21.15.145:0/1101159976 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a38716820 con 0x564a387a5ac0 2024-09-11T11:01:28.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dce530640 1 --2- 172.21.15.145:0/1101159976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a387a5ac0 0x564a387a7eb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400a480 tx=0x7f6dc401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9354a464e7fd46 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dcdd2f640 1 -- 172.21.15.145:0/1101159976 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc40b0070 con 0x564a387a5ac0 2024-09-11T11:01:28.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dcdd2f640 1 -- 172.21.15.145:0/1101159976 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc40ab540 con 0x564a387a5ac0 2024-09-11T11:01:28.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dcdd2f640 1 -- 172.21.15.145:0/1101159976 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc40ab820 con 0x564a387a5ac0 2024-09-11T11:01:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dd1221980 1 -- 172.21.15.145:0/1101159976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a387a5ac0 msgr2=0x564a387a7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1101159976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a387a5ac0 0x564a387a7eb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400a480 tx=0x7f6dc401b280 comp rx=0 tx=0).stop 2024-09-11T11:01:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dd1221980 1 -- 172.21.15.145:0/1101159976 shutdown_connections 2024-09-11T11:01:28.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1101159976 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a387a5ac0 0x564a387a7eb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dd1221980 1 -- 172.21.15.145:0/1101159976 >> 172.21.15.145:0/1101159976 conn(0x564a3879c090 msgr2=0x564a3879e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dd1221980 1 -- 172.21.15.145:0/1101159976 shutdown_connections 2024-09-11T11:01:28.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.484+0000 7f6dd1221980 1 -- 172.21.15.145:0/1101159976 wait complete. 2024-09-11T11:01:28.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.496+0000 7f6dd1221980 1 Processor -- start 2024-09-11T11:01:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.496+0000 7f6dd1221980 1 -- start start 2024-09-11T11:01:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.496+0000 7f6dd1221980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a3888c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.496+0000 7f6dd1221980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a3864f200 con 0x564a38716290 2024-09-11T11:01:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a3888c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a3888c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50210/0 (socket says 172.21.15.145:50210) 2024-09-11T11:01:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 -- 172.21.15.145:0/401448643 learned_addr learned my addr 172.21.15.145:0/401448643 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 -- 172.21.15.145:0/401448643 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a3888cdd0 con 0x564a38716290 2024-09-11T11:01:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 --2- 172.21.15.145:0/401448643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a3888c800 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8006fc0 tx=0x7f6dc8001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61efbaf77bfa5ebf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6cbce09640 1 -- 172.21.15.145:0/401448643 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc8004530 con 0x564a38716290 2024-09-11T11:01:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6cbce09640 1 -- 172.21.15.145:0/401448643 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc80046d0 con 0x564a38716290 2024-09-11T11:01:28.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6cbce09640 1 -- 172.21.15.145:0/401448643 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc8004a70 con 0x564a38716290 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 -- 172.21.15.145:0/401448643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 msgr2=0x564a3888c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 --2- 172.21.15.145:0/401448643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a3888c800 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8006fc0 tx=0x7f6dc8001af0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 -- 172.21.15.145:0/401448643 shutdown_connections 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 --2- 172.21.15.145:0/401448643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a3888c800 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 -- 172.21.15.145:0/401448643 >> 172.21.15.145:0/401448643 conn(0x564a3879c090 msgr2=0x564a38888430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 -- 172.21.15.145:0/401448643 shutdown_connections 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 -- 172.21.15.145:0/401448643 wait complete. 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 Processor -- start 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 -- start start 2024-09-11T11:01:28.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a38893b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dd1221980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a387a8f00 con 0x564a38716290 2024-09-11T11:01:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a38893b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a38893b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50226/0 (socket says 172.21.15.145:50226) 2024-09-11T11:01:28.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 -- 172.21.15.145:0/1514280780 learned_addr learned my addr 172.21.15.145:0/1514280780 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 -- 172.21.15.145:0/1514280780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a388940b0 con 0x564a38716290 2024-09-11T11:01:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.500+0000 7f6dced31640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a38893b70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8002260 tx=0x7f6dc8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6cbb606640 1 -- 172.21.15.145:0/1514280780 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc8013760 con 0x564a38716290 2024-09-11T11:01:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6cbb606640 1 -- 172.21.15.145:0/1514280780 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8013900 con 0x564a38716290 2024-09-11T11:01:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a38894340 con 0x564a38716290 2024-09-11T11:01:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6cbb606640 1 -- 172.21.15.145:0/1514280780 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc8013c00 con 0x564a38716290 2024-09-11T11:01:28.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a38897020 con 0x564a38716290 2024-09-11T11:01:28.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6cbb606640 1 -- 172.21.15.145:0/1514280780 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6dc8010070 con 0x564a38716290 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6cbb606640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6cb4034650 0x7f6cb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6cbb606640 1 -- 172.21.15.145:0/1514280780 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6dc8018070 con 0x564a38716290 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dce530640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6cb4034650 0x7f6cb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a387a5ac0 0x564a3889ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a3889b140 con 0x564a387a5ac0 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dcf532640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a387a5ac0 0x564a3889ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dce530640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6cb4034650 0x7f6cb4036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40ad000 tx=0x7f6dc40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dcf532640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a387a5ac0 0x564a3889ab00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dcf532640 1 -- 172.21.15.145:0/1514280780 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a387a5ac0 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a3889bf10 0x564a3889e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a3889e940 con 0x564a3889bf10 2024-09-11T11:01:28.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dced31640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a3889bf10 0x564a3889e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.504+0000 7f6dced31640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a3889bf10 0x564a3889e300 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dced31640 1 -- 172.21.15.145:0/1514280780 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dc801b030 con 0x564a3889bf10 2024-09-11T11:01:28.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388a01f0 con 0x564a3889bf10 2024-09-11T11:01:28.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dced31640 1 -- 172.21.15.145:0/1514280780 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6dc801b030 con 0x564a3889bf10 2024-09-11T11:01:28.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a3889f420 con 0x564a3889bf10 2024-09-11T11:01:28.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dced31640 1 -- 172.21.15.145:0/1514280780 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dc801b030 con 0x564a3889bf10 2024-09-11T11:01:28.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564a388a15a0 0x564a388a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388a3ed0 con 0x564a388a15a0 2024-09-11T11:01:28.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dce530640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564a388a15a0 0x564a388a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dce530640 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564a388a15a0 0x564a388a3990 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dce530640 1 -- 172.21.15.145:0/1514280780 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6dc40b3040 con 0x564a388a15a0 2024-09-11T11:01:28.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dd1221980 1 Processor -- start 2024-09-11T11:01:28.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dd1221980 1 -- start start 2024-09-11T11:01:28.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dd1221980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388b1960 0x564a388b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dd1221980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a386a8800 con 0x564a388b1960 2024-09-11T11:01:28.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388b1960 0x564a388b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388b1960 0x564a388b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50236/0 (socket says 172.21.15.145:50236) 2024-09-11T11:01:28.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dced31640 1 -- 172.21.15.145:0/1954297965 learned_addr learned my addr 172.21.15.145:0/1954297965 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.508+0000 7f6dced31640 1 -- 172.21.15.145:0/1954297965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a388b22c0 con 0x564a388b1960 2024-09-11T11:01:28.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dced31640 1 --2- 172.21.15.145:0/1954297965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388b1960 0x564a388b1d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80484a0 tx=0x7f6dc8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb8e01640 1 -- 172.21.15.145:0/1954297965 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc80128f0 con 0x564a388b1960 2024-09-11T11:01:28.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb8e01640 1 -- 172.21.15.145:0/1954297965 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8029470 con 0x564a388b1960 2024-09-11T11:01:28.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dd1221980 1 -- 172.21.15.145:0/1954297965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a388b24f0 con 0x564a388b1960 2024-09-11T11:01:28.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb8e01640 1 -- 172.21.15.145:0/1954297965 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc8029770 con 0x564a388b1960 2024-09-11T11:01:28.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dd1221980 1 -- 172.21.15.145:0/1954297965 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a388b5170 con 0x564a388b1960 2024-09-11T11:01:28.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb8e01640 1 -- 172.21.15.145:0/1954297965 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6dc8051060 con 0x564a388b1960 2024-09-11T11:01:28.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb8e01640 1 --2- 172.21.15.145:0/1954297965 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6ca8034650 0x7f6ca8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb8e01640 1 -- 172.21.15.145:0/1954297965 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6dc804f070 con 0x564a388b1960 2024-09-11T11:01:28.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dce530640 1 --2- 172.21.15.145:0/1954297965 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6ca8034650 0x7f6ca8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dd1221980 1 Processor -- start 2024-09-11T11:01:28.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dd1221980 1 -- start start 2024-09-11T11:01:28.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dce530640 1 --2- 172.21.15.145:0/1954297965 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6ca8034650 0x7f6ca8036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400a480 tx=0x7f6dc4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dd1221980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388be670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dd1221980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a3888d150 con 0x564a388be270 2024-09-11T11:01:28.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388be670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50246/0 (socket says 172.21.15.145:50246) 2024-09-11T11:01:28.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dced31640 1 -- 172.21.15.145:0/2667404052 learned_addr learned my addr 172.21.15.145:0/2667404052 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dced31640 1 -- 172.21.15.145:0/2667404052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a388bec40 con 0x564a388be270 2024-09-11T11:01:28.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6dced31640 1 --2- 172.21.15.145:0/2667404052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388be670 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8012f90 tx=0x7f6dc803f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d771b707f78b6dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb27fc640 1 -- 172.21.15.145:0/2667404052 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc8063070 con 0x564a388be270 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb27fc640 1 -- 172.21.15.145:0/2667404052 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8034dd0 con 0x564a388be270 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.512+0000 7f6cb27fc640 1 -- 172.21.15.145:0/2667404052 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc804e070 con 0x564a388be270 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- 172.21.15.145:0/2667404052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 msgr2=0x564a388be670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 --2- 172.21.15.145:0/2667404052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388be670 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8012f90 tx=0x7f6dc803f770 comp rx=0 tx=0).stop 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- 172.21.15.145:0/2667404052 shutdown_connections 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 --2- 172.21.15.145:0/2667404052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388be670 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- 172.21.15.145:0/2667404052 >> 172.21.15.145:0/2667404052 conn(0x564a388ba650 msgr2=0x564a388b8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- 172.21.15.145:0/2667404052 shutdown_connections 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- 172.21.15.145:0/2667404052 wait complete. 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 Processor -- start 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- start start 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564a388bf060 con 0x564a388be270 2024-09-11T11:01:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dced31640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50254/0 (socket says 172.21.15.145:50254) 2024-09-11T11:01:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 learned_addr learned my addr 172.21.15.145:0/3506921324 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a388c5a10 con 0x564a388be270 2024-09-11T11:01:28.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dced31640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388c54d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80472c0 tx=0x7f6dc8025f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6cb0ff9640 1 -- 172.21.15.145:0/3506921324 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc806d070 con 0x564a388be270 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6cb0ff9640 1 -- 172.21.15.145:0/3506921324 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc80115d0 con 0x564a388be270 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a388c5a10 con 0x564a388be270 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6cb0ff9640 1 -- 172.21.15.145:0/3506921324 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6dc8063040 con 0x564a388be270 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a388c5a10 con 0x564a388be270 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6cb0ff9640 1 -- 172.21.15.145:0/3506921324 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6dc8070070 con 0x564a388be270 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.516+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6cb0ff9640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c98034650 0x7f6c98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6cb0ff9640 1 -- 172.21.15.145:0/3506921324 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f6dc8059030 con 0x564a388be270 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dce530640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c98034650 0x7f6c98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a388d03b0 0x564a388d2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388d2fa0 con 0x564a388d03b0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dcf532640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a388d03b0 0x564a388d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dce530640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c98034650 0x7f6c98036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40ab510 tx=0x7f6dc40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dcf532640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a388d03b0 0x564a388d2850 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 realm 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388cf8a0 con 0x564a388d03b0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:28.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388d3a60 con 0x564a388d03b0 2024-09-11T11:01:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a388d4840 0x564a388d6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388d72c0 con 0x564a388d4840 2024-09-11T11:01:28.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dced31640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a388d4840 0x564a388d6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dced31640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a388d4840 0x564a388d6c30 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 20 searching for the correct realm 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564a388d9880 0x564a388dbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388dc2f0 con 0x564a388d9880 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.520+0000 7f6dce530640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564a388d9880 0x564a388dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dce530640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564a388d9880 0x564a388dbc70 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388dc2f0 con 0x564a388d4840 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dced31640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6dc8072070 0x7f6dc8041050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x7f6dc8072070 2024-09-11T11:01:28.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6dc8072070 0x7f6dc8041050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6dc8072070 0x7f6dc8041050 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d9880 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.524+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x7f6dc8072070 2024-09-11T11:01:28.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x7f6dc8072070 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d9880 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d9880 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d9880 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x7f6dc8072070 2024-09-11T11:01:28.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.528+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d03b0 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x7f6dc8072070 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d9880 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x7f6dc8072070 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d9880 2024-09-11T11:01:28.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564a388d7b10 con 0x564a388d4840 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388d8360 con 0x564a388d03b0 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.532+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388d8750 con 0x564a388d4840 2024-09-11T11:01:28.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388d8750 con 0x7f6dc8072070 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 zone default found 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 4 Realm: () 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 zonegroup default 2024-09-11T11:01:28.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388dc750 con 0x7f6dc8072070 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388d8c30 con 0x564a388d9880 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388dea80 con 0x564a388d9880 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 started sync module instance, tier type = 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:28.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388dde10 con 0x564a388d4840 2024-09-11T11:01:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94876776391472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388dde10 con 0x564a388d4840 2024-09-11T11:01:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.536+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388df500 con 0x564a388d03b0 2024-09-11T11:01:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94876776394832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388df920 con 0x564a388d03b0 2024-09-11T11:01:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e0360 con 0x564a388d4840 2024-09-11T11:01:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94876776391472] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94876776394832] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94876776398384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388df470 con 0x564a388d4840 2024-09-11T11:01:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e0c00 con 0x7f6dc8072070 2024-09-11T11:01:28.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94876776400720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388df470 con 0x7f6dc8072070 2024-09-11T11:01:28.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.540+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e16a0 con 0x564a388d4840 2024-09-11T11:01:28.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.544+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94876776398384] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.544+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94876776400720] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.544+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.544+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94876776401776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e1660 con 0x564a388d4840 2024-09-11T11:01:28.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.544+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e1a90 con 0x564a388d9880 2024-09-11T11:01:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.544+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.544+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94876776388960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e2330 con 0x564a388d9880 2024-09-11T11:01:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.544+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e2cf0 con 0x564a388d9880 2024-09-11T11:01:28.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94876776401776] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94876776388960] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94876776409152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e30e0 con 0x564a388d9880 2024-09-11T11:01:28.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e3930 con 0x7f6dc8072070 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94876776411840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e3d10 con 0x7f6dc8072070 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 20 add_watcher() i=0 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 20 add_watcher() i=1 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 20 add_watcher() i=2 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 20 add_watcher() i=3 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 20 add_watcher() i=4 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 20 add_watcher() i=5 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94876776409152] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 20 add_watcher() i=6 2024-09-11T11:01:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94876776411840] v32'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 20 add_watcher() i=7 2024-09-11T11:01:28.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:28.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388e1190 con 0x564a388d03b0 2024-09-11T11:01:28.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.548+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94876776413088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e1190 con 0x564a388d03b0 2024-09-11T11:01:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.552+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94876776413088] v32'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.552+0000 7f6c857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.552+0000 7f6dd1221980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.552+0000 7f6dd1221980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:28.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.552+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ef6f0 con 0x564a388d4840 2024-09-11T11:01:28.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.552+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.552+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ef7a0 con 0x7f6dc8072070 2024-09-11T11:01:28.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.552+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.556+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388efe40 con 0x564a388d9880 2024-09-11T11:01:28.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.556+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.556+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f0240 con 0x564a388d03b0 2024-09-11T11:01:28.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.556+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'113 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.556+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f07b0 con 0x564a388d4840 2024-09-11T11:01:28.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.560+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.560+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f07b0 con 0x564a388d9880 2024-09-11T11:01:28.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.560+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.560+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f0d20 con 0x564a388d4840 2024-09-11T11:01:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.564+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.564+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f11d0 con 0x564a388d03b0 2024-09-11T11:01:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.564+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.564+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f11d0 con 0x564a388d4840 2024-09-11T11:01:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.568+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.568+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f11d0 con 0x564a388d4840 2024-09-11T11:01:28.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.568+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.568+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f11d0 con 0x564a388d4840 2024-09-11T11:01:28.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.572+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.572+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f11d0 con 0x564a388d9880 2024-09-11T11:01:28.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.572+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.572+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f1740 con 0x564a388d4840 2024-09-11T11:01:28.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.572+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.572+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f1740 con 0x564a388d03b0 2024-09-11T11:01:28.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.576+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'27 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.576+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f1bf0 con 0x564a388d03b0 2024-09-11T11:01:28.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.576+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.576+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f1bf0 con 0x564a388d4840 2024-09-11T11:01:28.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.580+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.580+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f1bf0 con 0x564a388d4840 2024-09-11T11:01:28.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.580+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.580+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388f1bf0 con 0x564a388d9880 2024-09-11T11:01:28.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.584+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.584+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee4e0 con 0x564a388d4840 2024-09-11T11:01:28.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.584+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.584+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee4e0 con 0x564a388d03b0 2024-09-11T11:01:28.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.588+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.588+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee4e0 con 0x564a388d4840 2024-09-11T11:01:28.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.588+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.588+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d4840 2024-09-11T11:01:28.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.592+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.592+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d9880 2024-09-11T11:01:28.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.592+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.592+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d4840 2024-09-11T11:01:28.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.592+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.592+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d9880 2024-09-11T11:01:28.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.596+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.596+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d9880 2024-09-11T11:01:28.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.596+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'22 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.596+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d9880 2024-09-11T11:01:28.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.600+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.600+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d4840 2024-09-11T11:01:28.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.600+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.600+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d03b0 2024-09-11T11:01:28.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.604+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.604+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d4840 2024-09-11T11:01:28.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.604+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'28 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.604+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x564a388d03b0 2024-09-11T11:01:28.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.608+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.608+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee310 con 0x7f6dc8072070 2024-09-11T11:01:28.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.608+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.608+0000 7f6bfffff640 20 reqs_thread_entry: start 2024-09-11T11:01:28.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.608+0000 7f6dd1221980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:28.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 20 Filter name: none 2024-09-11T11:01:28.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6bfdffb640 20 reqs_thread_entry: start 2024-09-11T11:01:28.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:01:28.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a388ee0c0 con 0x7f6dc8072070 2024-09-11T11:01:28.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:01:28.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-11T11:01:28.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:28.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:28.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564a3890f490 con 0x564a388d03b0 2024-09-11T11:01:28.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv3 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.615 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-11T11:01:28.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6c857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.612+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94876776413088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e9470 con 0x564a388d03b0 2024-09-11T11:01:28.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.616+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94876776413088] v32'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.616+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94876776391472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388e3760 con 0x564a388d4840 2024-09-11T11:01:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.616+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94876776391472] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.616+0000 7f6dd1221980 20 remove_watcher() i=0 2024-09-11T11:01:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.616+0000 7f6dd1221980 2 removed watcher, disabling cache 2024-09-11T11:01:28.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.616+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94876776394832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388de330 con 0x564a388d03b0 2024-09-11T11:01:28.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.620+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94876776394832] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x564a388d03b0 2024-09-11T11:01:28.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.620+0000 7f6dd1221980 20 remove_watcher() i=1 2024-09-11T11:01:28.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.620+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94876776398384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388de330 con 0x564a388d4840 2024-09-11T11:01:28.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.620+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94876776398384] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.620+0000 7f6dd1221980 20 remove_watcher() i=2 2024-09-11T11:01:28.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.620+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94876776400720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388dfe30 con 0x7f6dc8072070 2024-09-11T11:01:28.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94876776400720] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dd1221980 20 remove_watcher() i=3 2024-09-11T11:01:28.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94876776401776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388de330 con 0x564a388d4840 2024-09-11T11:01:28.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dced31640 1 -- 172.21.15.145:0/3506921324 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94876776401776] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc8079070 con 0x564a388d4840 2024-09-11T11:01:28.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dd1221980 20 remove_watcher() i=4 2024-09-11T11:01:28.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94876776388960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388dfe30 con 0x564a388d9880 2024-09-11T11:01:28.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94876776388960] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dd1221980 20 remove_watcher() i=5 2024-09-11T11:01:28.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.624+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94876776409152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388de330 con 0x564a388d9880 2024-09-11T11:01:28.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dce530640 1 -- 172.21.15.145:0/3506921324 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94876776409152] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc40ca030 con 0x564a388d9880 2024-09-11T11:01:28.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 20 remove_watcher() i=6 2024-09-11T11:01:28.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94876776411840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564a388dfe30 con 0x7f6dc8072070 2024-09-11T11:01:28.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94876776411840] v32'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6dc00083f0 con 0x7f6dc8072070 2024-09-11T11:01:28.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 20 remove_watcher() i=7 2024-09-11T11:01:28.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a388d4840 msgr2=0x564a388d6c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a388d4840 0x564a388d6c30 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a388d03b0 msgr2=0x564a388d2850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a388d03b0 0x564a388d2850 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6dc8072070 msgr2=0x7f6dc8041050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6dc8072070 0x7f6dc8041050 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564a388d9880 msgr2=0x564a388dbc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564a388d9880 0x564a388dbc70 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c98034650 msgr2=0x7f6c98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c98034650 0x7f6c98036b10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40ab510 tx=0x7f6dc40a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dcf532640 1 -- 172.21.15.145:0/3506921324 reap_dead start 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 msgr2=0x564a388c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388c54d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80472c0 tx=0x7f6dc8025f20 comp rx=0 tx=0).stop 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 shutdown_connections 2024-09-11T11:01:28.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/3506921324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388be270 0x564a388c54d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 >> 172.21.15.145:0/3506921324 conn(0x564a388ba650 msgr2=0x564a388b8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 shutdown_connections 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/3506921324 wait complete. 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/1954297965 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6ca8034650 msgr2=0x7f6ca8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1954297965 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6ca8034650 0x7f6ca8036b10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400a480 tx=0x7f6dc4005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/1954297965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388b1960 msgr2=0x564a388b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1954297965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388b1960 0x564a388b1d80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80484a0 tx=0x7f6dc8010d50 comp rx=0 tx=0).stop 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/1954297965 shutdown_connections 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1954297965 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6ca8034650 0x7f6ca8036b10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1954297965 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a388b1960 0x564a388b1d80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/1954297965 >> 172.21.15.145:0/1954297965 conn(0x564a388a6ab0 msgr2=0x564a388a9530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/1954297965 shutdown_connections 2024-09-11T11:01:28.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.628+0000 7f6dd1221980 1 -- 172.21.15.145:0/1954297965 wait complete. 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a3889bf10 msgr2=0x564a3889e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564a3889bf10 0x564a3889e300 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a387a5ac0 msgr2=0x564a3889ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564a387a5ac0 0x564a3889ab00 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564a388a15a0 msgr2=0x564a388a3990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564a388a15a0 0x564a388a3990 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6cb4034650 msgr2=0x7f6cb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6cb4034650 0x7f6cb4036b10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40ad000 tx=0x7f6dc40a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 msgr2=0x564a38893b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 --2- 172.21.15.145:0/1514280780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564a38716290 0x564a38893b70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8002260 tx=0x7f6dc8000f50 comp rx=0 tx=0).stop 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dcf532640 1 -- 172.21.15.145:0/1514280780 reap_dead start 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 shutdown_connections 2024-09-11T11:01:28.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 >> 172.21.15.145:0/1514280780 conn(0x564a3879c090 msgr2=0x564a38886fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 shutdown_connections 2024-09-11T11:01:28.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.632+0000 7f6dd1221980 1 -- 172.21.15.145:0/1514280780 wait complete. 2024-09-11T11:01:28.645 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-11T11:01:28.645 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-11T11:01:28.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-11T11:01:28.646 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-11T11:01:28.724 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:28.725 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:28.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ecee8980 1 Processor -- start 2024-09-11T11:01:28.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ecee8980 1 -- start start 2024-09-11T11:01:28.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ecee8980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55d8788bb6a0 0x55d8788bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ecee8980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d878743ae0 con 0x55d8788bbff0 2024-09-11T11:01:28.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ecee8980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55d878767e30 con 0x55d8788bb6a0 2024-09-11T11:01:28.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ea9f8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55d8788bb6a0 0x55d8788bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ea1f7640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55d8788bbff0 0x55d8788c0a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54618/0 (socket says 172.21.15.145:54618) 2024-09-11T11:01:28.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ea9f8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55d8788bb6a0 0x55d8788bba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50262/0 (socket says 172.21.15.145:50262) 2024-09-11T11:01:28.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ea1f7640 1 -- 172.21.15.145:0/2366176062 learned_addr learned my addr 172.21.15.145:0/2366176062 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:28.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2366176062 >> v1:172.21.15.102:6789/0 conn(0x55d8788bbff0 legacy=0x55d8788c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.724+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2366176062 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8788c3270 con 0x55d8788bb6a0 2024-09-11T11:01:28.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/2366176062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8788bba80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f46e400a420 tx=0x7f46e401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fe04800dbd315f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46e99f6640 1 -- 172.21.15.145:0/2366176062 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40af070 con 0x55d8788bb6a0 2024-09-11T11:01:28.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46e99f6640 1 -- 172.21.15.145:0/2366176062 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e40aa530 con 0x55d8788bb6a0 2024-09-11T11:01:28.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46e99f6640 1 -- 172.21.15.145:0/2366176062 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40aa850 con 0x55d8788bb6a0 2024-09-11T11:01:28.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46ecee8980 1 -- 172.21.15.145:0/2366176062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 msgr2=0x55d8788bba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2366176062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8788bba80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f46e400a420 tx=0x7f46e401afd0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46ecee8980 1 -- 172.21.15.145:0/2366176062 shutdown_connections 2024-09-11T11:01:28.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2366176062 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8788bba80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46ecee8980 1 -- 172.21.15.145:0/2366176062 >> 172.21.15.145:0/2366176062 conn(0x55d8788b71c0 msgr2=0x55d8788b95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46ecee8980 1 -- 172.21.15.145:0/2366176062 shutdown_connections 2024-09-11T11:01:28.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.728+0000 7f46ecee8980 1 -- 172.21.15.145:0/2366176062 wait complete. 2024-09-11T11:01:28.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.740+0000 7f46ecee8980 1 Processor -- start 2024-09-11T11:01:28.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.740+0000 7f46ecee8980 1 -- start start 2024-09-11T11:01:28.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.740+0000 7f46ecee8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.740+0000 7f46ecee8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d878769200 con 0x55d8788bb6a0 2024-09-11T11:01:28.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.740+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789a6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50276/0 (socket says 172.21.15.145:50276) 2024-09-11T11:01:28.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2710656874 learned_addr learned my addr 172.21.15.145:0/2710656874 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2710656874 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8789a7090 con 0x55d8788bb6a0 2024-09-11T11:01:28.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/2710656874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789a6ac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f46e40ad040 tx=0x7f46e40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54000d47ced10b93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f45d8e09640 1 -- 172.21.15.145:0/2710656874 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40af050 con 0x55d8788bb6a0 2024-09-11T11:01:28.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f45d8e09640 1 -- 172.21.15.145:0/2710656874 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e40b0040 con 0x55d8788bb6a0 2024-09-11T11:01:28.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f45d8e09640 1 -- 172.21.15.145:0/2710656874 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40aaca0 con 0x55d8788bb6a0 2024-09-11T11:01:28.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 -- 172.21.15.145:0/2710656874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 msgr2=0x55d8789a6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2710656874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789a6ac0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f46e40ad040 tx=0x7f46e40033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 -- 172.21.15.145:0/2710656874 shutdown_connections 2024-09-11T11:01:28.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2710656874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789a6ac0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 -- 172.21.15.145:0/2710656874 >> 172.21.15.145:0/2710656874 conn(0x55d8788b71c0 msgr2=0x55d8789a26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 -- 172.21.15.145:0/2710656874 shutdown_connections 2024-09-11T11:01:28.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 -- 172.21.15.145:0/2710656874 wait complete. 2024-09-11T11:01:28.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 Processor -- start 2024-09-11T11:01:28.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 -- start start 2024-09-11T11:01:28.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ecee8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d8788c2cb0 con 0x55d8788bb6a0 2024-09-11T11:01:28.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50290/0 (socket says 172.21.15.145:50290) 2024-09-11T11:01:28.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2898489455 learned_addr learned my addr 172.21.15.145:0/2898489455 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2898489455 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8789ae1b0 con 0x55d8788bb6a0 2024-09-11T11:01:28.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.744+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789adc70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f46e4019680 tx=0x7f46e4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f45d7606640 1 -- 172.21.15.145:0/2898489455 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40c5070 con 0x55d8788bb6a0 2024-09-11T11:01:28.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f45d7606640 1 -- 172.21.15.145:0/2898489455 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e40b6d60 con 0x55d8788bb6a0 2024-09-11T11:01:28.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8789ae440 con 0x55d8788bb6a0 2024-09-11T11:01:28.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f45d7606640 1 -- 172.21.15.145:0/2898489455 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40c15f0 con 0x55d8788bb6a0 2024-09-11T11:01:28.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8789b1120 con 0x55d8788bb6a0 2024-09-11T11:01:28.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f45d7606640 1 -- 172.21.15.145:0/2898489455 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46e40c8070 con 0x55d8788bb6a0 2024-09-11T11:01:28.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f45d7606640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 0x7f45d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f45d7606640 1 -- 172.21.15.145:0/2898489455 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f46e40bb070 con 0x55d8788bb6a0 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 0x7f45d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8788bbff0 0x55d8789b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789b5270 con 0x55d8788bbff0 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46eb1f9640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8788bbff0 0x55d8789b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 0x7f45d0036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46d4001da0 tx=0x7f46d4001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46eb1f9640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8788bbff0 0x55d8789b4c00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46eb1f9640 1 -- 172.21.15.145:0/2898489455 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8788bbff0 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789b6070 0x55d8789b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789b8ac0 con 0x55d8789b6070 2024-09-11T11:01:28.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789b6070 0x55d8789b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.748+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789b6070 0x55d8789b8460 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2898489455 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46e40d1070 con 0x55d8789b6070 2024-09-11T11:01:28.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789ba370 con 0x55d8789b6070 2024-09-11T11:01:28.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2898489455 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f46e40d1070 con 0x55d8789b6070 2024-09-11T11:01:28.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789b95a0 con 0x55d8789b6070 2024-09-11T11:01:28.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2898489455 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46e40d1070 con 0x55d8789b6070 2024-09-11T11:01:28.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55d8789bb720 0x55d8789bdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789be050 con 0x55d8789bb720 2024-09-11T11:01:28.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55d8789bb720 0x55d8789bdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55d8789bb720 0x55d8789bdb10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea1f7640 1 -- 172.21.15.145:0/2898489455 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789bb720 2024-09-11T11:01:28.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ecee8980 1 Processor -- start 2024-09-11T11:01:28.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ecee8980 1 -- start start 2024-09-11T11:01:28.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ecee8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789cba10 0x55d8789cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ecee8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d8787c2800 con 0x55d8789cba10 2024-09-11T11:01:28.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789cba10 0x55d8789cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789cba10 0x55d8789cbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50298/0 (socket says 172.21.15.145:50298) 2024-09-11T11:01:28.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2175337852 learned_addr learned my addr 172.21.15.145:0/2175337852 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.752+0000 7f46ea9f8640 1 -- 172.21.15.145:0/2175337852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8789cc370 con 0x55d8789cba10 2024-09-11T11:01:28.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/2175337852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789cba10 0x55d8789cbe30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f46e40c8b10 tx=0x7f46e40d92d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45d4e01640 1 -- 172.21.15.145:0/2175337852 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40c1b60 con 0x55d8789cba10 2024-09-11T11:01:28.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45d4e01640 1 -- 172.21.15.145:0/2175337852 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e40a93a0 con 0x55d8789cba10 2024-09-11T11:01:28.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ecee8980 1 -- 172.21.15.145:0/2175337852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8789cc600 con 0x55d8789cba10 2024-09-11T11:01:28.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45d4e01640 1 -- 172.21.15.145:0/2175337852 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40c1d00 con 0x55d8789cba10 2024-09-11T11:01:28.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ecee8980 1 -- 172.21.15.145:0/2175337852 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8789cc600 con 0x55d8789cba10 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45d4e01640 1 -- 172.21.15.145:0/2175337852 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46e40e3cc0 con 0x55d8789cba10 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45d4e01640 1 --2- 172.21.15.145:0/2175337852 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45c4034650 0x7f45c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45d4e01640 1 -- 172.21.15.145:0/2175337852 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f46e40e9ae0 con 0x55d8789cba10 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/2175337852 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45c4034650 0x7f45c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ecee8980 1 Processor -- start 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ecee8980 1 -- start start 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/2175337852 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45c4034650 0x7f45c4036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d8789b2260 tx=0x7f46d400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ecee8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789d85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ecee8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d8789a7350 con 0x55d8789d81b0 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789d85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789d85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50310/0 (socket says 172.21.15.145:50310) 2024-09-11T11:01:28.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ea9f8640 1 -- 172.21.15.145:0/449751097 learned_addr learned my addr 172.21.15.145:0/449751097 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ea9f8640 1 -- 172.21.15.145:0/449751097 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8789d8b80 con 0x55d8789d81b0 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/449751097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789d85b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f46e40e3fd0 tx=0x7f46e40e7b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569b500e82ddef20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45ce7fc640 1 -- 172.21.15.145:0/449751097 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40e9e00 con 0x55d8789d81b0 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45ce7fc640 1 -- 172.21.15.145:0/449751097 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e4101070 con 0x55d8789d81b0 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.756+0000 7f45ce7fc640 1 -- 172.21.15.145:0/449751097 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40e73d0 con 0x55d8789d81b0 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- 172.21.15.145:0/449751097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 msgr2=0x55d8789d85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 --2- 172.21.15.145:0/449751097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789d85b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f46e40e3fd0 tx=0x7f46e40e7b20 comp rx=0 tx=0).stop 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- 172.21.15.145:0/449751097 shutdown_connections 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 --2- 172.21.15.145:0/449751097 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789d85b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- 172.21.15.145:0/449751097 >> 172.21.15.145:0/449751097 conn(0x55d8789d45e0 msgr2=0x55d8789d26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- 172.21.15.145:0/449751097 shutdown_connections 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- 172.21.15.145:0/449751097 wait complete. 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 Processor -- start 2024-09-11T11:01:28.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- start start 2024-09-11T11:01:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789df3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d8789d9050 con 0x55d8789d81b0 2024-09-11T11:01:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789df3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ea9f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789df3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50324/0 (socket says 172.21.15.145:50324) 2024-09-11T11:01:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 learned_addr learned my addr 172.21.15.145:0/3818715629 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d8789df930 con 0x55d8789d81b0 2024-09-11T11:01:28.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789df3f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f46e40bf9e0 tx=0x7f46e40e0ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f45ccff9640 1 -- 172.21.15.145:0/3818715629 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40cb030 con 0x55d8789d81b0 2024-09-11T11:01:28.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d8789df930 con 0x55d8789d81b0 2024-09-11T11:01:28.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f45ccff9640 1 -- 172.21.15.145:0/3818715629 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e40cb1d0 con 0x55d8789d81b0 2024-09-11T11:01:28.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f45ccff9640 1 -- 172.21.15.145:0/3818715629 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46e40d99c0 con 0x55d8789d81b0 2024-09-11T11:01:28.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8789df930 con 0x55d8789d81b0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f45ccff9640 1 -- 172.21.15.145:0/3818715629 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f46e410e020 con 0x55d8789d81b0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f45ccff9640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45b4034650 0x7f45b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f45ccff9640 1 -- 172.21.15.145:0/3818715629 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f46e40f7040 con 0x55d8789d81b0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45b4034650 0x7f45b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8789ea4c0 0x55d8789ec980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.760+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789ed0d0 con 0x55d8789ea4c0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46eb1f9640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8789ea4c0 0x55d8789ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45b4034650 0x7f45b4036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55d8789ba2c0 tx=0x7f46d4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46eb1f9640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8789ea4c0 0x55d8789ec980 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 realm 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789e98f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789edb60 con 0x55d8789ea4c0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789ee940 0x55d8789f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f13c0 con 0x55d8789ee940 2024-09-11T11:01:28.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789ee940 0x55d8789f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789ee940 0x55d8789f0d30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 20 searching for the correct realm 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55d8789f3980 0x55d8789f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f63f0 con 0x55d8789f3980 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55d8789f3980 0x55d8789f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.764+0000 7f46ea1f7640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55d8789f3980 0x55d8789f5d70 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f63f0 con 0x55d8789ee940 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea9f8640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f46e40ca070 0x7f46e40e6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x7f46e40ca070 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f46e40ca070 0x7f46e40e6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f46e40ca070 0x7f46e40e6330 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789f3980 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.768+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x7f46e40ca070 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x7f46e40ca070 2024-09-11T11:01:28.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789f3980 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789f3980 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789f3980 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x7f46e40ca070 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ea4c0 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.772+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x7f46e40ca070 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789f3980 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x7f46e40ca070 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789f3980 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f1c10 con 0x55d8789ee940 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f2460 con 0x55d8789ea4c0 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f2850 con 0x55d8789ee940 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.776+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f2850 con 0x7f46e40ca070 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 zone default found 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 4 Realm: () 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:28.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 zonegroup default 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f6850 con 0x7f46e40ca070 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f2d90 con 0x55d8789f3980 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f8b90 con 0x55d8789f3980 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 started sync module instance, tier type = 2024-09-11T11:01:28.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:28.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f7f10 con 0x55d8789ee940 2024-09-11T11:01:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94388225016848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f7f10 con 0x55d8789ee940 2024-09-11T11:01:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.780+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f9610 con 0x55d8789ea4c0 2024-09-11T11:01:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94388225020256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f9580 con 0x55d8789ea4c0 2024-09-11T11:01:28.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fa540 con 0x55d8789ee940 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94388225016848] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94388225020256] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94388225022464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fa540 con 0x55d8789ee940 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fa9a0 con 0x7f46e40ca070 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94388225014368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fa960 con 0x7f46e40ca070 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fb860 con 0x55d8789ee940 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.784+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94388225022464] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94388225014368] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94388225027472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fb3b0 con 0x55d8789ee940 2024-09-11T11:01:28.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fc100 con 0x55d8789f3980 2024-09-11T11:01:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94388225031248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fb3b0 con 0x55d8789f3980 2024-09-11T11:01:28.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fce80 con 0x55d8789f3980 2024-09-11T11:01:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94388225031248] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94388225027472] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94388225033376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fd270 con 0x55d8789f3980 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.788+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fdb00 con 0x7f46e40ca070 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94388225036912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fd6d0 con 0x7f46e40ca070 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 20 add_watcher() i=0 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 20 add_watcher() i=1 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 20 add_watcher() i=2 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 20 add_watcher() i=3 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 20 add_watcher() i=4 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 20 add_watcher() i=5 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94388225033376] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 20 add_watcher() i=6 2024-09-11T11:01:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94388225036912] v32'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 20 add_watcher() i=7 2024-09-11T11:01:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fc8c0 con 0x55d8789ea4c0 2024-09-11T11:01:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94388225034432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fe4e0 con 0x55d8789ea4c0 2024-09-11T11:01:28.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94388225034432] v32'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.792+0000 7f45a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:28.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:28.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 5 note: GC not initialized 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f451bfff640 20 reqs_thread_entry: start 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 Filter name: none 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f4519ffb640 20 reqs_thread_entry: start 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d878a24690 con 0x7f46e40ca070 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:28.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d878a241f0 con 0x7f46e40ca070 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d878a27f40 con 0x55d8789ea4c0 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(64 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:28.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:28.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:28.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:28.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:28.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:28.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-11T11:01:28.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d878a2b660 con 0x55d8789ea4c0 2024-09-11T11:01:28.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 fud.buckets [call] v32'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f46dc0083f0 con 0x55d8789ea4c0 2024-09-11T11:01:28.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-11T11:01:28.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d878a2a720 con 0x7f46e40ca070 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f46dc0083f0 con 0x7f46e40ca070 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.796+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d878a2f2e0 con 0x7f46e40ca070 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v32'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f46dc03f040 con 0x7f46e40ca070 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ecee8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ecee8980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ecee8980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-11T11:01:28.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94388225240432 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55d878a2c100 con 0x55d8789f3980 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== watch-notify(notify (1) cookie 94388225033376 notify 137438953476 ret 0) ==== 380+0+0 (crc 0 0 0) 0x55d878743ae0 con 0x55d8789f3980 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f45ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953476 cookie 94388225033376 notifier 4521 bl.length()=338 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f45ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f45ce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(68 notify.6 [notify cookie 94388225240432 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f45ce7fc640 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f45b0003eb0 con 0x55d8789f3980 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== watch-notify(notify_complete (2) cookie 94388225240432 notify 137438953476 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f46d40386d0 con 0x55d8789f3980 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f45a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.800+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94388225034432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d878a224c0 con 0x55d8789ea4c0 2024-09-11T11:01:28.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94388225034432] v32'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46dc03f040 con 0x55d8789ea4c0 2024-09-11T11:01:28.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94388225016848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d878a224c0 con 0x55d8789ee940 2024-09-11T11:01:28.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94388225016848] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46ecee8980 20 remove_watcher() i=0 2024-09-11T11:01:28.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46ecee8980 2 removed watcher, disabling cache 2024-09-11T11:01:28.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94388225020256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f8410 con 0x55d8789ea4c0 2024-09-11T11:01:28.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94388225020256] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc03f040 con 0x55d8789ea4c0 2024-09-11T11:01:28.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46ecee8980 20 remove_watcher() i=1 2024-09-11T11:01:28.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.804+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94388225022464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d878a224c0 con 0x55d8789ee940 2024-09-11T11:01:28.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.808+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94388225022464] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.808+0000 7f46ecee8980 20 remove_watcher() i=2 2024-09-11T11:01:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.808+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94388225014368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f9160 con 0x7f46e40ca070 2024-09-11T11:01:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.808+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94388225014368] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc03f040 con 0x7f46e40ca070 2024-09-11T11:01:28.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.808+0000 7f46ecee8980 20 remove_watcher() i=3 2024-09-11T11:01:28.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.808+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94388225027472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f8410 con 0x55d8789ee940 2024-09-11T11:01:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ea9f8640 1 -- 172.21.15.145:0/3818715629 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94388225027472] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46e40ee020 con 0x55d8789ee940 2024-09-11T11:01:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ecee8980 20 remove_watcher() i=4 2024-09-11T11:01:28.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94388225031248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d878a224c0 con 0x55d8789f3980 2024-09-11T11:01:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94388225031248] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ecee8980 20 remove_watcher() i=5 2024-09-11T11:01:28.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94388225033376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789f9160 con 0x55d8789f3980 2024-09-11T11:01:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ea1f7640 1 -- 172.21.15.145:0/3818715629 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94388225033376] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d400e6c0 con 0x55d8789f3980 2024-09-11T11:01:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ecee8980 20 remove_watcher() i=6 2024-09-11T11:01:28.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94388225036912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55d8789fad90 con 0x7f46e40ca070 2024-09-11T11:01:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94388225036912] v32'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46dc03f040 con 0x7f46e40ca070 2024-09-11T11:01:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.812+0000 7f46ecee8980 20 remove_watcher() i=7 2024-09-11T11:01:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789ee940 msgr2=0x55d8789f0d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789ee940 0x55d8789f0d30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8789ea4c0 msgr2=0x55d8789ec980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8789ea4c0 0x55d8789ec980 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f46e40ca070 msgr2=0x7f46e40e6330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f46e40ca070 0x7f46e40e6330 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55d8789f3980 msgr2=0x55d8789f5d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55d8789f3980 0x55d8789f5d70 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45b4034650 msgr2=0x7f45b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45b4034650 0x7f45b4036b10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x55d8789ba2c0 tx=0x7f46d4010000 comp rx=0 tx=0).stop 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46eb1f9640 1 -- 172.21.15.145:0/3818715629 reap_dead start 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 msgr2=0x55d8789df3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789df3f0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f46e40bf9e0 tx=0x7f46e40e0ec0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 shutdown_connections 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/3818715629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789d81b0 0x55d8789df3f0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 >> 172.21.15.145:0/3818715629 conn(0x55d8789d45e0 msgr2=0x55d8789d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 shutdown_connections 2024-09-11T11:01:28.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/3818715629 wait complete. 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2175337852 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45c4034650 msgr2=0x7f45c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2175337852 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45c4034650 0x7f45c4036b10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x55d8789b2260 tx=0x7f46d400f000 comp rx=0 tx=0).stop 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2175337852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789cba10 msgr2=0x55d8789cbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2175337852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789cba10 0x55d8789cbe30 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f46e40c8b10 tx=0x7f46e40d92d0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2175337852 shutdown_connections 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2175337852 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45c4034650 0x7f45c4036b10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2175337852 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8789cba10 0x55d8789cbe30 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2175337852 >> 172.21.15.145:0/2175337852 conn(0x55d8789c0b60 msgr2=0x55d8789c35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2175337852 shutdown_connections 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2175337852 wait complete. 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789b6070 msgr2=0x55d8789b8460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55d8789b6070 0x55d8789b8460 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8788bbff0 msgr2=0x55d8789b4c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55d8788bbff0 0x55d8789b4c00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55d8789bb720 msgr2=0x55d8789bdb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55d8789bb720 0x55d8789bdb10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 msgr2=0x7f45d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 0x7f45d0036b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f46d4001da0 tx=0x7f46d4001300 comp rx=0 tx=0).stop 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 msgr2=0x55d8789adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 --2- 172.21.15.145:0/2898489455 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d8788bb6a0 0x55d8789adc70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f46e4019680 tx=0x7f46e4019810 comp rx=0 tx=0).stop 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46eb1f9640 1 -- 172.21.15.145:0/2898489455 reap_dead start 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 shutdown_connections 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 >> 172.21.15.145:0/2898489455 conn(0x55d8788b71c0 msgr2=0x55d8789a1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 shutdown_connections 2024-09-11T11:01:28.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.816+0000 7f46ecee8980 1 -- 172.21.15.145:0/2898489455 wait complete. 2024-09-11T11:01:28.827 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '27698d38-fc40-410e-96d8-191ffc71147c.4235.1'] 2024-09-11T11:01:28.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '27698d38-fc40-410e-96d8-191ffc71147c.4235.1'] 2024-09-11T11:01:28.828 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:28.898 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:28.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4dce8980 1 Processor -- start 2024-09-11T11:01:28.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4dce8980 1 -- start start 2024-09-11T11:01:28.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4dce8980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555aaf15a9b0 0x555aaf15cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4dce8980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555aaefdeae0 con 0x555aaf156630 2024-09-11T11:01:28.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4dce8980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x555aaf002e30 con 0x555aaf15a9b0 2024-09-11T11:01:28.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4aff7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555aaf15a9b0 0x555aaf15cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4aff7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555aaf15a9b0 0x555aaf15cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50326/0 (socket says 172.21.15.145:50326) 2024-09-11T11:01:28.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4aff7640 1 -- 172.21.15.145:0/1139066082 learned_addr learned my addr 172.21.15.145:0/1139066082 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4b7f8640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x555aaf156630 0x555aaf156a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54628/0 (socket says 172.21.15.145:54628) 2024-09-11T11:01:28.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4aff7640 1 -- 172.21.15.145:0/1139066082 >> v1:172.21.15.102:6789/0 conn(0x555aaf156630 legacy=0x555aaf156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.896+0000 7f0e4aff7640 1 -- 172.21.15.145:0/1139066082 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaf15e2f0 con 0x555aaf15a9b0 2024-09-11T11:01:28.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/1139066082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf15a9b0 0x555aaf15cda0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000a5c0 tx=0x7f0e4001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd6d23743ae9d8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4a7f6640 1 -- 172.21.15.145:0/1139066082 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e400a6070 con 0x555aaf15a9b0 2024-09-11T11:01:28.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4a7f6640 1 -- 172.21.15.145:0/1139066082 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e400af070 con 0x555aaf15a9b0 2024-09-11T11:01:28.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4a7f6640 1 -- 172.21.15.145:0/1139066082 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e400aa5c0 con 0x555aaf15a9b0 2024-09-11T11:01:28.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1139066082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf15a9b0 msgr2=0x555aaf15cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/1139066082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf15a9b0 0x555aaf15cda0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000a5c0 tx=0x7f0e4001b340 comp rx=0 tx=0).stop 2024-09-11T11:01:28.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1139066082 shutdown_connections 2024-09-11T11:01:28.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/1139066082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf15a9b0 0x555aaf15cda0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1139066082 >> 172.21.15.145:0/1139066082 conn(0x555aaf152150 msgr2=0x555aaf154570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1139066082 shutdown_connections 2024-09-11T11:01:28.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.900+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1139066082 wait complete. 2024-09-11T11:01:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.912+0000 7f0e4dce8980 1 Processor -- start 2024-09-11T11:01:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- start start 2024-09-11T11:01:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf241a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555aaf004200 con 0x555aaf156630 2024-09-11T11:01:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf241a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf241a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50342/0 (socket says 172.21.15.145:50342) 2024-09-11T11:01:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/2818721820 learned_addr learned my addr 172.21.15.145:0/2818721820 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/2818721820 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaf242050 con 0x555aaf156630 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/2818721820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf241a80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00b240 tx=0x7f0e3c00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863d4cde2c102769 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0d3960a640 1 -- 172.21.15.145:0/2818721820 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c00e700 con 0x555aaf156630 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0d3960a640 1 -- 172.21.15.145:0/2818721820 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c00e8a0 con 0x555aaf156630 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0d3960a640 1 -- 172.21.15.145:0/2818721820 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c00eb80 con 0x555aaf156630 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2818721820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 msgr2=0x555aaf241a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/2818721820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf241a80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00b240 tx=0x7f0e3c00b700 comp rx=0 tx=0).stop 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2818721820 shutdown_connections 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/2818721820 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf241a80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2818721820 >> 172.21.15.145:0/2818721820 conn(0x555aaf152150 msgr2=0x555aaf23d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2818721820 shutdown_connections 2024-09-11T11:01:28.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2818721820 wait complete. 2024-09-11T11:01:28.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 Processor -- start 2024-09-11T11:01:28.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- start start 2024-09-11T11:01:28.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf248e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4dce8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555aaf15ddf0 con 0x555aaf156630 2024-09-11T11:01:28.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf248e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf248e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50352/0 (socket says 172.21.15.145:50352) 2024-09-11T11:01:28.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.916+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/3056335738 learned_addr learned my addr 172.21.15.145:0/3056335738 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/3056335738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaf249390 con 0x555aaf156630 2024-09-11T11:01:28.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf248e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c000c10 tx=0x7f0e3c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0d37e07640 1 -- 172.21.15.145:0/3056335738 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c00fa90 con 0x555aaf156630 2024-09-11T11:01:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555aaf249620 con 0x555aaf156630 2024-09-11T11:01:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0d37e07640 1 -- 172.21.15.145:0/3056335738 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c00fc50 con 0x555aaf156630 2024-09-11T11:01:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0d37e07640 1 -- 172.21.15.145:0/3056335738 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c01a480 con 0x555aaf156630 2024-09-11T11:01:28.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aaf24c300 con 0x555aaf156630 2024-09-11T11:01:28.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0d37e07640 1 -- 172.21.15.145:0/3056335738 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e3c017070 con 0x555aaf156630 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0d37e07640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d30034650 0x7f0d30036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0d37e07640 1 -- 172.21.15.145:0/3056335738 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f0e3c015020 con 0x555aaf156630 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d30034650 0x7f0d30036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf15a9b0 0x555aaf24fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf250450 con 0x555aaf15a9b0 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4bff9640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf15a9b0 0x555aaf24fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d30034650 0x7f0d30036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e400ae000 tx=0x7f0e400a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4bff9640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf15a9b0 0x555aaf24fde0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4bff9640 1 -- 172.21.15.145:0/3056335738 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf15a9b0 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf251290 0x555aaf253680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf253cb0 con 0x555aaf251290 2024-09-11T11:01:28.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.920+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf251290 0x555aaf253680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf251290 0x555aaf253680 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/3056335738 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf251290 2024-09-11T11:01:28.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf255560 con 0x555aaf251290 2024-09-11T11:01:28.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/3056335738 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf251290 2024-09-11T11:01:28.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2546d0 con 0x555aaf251290 2024-09-11T11:01:28.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/3056335738 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf251290 2024-09-11T11:01:28.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555aaf255140 0x555aaf258980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf259110 con 0x555aaf255140 2024-09-11T11:01:28.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555aaf255140 0x555aaf258980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555aaf255140 0x555aaf258980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4aff7640 1 -- 172.21.15.145:0/3056335738 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf255140 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4dce8980 1 Processor -- start 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4dce8980 1 -- start start 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4dce8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf0cd510 0x555aaf0cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4dce8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555aaf05d800 con 0x555aaf0cd510 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf0cd510 0x555aaf0cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf0cd510 0x555aaf0cbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50362/0 (socket says 172.21.15.145:50362) 2024-09-11T11:01:28.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.924+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/2153586972 learned_addr learned my addr 172.21.15.145:0/2153586972 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/2153586972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaf0cd930 con 0x555aaf0cd510 2024-09-11T11:01:28.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/2153586972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf0cd510 0x555aaf0cbb90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c017450 tx=0x7f0e3c017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0d35602640 1 -- 172.21.15.145:0/2153586972 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c042250 con 0x555aaf0cd510 2024-09-11T11:01:28.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2153586972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555aaf0cc130 con 0x555aaf0cd510 2024-09-11T11:01:28.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0d35602640 1 -- 172.21.15.145:0/2153586972 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c04a510 con 0x555aaf0cd510 2024-09-11T11:01:28.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0d35602640 1 -- 172.21.15.145:0/2153586972 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c04aa70 con 0x555aaf0cd510 2024-09-11T11:01:28.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2153586972 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aaf0cc130 con 0x555aaf0cd510 2024-09-11T11:01:28.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0d35602640 1 -- 172.21.15.145:0/2153586972 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e3c04ac10 con 0x555aaf0cd510 2024-09-11T11:01:28.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0d35602640 1 --2- 172.21.15.145:0/2153586972 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d24034650 0x7f0d24036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0d35602640 1 -- 172.21.15.145:0/2153586972 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f0e3c035040 con 0x555aaf0cd510 2024-09-11T11:01:28.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/2153586972 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d24034650 0x7f0d24036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4dce8980 1 Processor -- start 2024-09-11T11:01:28.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4dce8980 1 -- start start 2024-09-11T11:01:28.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4dce8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf2758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4dce8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555aaf2423d0 con 0x555aaf275510 2024-09-11T11:01:28.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/2153586972 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d24034650 0x7f0d24036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x555aaf24d440 tx=0x7f0e40005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf2758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf2758f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50376/0 (socket says 172.21.15.145:50376) 2024-09-11T11:01:28.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/1259005322 learned_addr learned my addr 172.21.15.145:0/1259005322 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/1259005322 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaf275ec0 con 0x555aaf275510 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.928+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/1259005322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf2758f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c01b6e0 tx=0x7f0e3c047bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3936eac5a6ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0d2effd640 1 -- 172.21.15.145:0/1259005322 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c062070 con 0x555aaf275510 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0d2effd640 1 -- 172.21.15.145:0/1259005322 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c042890 con 0x555aaf275510 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0d2effd640 1 -- 172.21.15.145:0/1259005322 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c01ba70 con 0x555aaf275510 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1259005322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 msgr2=0x555aaf2758f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/1259005322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf2758f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c01b6e0 tx=0x7f0e3c047bb0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1259005322 shutdown_connections 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/1259005322 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf2758f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1259005322 >> 172.21.15.145:0/1259005322 conn(0x555aaf2718f0 msgr2=0x555aaf26f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1259005322 shutdown_connections 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- 172.21.15.145:0/1259005322 wait complete. 2024-09-11T11:01:28.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 Processor -- start 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- start start 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf27c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x555aaf276360 con 0x555aaf275510 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf27c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4b7f8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf27c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50378/0 (socket says 172.21.15.145:50378) 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 learned_addr learned my addr 172.21.15.145:0/4212259507 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aaf27cc90 con 0x555aaf275510 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf27c750 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c032790 tx=0x7f0e3c029f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0d2d7fa640 1 -- 172.21.15.145:0/4212259507 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c06d020 con 0x555aaf275510 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555aaf27cc90 con 0x555aaf275510 2024-09-11T11:01:28.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0d2d7fa640 1 -- 172.21.15.145:0/4212259507 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e3c034dd0 con 0x555aaf275510 2024-09-11T11:01:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aaf27cc90 con 0x555aaf275510 2024-09-11T11:01:28.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0d2d7fa640 1 -- 172.21.15.145:0/4212259507 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e3c062030 con 0x555aaf275510 2024-09-11T11:01:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.932+0000 7f0d2d7fa640 1 -- 172.21.15.145:0/4212259507 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0e3c070020 con 0x555aaf275510 2024-09-11T11:01:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0d2d7fa640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d14034650 0x7f0d14036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0d2d7fa640 1 -- 172.21.15.145:0/4212259507 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f0e3c063070 con 0x555aaf275510 2024-09-11T11:01:28.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d14034650 0x7f0d14036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf287870 0x555aaf289d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf28a480 con 0x555aaf287870 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4bff9640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf287870 0x555aaf289d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d14034650 0x7f0d14036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000c10 tx=0x7f0e400c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4bff9640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf287870 0x555aaf289d30 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 realm 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf286ce0 con 0x555aaf287870 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf28af50 con 0x555aaf287870 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf28bd00 0x555aaf28e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf28e770 con 0x555aaf28bd00 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf28bd00 0x555aaf28e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf28bd00 0x555aaf28e0f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf28efc0 con 0x555aaf28bd00 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 20 searching for the correct realm 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555aaf290d30 0x555aaf293120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf290d30 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.936+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555aaf290d30 0x555aaf293120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4aff7640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555aaf290d30 0x555aaf293120 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4b7f8640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0e3c07d040 0x7f0e3c069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x7f0e3c07d040 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0e3c07d040 0x7f0e3c069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0e3c07d040 0x7f0e3c069640 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf290d30 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.940+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x7f0e3c07d040 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x7f0e3c07d040 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf290d30 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf290d30 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf290d30 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x7f0e3c07d040 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf287870 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.944+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x7f0e3c07d040 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf290d30 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x7f0e3c07d040 2024-09-11T11:01:28.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf290d30 2024-09-11T11:01:28.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2937a0 con 0x555aaf28bd00 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf28f910 con 0x555aaf287870 2024-09-11T11:01:28.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf28f550 con 0x555aaf28bd00 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.948+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf290230 con 0x7f0e3c07d040 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 zone default found 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 4 Realm: () 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:28.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 zonegroup default 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf28fe00 con 0x7f0e3c07d040 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf295fc0 con 0x555aaf290d30 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf296360 con 0x555aaf290d30 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 started sync module instance, tier type = 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf295450 con 0x555aaf28bd00 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93847974140320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf295450 con 0x555aaf28bd00 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.952+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf296d20 con 0x555aaf287870 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93847974144112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf297140 con 0x555aaf287870 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf297c30 con 0x555aaf28bd00 2024-09-11T11:01:28.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93847974140320] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93847974144112] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93847974147840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf296c90 con 0x555aaf28bd00 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2984d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93847974150176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf296c90 con 0x7f0e3c07d040 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.956+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf298f90 con 0x555aaf28bd00 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93847974147840] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93847974150176] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93847974151232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf298f50 con 0x555aaf28bd00 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf299380 con 0x555aaf290d30 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93847974137760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf299c20 con 0x555aaf290d30 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf29a620 con 0x555aaf290d30 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93847974151232] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93847974137760] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93847974152800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf29aa10 con 0x555aaf290d30 2024-09-11T11:01:28.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.960+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf29b260 con 0x7f0e3c07d040 2024-09-11T11:01:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93847974152800] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93847974160912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf29b650 con 0x7f0e3c07d040 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 20 add_watcher() i=0 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 20 add_watcher() i=1 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 20 add_watcher() i=2 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 20 add_watcher() i=3 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 20 add_watcher() i=4 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 20 add_watcher() i=5 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 20 add_watcher() i=6 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93847974160912] v32'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 20 add_watcher() i=7 2024-09-11T11:01:28.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf29e680 con 0x555aaf287870 2024-09-11T11:01:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93847974162384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf29bb90 con 0x555aaf287870 2024-09-11T11:01:28.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93847974162384] v32'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.964+0000 7f0d027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 5 note: GC not initialized 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0d017e2640 20 reqs_thread_entry: start 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 Filter name: none 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0cfa7fc640 20 reqs_thread_entry: start 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2c1d90 con 0x555aaf287870 2024-09-11T11:01:28.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2c3e70 con 0x7f0e3c07d040 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 rados->read ofs=0 len=0 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2c5690 con 0x555aaf287870 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2c9cf0 con 0x555aaf287870 2024-09-11T11:01:28.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 fud.buckets [call] v32'5 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.968+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2cfcc0 con 0x555aaf287870 2024-09-11T11:01:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(66 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:28.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1, ofs0, ns] 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93847974334272 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2ca120 con 0x555aaf28bd00 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 93847974151232 notify 137438953492 ret 0) ==== 794+0+0 (crc 0 0 0) 0x555aaf0cd930 con 0x555aaf28bd00 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0d2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953492 cookie 93847974151232 notifier 4528 bl.length()=752 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0d2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0d2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0d2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0d2effd640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0d10003eb0 con 0x555aaf28bd00 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.4 [notify cookie 93847974334272 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 93847974334272 notify 137438953492 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555aaf24c300 con 0x555aaf28bd00 2024-09-11T11:01:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_sources= new_sources= 2024-09-11T11:01:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential sources added=[] removed=[] 2024-09-11T11:01:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_dests= new_dests= 2024-09-11T11:01:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential dests added=[] removed=[] 2024-09-11T11:01:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2c4f40 con 0x7f0e3c07d040 2024-09-11T11:01:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 foo.buckets [call] v32'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.972+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2c4f40 con 0x7f0e3c07d040 2024-09-11T11:01:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4dce8980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-11T11:01:28.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4dce8980 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4dce8980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93847974334272 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2c39c0 con 0x555aaf290d30 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== watch-notify(notify (1) cookie 93847974152800 notify 137438953477 ret 0) ==== 356+0+0 (crc 0 0 0) 0x7f0e400bf5b0 con 0x555aaf290d30 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0d2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953477 cookie 93847974152800 notifier 4528 bl.length()=314 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0d2e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0d2e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(71 notify.6 [notify cookie 93847974334272 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0d2e7fc640 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f0c74003410 con 0x555aaf290d30 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== watch-notify(notify_complete (2) cookie 93847974334272 notify 137438953477 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0e400bf850 con 0x555aaf290d30 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0d027e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:28.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93847974162384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2bfbc0 con 0x555aaf287870 2024-09-11T11:01:28.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93847974162384] v32'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.976+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93847974140320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2bfbc0 con 0x555aaf28bd00 2024-09-11T11:01:28.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.980+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93847974140320] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.980+0000 7f0e4dce8980 20 remove_watcher() i=0 2024-09-11T11:01:28.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.980+0000 7f0e4dce8980 2 removed watcher, disabling cache 2024-09-11T11:01:28.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.980+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93847974144112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2bfbc0 con 0x555aaf287870 2024-09-11T11:01:28.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.980+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93847974144112] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x555aaf287870 2024-09-11T11:01:28.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.980+0000 7f0e4dce8980 20 remove_watcher() i=1 2024-09-11T11:01:28.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.980+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93847974147840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf296870 con 0x555aaf28bd00 2024-09-11T11:01:28.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.984+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93847974147840] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.984+0000 7f0e4dce8980 20 remove_watcher() i=2 2024-09-11T11:01:28.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.984+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93847974150176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2bfbc0 con 0x7f0e3c07d040 2024-09-11T11:01:28.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.984+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93847974150176] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.984+0000 7f0e4dce8980 20 remove_watcher() i=3 2024-09-11T11:01:28.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.984+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93847974151232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf297700 con 0x555aaf28bd00 2024-09-11T11:01:28.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4b7f8640 1 -- 172.21.15.145:0/4212259507 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93847974151232] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e3c02e070 con 0x555aaf28bd00 2024-09-11T11:01:28.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 20 remove_watcher() i=4 2024-09-11T11:01:28.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93847974137760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf296870 con 0x555aaf290d30 2024-09-11T11:01:28.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93847974137760] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 20 remove_watcher() i=5 2024-09-11T11:01:28.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93847974152800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf2bfbc0 con 0x555aaf290d30 2024-09-11T11:01:28.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4aff7640 1 -- 172.21.15.145:0/4212259507 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93847974152800] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e400aaad0 con 0x555aaf290d30 2024-09-11T11:01:28.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 20 remove_watcher() i=6 2024-09-11T11:01:28.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93847974160912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x555aaf298450 con 0x7f0e3c07d040 2024-09-11T11:01:28.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93847974160912] v32'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0e4400a4d0 con 0x7f0e3c07d040 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 20 remove_watcher() i=7 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf28bd00 msgr2=0x555aaf28e0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf28bd00 0x555aaf28e0f0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf287870 msgr2=0x555aaf289d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf287870 0x555aaf289d30 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0e3c07d040 msgr2=0x7f0e3c069640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0e3c07d040 0x7f0e3c069640 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555aaf290d30 msgr2=0x555aaf293120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x555aaf290d30 0x555aaf293120 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d14034650 msgr2=0x7f0d14036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d14034650 0x7f0d14036b10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0e40000c10 tx=0x7f0e400c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 msgr2=0x555aaf27c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/4212259507 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf275510 0x555aaf27c750 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c032790 tx=0x7f0e3c029f20 comp rx=0 tx=0).stop 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4bff9640 1 -- 172.21.15.145:0/4212259507 reap_dead start 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 shutdown_connections 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 >> 172.21.15.145:0/4212259507 conn(0x555aaf2718f0 msgr2=0x555aaf26f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 shutdown_connections 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/4212259507 wait complete. 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2153586972 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d24034650 msgr2=0x7f0d24036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/2153586972 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d24034650 0x7f0d24036b10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x555aaf24d440 tx=0x7f0e40005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2153586972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf0cd510 msgr2=0x555aaf0cbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.988+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/2153586972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf0cd510 0x555aaf0cbb90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c017450 tx=0x7f0e3c017f50 comp rx=0 tx=0).stop 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2153586972 shutdown_connections 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/2153586972 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d24034650 0x7f0d24036b10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/2153586972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf0cd510 0x555aaf0cbb90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2153586972 >> 172.21.15.145:0/2153586972 conn(0x555aaf25bcf0 msgr2=0x555aaf25e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2153586972 shutdown_connections 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/2153586972 wait complete. 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf251290 msgr2=0x555aaf253680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x555aaf251290 0x555aaf253680 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf15a9b0 msgr2=0x555aaf24fde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x555aaf15a9b0 0x555aaf24fde0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555aaf255140 msgr2=0x555aaf258980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x555aaf255140 0x555aaf258980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d30034650 msgr2=0x7f0d30036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0d30034650 0x7f0d30036b10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0e400ae000 tx=0x7f0e400a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:28.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 msgr2=0x555aaf248e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:28.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 --2- 172.21.15.145:0/3056335738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555aaf156630 0x555aaf248e50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c000c10 tx=0x7f0e3c000ee0 comp rx=0 tx=0).stop 2024-09-11T11:01:28.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4bff9640 1 -- 172.21.15.145:0/3056335738 reap_dead start 2024-09-11T11:01:28.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 shutdown_connections 2024-09-11T11:01:28.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 >> 172.21.15.145:0/3056335738 conn(0x555aaf152150 msgr2=0x555aaf23c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:28.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 shutdown_connections 2024-09-11T11:01:28.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:28.992+0000 7f0e4dce8980 1 -- 172.21.15.145:0/3056335738 wait complete. 2024-09-11T11:01:29.003 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-11T11:01:29.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-11T11:01:29.003 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-11T11:01:29.072 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:29.073 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:29.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26fb10980 1 Processor -- start 2024-09-11T11:01:29.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26fb10980 1 -- start start 2024-09-11T11:01:29.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26fb10980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e33dad2290 0x55e33db627a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26fb10980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e33d9e5ae0 con 0x55e33db62ce0 2024-09-11T11:01:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26fb10980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55e33da09e30 con 0x55e33dad2290 2024-09-11T11:01:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26d620640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e33dad2290 0x55e33db627a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26ce1f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55e33db62ce0 0x55e33db650d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54636/0 (socket says 172.21.15.145:54636) 2024-09-11T11:01:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26ce1f640 1 -- 172.21.15.145:0/871802513 learned_addr learned my addr 172.21.15.145:0/871802513 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26d620640 1 -- 172.21.15.145:0/871802513 >> v1:172.21.15.102:6789/0 conn(0x55e33db62ce0 legacy=0x55e33db650d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26d620640 1 -- 172.21.15.145:0/871802513 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33dad2670 con 0x55e33dad2290 2024-09-11T11:01:29.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb26d620640 1 --2- 172.21.15.145:0/871802513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33db627a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb26000a420 tx=0x7fb26001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde6ecd78ff6d504 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.072+0000 7fb267fff640 1 -- 172.21.15.145:0/871802513 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600af070 con 0x55e33dad2290 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb267fff640 1 -- 172.21.15.145:0/871802513 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2600aa530 con 0x55e33dad2290 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb267fff640 1 -- 172.21.15.145:0/871802513 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600aa850 con 0x55e33dad2290 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb26fb10980 1 -- 172.21.15.145:0/871802513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 msgr2=0x55e33db627a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb26fb10980 1 --2- 172.21.15.145:0/871802513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33db627a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb26000a420 tx=0x7fb26001afd0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb26fb10980 1 -- 172.21.15.145:0/871802513 shutdown_connections 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb26fb10980 1 --2- 172.21.15.145:0/871802513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33db627a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb26fb10980 1 -- 172.21.15.145:0/871802513 >> 172.21.15.145:0/871802513 conn(0x55e33db58090 msgr2=0x55e33db5a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb26fb10980 1 -- 172.21.15.145:0/871802513 shutdown_connections 2024-09-11T11:01:29.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.076+0000 7fb26fb10980 1 -- 172.21.15.145:0/871802513 wait complete. 2024-09-11T11:01:29.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 Processor -- start 2024-09-11T11:01:29.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 -- start start 2024-09-11T11:01:29.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc4ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e33da0b200 con 0x55e33dad2290 2024-09-11T11:01:29.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc4ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc4ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50394/0 (socket says 172.21.15.145:50394) 2024-09-11T11:01:29.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26d620640 1 -- 172.21.15.145:0/2035337829 learned_addr learned my addr 172.21.15.145:0/2035337829 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26d620640 1 -- 172.21.15.145:0/2035337829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33dc4b1d0 con 0x55e33dad2290 2024-09-11T11:01:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26d620640 1 --2- 172.21.15.145:0/2035337829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc4ac00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb2600ad040 tx=0x7fb2600033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f3c75a857e4612 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb15b606640 1 -- 172.21.15.145:0/2035337829 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600af040 con 0x55e33dad2290 2024-09-11T11:01:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb15b606640 1 -- 172.21.15.145:0/2035337829 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2600aa9a0 con 0x55e33dad2290 2024-09-11T11:01:29.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb15b606640 1 -- 172.21.15.145:0/2035337829 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600aac80 con 0x55e33dad2290 2024-09-11T11:01:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 -- 172.21.15.145:0/2035337829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 msgr2=0x55e33dc4ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 --2- 172.21.15.145:0/2035337829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc4ac00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb2600ad040 tx=0x7fb2600033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 -- 172.21.15.145:0/2035337829 shutdown_connections 2024-09-11T11:01:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 --2- 172.21.15.145:0/2035337829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc4ac00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.088+0000 7fb26fb10980 1 -- 172.21.15.145:0/2035337829 >> 172.21.15.145:0/2035337829 conn(0x55e33db58090 msgr2=0x55e33dc46830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 -- 172.21.15.145:0/2035337829 shutdown_connections 2024-09-11T11:01:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 -- 172.21.15.145:0/2035337829 wait complete. 2024-09-11T11:01:29.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 Processor -- start 2024-09-11T11:01:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 -- start start 2024-09-11T11:01:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc51df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e33db69220 con 0x55e33dad2290 2024-09-11T11:01:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc51df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc51df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50400/0 (socket says 172.21.15.145:50400) 2024-09-11T11:01:29.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26d620640 1 -- 172.21.15.145:0/1697518137 learned_addr learned my addr 172.21.15.145:0/1697518137 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26d620640 1 -- 172.21.15.145:0/1697518137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33dc52330 con 0x55e33dad2290 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26d620640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc51df0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb2600aa500 tx=0x7fb260017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb159e03640 1 -- 172.21.15.145:0/1697518137 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600c5070 con 0x55e33dad2290 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb159e03640 1 -- 172.21.15.145:0/1697518137 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2600c1880 con 0x55e33dad2290 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e33dc525c0 con 0x55e33dad2290 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb159e03640 1 -- 172.21.15.145:0/1697518137 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600c1b60 con 0x55e33dad2290 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33dc552a0 con 0x55e33dad2290 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb159e03640 1 -- 172.21.15.145:0/1697518137 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb2600b5470 con 0x55e33dad2290 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb159e03640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb154034650 0x7fb154036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb159e03640 1 -- 172.21.15.145:0/1697518137 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fb2600bb070 con 0x55e33dad2290 2024-09-11T11:01:29.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb154034650 0x7fb154036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33db62ce0 0x55e33dc58ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc59430 con 0x55e33db62ce0 2024-09-11T11:01:29.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.092+0000 7fb26de21640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33db62ce0 0x55e33dc58ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb154034650 0x7fb154036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb258001da0 tx=0x7fb258001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26de21640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33db62ce0 0x55e33dc58ef0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26de21640 1 -- 172.21.15.145:0/1697518137 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33db62ce0 2024-09-11T11:01:29.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc5a190 0x55e33dc5c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc5cbc0 con 0x55e33dc5a190 2024-09-11T11:01:29.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26d620640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc5a190 0x55e33dc5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26d620640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc5a190 0x55e33dc5c580 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26d620640 1 -- 172.21.15.145:0/1697518137 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2600d0070 con 0x55e33dc5a190 2024-09-11T11:01:29.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc5e470 con 0x55e33dc5a190 2024-09-11T11:01:29.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26d620640 1 -- 172.21.15.145:0/1697518137 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2600d0070 con 0x55e33dc5a190 2024-09-11T11:01:29.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc5d5e0 con 0x55e33dc5a190 2024-09-11T11:01:29.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26d620640 1 -- 172.21.15.145:0/1697518137 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2600d0070 con 0x55e33dc5a190 2024-09-11T11:01:29.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e33dc5e050 0x55e33dc61890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc62020 con 0x55e33dc5e050 2024-09-11T11:01:29.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e33dc5e050 0x55e33dc61890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.096+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e33dc5e050 0x55e33dc61890 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26ce1f640 1 -- 172.21.15.145:0/1697518137 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc5e050 2024-09-11T11:01:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 Processor -- start 2024-09-11T11:01:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 -- start start 2024-09-11T11:01:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc6faf0 0x55e33dc6ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e33da64800 con 0x55e33dc6faf0 2024-09-11T11:01:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc6faf0 0x55e33dc6ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc6faf0 0x55e33dc6ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50414/0 (socket says 172.21.15.145:50414) 2024-09-11T11:01:29.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26d620640 1 -- 172.21.15.145:0/609336319 learned_addr learned my addr 172.21.15.145:0/609336319 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26d620640 1 -- 172.21.15.145:0/609336319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33dc70450 con 0x55e33dc6faf0 2024-09-11T11:01:29.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26d620640 1 --2- 172.21.15.145:0/609336319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc6faf0 0x55e33dc6ff10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb2600e31a0 tx=0x7fb2600e47f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb152ffd640 1 -- 172.21.15.145:0/609336319 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600a9b20 con 0x55e33dc6faf0 2024-09-11T11:01:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb152ffd640 1 -- 172.21.15.145:0/609336319 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2600a9cc0 con 0x55e33dc6faf0 2024-09-11T11:01:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 -- 172.21.15.145:0/609336319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e33dc706e0 con 0x55e33dc6faf0 2024-09-11T11:01:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb152ffd640 1 -- 172.21.15.145:0/609336319 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600d8570 con 0x55e33dc6faf0 2024-09-11T11:01:29.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 -- 172.21.15.145:0/609336319 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33dc73360 con 0x55e33dc6faf0 2024-09-11T11:01:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb152ffd640 1 -- 172.21.15.145:0/609336319 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb2600d8710 con 0x55e33dc6faf0 2024-09-11T11:01:29.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb152ffd640 1 --2- 172.21.15.145:0/609336319 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb148034650 0x7fb148036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb152ffd640 1 -- 172.21.15.145:0/609336319 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fb2600f2850 con 0x55e33dc6faf0 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/609336319 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb148034650 0x7fb148036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 Processor -- start 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 -- start start 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc7c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26fb10980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e33dc4b490 con 0x55e33dc7c460 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.100+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/609336319 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb148034650 0x7fb148036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55e33dc563e0 tx=0x7fb25800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc7c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc7c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50418/0 (socket says 172.21.15.145:50418) 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 -- 172.21.15.145:0/1857796569 learned_addr learned my addr 172.21.15.145:0/1857796569 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 -- 172.21.15.145:0/1857796569 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33dc7ce10 con 0x55e33dc7c460 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 --2- 172.21.15.145:0/1857796569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc7c840 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb2600a9fc0 tx=0x7fb2600e1e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba6c2f793fd9b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb150ff9640 1 -- 172.21.15.145:0/1857796569 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600c9400 con 0x55e33dc7c460 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb150ff9640 1 -- 172.21.15.145:0/1857796569 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb260102070 con 0x55e33dc7c460 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb150ff9640 1 -- 172.21.15.145:0/1857796569 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600d4ab0 con 0x55e33dc7c460 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- 172.21.15.145:0/1857796569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 msgr2=0x55e33dc7c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1857796569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc7c840 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb2600a9fc0 tx=0x7fb2600e1e50 comp rx=0 tx=0).stop 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- 172.21.15.145:0/1857796569 shutdown_connections 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1857796569 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc7c840 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- 172.21.15.145:0/1857796569 >> 172.21.15.145:0/1857796569 conn(0x55e33dc78840 msgr2=0x55e33dc76940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- 172.21.15.145:0/1857796569 shutdown_connections 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- 172.21.15.145:0/1857796569 wait complete. 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 Processor -- start 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- start start 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc835f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e33dc7d2b0 con 0x55e33dc7c460 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc835f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc835f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50422/0 (socket says 172.21.15.145:50422) 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 learned_addr learned my addr 172.21.15.145:0/3250426465 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e33dc83b30 con 0x55e33dc7c460 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26d620640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc835f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb2600a9fc0 tx=0x7fb2600c8fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb13effd640 1 -- 172.21.15.145:0/3250426465 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600c03e0 con 0x55e33dc7c460 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e33dc83b30 con 0x55e33dc7c460 2024-09-11T11:01:29.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e33dc83b30 con 0x55e33dc7c460 2024-09-11T11:01:29.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb13effd640 1 -- 172.21.15.145:0/3250426465 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26010d070 con 0x55e33dc7c460 2024-09-11T11:01:29.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.104+0000 7fb13effd640 1 -- 172.21.15.145:0/3250426465 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2600c9400 con 0x55e33dc7c460 2024-09-11T11:01:29.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb13effd640 1 -- 172.21.15.145:0/3250426465 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb2600fb040 con 0x55e33dc7c460 2024-09-11T11:01:29.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb13effd640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb138034600 0x7fb138036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb13effd640 1 -- 172.21.15.145:0/3250426465 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fb2600f8040 con 0x55e33dc7c460 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb138034600 0x7fb138036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33dc8e600 0x55e33dc90aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc911f0 con 0x55e33dc8e600 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26de21640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33dc8e600 0x55e33dc90aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb138034600 0x7fb138036ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55e33dc62420 tx=0x7fb258010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26de21640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33dc8e600 0x55e33dc90aa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 20 realm 2024-09-11T11:01:29.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc8daf0 con 0x55e33dc8e600 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc91cb0 con 0x55e33dc8e600 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc92a90 0x55e33dc94e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc95510 con 0x55e33dc92a90 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26d620640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc92a90 0x55e33dc94e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.108+0000 7fb26d620640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc92a90 0x55e33dc94e80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26fb10980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc95a50 con 0x55e33dc92a90 2024-09-11T11:01:29.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26fb10980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:29.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26fb10980 20 searching for the correct realm 2024-09-11T11:01:29.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e33dc97230 0x55e33dc996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc99dc0 con 0x55e33dc97230 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e33dc97230 0x55e33dc996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26ce1f640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e33dc97230 0x55e33dc996f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc99dc0 con 0x55e33dc92a90 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26d620640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb260109040 0x7fb2600c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x7fb260109040 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26de21640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb260109040 0x7fb2600c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26de21640 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb260109040 0x7fb2600c97c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc97230 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.112+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc92a90 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc92a90 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x7fb260109040 2024-09-11T11:01:29.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x7fb260109040 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc92a90 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc97230 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc92a90 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.116+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc97230 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc97230 2024-09-11T11:01:29.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x7fb260109040 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc8e600 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x7fb260109040 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc97230 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x7fb260109040 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc92a90 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc92a90 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc97230 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.120+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc92a90 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x7fb260111030 con 0x55e33dc92a90 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:29.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc95660 con 0x55e33dc8e600 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc95a50 con 0x55e33dc92a90 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc95a50 con 0x7fb260109040 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 zone default found 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 4 Realm: () 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 zonegroup default 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9a240 con 0x7fb260109040 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9bff0 con 0x55e33dc97230 2024-09-11T11:01:29.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9c560 con 0x55e33dc97230 2024-09-11T11:01:29.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 started sync module instance, tier type = 2024-09-11T11:01:29.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:29.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.124+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9b460 con 0x55e33dc92a90 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.128+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.128+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94434482567552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9b460 con 0x55e33dc92a90 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.128+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9d060 con 0x55e33dc8e600 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.128+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.128+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94434482572080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9d4d0 con 0x55e33dc8e600 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.128+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9df90 con 0x55e33dc92a90 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.128+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94434482567552] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.128+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94434482572080] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94434482575968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9d020 con 0x55e33dc92a90 2024-09-11T11:01:29.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9e830 con 0x7fb260109040 2024-09-11T11:01:29.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94434482578304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9d020 con 0x7fb260109040 2024-09-11T11:01:29.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9f2f0 con 0x55e33dc92a90 2024-09-11T11:01:29.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94434482575968] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94434482578304] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94434482579360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9f2b0 con 0x55e33dc92a90 2024-09-11T11:01:29.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.132+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9f6e0 con 0x55e33dc97230 2024-09-11T11:01:29.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.136+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.136+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94434482565040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9ff30 con 0x55e33dc97230 2024-09-11T11:01:29.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.136+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dca0930 con 0x55e33dc97230 2024-09-11T11:01:29.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.136+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.136+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94434482588960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dca15f0 con 0x55e33dc97230 2024-09-11T11:01:29.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.136+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dca2030 con 0x7fb260109040 2024-09-11T11:01:29.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.136+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94434482579360] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.136+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94434482565040] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94434482584192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dca1ff0 con 0x7fb260109040 2024-09-11T11:01:29.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 add_watcher() i=0 2024-09-11T11:01:29.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 add_watcher() i=1 2024-09-11T11:01:29.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 add_watcher() i=2 2024-09-11T11:01:29.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 add_watcher() i=3 2024-09-11T11:01:29.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 add_watcher() i=4 2024-09-11T11:01:29.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 add_watcher() i=5 2024-09-11T11:01:29.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94434482588960] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 add_watcher() i=6 2024-09-11T11:01:29.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94434482584192] v32'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 add_watcher() i=7 2024-09-11T11:01:29.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:29.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dca1140 con 0x55e33dc8e600 2024-09-11T11:01:29.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94434482580928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dca2220 con 0x55e33dc8e600 2024-09-11T11:01:29.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94434482580928] v32'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb1237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:29.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:29.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.140+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcad2f0 con 0x55e33dc92a90 2024-09-11T11:01:29.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.144+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.144+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcad3e0 con 0x7fb260109040 2024-09-11T11:01:29.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.144+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.144+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcadb10 con 0x55e33dc97230 2024-09-11T11:01:29.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.148+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.148+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcadfc0 con 0x55e33dc8e600 2024-09-11T11:01:29.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.148+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'122 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.148+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcab190 con 0x55e33dc92a90 2024-09-11T11:01:29.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.152+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.152+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcab190 con 0x55e33dc97230 2024-09-11T11:01:29.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.152+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.152+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcab190 con 0x55e33dc92a90 2024-09-11T11:01:29.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.152+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.152+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcab190 con 0x55e33dc8e600 2024-09-11T11:01:29.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.156+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.156+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaed10 con 0x55e33dc92a90 2024-09-11T11:01:29.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.156+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.156+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaed10 con 0x55e33dc92a90 2024-09-11T11:01:29.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.160+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.160+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaed10 con 0x55e33dc92a90 2024-09-11T11:01:29.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.160+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.160+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaed10 con 0x55e33dc97230 2024-09-11T11:01:29.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.160+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.160+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf280 con 0x55e33dc92a90 2024-09-11T11:01:29.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.164+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.164+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf280 con 0x55e33dc8e600 2024-09-11T11:01:29.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.164+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'29 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.164+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf730 con 0x55e33dc8e600 2024-09-11T11:01:29.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.164+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.164+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf730 con 0x55e33dc92a90 2024-09-11T11:01:29.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.168+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.168+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf730 con 0x55e33dc92a90 2024-09-11T11:01:29.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.168+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.168+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf730 con 0x55e33dc97230 2024-09-11T11:01:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.172+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.172+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf5f0 con 0x55e33dc92a90 2024-09-11T11:01:29.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.172+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.172+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf5f0 con 0x55e33dc8e600 2024-09-11T11:01:29.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.176+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.176+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf5f0 con 0x55e33dc92a90 2024-09-11T11:01:29.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.176+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.176+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf5f0 con 0x55e33dc92a90 2024-09-11T11:01:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.180+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.180+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf5f0 con 0x55e33dc97230 2024-09-11T11:01:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.180+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.180+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf680 con 0x55e33dc92a90 2024-09-11T11:01:29.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.184+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.184+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf680 con 0x55e33dc97230 2024-09-11T11:01:29.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.184+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.184+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf710 con 0x55e33dc97230 2024-09-11T11:01:29.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.188+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'24 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.188+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf710 con 0x55e33dc97230 2024-09-11T11:01:29.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.188+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.188+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf710 con 0x55e33dc92a90 2024-09-11T11:01:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.192+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.192+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf710 con 0x55e33dc8e600 2024-09-11T11:01:29.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.192+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.192+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf710 con 0x55e33dc92a90 2024-09-11T11:01:29.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'31 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf710 con 0x55e33dc8e600 2024-09-11T11:01:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcaf710 con 0x7fb260109040 2024-09-11T11:01:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb1227e4640 20 reqs_thread_entry: start 2024-09-11T11:01:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26fb10980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26fb10980 20 Filter name: none 2024-09-11T11:01:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb093fff640 20 reqs_thread_entry: start 2024-09-11T11:01:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26fb10980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:01:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26fb10980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.196+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dccac60 con 0x7fb260109040 2024-09-11T11:01:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:01:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-11T11:01:29.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:01:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dccd130 con 0x55e33dc8e600 2024-09-11T11:01:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv4 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-11T11:01:29.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dccb110 con 0x55e33dc97230 2024-09-11T11:01:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-11T11:01:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94434482764960 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dccd800 con 0x55e33dc92a90 2024-09-11T11:01:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== watch-notify(notify (1) cookie 94434482575968 notify 137438953493 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e33dcaed10 con 0x55e33dc92a90 2024-09-11T11:01:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb150ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94434482575968 notifier 4535 bl.length()=170 2024-09-11T11:01:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb150ff9640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb130003d70 con 0x55e33dc92a90 2024-09-11T11:01:29.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(97 notify.2 [notify cookie 94434482764960 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.200+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== watch-notify(notify_complete (2) cookie 94434482764960 notify 137438953493 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e33dc70450 con 0x55e33dc92a90 2024-09-11T11:01:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 10 removing email index: 2024-09-11T11:01:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 10 removing user buckets index 2024-09-11T11:01:29.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dccd780 con 0x55e33dc8e600 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(99 fud.buckets [delete] v32'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94434482771840 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcccc80 con 0x55e33dc97230 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== watch-notify(notify (1) cookie 94434482588960 notify 137438953478 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55e33dcab080 con 0x55e33dc97230 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb13ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953478 cookie 94434482588960 notifier 4535 bl.length()=160 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(100 notify.6 [notify cookie 94434482771840 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb13ffff640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb0a00032d0 con 0x55e33dc97230 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== watch-notify(notify_complete (2) cookie 94434482771840 notify 137438953478 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e33dcaca50 con 0x55e33dc97230 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 10 removing user index: fud 2024-09-11T11:01:29.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dcccc80 con 0x7fb260109040 2024-09-11T11:01:29.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(102 fud [call,call,delete] v32'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.204+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94434482770512 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55e33dccc120 con 0x55e33dc97230 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== watch-notify(notify (1) cookie 94434482565040 notify 137438953479 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55e33dcaca50 con 0x55e33dc97230 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb13ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953479 cookie 94434482565040 notifier 4535 bl.length()=152 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb13ffff640 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb0a00032d0 con 0x55e33dc97230 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(103 notify.5 [notify cookie 94434482770512 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== watch-notify(notify_complete (2) cookie 94434482770512 notify 137438953479 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e33dcab530 con 0x55e33dc97230 2024-09-11T11:01:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb1237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94434482580928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dccc530 con 0x55e33dc8e600 2024-09-11T11:01:29.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94434482580928] v32'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.208+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94434482567552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9edc0 con 0x55e33dc92a90 2024-09-11T11:01:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.212+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94434482567552] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.212+0000 7fb26fb10980 20 remove_watcher() i=0 2024-09-11T11:01:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.212+0000 7fb26fb10980 2 removed watcher, disabling cache 2024-09-11T11:01:29.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.212+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94434482572080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9b960 con 0x55e33dc8e600 2024-09-11T11:01:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.212+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94434482572080] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x55e33dc8e600 2024-09-11T11:01:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.212+0000 7fb26fb10980 20 remove_watcher() i=1 2024-09-11T11:01:29.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.212+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94434482575968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9b960 con 0x55e33dc92a90 2024-09-11T11:01:29.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.216+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94434482575968] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.216+0000 7fb26fb10980 20 remove_watcher() i=2 2024-09-11T11:01:29.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.216+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94434482578304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9da60 con 0x7fb260109040 2024-09-11T11:01:29.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.216+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94434482578304] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.216+0000 7fb26fb10980 20 remove_watcher() i=3 2024-09-11T11:01:29.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.216+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94434482579360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9da60 con 0x55e33dc92a90 2024-09-11T11:01:29.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26d620640 1 -- 172.21.15.145:0/3250426465 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94434482579360] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2600ea020 con 0x55e33dc92a90 2024-09-11T11:01:29.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26fb10980 20 remove_watcher() i=4 2024-09-11T11:01:29.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94434482565040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9da60 con 0x55e33dc97230 2024-09-11T11:01:29.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94434482565040] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26fb10980 20 remove_watcher() i=5 2024-09-11T11:01:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94434482588960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dc9da60 con 0x55e33dc97230 2024-09-11T11:01:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26ce1f640 1 -- 172.21.15.145:0/3250426465 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94434482588960] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb25800e6c0 con 0x55e33dc97230 2024-09-11T11:01:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26fb10980 20 remove_watcher() i=6 2024-09-11T11:01:29.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.220+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94434482584192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55e33dca0d20 con 0x7fb260109040 2024-09-11T11:01:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94434482584192] v32'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2680083f0 con 0x7fb260109040 2024-09-11T11:01:29.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 20 remove_watcher() i=7 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc92a90 msgr2=0x55e33dc94e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc92a90 0x55e33dc94e80 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33dc8e600 msgr2=0x55e33dc90aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33dc8e600 0x55e33dc90aa0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb260109040 msgr2=0x7fb2600c97c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb260109040 0x7fb2600c97c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e33dc97230 msgr2=0x55e33dc996f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e33dc97230 0x55e33dc996f0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb138034600 msgr2=0x7fb138036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb138034600 0x7fb138036ac0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55e33dc62420 tx=0x7fb258010000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26de21640 1 -- 172.21.15.145:0/3250426465 reap_dead start 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 msgr2=0x55e33dc835f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc835f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb2600a9fc0 tx=0x7fb2600c8fa0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 shutdown_connections 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/3250426465 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc7c460 0x55e33dc835f0 secure :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb2600a9fc0 tx=0x7fb2600c8fa0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 >> 172.21.15.145:0/3250426465 conn(0x55e33dc78840 msgr2=0x55e33dc76910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 shutdown_connections 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/3250426465 wait complete. 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/609336319 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb148034650 msgr2=0x7fb148036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/609336319 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb148034650 0x7fb148036b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55e33dc563e0 tx=0x7fb25800f000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/609336319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc6faf0 msgr2=0x55e33dc6ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/609336319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc6faf0 0x55e33dc6ff10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb2600e31a0 tx=0x7fb2600e47f0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/609336319 shutdown_connections 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/609336319 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb148034650 0x7fb148036b10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/609336319 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dc6faf0 0x55e33dc6ff10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/609336319 >> 172.21.15.145:0/609336319 conn(0x55e33dc64c40 msgr2=0x55e33dc676c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/609336319 shutdown_connections 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/609336319 wait complete. 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc5a190 msgr2=0x55e33dc5c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e33dc5a190 0x55e33dc5c580 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33db62ce0 msgr2=0x55e33dc58ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e33db62ce0 0x55e33dc58ef0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e33dc5e050 msgr2=0x55e33dc61890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e33dc5e050 0x55e33dc61890 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb154034650 msgr2=0x7fb154036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb154034650 0x7fb154036b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb258001da0 tx=0x7fb258001300 comp rx=0 tx=0).stop 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 msgr2=0x55e33dc51df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 --2- 172.21.15.145:0/1697518137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e33dad2290 0x55e33dc51df0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb2600aa500 tx=0x7fb260017d70 comp rx=0 tx=0).stop 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26de21640 1 -- 172.21.15.145:0/1697518137 reap_dead start 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 shutdown_connections 2024-09-11T11:01:29.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 >> 172.21.15.145:0/1697518137 conn(0x55e33db58090 msgr2=0x55e33dc453b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 shutdown_connections 2024-09-11T11:01:29.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.224+0000 7fb26fb10980 1 -- 172.21.15.145:0/1697518137 wait complete. 2024-09-11T11:01:29.240 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-11T11:01:29.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-11T11:01:29.240 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-11T11:01:29.329 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:29.329 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:29.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a64e1f980 1 Processor -- start 2024-09-11T11:01:29.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a64e1f980 1 -- start start 2024-09-11T11:01:29.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a64e1f980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55fa7df1c880 0x55fa7df1cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a64e1f980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa7dda2ae0 con 0x55fa7df1d1d0 2024-09-11T11:01:29.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a64e1f980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55fa7ddc6e30 con 0x55fa7df1c880 2024-09-11T11:01:29.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a6292f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55fa7df1c880 0x55fa7df1cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a6212e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55fa7df1d1d0 0x55fa7df21c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54652/0 (socket says 172.21.15.145:54652) 2024-09-11T11:01:29.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a6212e640 1 -- 172.21.15.145:0/3641743145 learned_addr learned my addr 172.21.15.145:0/3641743145 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:29.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a6292f640 1 -- 172.21.15.145:0/3641743145 >> v1:172.21.15.102:6789/0 conn(0x55fa7df1d1d0 legacy=0x55fa7df21c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.328+0000 7f9a6292f640 1 -- 172.21.15.145:0/3641743145 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7df24450 con 0x55fa7df1c880 2024-09-11T11:01:29.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a6292f640 1 --2- 172.21.15.145:0/3641743145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7df1cc60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00a480 tx=0x7f9a5c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845fed985a51c943 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a6192d640 1 -- 172.21.15.145:0/3641743145 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0b0070 con 0x55fa7df1c880 2024-09-11T11:01:29.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a6192d640 1 -- 172.21.15.145:0/3641743145 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0ab540 con 0x55fa7df1c880 2024-09-11T11:01:29.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a6192d640 1 -- 172.21.15.145:0/3641743145 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0ab840 con 0x55fa7df1c880 2024-09-11T11:01:29.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3641743145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 msgr2=0x55fa7df1cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/3641743145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7df1cc60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c00a480 tx=0x7f9a5c01b280 comp rx=0 tx=0).stop 2024-09-11T11:01:29.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3641743145 shutdown_connections 2024-09-11T11:01:29.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/3641743145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7df1cc60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3641743145 >> 172.21.15.145:0/3641743145 conn(0x55fa7de901d0 msgr2=0x55fa7de905e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3641743145 shutdown_connections 2024-09-11T11:01:29.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.332+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3641743145 wait complete. 2024-09-11T11:01:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 Processor -- start 2024-09-11T11:01:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 -- start start 2024-09-11T11:01:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e007c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa7ddc8200 con 0x55fa7df1c880 2024-09-11T11:01:29.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e007c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e007c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50438/0 (socket says 172.21.15.145:50438) 2024-09-11T11:01:29.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a6292f640 1 -- 172.21.15.145:0/348885872 learned_addr learned my addr 172.21.15.145:0/348885872 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a6292f640 1 -- 172.21.15.145:0/348885872 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7e008200 con 0x55fa7df1c880 2024-09-11T11:01:29.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a6292f640 1 --2- 172.21.15.145:0/348885872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e007c30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ae040 tx=0x7f9a5c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be91f333c5c78cc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9950e09640 1 -- 172.21.15.145:0/348885872 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0b0040 con 0x55fa7df1c880 2024-09-11T11:01:29.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9950e09640 1 -- 172.21.15.145:0/348885872 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0ab9b0 con 0x55fa7df1c880 2024-09-11T11:01:29.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9950e09640 1 -- 172.21.15.145:0/348885872 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0abc90 con 0x55fa7df1c880 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 -- 172.21.15.145:0/348885872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 msgr2=0x55fa7e007c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/348885872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e007c30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ae040 tx=0x7f9a5c003030 comp rx=0 tx=0).stop 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 -- 172.21.15.145:0/348885872 shutdown_connections 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/348885872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e007c30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 -- 172.21.15.145:0/348885872 >> 172.21.15.145:0/348885872 conn(0x55fa7de901d0 msgr2=0x55fa7e003860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 -- 172.21.15.145:0/348885872 shutdown_connections 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 -- 172.21.15.145:0/348885872 wait complete. 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 Processor -- start 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.348+0000 7f9a64e1f980 1 -- start start 2024-09-11T11:01:29.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a64e1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e00ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a64e1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa7df23e90 con 0x55fa7df1c880 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e00ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e00ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50454/0 (socket says 172.21.15.145:50454) 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a6292f640 1 -- 172.21.15.145:0/2087909 learned_addr learned my addr 172.21.15.145:0/2087909 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a6292f640 1 -- 172.21.15.145:0/2087909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7e00f3a0 con 0x55fa7df1c880 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a6292f640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e00ee60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0030b0 tx=0x7f9a5c018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f994f606640 1 -- 172.21.15.145:0/2087909 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0c5070 con 0x55fa7df1c880 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f994f606640 1 -- 172.21.15.145:0/2087909 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0b6970 con 0x55fa7df1c880 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa7e00f630 con 0x55fa7df1c880 2024-09-11T11:01:29.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f994f606640 1 -- 172.21.15.145:0/2087909 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0b0050 con 0x55fa7df1c880 2024-09-11T11:01:29.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa7e00fa60 con 0x55fa7df1c880 2024-09-11T11:01:29.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f994f606640 1 -- 172.21.15.145:0/2087909 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a5c0c8070 con 0x55fa7df1c880 2024-09-11T11:01:29.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f994f606640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9948034650 0x7f9948036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f994f606640 1 -- 172.21.15.145:0/2087909 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f9a5c0bc070 con 0x55fa7df1c880 2024-09-11T11:01:29.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a6212e640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9948034650 0x7f9948036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7df1d1d0 0x55fa7e015df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e016460 con 0x55fa7df1d1d0 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a63130640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7df1d1d0 0x55fa7e015df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a6212e640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9948034650 0x7f9948036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a58000f70 tx=0x7f9a580012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a63130640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7df1d1d0 0x55fa7e015df0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a63130640 1 -- 172.21.15.145:0/2087909 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7df1d1d0 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e017250 0x55fa7e019640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.352+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e019c80 con 0x55fa7e017250 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a6292f640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e017250 0x55fa7e019640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a6292f640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e017250 0x55fa7e019640 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a6292f640 1 -- 172.21.15.145:0/2087909 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a5c0c7030 con 0x55fa7e017250 2024-09-11T11:01:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e01b530 con 0x55fa7e017250 2024-09-11T11:01:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a6292f640 1 -- 172.21.15.145:0/2087909 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9a5c0c7030 con 0x55fa7e017250 2024-09-11T11:01:29.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e01a6a0 con 0x55fa7e017250 2024-09-11T11:01:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a6292f640 1 -- 172.21.15.145:0/2087909 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a5c0c7030 con 0x55fa7e017250 2024-09-11T11:01:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55fa7e01b110 0x55fa7e01e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e01f0e0 con 0x55fa7e01b110 2024-09-11T11:01:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a6212e640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55fa7e01b110 0x55fa7e01e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a6212e640 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55fa7e01b110 0x55fa7e01e950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a6212e640 1 -- 172.21.15.145:0/2087909 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e01b110 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a64e1f980 1 Processor -- start 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a64e1f980 1 -- start start 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.356+0000 7f9a64e1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e02cbb0 0x55fa7e02cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a64e1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa7de21800 con 0x55fa7e02cbb0 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e02cbb0 0x55fa7e02cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e02cbb0 0x55fa7e02cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50460/0 (socket says 172.21.15.145:50460) 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a6292f640 1 -- 172.21.15.145:0/1682567495 learned_addr learned my addr 172.21.15.145:0/1682567495 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a6292f640 1 -- 172.21.15.145:0/1682567495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7e02d510 con 0x55fa7e02cbb0 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a6292f640 1 --2- 172.21.15.145:0/1682567495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e02cbb0 0x55fa7e02cfd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0e2000 tx=0x7f9a5c0b7af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f994ce01640 1 -- 172.21.15.145:0/1682567495 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0d5040 con 0x55fa7e02cbb0 2024-09-11T11:01:29.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f994ce01640 1 -- 172.21.15.145:0/1682567495 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0e3b50 con 0x55fa7e02cbb0 2024-09-11T11:01:29.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f994ce01640 1 -- 172.21.15.145:0/1682567495 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0e3e30 con 0x55fa7e02cbb0 2024-09-11T11:01:29.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a64e1f980 1 -- 172.21.15.145:0/1682567495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa7e02d7a0 con 0x55fa7e02cbb0 2024-09-11T11:01:29.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a64e1f980 1 -- 172.21.15.145:0/1682567495 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa7e030420 con 0x55fa7e02cbb0 2024-09-11T11:01:29.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f994ce01640 1 -- 172.21.15.145:0/1682567495 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a5c0ad000 con 0x55fa7e02cbb0 2024-09-11T11:01:29.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f994ce01640 1 --2- 172.21.15.145:0/1682567495 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f993c034600 0x7f993c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f994ce01640 1 -- 172.21.15.145:0/1682567495 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f9a5c0e0040 con 0x55fa7e02cbb0 2024-09-11T11:01:29.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a6212e640 1 --2- 172.21.15.145:0/1682567495 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f993c034600 0x7f993c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a64e1f980 1 Processor -- start 2024-09-11T11:01:29.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a64e1f980 1 -- start start 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a6212e640 1 --2- 172.21.15.145:0/1682567495 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f993c034600 0x7f993c036ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800bf60 tx=0x7f9a5800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a64e1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e039940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.360+0000 7f9a64e1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa7e0084c0 con 0x55fa7e039560 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e039940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e039940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50474/0 (socket says 172.21.15.145:50474) 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 -- 172.21.15.145:0/3951982220 learned_addr learned my addr 172.21.15.145:0/3951982220 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 -- 172.21.15.145:0/3951982220 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7e039f10 con 0x55fa7e039560 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 --2- 172.21.15.145:0/3951982220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e039940 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ab000 tx=0x7f9a5c0e0990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bca22f6d853d4bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f99467fc640 1 -- 172.21.15.145:0/3951982220 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0f0040 con 0x55fa7e039560 2024-09-11T11:01:29.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f99467fc640 1 -- 172.21.15.145:0/3951982220 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0e33e0 con 0x55fa7e039560 2024-09-11T11:01:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f99467fc640 1 -- 172.21.15.145:0/3951982220 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0c93b0 con 0x55fa7e039560 2024-09-11T11:01:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3951982220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 msgr2=0x55fa7e039940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/3951982220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e039940 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ab000 tx=0x7f9a5c0e0990 comp rx=0 tx=0).stop 2024-09-11T11:01:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3951982220 shutdown_connections 2024-09-11T11:01:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/3951982220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e039940 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3951982220 >> 172.21.15.145:0/3951982220 conn(0x55fa7e035940 msgr2=0x55fa7e033a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3951982220 shutdown_connections 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 -- 172.21.15.145:0/3951982220 wait complete. 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 Processor -- start 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 -- start start 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e040530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55fa7e039f10 con 0x55fa7e039560 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e040530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e040530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50476/0 (socket says 172.21.15.145:50476) 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 learned_addr learned my addr 172.21.15.145:0/2926817127 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa7e040a70 con 0x55fa7e039560 2024-09-11T11:01:29.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a6292f640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e040530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ca600 tx=0x7f9a5c0d9e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9944ff9640 1 -- 172.21.15.145:0/2926817127 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0f0050 con 0x55fa7e039560 2024-09-11T11:01:29.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9944ff9640 1 -- 172.21.15.145:0/2926817127 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c0df960 con 0x55fa7e039560 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9944ff9640 1 -- 172.21.15.145:0/2926817127 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9a5c0dfc60 con 0x55fa7e039560 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.364+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa7e040a70 con 0x55fa7e039560 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa7e040a70 con 0x55fa7e039560 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9944ff9640 1 -- 172.21.15.145:0/2926817127 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9a5c0df1d0 con 0x55fa7e039560 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9944ff9640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f992c034650 0x7f992c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9944ff9640 1 -- 172.21.15.145:0/2926817127 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f9a5c0a8070 con 0x55fa7e039560 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a6212e640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f992c034650 0x7f992c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7e04b440 0x55fa7e04d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a6212e640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f992c034650 0x7f992c036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55fa7e0132e0 tx=0x7f9a58010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e04e050 con 0x55fa7e04b440 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a63130640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7e04b440 0x55fa7e04d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a63130640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7e04b440 0x55fa7e04d900 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 20 realm 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e04a870 con 0x55fa7e04b440 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:29.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e04e900 con 0x55fa7e04b440 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e04f6e0 0x55fa7e051ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e052160 con 0x55fa7e04f6e0 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.368+0000 7f9a6292f640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e04f6e0 0x55fa7e051ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6292f640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e04f6e0 0x55fa7e051ad0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9a5c116070 con 0x55fa7e04f6e0 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a64e1f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9a5c116070 con 0x55fa7e04f6e0 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a64e1f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a64e1f980 20 searching for the correct realm 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55fa7e054720 0x55fa7e056b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e057190 con 0x55fa7e054720 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6212e640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55fa7e054720 0x55fa7e056b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6212e640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55fa7e054720 0x55fa7e056b10 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e057190 con 0x55fa7e04f6e0 2024-09-11T11:01:29.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9a5c116070 con 0x55fa7e04f6e0 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6292f640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9a5c0ca060 0x7f9a5c0dc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a63130640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9a5c0ca060 0x7f9a5c0dc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a63130640 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9a5c0ca060 0x7f9a5c0dc920 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.372+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e054720 2024-09-11T11:01:29.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e054720 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.376+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e054720 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e054720 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04b440 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e054720 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.380+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e054720 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0529b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e053200 con 0x55fa7e04b440 2024-09-11T11:01:29.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0535f0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0535f0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:29.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 zone default found 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 4 Realm: () 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 zonegroup default 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0575f0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e053b30 con 0x55fa7e054720 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e059d50 con 0x55fa7e054720 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 started sync module instance, tier type = 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.384+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e058810 con 0x55fa7e04f6e0 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.388+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.388+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94534344477744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e058810 con 0x55fa7e04f6e0 2024-09-11T11:01:29.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.388+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05a5a0 con 0x55fa7e04b440 2024-09-11T11:01:29.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.388+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.388+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94534344483056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05a9c0 con 0x55fa7e04b440 2024-09-11T11:01:29.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.388+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05b380 con 0x55fa7e04f6e0 2024-09-11T11:01:29.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.388+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94534344477744] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.388+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94534344483056] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94534344486608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05a9c0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05b330 con 0x7f9a5c0ca060 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94534344488816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05b2f0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05c6c0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94534344488816] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94534344486608] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94534344484112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05c210 con 0x55fa7e04f6e0 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.392+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05cf90 con 0x55fa7e054720 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94534344493792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05c210 con 0x55fa7e054720 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05dcf0 con 0x55fa7e054720 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94534344484112] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94534344493792] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94534344495920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05e0e0 con 0x55fa7e054720 2024-09-11T11:01:29.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05e930 con 0x7f9a5c0ca060 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94534344495920] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94534344499424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05ed50 con 0x7f9a5c0ca060 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 20 add_watcher() i=0 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 20 add_watcher() i=1 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 20 add_watcher() i=2 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 20 add_watcher() i=3 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 20 add_watcher() i=4 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 20 add_watcher() i=5 2024-09-11T11:01:29.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.396+0000 7f9a64e1f980 20 add_watcher() i=6 2024-09-11T11:01:29.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94534344499424] v32'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 20 add_watcher() i=7 2024-09-11T11:01:29.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:29.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e061db0 con 0x55fa7e04b440 2024-09-11T11:01:29.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94534344500480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05f150 con 0x55fa7e04b440 2024-09-11T11:01:29.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94534344500480] v32'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f99197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 5 note: GC not initialized 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9893fff640 20 reqs_thread_entry: start 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 20 Filter name: none 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9891ffb640 20 reqs_thread_entry: start 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0856b0 con 0x55fa7e054720 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.400+0000 7f9a64e1f980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e083da0 con 0x55fa7e054720 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e088450 con 0x55fa7e054720 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v32'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94534344670816 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e088fc0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== watch-notify(notify (1) cookie 94534344488816 notify 137438953486 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7f9a540267f0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f99467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953486 cookie 94534344488816 notifier 4542 bl.length()=610 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f99467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f99467fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(65 notify.3 [notify cookie 94534344670816 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f99467fc640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9928003eb0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== watch-notify(notify_complete (2) cookie 94534344670816 notify 137438953486 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9a54026a90 con 0x7f9a5c0ca060 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e087e60 con 0x55fa7e054720 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v32'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-11T11:01:29.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94534344670816 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e087240 con 0x55fa7e04f6e0 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.404+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94534344486608 notify 137438953494 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55fa7e02d7a0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f99467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953494 cookie 94534344486608 notifier 4542 bl.length()=192 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f99467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f99467fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f99467fc640 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f9928003eb0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [notify cookie 94534344670816 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94534344670816 notify 137438953494 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9a5c12d040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.417 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-11T11:01:29.408000Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:29.407988Z","tags":[],"group_ids":[]} 2024-09-11T11:01:29.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f99197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94534344500480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0832b0 con 0x55fa7e04b440 2024-09-11T11:01:29.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94534344500480] v32'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.408+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94534344477744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0832b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.412+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94534344477744] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.412+0000 7f9a64e1f980 20 remove_watcher() i=0 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.412+0000 7f9a64e1f980 2 removed watcher, disabling cache 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.412+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94534344483056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e058c30 con 0x55fa7e04b440 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.412+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94534344483056] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x55fa7e04b440 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.412+0000 7f9a64e1f980 20 remove_watcher() i=1 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.412+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94534344486608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0832b0 con 0x55fa7e04f6e0 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94534344486608] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a64e1f980 20 remove_watcher() i=2 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94534344488816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05a0f0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94534344488816] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a64e1f980 20 remove_watcher() i=3 2024-09-11T11:01:29.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94534344484112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e058c30 con 0x55fa7e04f6e0 2024-09-11T11:01:29.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a6292f640 1 -- 172.21.15.145:0/2926817127 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94534344484112] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5c123040 con 0x55fa7e04f6e0 2024-09-11T11:01:29.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a64e1f980 20 remove_watcher() i=4 2024-09-11T11:01:29.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.416+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94534344493792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05a5a0 con 0x55fa7e054720 2024-09-11T11:01:29.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94534344493792] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 20 remove_watcher() i=5 2024-09-11T11:01:29.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94534344495920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e05aed0 con 0x55fa7e054720 2024-09-11T11:01:29.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a6212e640 1 -- 172.21.15.145:0/2926817127 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94534344495920] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5800e620 con 0x55fa7e054720 2024-09-11T11:01:29.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 20 remove_watcher() i=6 2024-09-11T11:01:29.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94534344499424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55fa7e0832b0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94534344499424] v32'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9a5400a4d0 con 0x7f9a5c0ca060 2024-09-11T11:01:29.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 20 remove_watcher() i=7 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e04f6e0 msgr2=0x55fa7e051ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e04f6e0 0x55fa7e051ad0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7e04b440 msgr2=0x55fa7e04d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7e04b440 0x55fa7e04d900 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9a5c0ca060 msgr2=0x7f9a5c0dc920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9a5c0ca060 0x7f9a5c0dc920 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55fa7e054720 msgr2=0x55fa7e056b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55fa7e054720 0x55fa7e056b10 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f992c034650 msgr2=0x7f992c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f992c034650 0x7f992c036b10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55fa7e0132e0 tx=0x7f9a58010000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 msgr2=0x55fa7e040530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a63130640 1 -- 172.21.15.145:0/2926817127 reap_dead start 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e040530 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0ca600 tx=0x7f9a5c0d9e90 comp rx=0 tx=0).stop 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 shutdown_connections 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2926817127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e039560 0x55fa7e040530 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 >> 172.21.15.145:0/2926817127 conn(0x55fa7e035940 msgr2=0x55fa7e033a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 shutdown_connections 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2926817127 wait complete. 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/1682567495 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f993c034600 msgr2=0x7f993c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/1682567495 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f993c034600 0x7f993c036ac0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800bf60 tx=0x7f9a5800f000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/1682567495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e02cbb0 msgr2=0x55fa7e02cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/1682567495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e02cbb0 0x55fa7e02cfd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0e2000 tx=0x7f9a5c0b7af0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/1682567495 shutdown_connections 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/1682567495 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f993c034600 0x7f993c036ac0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/1682567495 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7e02cbb0 0x55fa7e02cfd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/1682567495 >> 172.21.15.145:0/1682567495 conn(0x55fa7e021d00 msgr2=0x55fa7e024780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/1682567495 shutdown_connections 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.420+0000 7f9a64e1f980 1 -- 172.21.15.145:0/1682567495 wait complete. 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e017250 msgr2=0x55fa7e019640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55fa7e017250 0x55fa7e019640 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7df1d1d0 msgr2=0x55fa7e015df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55fa7df1d1d0 0x55fa7e015df0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55fa7e01b110 msgr2=0x55fa7e01e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55fa7e01b110 0x55fa7e01e950 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9948034650 msgr2=0x7f9948036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9948034650 0x7f9948036b10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9a58000f70 tx=0x7f9a580012c0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 msgr2=0x55fa7e00ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 --2- 172.21.15.145:0/2087909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55fa7df1c880 0x55fa7e00ee60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c0030b0 tx=0x7f9a5c018020 comp rx=0 tx=0).stop 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a63130640 1 -- 172.21.15.145:0/2087909 reap_dead start 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 shutdown_connections 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 >> 172.21.15.145:0/2087909 conn(0x55fa7de901d0 msgr2=0x55fa7e0023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 shutdown_connections 2024-09-11T11:01:29.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.424+0000 7f9a64e1f980 1 -- 172.21.15.145:0/2087909 wait complete. 2024-09-11T11:01:29.434 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-11T11:01:29.408000Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:29.407988Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:29.435 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-11T11:01:29.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-11T11:01:29.435 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-11T11:01:29.467 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:29.467 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:29.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.464+0000 7f42106ec980 1 Processor -- start 2024-09-11T11:01:29.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.464+0000 7f42106ec980 1 -- start start 2024-09-11T11:01:29.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.464+0000 7f42106ec980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556dd3bcd630 0x556dd3bcda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.464+0000 7f42106ec980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556dd3a55ae0 con 0x556dd3bcdf80 2024-09-11T11:01:29.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.464+0000 7f42106ec980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x556dd3a79e30 con 0x556dd3bcd630 2024-09-11T11:01:29.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.464+0000 7f420e1fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556dd3bcd630 0x556dd3bcda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.464+0000 7f420d9fb640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x556dd3bcdf80 0x556dd3bd29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54664/0 (socket says 172.21.15.145:54664) 2024-09-11T11:01:29.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.464+0000 7f420d9fb640 1 -- 172.21.15.145:0/2324807129 learned_addr learned my addr 172.21.15.145:0/2324807129 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:29.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f420e1fc640 1 -- 172.21.15.145:0/2324807129 >> v1:172.21.15.102:6789/0 conn(0x556dd3bcdf80 legacy=0x556dd3bd29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f420e1fc640 1 -- 172.21.15.145:0/2324807129 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd3bd5200 con 0x556dd3bcd630 2024-09-11T11:01:29.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f420e1fc640 1 --2- 172.21.15.145:0/2324807129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3bcda10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f420800a420 tx=0x7f420801afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76be8293d0121d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f420d1fa640 1 -- 172.21.15.145:0/2324807129 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080af070 con 0x556dd3bcd630 2024-09-11T11:01:29.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f420d1fa640 1 -- 172.21.15.145:0/2324807129 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42080aa530 con 0x556dd3bcd630 2024-09-11T11:01:29.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f420d1fa640 1 -- 172.21.15.145:0/2324807129 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080aa850 con 0x556dd3bcd630 2024-09-11T11:01:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f42106ec980 1 -- 172.21.15.145:0/2324807129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 msgr2=0x556dd3bcda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f42106ec980 1 --2- 172.21.15.145:0/2324807129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3bcda10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f420800a420 tx=0x7f420801afd0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f42106ec980 1 -- 172.21.15.145:0/2324807129 shutdown_connections 2024-09-11T11:01:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f42106ec980 1 --2- 172.21.15.145:0/2324807129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3bcda10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f42106ec980 1 -- 172.21.15.145:0/2324807129 >> 172.21.15.145:0/2324807129 conn(0x556dd3bc9150 msgr2=0x556dd3bcb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f42106ec980 1 -- 172.21.15.145:0/2324807129 shutdown_connections 2024-09-11T11:01:29.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.468+0000 7f42106ec980 1 -- 172.21.15.145:0/2324807129 wait complete. 2024-09-11T11:01:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.480+0000 7f42106ec980 1 Processor -- start 2024-09-11T11:01:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.480+0000 7f42106ec980 1 -- start start 2024-09-11T11:01:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.480+0000 7f42106ec980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cb89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.480+0000 7f42106ec980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556dd3a7b200 con 0x556dd3bcd630 2024-09-11T11:01:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cb89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cb89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50494/0 (socket says 172.21.15.145:50494) 2024-09-11T11:01:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 -- 172.21.15.145:0/3183728716 learned_addr learned my addr 172.21.15.145:0/3183728716 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 -- 172.21.15.145:0/3183728716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd3cb8fb0 con 0x556dd3bcd630 2024-09-11T11:01:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 --2- 172.21.15.145:0/3183728716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cb89e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f420800a420 tx=0x7f42080033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33e8fe0f3b912cd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f40fc608640 1 -- 172.21.15.145:0/3183728716 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080af050 con 0x556dd3bcd630 2024-09-11T11:01:29.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f40fc608640 1 -- 172.21.15.145:0/3183728716 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42080b0040 con 0x556dd3bcd630 2024-09-11T11:01:29.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f40fc608640 1 -- 172.21.15.145:0/3183728716 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080aac60 con 0x556dd3bcd630 2024-09-11T11:01:29.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 -- 172.21.15.145:0/3183728716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 msgr2=0x556dd3cb89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 --2- 172.21.15.145:0/3183728716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cb89e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f420800a420 tx=0x7f42080033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 -- 172.21.15.145:0/3183728716 shutdown_connections 2024-09-11T11:01:29.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 --2- 172.21.15.145:0/3183728716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cb89e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 -- 172.21.15.145:0/3183728716 >> 172.21.15.145:0/3183728716 conn(0x556dd3bc9150 msgr2=0x556dd3cb4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 -- 172.21.15.145:0/3183728716 shutdown_connections 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 -- 172.21.15.145:0/3183728716 wait complete. 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 Processor -- start 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 -- start start 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cbfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f42106ec980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556dd3bd4c40 con 0x556dd3bcd630 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cbfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cbfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50508/0 (socket says 172.21.15.145:50508) 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 -- 172.21.15.145:0/1457510502 learned_addr learned my addr 172.21.15.145:0/1457510502 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 -- 172.21.15.145:0/1457510502 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd3cc01a0 con 0x556dd3bcd630 2024-09-11T11:01:29.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.484+0000 7f420e1fc640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cbfc60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f420801b870 tx=0x7f4208019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f40fae05640 1 -- 172.21.15.145:0/1457510502 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080c5020 con 0x556dd3bcd630 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dd3cc0430 con 0x556dd3bcd630 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f40fae05640 1 -- 172.21.15.145:0/1457510502 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42080b6cb0 con 0x556dd3bcd630 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f40fae05640 1 -- 172.21.15.145:0/1457510502 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080c1480 con 0x556dd3bcd630 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dd3cc3110 con 0x556dd3bcd630 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f40fae05640 1 -- 172.21.15.145:0/1457510502 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42080c8070 con 0x556dd3bcd630 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f40fae05640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40f4034650 0x7f40f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f40fae05640 1 -- 172.21.15.145:0/1457510502 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f42080bb070 con 0x556dd3bcd630 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f420d9fb640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40f4034650 0x7f40f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f42106ec980 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3bcdf80 0x556dd3cc6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3cc7330 con 0x556dd3bcdf80 2024-09-11T11:01:29.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f420e9fd640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3bcdf80 0x556dd3cc6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f420d9fb640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40f4034650 0x7f40f4036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f41f8000f70 tx=0x7f41f80012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f420e9fd640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3bcdf80 0x556dd3cc6d60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f420e9fd640 1 -- 172.21.15.145:0/1457510502 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3bcdf80 2024-09-11T11:01:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f42106ec980 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3cc80e0 0x556dd3cca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3ccab10 con 0x556dd3cc80e0 2024-09-11T11:01:29.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f420e1fc640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3cc80e0 0x556dd3cca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f420e1fc640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3cc80e0 0x556dd3cca4d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f420e1fc640 1 -- 172.21.15.145:0/1457510502 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42080c7030 con 0x556dd3cc80e0 2024-09-11T11:01:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.488+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3ccc3c0 con 0x556dd3cc80e0 2024-09-11T11:01:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f420e1fc640 1 -- 172.21.15.145:0/1457510502 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42080c7030 con 0x556dd3cc80e0 2024-09-11T11:01:29.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3ccb5f0 con 0x556dd3cc80e0 2024-09-11T11:01:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f420e1fc640 1 -- 172.21.15.145:0/1457510502 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42080c7030 con 0x556dd3cc80e0 2024-09-11T11:01:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f42106ec980 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556dd3ccd770 0x556dd3ccfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3cd00a0 con 0x556dd3ccd770 2024-09-11T11:01:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f420d9fb640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556dd3ccd770 0x556dd3ccfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f420d9fb640 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556dd3ccd770 0x556dd3ccfb60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f420d9fb640 1 -- 172.21.15.145:0/1457510502 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3ccd770 2024-09-11T11:01:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f42106ec980 1 Processor -- start 2024-09-11T11:01:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f42106ec980 1 -- start start 2024-09-11T11:01:29.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f42106ec980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cddaa0 0x556dd3cddec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f42106ec980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556dd3ad4800 con 0x556dd3cddaa0 2024-09-11T11:01:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cddaa0 0x556dd3cddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cddaa0 0x556dd3cddec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50524/0 (socket says 172.21.15.145:50524) 2024-09-11T11:01:29.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.492+0000 7f420e1fc640 1 -- 172.21.15.145:0/1254623233 learned_addr learned my addr 172.21.15.145:0/1254623233 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420e1fc640 1 -- 172.21.15.145:0/1254623233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd3cde400 con 0x556dd3cddaa0 2024-09-11T11:01:29.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420e1fc640 1 --2- 172.21.15.145:0/1254623233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cddaa0 0x556dd3cddec0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f42080b8010 tx=0x7f42080c16e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f3fff640 1 -- 172.21.15.145:0/1254623233 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080a9730 con 0x556dd3cddaa0 2024-09-11T11:01:29.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f3fff640 1 -- 172.21.15.145:0/1254623233 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42080a98f0 con 0x556dd3cddaa0 2024-09-11T11:01:29.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f42106ec980 1 -- 172.21.15.145:0/1254623233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dd3cde690 con 0x556dd3cddaa0 2024-09-11T11:01:29.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f3fff640 1 -- 172.21.15.145:0/1254623233 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080bfa30 con 0x556dd3cddaa0 2024-09-11T11:01:29.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f42106ec980 1 -- 172.21.15.145:0/1254623233 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dd3cde690 con 0x556dd3cddaa0 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f3fff640 1 -- 172.21.15.145:0/1254623233 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f42080bfbd0 con 0x556dd3cddaa0 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f3fff640 1 --2- 172.21.15.145:0/1254623233 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40e8034650 0x7f40e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f3fff640 1 -- 172.21.15.145:0/1254623233 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f42080e0ae0 con 0x556dd3cddaa0 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420d9fb640 1 --2- 172.21.15.145:0/1254623233 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40e8034650 0x7f40e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f42106ec980 1 Processor -- start 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f42106ec980 1 -- start start 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f42106ec980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cea5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f42106ec980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556dd3cb9270 con 0x556dd3cea1e0 2024-09-11T11:01:29.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420d9fb640 1 --2- 172.21.15.145:0/1254623233 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40e8034650 0x7f40e8036b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f41f800bf60 tx=0x7f41f800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cea5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cea5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50538/0 (socket says 172.21.15.145:50538) 2024-09-11T11:01:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420e1fc640 1 -- 172.21.15.145:0/1965166571 learned_addr learned my addr 172.21.15.145:0/1965166571 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420e1fc640 1 -- 172.21.15.145:0/1965166571 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd3ceabb0 con 0x556dd3cea1e0 2024-09-11T11:01:29.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f420e1fc640 1 --2- 172.21.15.145:0/1965166571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cea5e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f42080deb10 tx=0x7f42080e3f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761ccbb6e093494c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f1ffb640 1 -- 172.21.15.145:0/1965166571 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080de390 con 0x556dd3cea1e0 2024-09-11T11:01:29.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f1ffb640 1 -- 172.21.15.145:0/1965166571 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42080f2070 con 0x556dd3cea1e0 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.496+0000 7f40f1ffb640 1 -- 172.21.15.145:0/1965166571 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080b4960 con 0x556dd3cea1e0 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- 172.21.15.145:0/1965166571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 msgr2=0x556dd3cea5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 --2- 172.21.15.145:0/1965166571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cea5e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f42080deb10 tx=0x7f42080e3f00 comp rx=0 tx=0).stop 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- 172.21.15.145:0/1965166571 shutdown_connections 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 --2- 172.21.15.145:0/1965166571 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cea5e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- 172.21.15.145:0/1965166571 >> 172.21.15.145:0/1965166571 conn(0x556dd3ce65c0 msgr2=0x556dd3ce46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- 172.21.15.145:0/1965166571 shutdown_connections 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- 172.21.15.145:0/1965166571 wait complete. 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 Processor -- start 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- start start 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cf1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556dd3ceb030 con 0x556dd3cea1e0 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cf1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f420e1fc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cf1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50544/0 (socket says 172.21.15.145:50544) 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 learned_addr learned my addr 172.21.15.145:0/3679248967 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dd3cf1960 con 0x556dd3cea1e0 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f420e1fc640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cf1420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f42080e18a0 tx=0x7f42080bcfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f40dffff640 1 -- 172.21.15.145:0/3679248967 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4208107070 con 0x556dd3cea1e0 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f40dffff640 1 -- 172.21.15.145:0/3679248967 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42080d4de0 con 0x556dd3cea1e0 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dd3cf1960 con 0x556dd3cea1e0 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f40dffff640 1 -- 172.21.15.145:0/3679248967 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42080ca5b0 con 0x556dd3cea1e0 2024-09-11T11:01:29.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dd3cf1960 con 0x556dd3cea1e0 2024-09-11T11:01:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f40dffff640 1 -- 172.21.15.145:0/3679248967 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f420810a070 con 0x556dd3cea1e0 2024-09-11T11:01:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f40dffff640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40d8034650 0x7f40d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f40dffff640 1 -- 172.21.15.145:0/3679248967 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f42080fd030 con 0x556dd3cea1e0 2024-09-11T11:01:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f420d9fb640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40d8034650 0x7f40d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3cfc4f0 0x556dd3cfe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3cff100 con 0x556dd3cfc4f0 2024-09-11T11:01:29.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.500+0000 7f420e9fd640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3cfc4f0 0x556dd3cfe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420d9fb640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40d8034650 0x7f40d8036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x556dd3cc4250 tx=0x7f41f8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420e9fd640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3cfc4f0 0x556dd3cfe9b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 realm 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3cfb920 con 0x556dd3cfc4f0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3cffb90 con 0x556dd3cfc4f0 2024-09-11T11:01:29.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3d00970 0x556dd3d02d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d033f0 con 0x556dd3d00970 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420e1fc640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3d00970 0x556dd3d02d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420e1fc640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3d00970 0x556dd3d02d60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 20 searching for the correct realm 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556dd3d059b0 0x556dd3d07da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d08420 con 0x556dd3d059b0 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.504+0000 7f420d9fb640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556dd3d059b0 0x556dd3d07da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420d9fb640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556dd3d059b0 0x556dd3d07da0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d08420 con 0x556dd3d00970 2024-09-11T11:01:29.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e1fc640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f420810c060 0x7f42080d2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x7f420810c060 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f420810c060 0x7f42080d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f420810c060 0x7f42080d2310 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d059b0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.508+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x7f420810c060 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x7f420810c060 2024-09-11T11:01:29.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d059b0 2024-09-11T11:01:29.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d059b0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d059b0 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.512+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x7f420810c060 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3cfc4f0 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x7f420810c060 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d059b0 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x7f420810c060 2024-09-11T11:01:29.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d059b0 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d03c40 con 0x556dd3d00970 2024-09-11T11:01:29.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f42106ec980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f42106ec980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f42106ec980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f42106ec980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f42106ec980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.516+0000 7f42106ec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d04490 con 0x556dd3cfc4f0 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d04880 con 0x556dd3d00970 2024-09-11T11:01:29.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d04880 con 0x7f420810c060 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 zone default found 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 4 Realm: () 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 zonegroup default 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d08880 con 0x7f420810c060 2024-09-11T11:01:29.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d04e20 con 0x556dd3d059b0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0ac30 con 0x556dd3d059b0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 started sync module instance, tier type = 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.520+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d09f40 con 0x556dd3d00970 2024-09-11T11:01:29.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93930193462336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d09f40 con 0x556dd3d00970 2024-09-11T11:01:29.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0b6b0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93930193465856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0b620 con 0x556dd3cfc4f0 2024-09-11T11:01:29.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0c5e0 con 0x556dd3d00970 2024-09-11T11:01:29.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93930193465856] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93930193462336] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93930193459856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0c5e0 con 0x556dd3d00970 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.524+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0ca80 con 0x7f420810c060 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93930193468064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0ca40 con 0x7f420810c060 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0d960 con 0x556dd3d00970 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93930193468064] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93930193459856] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93930193469680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0d960 con 0x556dd3d00970 2024-09-11T11:01:29.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0dd50 con 0x556dd3d059b0 2024-09-11T11:01:29.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93930193473136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0e5a0 con 0x556dd3d059b0 2024-09-11T11:01:29.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.528+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0efa0 con 0x556dd3d059b0 2024-09-11T11:01:29.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93930193469680] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93930193473136] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93930193474704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0f390 con 0x556dd3d059b0 2024-09-11T11:01:29.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0fbe0 con 0x7f420810c060 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93930193474704] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93930193482640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0ffd0 con 0x7f420810c060 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 20 add_watcher() i=0 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 20 add_watcher() i=1 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 20 add_watcher() i=2 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 20 add_watcher() i=3 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 20 add_watcher() i=4 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 20 add_watcher() i=5 2024-09-11T11:01:29.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 20 add_watcher() i=6 2024-09-11T11:01:29.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93930193482640] v32'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 20 add_watcher() i=7 2024-09-11T11:01:29.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:29.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d13030 con 0x556dd3cfc4f0 2024-09-11T11:01:29.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.532+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93930193484160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d103e0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93930193484160] v32'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f40c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 5 note: GC not initialized 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f403f7fe640 20 reqs_thread_entry: start 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 Filter name: none 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f403d7fa640 20 reqs_thread_entry: start 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-11T11:01:29.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d368a0 con 0x556dd3d059b0 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 rados_obj.operate() r=0 bl.length=419 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d362f0 con 0x7f420810c060 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:29.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d3a090 con 0x556dd3cfc4f0 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(64 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-11T11:01:29.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.536+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d3e5d0 con 0x7f420810c060 2024-09-11T11:01:29.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(65 foo.buckets [call] v32'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:66 8.4 8:26ce5188:root::.bucket.meta.testx%3amyfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d41ee0 con 0x7f420810c060 2024-09-11T11:01:29.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [create,call,writefull 0~412,setxattr (203)] v32'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x7 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1, ofs0, ns] 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 93930193681680 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d41950 con 0x7f420810c060 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== watch-notify(notify (1) cookie 93930193468064 notify 137438953487 ret 0) ==== 889+0+0 (crc 0 0 0) 0x556dd3d42280 con 0x7f420810c060 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f40f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953487 cookie 93930193468064 notifier 4549 bl.length()=847 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f40f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x7 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f40f17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f40f17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f40f17fa640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4044003560 con 0x7f420810c060 2024-09-11T11:01:29.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(67 notify.3 [notify cookie 93930193681680 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== watch-notify(notify_complete (2) cookie 93930193681680 notify 137438953487 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556dd3d3e3d0 con 0x7f420810c060 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 20 handle_bi_update(): bucket=testx:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_sources= new_sources= 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 20 handle_bi_update(): bucket=testx:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential sources added=[] removed=[] 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 20 handle_bi_update(): bucket=testx:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_dests= new_dests= 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 20 handle_bi_update(): bucket=testx:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential dests added=[] removed=[] 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d41a50 con 0x556dd3cfc4f0 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v32'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.540+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d41a50 con 0x556dd3cfc4f0 2024-09-11T11:01:29.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v32'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f42106ec980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f42106ec980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f42106ec980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93930193687968 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d419c0 con 0x556dd3d00970 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 93930193469680 notify 137438953495 ret 0) ==== 390+0+0 (crc 0 0 0) 0x556dd3cde400 con 0x556dd3d00970 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f40f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 93930193469680 notifier 4549 bl.length()=348 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f40f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f40f1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f40f1ffb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f40d4003eb0 con 0x556dd3d00970 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(71 notify.4 [notify cookie 93930193687968 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 93930193687968 notify 137438953495 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f42080da070 con 0x556dd3d00970 2024-09-11T11:01:29.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.544+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d41a50 con 0x7f420810c060 2024-09-11T11:01:29.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(73 myfoo [call,delete] v32'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f42106ec980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-11T11:01:29.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f42106ec980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-11T11:01:29.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93930193687968 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d419c0 con 0x556dd3d059b0 2024-09-11T11:01:29.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== watch-notify(notify (1) cookie 93930193474704 notify 137438953480 ret 0) ==== 191+0+0 (crc 0 0 0) 0x556dd3a55ae0 con 0x556dd3d059b0 2024-09-11T11:01:29.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f40f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953480 cookie 93930193474704 notifier 4549 bl.length()=149 2024-09-11T11:01:29.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f40f17fa640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f4044003540 con 0x556dd3d059b0 2024-09-11T11:01:29.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(74 notify.6 [notify cookie 93930193687968 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== watch-notify(notify_complete (2) cookie 93930193687968 notify 137438953480 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f41f80385f0 con 0x556dd3d059b0 2024-09-11T11:01:29.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d41a50 con 0x556dd3cfc4f0 2024-09-11T11:01:29.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call,delete] v32'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f42106ec980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 from cache 2024-09-11T11:01:29.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f42106ec980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1, ofs0, ns] 2024-09-11T11:01:29.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [notify cookie 93930193656128 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d41a50 con 0x556dd3d00970 2024-09-11T11:01:29.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 93930193469680 notify 137438953496 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f42080da070 con 0x556dd3d00970 2024-09-11T11:01:29.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f40f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 93930193469680 notifier 4549 bl.length()=206 2024-09-11T11:01:29.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f40f1ffb640 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f40d4003eb0 con 0x556dd3d00970 2024-09-11T11:01:29.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(77 notify.4 [notify cookie 93930193656128 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(78 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.548+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 93930193656128 notify 137438953496 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556dd3cc3110 con 0x556dd3d00970 2024-09-11T11:01:29.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.552+0000 7f40c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.552+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93930193484160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d34530 con 0x556dd3cfc4f0 2024-09-11T11:01:29.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.552+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93930193484160] v32'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.552+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93930193462336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d34530 con 0x556dd3d00970 2024-09-11T11:01:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93930193462336] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f42106ec980 20 remove_watcher() i=0 2024-09-11T11:01:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f42106ec980 2 removed watcher, disabling cache 2024-09-11T11:01:29.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93930193465856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d34530 con 0x556dd3cfc4f0 2024-09-11T11:01:29.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93930193465856] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x556dd3cfc4f0 2024-09-11T11:01:29.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f42106ec980 20 remove_watcher() i=1 2024-09-11T11:01:29.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93930193459856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0b200 con 0x556dd3d00970 2024-09-11T11:01:29.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93930193459856] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f42106ec980 20 remove_watcher() i=2 2024-09-11T11:01:29.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.556+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93930193468064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d34530 con 0x7f420810c060 2024-09-11T11:01:29.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93930193468064] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f42106ec980 20 remove_watcher() i=3 2024-09-11T11:01:29.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93930193469680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d09a90 con 0x556dd3d00970 2024-09-11T11:01:29.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f420e1fc640 1 -- 172.21.15.145:0/3679248967 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93930193469680] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4208109030 con 0x556dd3d00970 2024-09-11T11:01:29.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f42106ec980 20 remove_watcher() i=4 2024-09-11T11:01:29.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93930193473136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0b200 con 0x556dd3d059b0 2024-09-11T11:01:29.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93930193473136] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f42106ec980 20 remove_watcher() i=5 2024-09-11T11:01:29.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.560+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93930193474704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d0baa0 con 0x556dd3d059b0 2024-09-11T11:01:29.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f420d9fb640 1 -- 172.21.15.145:0/3679248967 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93930193474704] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f41f800e620 con 0x556dd3d059b0 2024-09-11T11:01:29.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 20 remove_watcher() i=6 2024-09-11T11:01:29.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93930193482640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x556dd3d34530 con 0x7f420810c060 2024-09-11T11:01:29.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93930193482640] v32'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42000083f0 con 0x7f420810c060 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 20 remove_watcher() i=7 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3d00970 msgr2=0x556dd3d02d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3d00970 0x556dd3d02d60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3cfc4f0 msgr2=0x556dd3cfe9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3cfc4f0 0x556dd3cfe9b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f420810c060 msgr2=0x7f42080d2310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f420810c060 0x7f42080d2310 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556dd3d059b0 msgr2=0x556dd3d07da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556dd3d059b0 0x556dd3d07da0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40d8034650 msgr2=0x7f40d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40d8034650 0x7f40d8036b10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x556dd3cc4250 tx=0x7f41f8010000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 msgr2=0x556dd3cf1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f420e9fd640 1 -- 172.21.15.145:0/3679248967 reap_dead start 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cf1420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f42080e18a0 tx=0x7f42080bcfb0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 shutdown_connections 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/3679248967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cea1e0 0x556dd3cf1420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 >> 172.21.15.145:0/3679248967 conn(0x556dd3ce65c0 msgr2=0x556dd3ce4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 shutdown_connections 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/3679248967 wait complete. 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1254623233 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40e8034650 msgr2=0x7f40e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1254623233 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40e8034650 0x7f40e8036b10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f41f800bf60 tx=0x7f41f800f000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1254623233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cddaa0 msgr2=0x556dd3cddec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1254623233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cddaa0 0x556dd3cddec0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f42080b8010 tx=0x7f42080c16e0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1254623233 shutdown_connections 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1254623233 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40e8034650 0x7f40e8036b10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1254623233 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3cddaa0 0x556dd3cddec0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1254623233 >> 172.21.15.145:0/1254623233 conn(0x556dd3cd2bf0 msgr2=0x556dd3cd5670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1254623233 shutdown_connections 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1254623233 wait complete. 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3cc80e0 msgr2=0x556dd3cca4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556dd3cc80e0 0x556dd3cca4d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3bcdf80 msgr2=0x556dd3cc6d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556dd3bcdf80 0x556dd3cc6d60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556dd3ccd770 msgr2=0x556dd3ccfb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556dd3ccd770 0x556dd3ccfb60 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40f4034650 msgr2=0x7f40f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f40f4034650 0x7f40f4036b10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f41f8000f70 tx=0x7f41f80012c0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 msgr2=0x556dd3cbfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 --2- 172.21.15.145:0/1457510502 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556dd3bcd630 0x556dd3cbfc60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f420801b870 tx=0x7f4208019810 comp rx=0 tx=0).stop 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f420e9fd640 1 -- 172.21.15.145:0/1457510502 reap_dead start 2024-09-11T11:01:29.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 shutdown_connections 2024-09-11T11:01:29.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 >> 172.21.15.145:0/1457510502 conn(0x556dd3bc9150 msgr2=0x556dd3cb3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 shutdown_connections 2024-09-11T11:01:29.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.564+0000 7f42106ec980 1 -- 172.21.15.145:0/1457510502 wait complete. 2024-09-11T11:01:29.577 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-11T11:01:29.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-11T11:01:29.578 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-11T11:01:29.656 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:29.657 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:29.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d04e25980 1 Processor -- start 2024-09-11T11:01:29.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d04e25980 1 -- start start 2024-09-11T11:01:29.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d04e25980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55edb5ecb8e0 0x55edb5ecbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d04e25980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55edb5d51ae0 con 0x55edb5ecc230 2024-09-11T11:01:29.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d04e25980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55edb5d75e30 con 0x55edb5ecb8e0 2024-09-11T11:01:29.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d02935640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55edb5ecb8e0 0x55edb5ecbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d02134640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55edb5ecc230 0x55edb5ed0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54670/0 (socket says 172.21.15.145:54670) 2024-09-11T11:01:29.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d02134640 1 -- 172.21.15.145:0/3769224282 learned_addr learned my addr 172.21.15.145:0/3769224282 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:29.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d02935640 1 -- 172.21.15.145:0/3769224282 >> v1:172.21.15.102:6789/0 conn(0x55edb5ecc230 legacy=0x55edb5ed0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d02935640 1 -- 172.21.15.145:0/3769224282 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb5ed34b0 con 0x55edb5ecb8e0 2024-09-11T11:01:29.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.656+0000 7f5d02935640 1 --2- 172.21.15.145:0/3769224282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5ecbcc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400a420 tx=0x7f5cf401afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d89571e3147d835 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d01933640 1 -- 172.21.15.145:0/3769224282 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40af070 con 0x55edb5ecb8e0 2024-09-11T11:01:29.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d01933640 1 -- 172.21.15.145:0/3769224282 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40aa530 con 0x55edb5ecb8e0 2024-09-11T11:01:29.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d01933640 1 -- 172.21.15.145:0/3769224282 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40aa850 con 0x55edb5ecb8e0 2024-09-11T11:01:29.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d04e25980 1 -- 172.21.15.145:0/3769224282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 msgr2=0x55edb5ecbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d04e25980 1 --2- 172.21.15.145:0/3769224282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5ecbcc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400a420 tx=0x7f5cf401afd0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d04e25980 1 -- 172.21.15.145:0/3769224282 shutdown_connections 2024-09-11T11:01:29.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d04e25980 1 --2- 172.21.15.145:0/3769224282 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5ecbcc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d04e25980 1 -- 172.21.15.145:0/3769224282 >> 172.21.15.145:0/3769224282 conn(0x55edb5e3f230 msgr2=0x55edb5e3f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d04e25980 1 -- 172.21.15.145:0/3769224282 shutdown_connections 2024-09-11T11:01:29.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.660+0000 7f5d04e25980 1 -- 172.21.15.145:0/3769224282 wait complete. 2024-09-11T11:01:29.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d04e25980 1 Processor -- start 2024-09-11T11:01:29.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d04e25980 1 -- start start 2024-09-11T11:01:29.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d04e25980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fb6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d04e25980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edb5d77200 con 0x55edb5ecb8e0 2024-09-11T11:01:29.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fb6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fb6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50564/0 (socket says 172.21.15.145:50564) 2024-09-11T11:01:29.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d02935640 1 -- 172.21.15.145:0/2058768774 learned_addr learned my addr 172.21.15.145:0/2058768774 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d02935640 1 -- 172.21.15.145:0/2058768774 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb5fb7200 con 0x55edb5ecb8e0 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5d02935640 1 --2- 172.21.15.145:0/2058768774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fb6c30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400a420 tx=0x7f5cf40033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab29cd705e38b0c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5bf0e09640 1 -- 172.21.15.145:0/2058768774 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40af050 con 0x55edb5ecb8e0 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5bf0e09640 1 -- 172.21.15.145:0/2058768774 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40b0040 con 0x55edb5ecb8e0 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.672+0000 7f5bf0e09640 1 -- 172.21.15.145:0/2058768774 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40aac60 con 0x55edb5ecb8e0 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- 172.21.15.145:0/2058768774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 msgr2=0x55edb5fb6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 --2- 172.21.15.145:0/2058768774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fb6c30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5cf400a420 tx=0x7f5cf40033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- 172.21.15.145:0/2058768774 shutdown_connections 2024-09-11T11:01:29.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 --2- 172.21.15.145:0/2058768774 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fb6c30 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- 172.21.15.145:0/2058768774 >> 172.21.15.145:0/2058768774 conn(0x55edb5e3f230 msgr2=0x55edb5fb2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- 172.21.15.145:0/2058768774 shutdown_connections 2024-09-11T11:01:29.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- 172.21.15.145:0/2058768774 wait complete. 2024-09-11T11:01:29.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 Processor -- start 2024-09-11T11:01:29.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- start start 2024-09-11T11:01:29.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fbdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edb5ed2ef0 con 0x55edb5ecb8e0 2024-09-11T11:01:29.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fbdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fbdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50576/0 (socket says 172.21.15.145:50576) 2024-09-11T11:01:29.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d02935640 1 -- 172.21.15.145:0/531051937 learned_addr learned my addr 172.21.15.145:0/531051937 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d02935640 1 -- 172.21.15.145:0/531051937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb5fbe400 con 0x55edb5ecb8e0 2024-09-11T11:01:29.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d02935640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fbdec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5cf401b870 tx=0x7f5cf4019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5bef606640 1 -- 172.21.15.145:0/531051937 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40c5020 con 0x55edb5ecb8e0 2024-09-11T11:01:29.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edb5fbe690 con 0x55edb5ecb8e0 2024-09-11T11:01:29.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5bef606640 1 -- 172.21.15.145:0/531051937 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40c1480 con 0x55edb5ecb8e0 2024-09-11T11:01:29.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb5fc1370 con 0x55edb5ecb8e0 2024-09-11T11:01:29.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.676+0000 7f5bef606640 1 -- 172.21.15.145:0/531051937 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40c1760 con 0x55edb5ecb8e0 2024-09-11T11:01:29.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5bef606640 1 -- 172.21.15.145:0/531051937 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5cf40ca440 con 0x55edb5ecb8e0 2024-09-11T11:01:29.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5bef606640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5be80346a0 0x7f5be8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5bef606640 1 -- 172.21.15.145:0/531051937 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f5cf40bb070 con 0x55edb5ecb8e0 2024-09-11T11:01:29.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d02134640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5be80346a0 0x7f5be8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d04e25980 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ecc230 0x55edb5fc4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb5fc5540 con 0x55edb5ecc230 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d03136640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ecc230 0x55edb5fc4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d02134640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5be80346a0 0x7f5be8036b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cec000f70 tx=0x7f5cec0012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d03136640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ecc230 0x55edb5fc4fc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d03136640 1 -- 172.21.15.145:0/531051937 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ecc230 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d04e25980 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5fc6340 0x55edb5fc8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb5fc8d70 con 0x55edb5fc6340 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d02935640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5fc6340 0x55edb5fc8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d02935640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5fc6340 0x55edb5fc8730 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d02935640 1 -- 172.21.15.145:0/531051937 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cf40c7070 con 0x55edb5fc6340 2024-09-11T11:01:29.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.680+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb5fca620 con 0x55edb5fc6340 2024-09-11T11:01:29.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02935640 1 -- 172.21.15.145:0/531051937 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5cf40c7070 con 0x55edb5fc6340 2024-09-11T11:01:29.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb5fc9850 con 0x55edb5fc6340 2024-09-11T11:01:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02935640 1 -- 172.21.15.145:0/531051937 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cf40c7070 con 0x55edb5fc6340 2024-09-11T11:01:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d04e25980 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55edb5fcb9d0 0x55edb5fcddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb5fce300 con 0x55edb5fcb9d0 2024-09-11T11:01:29.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02134640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55edb5fcb9d0 0x55edb5fcddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02134640 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55edb5fcb9d0 0x55edb5fcddc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02134640 1 -- 172.21.15.145:0/531051937 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb5fcb9d0 2024-09-11T11:01:29.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d04e25980 1 Processor -- start 2024-09-11T11:01:29.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d04e25980 1 -- start start 2024-09-11T11:01:29.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d04e25980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fdbd70 0x55edb5fdc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d04e25980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edb5dd0800 con 0x55edb5fdbd70 2024-09-11T11:01:29.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fdbd70 0x55edb5fdc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fdbd70 0x55edb5fdc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50584/0 (socket says 172.21.15.145:50584) 2024-09-11T11:01:29.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02935640 1 -- 172.21.15.145:0/2298234776 learned_addr learned my addr 172.21.15.145:0/2298234776 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02935640 1 -- 172.21.15.145:0/2298234776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb5fdc6d0 con 0x55edb5fdbd70 2024-09-11T11:01:29.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5d02935640 1 --2- 172.21.15.145:0/2298234776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fdbd70 0x55edb5fdc190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40e33d0 tx=0x7f5cf40ca990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.684+0000 7f5bece01640 1 -- 172.21.15.145:0/2298234776 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40e8020 con 0x55edb5fdbd70 2024-09-11T11:01:29.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5bece01640 1 -- 172.21.15.145:0/2298234776 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40c93e0 con 0x55edb5fdbd70 2024-09-11T11:01:29.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- 172.21.15.145:0/2298234776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edb5fdc960 con 0x55edb5fdbd70 2024-09-11T11:01:29.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5bece01640 1 -- 172.21.15.145:0/2298234776 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40c96c0 con 0x55edb5fdbd70 2024-09-11T11:01:29.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- 172.21.15.145:0/2298234776 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb5fdc960 con 0x55edb5fdbd70 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5bece01640 1 -- 172.21.15.145:0/2298234776 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5cf40db070 con 0x55edb5fdbd70 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5bece01640 1 --2- 172.21.15.145:0/2298234776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bdc034650 0x7f5bdc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5bece01640 1 -- 172.21.15.145:0/2298234776 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f5cf40d30b0 con 0x55edb5fdbd70 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d02134640 1 --2- 172.21.15.145:0/2298234776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bdc034650 0x7f5bdc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 Processor -- start 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- start start 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d02134640 1 --2- 172.21.15.145:0/2298234776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bdc034650 0x7f5bdc036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00bf60 tx=0x7f5cec00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fe89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edb5fb74c0 con 0x55edb5fe85c0 2024-09-11T11:01:29.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fe89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fe89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50592/0 (socket says 172.21.15.145:50592) 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d02935640 1 -- 172.21.15.145:0/1967235441 learned_addr learned my addr 172.21.15.145:0/1967235441 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d02935640 1 -- 172.21.15.145:0/1967235441 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb5fe8f90 con 0x55edb5fe85c0 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d02935640 1 --2- 172.21.15.145:0/1967235441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fe89c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40e3fd0 tx=0x7f5cf40e3c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9230cf343c26242d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5be67fc640 1 -- 172.21.15.145:0/1967235441 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40bfde0 con 0x55edb5fe85c0 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5be67fc640 1 -- 172.21.15.145:0/1967235441 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40bf8c0 con 0x55edb5fe85c0 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5be67fc640 1 -- 172.21.15.145:0/1967235441 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40c2910 con 0x55edb5fe85c0 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- 172.21.15.145:0/1967235441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 msgr2=0x55edb5fe89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 --2- 172.21.15.145:0/1967235441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fe89c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40e3fd0 tx=0x7f5cf40e3c10 comp rx=0 tx=0).stop 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- 172.21.15.145:0/1967235441 shutdown_connections 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 --2- 172.21.15.145:0/1967235441 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fe89c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- 172.21.15.145:0/1967235441 >> 172.21.15.145:0/1967235441 conn(0x55edb5fe4950 msgr2=0x55edb5fe2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- 172.21.15.145:0/1967235441 shutdown_connections 2024-09-11T11:01:29.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.688+0000 7f5d04e25980 1 -- 172.21.15.145:0/1967235441 wait complete. 2024-09-11T11:01:29.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 1 Processor -- start 2024-09-11T11:01:29.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 1 -- start start 2024-09-11T11:01:29.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fef730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55edb5fe94e0 con 0x55edb5fe85c0 2024-09-11T11:01:29.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fef730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d02935640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fef730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50608/0 (socket says 172.21.15.145:50608) 2024-09-11T11:01:29.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 learned_addr learned my addr 172.21.15.145:0/376552550 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb5fefc70 con 0x55edb5fe85c0 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d02935640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fef730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40b4450 tx=0x7f5cf40b9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5be4ff9640 1 -- 172.21.15.145:0/376552550 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40dc870 con 0x55edb5fe85c0 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55edb5fefc70 con 0x55edb5fe85c0 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5be4ff9640 1 -- 172.21.15.145:0/376552550 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf40c2c40 con 0x55edb5fe85c0 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5be4ff9640 1 -- 172.21.15.145:0/376552550 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cf40e34c0 con 0x55edb5fe85c0 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb5ff00e0 con 0x55edb5fe85c0 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5be4ff9640 1 -- 172.21.15.145:0/376552550 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5cf4114060 con 0x55edb5fe85c0 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5be4ff9640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bcc034650 0x7f5bcc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5be4ff9640 1 -- 172.21.15.145:0/376552550 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f5cf410eaa0 con 0x55edb5fe85c0 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d02134640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bcc034650 0x7f5bcc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ffa730 0x55edb5ffcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb5ffd340 con 0x55edb5ffa730 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d03136640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ffa730 0x55edb5ffcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d02134640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bcc034650 0x7f5bcc036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55edb5fce6e0 tx=0x7f5cec010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.692+0000 7f5d03136640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ffa730 0x55edb5ffcbf0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 realm 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb5ff9be0 con 0x55edb5ffa730 2024-09-11T11:01:29.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb5ffde10 con 0x55edb5ffa730 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5ffe9f0 0x55edb6000eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001620 con 0x55edb5ffe9f0 2024-09-11T11:01:29.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d02935640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5ffe9f0 0x55edb6000eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d02935640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5ffe9f0 0x55edb6000eb0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 20 searching for the correct realm 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55edb6003c30 0x55edb6006020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb60066a0 con 0x55edb6003c30 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d02134640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55edb6003c30 0x55edb6006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d02134640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55edb6003c30 0x55edb6006020 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.696+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb60066a0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02935640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5cf4116070 0x7f5cf40c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x7f5cf4116070 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5cf4116070 0x7f5cf40c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5cf4116070 0x7f5cf40c0720 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb6003c30 2024-09-11T11:01:29.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x7f5cf4116070 2024-09-11T11:01:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.700+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x7f5cf4116070 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb6003c30 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb6003c30 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb6003c30 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x7f5cf4116070 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffa730 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x7f5cf4116070 2024-09-11T11:01:29.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.704+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb6003c30 2024-09-11T11:01:29.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x7f5cf4116070 2024-09-11T11:01:29.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb6003c30 2024-09-11T11:01:29.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55edb6001ec0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb6002710 con 0x55edb5ffa730 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.708+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb6002b00 con 0x55edb5ffe9f0 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb6002b00 con 0x7f5cf4116070 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 zone default found 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 4 Realm: () 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:29.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 zonegroup default 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb6006b50 con 0x7f5cf4116070 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb60088d0 con 0x55edb6003c30 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb6008c70 con 0x55edb6003c30 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 started sync module instance, tier type = 2024-09-11T11:01:29.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:29.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.712+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6007d70 con 0x55edb5ffe9f0 2024-09-11T11:01:29.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94479449096816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6007d70 con 0x55edb5ffe9f0 2024-09-11T11:01:29.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6009690 con 0x55edb5ffa730 2024-09-11T11:01:29.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94479449100672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6009650 con 0x55edb5ffa730 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600a5a0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94479449096816] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94479449100672] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94479449102976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600a5a0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.716+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600aa00 con 0x7f5cf4116070 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94479449094336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600a9c0 con 0x7f5cf4116070 2024-09-11T11:01:29.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600b8c0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94479449102976] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94479449094336] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94479449107952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600b410 con 0x55edb5ffe9f0 2024-09-11T11:01:29.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600c160 con 0x55edb6003c30 2024-09-11T11:01:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94479449111728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600b410 con 0x55edb6003c30 2024-09-11T11:01:29.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.720+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600cee0 con 0x55edb6003c30 2024-09-11T11:01:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94479449107952] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94479449111728] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94479449113856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600d2d0 con 0x55edb6003c30 2024-09-11T11:01:29.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600db20 con 0x7f5cf4116070 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94479449113856] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94479449117872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600df40 con 0x7f5cf4116070 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 20 add_watcher() i=0 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 20 add_watcher() i=1 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 20 add_watcher() i=2 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 20 add_watcher() i=3 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 20 add_watcher() i=4 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 20 add_watcher() i=5 2024-09-11T11:01:29.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 20 add_watcher() i=6 2024-09-11T11:01:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94479449117872] v32'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 20 add_watcher() i=7 2024-09-11T11:01:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb600ca10 con 0x55edb5ffa730 2024-09-11T11:01:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.724+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94479449119184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb600ca10 con 0x55edb5ffa730 2024-09-11T11:01:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94479449119184] v32'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5bb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 5 note: GC not initialized 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5b33fff640 20 reqs_thread_entry: start 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 20 Filter name: none 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5b31ffb640 20 reqs_thread_entry: start 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55edb6033fd0 con 0x55edb5ffa730 2024-09-11T11:01:29.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 20 rados_obj.operate() r=0 bl.length=193 2024-09-11T11:01:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5bb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.728+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94479449119184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x55edb5ffa730 2024-09-11T11:01:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.732+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94479449119184] v32'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.732+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94479449096816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.732+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94479449096816] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.732+0000 7f5d04e25980 20 remove_watcher() i=0 2024-09-11T11:01:29.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.732+0000 7f5d04e25980 2 removed watcher, disabling cache 2024-09-11T11:01:29.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.732+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94479449100672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x55edb5ffa730 2024-09-11T11:01:29.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94479449100672] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x55edb5ffa730 2024-09-11T11:01:29.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d04e25980 20 remove_watcher() i=1 2024-09-11T11:01:29.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94479449102976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94479449102976] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d04e25980 20 remove_watcher() i=2 2024-09-11T11:01:29.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94479449094336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x7f5cf4116070 2024-09-11T11:01:29.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94479449094336] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d04e25980 20 remove_watcher() i=3 2024-09-11T11:01:29.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.736+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94479449107952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x55edb5ffe9f0 2024-09-11T11:01:29.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d02935640 1 -- 172.21.15.145:0/376552550 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94479449107952] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cf40ea020 con 0x55edb5ffe9f0 2024-09-11T11:01:29.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d04e25980 20 remove_watcher() i=4 2024-09-11T11:01:29.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94479449111728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x55edb6003c30 2024-09-11T11:01:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94479449111728] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d04e25980 20 remove_watcher() i=5 2024-09-11T11:01:29.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94479449113856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x55edb6003c30 2024-09-11T11:01:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d02134640 1 -- 172.21.15.145:0/376552550 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94479449113856] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cec00e620 con 0x55edb6003c30 2024-09-11T11:01:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d04e25980 20 remove_watcher() i=6 2024-09-11T11:01:29.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.740+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94479449117872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55edb6031fc0 con 0x7f5cf4116070 2024-09-11T11:01:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94479449117872] v32'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5cfc0083f0 con 0x7f5cf4116070 2024-09-11T11:01:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 20 remove_watcher() i=7 2024-09-11T11:01:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5ffe9f0 msgr2=0x55edb6000eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5ffe9f0 0x55edb6000eb0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ffa730 msgr2=0x55edb5ffcbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ffa730 0x55edb5ffcbf0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5cf4116070 msgr2=0x7f5cf40c0720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5cf4116070 0x7f5cf40c0720 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55edb6003c30 msgr2=0x55edb6006020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55edb6003c30 0x55edb6006020 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bcc034650 msgr2=0x7f5bcc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bcc034650 0x7f5bcc036b10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55edb5fce6e0 tx=0x7f5cec010000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 msgr2=0x55edb5fef730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d03136640 1 -- 172.21.15.145:0/376552550 reap_dead start 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fef730 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40b4450 tx=0x7f5cf40b9fb0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 shutdown_connections 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/376552550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fe85c0 0x55edb5fef730 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 >> 172.21.15.145:0/376552550 conn(0x55edb5fe4950 msgr2=0x55edb5fe2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 shutdown_connections 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/376552550 wait complete. 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/2298234776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bdc034650 msgr2=0x7f5bdc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/2298234776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bdc034650 0x7f5bdc036b10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00bf60 tx=0x7f5cec00f000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/2298234776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fdbd70 msgr2=0x55edb5fdc190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/2298234776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fdbd70 0x55edb5fdc190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5cf40e33d0 tx=0x7f5cf40ca990 comp rx=0 tx=0).stop 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/2298234776 shutdown_connections 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/2298234776 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5bdc034650 0x7f5bdc036b10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/2298234776 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5fdbd70 0x55edb5fdc190 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/2298234776 >> 172.21.15.145:0/2298234776 conn(0x55edb5fd0ec0 msgr2=0x55edb5fd3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/2298234776 shutdown_connections 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/2298234776 wait complete. 2024-09-11T11:01:29.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5fc6340 msgr2=0x55edb5fc8730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55edb5fc6340 0x55edb5fc8730 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ecc230 msgr2=0x55edb5fc4fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55edb5ecc230 0x55edb5fc4fc0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55edb5fcb9d0 msgr2=0x55edb5fcddc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55edb5fcb9d0 0x55edb5fcddc0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5be80346a0 msgr2=0x7f5be8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5be80346a0 0x7f5be8036b60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5cec000f70 tx=0x7f5cec0012c0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 msgr2=0x55edb5fbdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 --2- 172.21.15.145:0/531051937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55edb5ecb8e0 0x55edb5fbdec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5cf401b870 tx=0x7f5cf4019810 comp rx=0 tx=0).stop 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d03136640 1 -- 172.21.15.145:0/531051937 reap_dead start 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 shutdown_connections 2024-09-11T11:01:29.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 >> 172.21.15.145:0/531051937 conn(0x55edb5e3f230 msgr2=0x55edb5fb13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 shutdown_connections 2024-09-11T11:01:29.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.744+0000 7f5d04e25980 1 -- 172.21.15.145:0/531051937 wait complete. 2024-09-11T11:01:29.756 INFO:teuthology.orchestra.run.smithi145.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"xs57MK/Y68oBK1QzWxHsYCSq","ver":2},"mtime":"2024-09-11T11:01:29.547281Z","data":{"bucket":{"name":"myfoo","marker":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","bucket_id":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-11T11:01:26.276370Z","linked":true,"has_bucket_info":false}} 2024-09-11T11:01:29.756 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'xs57MK/Y68oBK1QzWxHsYCSq', 'ver': 2}, 'mtime': '2024-09-11T11:01:29.547281Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'bucket_id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-11T11:01:26.276370Z', 'linked': True, 'has_bucket_info': False}} 2024-09-11T11:01:29.756 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-11T11:01:29.756 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-11T11:01:29.757 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-11T11:01:29.825 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:29.825 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:29.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5673bf3980 1 Processor -- start 2024-09-11T11:01:29.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5673bf3980 1 -- start start 2024-09-11T11:01:29.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5673bf3980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ba5b1c17d0 0x55ba5b1c0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5673bf3980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba5b0d2ae0 con 0x55ba5b1c13c0 2024-09-11T11:01:29.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5673bf3980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55ba5b0f6e30 con 0x55ba5b1c17d0 2024-09-11T11:01:29.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5670f02640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ba5b1c17d0 0x55ba5b1c0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5671703640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55ba5b1c13c0 0x55ba5b1bfb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54684/0 (socket says 172.21.15.145:54684) 2024-09-11T11:01:29.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5671703640 1 -- 172.21.15.145:0/2548526163 learned_addr learned my addr 172.21.15.145:0/2548526163 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:29.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5670f02640 1 -- 172.21.15.145:0/2548526163 >> v1:172.21.15.102:6789/0 conn(0x55ba5b1c13c0 legacy=0x55ba5b1bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.824+0000 7f5670f02640 1 -- 172.21.15.145:0/2548526163 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5b1c08f0 con 0x55ba5b1c17d0 2024-09-11T11:01:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5670f02640 1 --2- 172.21.15.145:0/2548526163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c17d0 0x55ba5b1c0290 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f566800a480 tx=0x7f566801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a8d35b52f7b06d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5663fff640 1 -- 172.21.15.145:0/2548526163 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56680b0070 con 0x55ba5b1c17d0 2024-09-11T11:01:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5663fff640 1 -- 172.21.15.145:0/2548526163 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56680ab540 con 0x55ba5b1c17d0 2024-09-11T11:01:29.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5663fff640 1 -- 172.21.15.145:0/2548526163 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56680ab840 con 0x55ba5b1c17d0 2024-09-11T11:01:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5673bf3980 1 -- 172.21.15.145:0/2548526163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c17d0 msgr2=0x55ba5b1c0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2548526163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c17d0 0x55ba5b1c0290 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f566800a480 tx=0x7f566801b280 comp rx=0 tx=0).stop 2024-09-11T11:01:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5673bf3980 1 -- 172.21.15.145:0/2548526163 shutdown_connections 2024-09-11T11:01:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2548526163 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c17d0 0x55ba5b1c0290 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5673bf3980 1 -- 172.21.15.145:0/2548526163 >> 172.21.15.145:0/2548526163 conn(0x55ba5b2461c0 msgr2=0x55ba5b2485e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5673bf3980 1 -- 172.21.15.145:0/2548526163 shutdown_connections 2024-09-11T11:01:29.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.828+0000 7f5673bf3980 1 -- 172.21.15.145:0/2548526163 wait complete. 2024-09-11T11:01:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5673bf3980 1 Processor -- start 2024-09-11T11:01:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5673bf3980 1 -- start start 2024-09-11T11:01:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5673bf3980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b337bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5673bf3980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b0f8200 con 0x55ba5b1c13c0 2024-09-11T11:01:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b337bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b337bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50628/0 (socket says 172.21.15.145:50628) 2024-09-11T11:01:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5671703640 1 -- 172.21.15.145:0/2634639272 learned_addr learned my addr 172.21.15.145:0/2634639272 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5671703640 1 -- 172.21.15.145:0/2634639272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5b338180 con 0x55ba5b1c13c0 2024-09-11T11:01:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f5671703640 1 --2- 172.21.15.145:0/2634639272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b337bb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f566c0015f0 tx=0x7f566c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2bea56d19dfb67 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f555f606640 1 -- 172.21.15.145:0/2634639272 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c004530 con 0x55ba5b1c13c0 2024-09-11T11:01:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f555f606640 1 -- 172.21.15.145:0/2634639272 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c0046f0 con 0x55ba5b1c13c0 2024-09-11T11:01:29.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.840+0000 7f555f606640 1 -- 172.21.15.145:0/2634639272 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c004a90 con 0x55ba5b1c13c0 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- 172.21.15.145:0/2634639272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 msgr2=0x55ba5b337bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2634639272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b337bb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f566c0015f0 tx=0x7f566c001ab0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- 172.21.15.145:0/2634639272 shutdown_connections 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2634639272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b337bb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- 172.21.15.145:0/2634639272 >> 172.21.15.145:0/2634639272 conn(0x55ba5b2461c0 msgr2=0x55ba5b3337e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- 172.21.15.145:0/2634639272 shutdown_connections 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- 172.21.15.145:0/2634639272 wait complete. 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 Processor -- start 2024-09-11T11:01:29.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- start start 2024-09-11T11:01:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b33ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b256210 con 0x55ba5b1c13c0 2024-09-11T11:01:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b33ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b33ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50640/0 (socket says 172.21.15.145:50640) 2024-09-11T11:01:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5671703640 1 -- 172.21.15.145:0/974132631 learned_addr learned my addr 172.21.15.145:0/974132631 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5671703640 1 -- 172.21.15.145:0/974132631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5b33f460 con 0x55ba5b1c13c0 2024-09-11T11:01:29.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5671703640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b33ef20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55ba5b338d90 tx=0x7f566c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f555de03640 1 -- 172.21.15.145:0/974132631 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c013760 con 0x55ba5b1c13c0 2024-09-11T11:01:29.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba5b33f6f0 con 0x55ba5b1c13c0 2024-09-11T11:01:29.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5b3423d0 con 0x55ba5b1c13c0 2024-09-11T11:01:29.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f555de03640 1 -- 172.21.15.145:0/974132631 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c013900 con 0x55ba5b1c13c0 2024-09-11T11:01:29.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f555de03640 1 -- 172.21.15.145:0/974132631 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c013be0 con 0x55ba5b1c13c0 2024-09-11T11:01:29.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.844+0000 7f555de03640 1 -- 172.21.15.145:0/974132631 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f566c010070 con 0x55ba5b1c13c0 2024-09-11T11:01:29.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f555de03640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5558034650 0x7f5558036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f555de03640 1 -- 172.21.15.145:0/974132631 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f566c018070 con 0x55ba5b1c13c0 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5670f02640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5558034650 0x7f5558036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5673bf3980 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b1c17d0 0x55ba5b345f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b346550 con 0x55ba5b1c17d0 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5671f04640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b1c17d0 0x55ba5b345f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5670f02640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5558034650 0x7f5558036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56680ad000 tx=0x7f56680a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5671f04640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b1c17d0 0x55ba5b345f30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5671f04640 1 -- 172.21.15.145:0/974132631 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b1c17d0 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5673bf3980 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b347340 0x55ba5b349730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b349d70 con 0x55ba5b347340 2024-09-11T11:01:29.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5671703640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b347340 0x55ba5b349730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5671703640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b347340 0x55ba5b349730 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5671703640 1 -- 172.21.15.145:0/974132631 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f566c01b030 con 0x55ba5b347340 2024-09-11T11:01:29.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b34b620 con 0x55ba5b347340 2024-09-11T11:01:29.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5671703640 1 -- 172.21.15.145:0/974132631 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f566c01b030 con 0x55ba5b347340 2024-09-11T11:01:29.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.848+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b34a850 con 0x55ba5b347340 2024-09-11T11:01:29.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5671703640 1 -- 172.21.15.145:0/974132631 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f566c01b030 con 0x55ba5b347340 2024-09-11T11:01:29.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5673bf3980 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ba5b34c9d0 0x55ba5b34edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b34f300 con 0x55ba5b34c9d0 2024-09-11T11:01:29.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5670f02640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ba5b34c9d0 0x55ba5b34edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5670f02640 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ba5b34c9d0 0x55ba5b34edc0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5670f02640 1 -- 172.21.15.145:0/974132631 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f56680b3040 con 0x55ba5b34c9d0 2024-09-11T11:01:29.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5673bf3980 1 Processor -- start 2024-09-11T11:01:29.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5673bf3980 1 -- start start 2024-09-11T11:01:29.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5673bf3980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b35cd20 0x55ba5b35d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5673bf3980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b151800 con 0x55ba5b35cd20 2024-09-11T11:01:29.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b35cd20 0x55ba5b35d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b35cd20 0x55ba5b35d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50644/0 (socket says 172.21.15.145:50644) 2024-09-11T11:01:29.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5671703640 1 -- 172.21.15.145:0/4190593572 learned_addr learned my addr 172.21.15.145:0/4190593572 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5671703640 1 -- 172.21.15.145:0/4190593572 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5b35d680 con 0x55ba5b35cd20 2024-09-11T11:01:29.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5671703640 1 --2- 172.21.15.145:0/4190593572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b35cd20 0x55ba5b35d140 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f566c0483a0 tx=0x7f566c028960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5556ffd640 1 -- 172.21.15.145:0/4190593572 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c020d50 con 0x55ba5b35cd20 2024-09-11T11:01:29.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5673bf3980 1 -- 172.21.15.145:0/4190593572 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba5b35d910 con 0x55ba5b35cd20 2024-09-11T11:01:29.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5556ffd640 1 -- 172.21.15.145:0/4190593572 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c0413c0 con 0x55ba5b35cd20 2024-09-11T11:01:29.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5673bf3980 1 -- 172.21.15.145:0/4190593572 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5b360590 con 0x55ba5b35cd20 2024-09-11T11:01:29.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.852+0000 7f5556ffd640 1 -- 172.21.15.145:0/4190593572 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c0416a0 con 0x55ba5b35cd20 2024-09-11T11:01:29.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5556ffd640 1 -- 172.21.15.145:0/4190593572 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f566c029470 con 0x55ba5b35cd20 2024-09-11T11:01:29.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5556ffd640 1 --2- 172.21.15.145:0/4190593572 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5548034650 0x7f5548036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5556ffd640 1 -- 172.21.15.145:0/4190593572 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f566c054af0 con 0x55ba5b35cd20 2024-09-11T11:01:29.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5670f02640 1 --2- 172.21.15.145:0/4190593572 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5548034650 0x7f5548036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 Processor -- start 2024-09-11T11:01:29.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- start start 2024-09-11T11:01:29.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5670f02640 1 --2- 172.21.15.145:0/4190593572 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5548034650 0x7f5548036b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55ba5b343510 tx=0x7f5668005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b369a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b338500 con 0x55ba5b369670 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b369a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b369a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50646/0 (socket says 172.21.15.145:50646) 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5671703640 1 -- 172.21.15.145:0/2297399524 learned_addr learned my addr 172.21.15.145:0/2297399524 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5671703640 1 -- 172.21.15.145:0/2297399524 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5b36a020 con 0x55ba5b369670 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5671703640 1 --2- 172.21.15.145:0/2297399524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b369a50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f566c0046c0 tx=0x7f566c0349c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0e57e46720ac37 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5554ff9640 1 -- 172.21.15.145:0/2297399524 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c059040 con 0x55ba5b369670 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5554ff9640 1 -- 172.21.15.145:0/2297399524 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c063070 con 0x55ba5b369670 2024-09-11T11:01:29.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5554ff9640 1 -- 172.21.15.145:0/2297399524 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c005df0 con 0x55ba5b369670 2024-09-11T11:01:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- 172.21.15.145:0/2297399524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 msgr2=0x55ba5b369a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2297399524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b369a50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f566c0046c0 tx=0x7f566c0349c0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- 172.21.15.145:0/2297399524 shutdown_connections 2024-09-11T11:01:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2297399524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b369a50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- 172.21.15.145:0/2297399524 >> 172.21.15.145:0/2297399524 conn(0x55ba5b365a50 msgr2=0x55ba5b363b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- 172.21.15.145:0/2297399524 shutdown_connections 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- 172.21.15.145:0/2297399524 wait complete. 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 Processor -- start 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- start start 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b3708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5673bf3980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ba5b36a4c0 con 0x55ba5b369670 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b3708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5671703640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b3708b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50654/0 (socket says 172.21.15.145:50654) 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.856+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 learned_addr learned my addr 172.21.15.145:0/2691867996 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5b370df0 con 0x55ba5b369670 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5671703640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b3708b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f566c0046c0 tx=0x7f566c0418a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5546ffd640 1 -- 172.21.15.145:0/2691867996 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c071020 con 0x55ba5b369670 2024-09-11T11:01:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba5b370df0 con 0x55ba5b369670 2024-09-11T11:01:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5546ffd640 1 -- 172.21.15.145:0/2691867996 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c020720 con 0x55ba5b369670 2024-09-11T11:01:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5546ffd640 1 -- 172.21.15.145:0/2691867996 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c041b30 con 0x55ba5b369670 2024-09-11T11:01:29.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5b370df0 con 0x55ba5b369670 2024-09-11T11:01:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5546ffd640 1 -- 172.21.15.145:0/2691867996 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f566c074020 con 0x55ba5b369670 2024-09-11T11:01:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5546ffd640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f553c034650 0x7f553c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5546ffd640 1 -- 172.21.15.145:0/2691867996 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7f566c077ab0 con 0x55ba5b369670 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5670f02640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f553c034650 0x7f553c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b37b8d0 0x55ba5b37dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b37e4e0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5671f04640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b37b8d0 0x55ba5b37dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5670f02640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f553c034650 0x7f553c036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5668018eb0 tx=0x7f56680a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5671f04640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b37b8d0 0x55ba5b37dd90 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 20 realm 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b37ad80 con 0x55ba5b37b8d0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b37efa0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b37fd80 0x55ba5b382170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.860+0000 7f5671703640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b37fd80 0x55ba5b382170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671703640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b37fd80 0x55ba5b382170 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f566c05c040 con 0x55ba5b37fd80 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5673bf3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b383050 con 0x55ba5b37fd80 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f566c05c040 con 0x55ba5b37fd80 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5673bf3980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5673bf3980 20 searching for the correct realm 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ba5b3848e0 0x55ba5b386da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b387470 con 0x55ba5b3848e0 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5670f02640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ba5b3848e0 0x55ba5b386da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5670f02640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ba5b3848e0 0x55ba5b386da0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b387470 con 0x55ba5b37fd80 2024-09-11T11:01:29.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f566c05c040 con 0x55ba5b37fd80 2024-09-11T11:01:29.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671703640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f566c076020 0x7f566c054450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:29.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x7f566c076020 2024-09-11T11:01:29.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671f04640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f566c076020 0x7f566c054450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671f04640 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f566c076020 0x7f566c054450 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.864+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b3848e0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05c040 con 0x55ba5b37fd80 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05c040 con 0x55ba5b37fd80 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x7f566c076020 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x7f566c076020 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b3848e0 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.868+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b3848e0 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b3848e0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x7f566c076020 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37b8d0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x7f566c076020 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b3848e0 2024-09-11T11:01:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x7f566c076020 2024-09-11T11:01:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.872+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b3848e0 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382800 con 0x55ba5b37fd80 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b382cf0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3830e0 con 0x55ba5b37fd80 2024-09-11T11:01:29.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3830e0 con 0x7f566c076020 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 zone default found 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 4 Realm: () 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 zonegroup default 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3878f0 con 0x7f566c076020 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3896a0 con 0x55ba5b3848e0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b389b10 con 0x55ba5b3848e0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:29.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 started sync module instance, tier type = 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.876+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b388b10 con 0x55ba5b37fd80 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.880+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.880+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94258882711568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b388b10 con 0x55ba5b37fd80 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.880+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38a5d0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.880+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.880+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94258882715840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38a590 con 0x55ba5b37b8d0 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.880+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38b500 con 0x55ba5b37fd80 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.880+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94258882711568] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.880+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94258882715840] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94258882718192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38b010 con 0x55ba5b37fd80 2024-09-11T11:01:29.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38bda0 con 0x7f566c076020 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94258882722032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38b010 con 0x7f566c076020 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38c7e0 con 0x55ba5b37fd80 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94258882722032] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94258882718192] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94258882709088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38c330 con 0x55ba5b37fd80 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.884+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38d080 con 0x55ba5b3848e0 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94258882726864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38c330 con 0x55ba5b3848e0 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38dde0 con 0x55ba5b3848e0 2024-09-11T11:01:29.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94258882726864] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94258882729536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38e6b0 con 0x55ba5b3848e0 2024-09-11T11:01:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38f070 con 0x7f566c076020 2024-09-11T11:01:29.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94258882709088] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94258882735040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38f490 con 0x7f566c076020 2024-09-11T11:01:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 20 add_watcher() i=0 2024-09-11T11:01:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 20 add_watcher() i=1 2024-09-11T11:01:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 20 add_watcher() i=2 2024-09-11T11:01:29.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 20 add_watcher() i=3 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 20 add_watcher() i=4 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 20 add_watcher() i=5 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94258882729536] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.888+0000 7f5673bf3980 20 add_watcher() i=6 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94258882735040] v32'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 20 add_watcher() i=7 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38f490 con 0x55ba5b37b8d0 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94258882736096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38f400 con 0x55ba5b37b8d0 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94258882736096] v32'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f55277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 5 note: GC not initialized 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f55267e4640 20 reqs_thread_entry: start 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 20 Filter name: none 2024-09-11T11:01:29.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5497fff640 20 reqs_thread_entry: start 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3b5ab0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.892+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3b5590 con 0x55ba5b37b8d0 2024-09-11T11:01:29.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 20 rados_obj.operate() r=0 bl.length=193 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 20 rados->read ofs=0 len=0 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.4 8:26ce5188:root::.bucket.meta.testx%3amyfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3b93c0 con 0x7f566c076020 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 20 rados_obj.operate() r=0 bl.length=412 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:29.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-11T11:01:29.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:29.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-11T11:01:29.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3bda30 con 0x55ba5b37b8d0 2024-09-11T11:01:29.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v32'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3c1340 con 0x55ba5b37b8d0 2024-09-11T11:01:29.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(66 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [create,call,writefull 0~379,setxattr (123)] v32'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x7 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1, ofs0, ns] 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94258882932960 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3c0d60 con 0x55ba5b37fd80 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94258882709088 notify 137438953497 ret 0) ==== 770+0+0 (crc 0 0 0) 0x55ba5b35d910 con 0x55ba5b37fd80 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5554ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94258882709088 notifier 4563 bl.length()=728 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5554ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x7 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5554ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5554ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5554ff9640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5534003eb0 con 0x55ba5b37fd80 2024-09-11T11:01:29.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.896+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.4 [notify cookie 94258882932960 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94258882932960 notify 137438953497 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba5b35d680 con 0x55ba5b37fd80 2024-09-11T11:01:29.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_sources= new_sources= 2024-09-11T11:01:29.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential sources added=[] removed=[] 2024-09-11T11:01:29.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_dests= new_dests= 2024-09-11T11:01:29.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential dests added=[] removed=[] 2024-09-11T11:01:29.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3c0e60 con 0x7f566c076020 2024-09-11T11:01:29.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 foo.buckets [call] v32'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3c02c0 con 0x7f566c076020 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v32'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94258882939312 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3c18d0 con 0x55ba5b3848e0 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== watch-notify(notify (1) cookie 94258882729536 notify 137438953481 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55ba5b1c08f0 con 0x55ba5b3848e0 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5547fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94258882729536 notifier 4563 bl.length()=314 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5547fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5547fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5547fff640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f54a4003410 con 0x55ba5b3848e0 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(71 notify.6 [notify cookie 94258882939312 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== watch-notify(notify_complete (2) cookie 94258882939312 notify 137438953481 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f56680b69b0 con 0x55ba5b3848e0 2024-09-11T11:01:29.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.900+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3c09b0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(73 testx/myfoo [call,delete] v32'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5673bf3980 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-11T11:01:29.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5673bf3980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-11T11:01:29.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94258882939312 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3be0d0 con 0x55ba5b37fd80 2024-09-11T11:01:29.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 94258882709088 notify 137438953498 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55ba5b35d680 con 0x55ba5b37fd80 2024-09-11T11:01:29.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5554ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94258882709088 notifier 4563 bl.length()=155 2024-09-11T11:01:29.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5554ff9640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f5534003eb0 con 0x55ba5b37fd80 2024-09-11T11:01:29.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(74 notify.4 [notify cookie 94258882939312 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.904+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 94258882939312 notify 137438953498 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba5b3423d0 con 0x55ba5b37fd80 2024-09-11T11:01:29.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 8.4 8:26ce5188:root::.bucket.meta.testx%3amyfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3c1060 con 0x7f566c076020 2024-09-11T11:01:29.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call,delete] v32'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5673bf3980 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 from cache 2024-09-11T11:01:29.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5673bf3980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1, ofs0, ns] 2024-09-11T11:01:29.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify cookie 94258882939312 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3b8c90 con 0x7f566c076020 2024-09-11T11:01:29.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== watch-notify(notify (1) cookie 94258882722032 notify 137438953488 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55ba5b3c0e60 con 0x7f566c076020 2024-09-11T11:01:29.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5547fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94258882722032 notifier 4563 bl.length()=212 2024-09-11T11:01:29.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(77 notify.3 [notify cookie 94258882939312 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5547fff640 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7f54a4003480 con 0x7f566c076020 2024-09-11T11:01:29.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== watch-notify(notify_complete (2) cookie 94258882939312 notify 137438953488 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ba5b3c00f0 con 0x7f566c076020 2024-09-11T11:01:29.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(78 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f55277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:29.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.908+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94258882736096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3b38e0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94258882736096] v32'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94258882711568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3b38e0 con 0x55ba5b37fd80 2024-09-11T11:01:29.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94258882711568] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5673bf3980 20 remove_watcher() i=0 2024-09-11T11:01:29.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5673bf3980 2 removed watcher, disabling cache 2024-09-11T11:01:29.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94258882715840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b389010 con 0x55ba5b37b8d0 2024-09-11T11:01:29.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94258882715840] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x55ba5b37b8d0 2024-09-11T11:01:29.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5673bf3980 20 remove_watcher() i=1 2024-09-11T11:01:29.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.912+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94258882718192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3b38e0 con 0x55ba5b37fd80 2024-09-11T11:01:29.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.916+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94258882718192] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.916+0000 7f5673bf3980 20 remove_watcher() i=2 2024-09-11T11:01:29.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.916+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94258882722032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b389010 con 0x7f566c076020 2024-09-11T11:01:29.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.916+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94258882722032] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.916+0000 7f5673bf3980 20 remove_watcher() i=3 2024-09-11T11:01:29.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.916+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94258882709088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b3b38e0 con 0x55ba5b37fd80 2024-09-11T11:01:29.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5671703640 1 -- 172.21.15.145:0/2691867996 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94258882709088] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c090040 con 0x55ba5b37fd80 2024-09-11T11:01:29.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5673bf3980 20 remove_watcher() i=4 2024-09-11T11:01:29.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94258882726864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b38b8f0 con 0x55ba5b3848e0 2024-09-11T11:01:29.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94258882726864] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5673bf3980 20 remove_watcher() i=5 2024-09-11T11:01:29.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94258882729536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b389010 con 0x55ba5b3848e0 2024-09-11T11:01:29.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5670f02640 1 -- 172.21.15.145:0/2691867996 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94258882729536] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56680d8070 con 0x55ba5b3848e0 2024-09-11T11:01:29.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5673bf3980 20 remove_watcher() i=6 2024-09-11T11:01:29.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.920+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94258882735040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55ba5b388660 con 0x7f566c076020 2024-09-11T11:01:29.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94258882735040] v32'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f56640083f0 con 0x7f566c076020 2024-09-11T11:01:29.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 20 remove_watcher() i=7 2024-09-11T11:01:29.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b37fd80 msgr2=0x55ba5b382170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b37fd80 0x55ba5b382170 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b37b8d0 msgr2=0x55ba5b37dd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b37b8d0 0x55ba5b37dd90 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f566c076020 msgr2=0x7f566c054450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f566c076020 0x7f566c054450 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ba5b3848e0 msgr2=0x55ba5b386da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ba5b3848e0 0x55ba5b386da0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f553c034650 msgr2=0x7f553c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f553c034650 0x7f553c036b10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5668018eb0 tx=0x7f56680a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 msgr2=0x55ba5b3708b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5671f04640 1 -- 172.21.15.145:0/2691867996 reap_dead start 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b3708b0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f566c0046c0 tx=0x7f566c0418a0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 shutdown_connections 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/2691867996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b369670 0x55ba5b3708b0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 >> 172.21.15.145:0/2691867996 conn(0x55ba5b365a50 msgr2=0x55ba5b363b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 shutdown_connections 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/2691867996 wait complete. 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/4190593572 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5548034650 msgr2=0x7f5548036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/4190593572 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5548034650 0x7f5548036b10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55ba5b343510 tx=0x7f5668005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/4190593572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b35cd20 msgr2=0x55ba5b35d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/4190593572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b35cd20 0x55ba5b35d140 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f566c0483a0 tx=0x7f566c028960 comp rx=0 tx=0).stop 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/4190593572 shutdown_connections 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/4190593572 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5548034650 0x7f5548036b10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/4190593572 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b35cd20 0x55ba5b35d140 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/4190593572 >> 172.21.15.145:0/4190593572 conn(0x55ba5b351e70 msgr2=0x55ba5b3548f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/4190593572 shutdown_connections 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/4190593572 wait complete. 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b347340 msgr2=0x55ba5b349730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ba5b347340 0x55ba5b349730 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b1c17d0 msgr2=0x55ba5b345f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ba5b1c17d0 0x55ba5b345f30 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ba5b34c9d0 msgr2=0x55ba5b34edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ba5b34c9d0 0x55ba5b34edc0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5558034650 msgr2=0x7f5558036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5558034650 0x7f5558036b10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f56680ad000 tx=0x7f56680a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 msgr2=0x55ba5b33ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 --2- 172.21.15.145:0/974132631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ba5b1c13c0 0x55ba5b33ef20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x55ba5b338d90 tx=0x7f566c000f50 comp rx=0 tx=0).stop 2024-09-11T11:01:29.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5671f04640 1 -- 172.21.15.145:0/974132631 reap_dead start 2024-09-11T11:01:29.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 shutdown_connections 2024-09-11T11:01:29.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 >> 172.21.15.145:0/974132631 conn(0x55ba5b2461c0 msgr2=0x55ba5b332360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:29.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 shutdown_connections 2024-09-11T11:01:29.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:29.924+0000 7f5673bf3980 1 -- 172.21.15.145:0/974132631 wait complete. 2024-09-11T11:01:29.937 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-11T11:01:29.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-11T11:01:29.937 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-11T11:01:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:30.012 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:30.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8eb7db980 1 Processor -- start 2024-09-11T11:01:30.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8eb7db980 1 -- start start 2024-09-11T11:01:30.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8eb7db980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557d5b315b10 0x557d5b317f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8eb7db980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557d5b19fae0 con 0x557d5b318440 2024-09-11T11:01:30.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8eb7db980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x557d5b1c3e30 con 0x557d5b315b10 2024-09-11T11:01:30.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8e92eb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557d5b315b10 0x557d5b317f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8e8aea640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x557d5b318440 0x557d5b31efe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54696/0 (socket says 172.21.15.145:54696) 2024-09-11T11:01:30.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8e92eb640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557d5b315b10 0x557d5b317f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50662/0 (socket says 172.21.15.145:50662) 2024-09-11T11:01:30.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2697177129 learned_addr learned my addr 172.21.15.145:0/2697177129 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:30.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2697177129 >> v1:172.21.15.102:6789/0 conn(0x557d5b318440 legacy=0x557d5b31efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2697177129 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5b3188e0 con 0x557d5b315b10 2024-09-11T11:01:30.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2697177129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b317f00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400a480 tx=0x7fb8e401b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfc950f014b18e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.012+0000 7fb8e3fff640 1 -- 172.21.15.145:0/2697177129 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40aa570 con 0x557d5b315b10 2024-09-11T11:01:30.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8e3fff640 1 -- 172.21.15.145:0/2697177129 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e40af070 con 0x557d5b315b10 2024-09-11T11:01:30.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8e3fff640 1 -- 172.21.15.145:0/2697177129 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40aa860 con 0x557d5b315b10 2024-09-11T11:01:30.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2697177129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 msgr2=0x557d5b317f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2697177129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b317f00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb8e400a480 tx=0x7fb8e401b310 comp rx=0 tx=0).stop 2024-09-11T11:01:30.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2697177129 shutdown_connections 2024-09-11T11:01:30.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2697177129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b317f00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2697177129 >> 172.21.15.145:0/2697177129 conn(0x557d5b3117b0 msgr2=0x557d5b313bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2697177129 shutdown_connections 2024-09-11T11:01:30.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.016+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2697177129 wait complete. 2024-09-11T11:01:30.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8eb7db980 1 Processor -- start 2024-09-11T11:01:30.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8eb7db980 1 -- start start 2024-09-11T11:01:30.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8eb7db980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b404c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8eb7db980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d5b1c5200 con 0x557d5b315b10 2024-09-11T11:01:30.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b404c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b404c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50678/0 (socket says 172.21.15.145:50678) 2024-09-11T11:01:30.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2188428598 learned_addr learned my addr 172.21.15.145:0/2188428598 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2188428598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5b4051e0 con 0x557d5b315b10 2024-09-11T11:01:30.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2188428598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b404c10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4018f40 tx=0x7fb8e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7864f4c276988ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb7d7606640 1 -- 172.21.15.145:0/2188428598 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40aa990 con 0x557d5b315b10 2024-09-11T11:01:30.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb7d7606640 1 -- 172.21.15.145:0/2188428598 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e40aab30 con 0x557d5b315b10 2024-09-11T11:01:30.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.028+0000 7fb7d7606640 1 -- 172.21.15.145:0/2188428598 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40aae30 con 0x557d5b315b10 2024-09-11T11:01:30.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2188428598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 msgr2=0x557d5b404c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2188428598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b404c10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4018f40 tx=0x7fb8e4003030 comp rx=0 tx=0).stop 2024-09-11T11:01:30.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2188428598 shutdown_connections 2024-09-11T11:01:30.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2188428598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b404c10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2188428598 >> 172.21.15.145:0/2188428598 conn(0x557d5b3117b0 msgr2=0x557d5b400840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2188428598 shutdown_connections 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2188428598 wait complete. 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 Processor -- start 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- start start 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b40be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d5b3231f0 con 0x557d5b315b10 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b40be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b40be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50688/0 (socket says 172.21.15.145:50688) 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2649228633 learned_addr learned my addr 172.21.15.145:0/2649228633 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2649228633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5b40c370 con 0x557d5b315b10 2024-09-11T11:01:30.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b40be30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40aa730 tx=0x7fb8e40180b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb7d5e03640 1 -- 172.21.15.145:0/2649228633 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40ca020 con 0x557d5b315b10 2024-09-11T11:01:30.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d5b40c600 con 0x557d5b315b10 2024-09-11T11:01:30.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb7d5e03640 1 -- 172.21.15.145:0/2649228633 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e40c6590 con 0x557d5b315b10 2024-09-11T11:01:30.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5b40f2e0 con 0x557d5b315b10 2024-09-11T11:01:30.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb7d5e03640 1 -- 172.21.15.145:0/2649228633 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40c6870 con 0x557d5b315b10 2024-09-11T11:01:30.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.032+0000 7fb7d5e03640 1 -- 172.21.15.145:0/2649228633 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8e40cd020 con 0x557d5b315b10 2024-09-11T11:01:30.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb7d5e03640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7d0034650 0x7fb7d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb7d5e03640 1 -- 172.21.15.145:0/2649228633 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fb8e40c1070 con 0x557d5b315b10 2024-09-11T11:01:30.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7d0034650 0x7fb7d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b318440 0x557d5b412f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b413500 con 0x557d5b318440 2024-09-11T11:01:30.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e9aec640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b318440 0x557d5b412f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7d0034650 0x7fb7d0036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4001da0 tx=0x7fb8d4001300 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e9aec640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b318440 0x557d5b412f30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2649228633 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b318440 2024-09-11T11:01:30.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b4142d0 0x557d5b4166c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b416cf0 con 0x557d5b4142d0 2024-09-11T11:01:30.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b4142d0 0x557d5b4166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b4142d0 0x557d5b4166c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2649228633 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8e40a8070 con 0x557d5b4142d0 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4185a0 con 0x557d5b4142d0 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2649228633 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb8e40a8070 con 0x557d5b4142d0 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.036+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b417710 con 0x557d5b4142d0 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2649228633 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8e40a8070 con 0x557d5b4142d0 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557d5b419950 0x557d5b41bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b41c280 con 0x557d5b419950 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557d5b419950 0x557d5b41bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557d5b419950 0x557d5b41bd40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2649228633 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b419950 2024-09-11T11:01:30.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8eb7db980 1 Processor -- start 2024-09-11T11:01:30.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8eb7db980 1 -- start start 2024-09-11T11:01:30.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8eb7db980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b429c30 0x557d5b42a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8eb7db980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d5b21e800 con 0x557d5b429c30 2024-09-11T11:01:30.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b429c30 0x557d5b42a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b429c30 0x557d5b42a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50694/0 (socket says 172.21.15.145:50694) 2024-09-11T11:01:30.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e92eb640 1 -- 172.21.15.145:0/1062175254 learned_addr learned my addr 172.21.15.145:0/1062175254 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e92eb640 1 -- 172.21.15.145:0/1062175254 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5b42a590 con 0x557d5b429c30 2024-09-11T11:01:30.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/1062175254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b429c30 0x557d5b42a050 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4003070 tx=0x7fb8e40cefa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb7ceffd640 1 -- 172.21.15.145:0/1062175254 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40c53c0 con 0x557d5b429c30 2024-09-11T11:01:30.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb7ceffd640 1 -- 172.21.15.145:0/1062175254 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e40e8070 con 0x557d5b429c30 2024-09-11T11:01:30.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1062175254 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d5b42a820 con 0x557d5b429c30 2024-09-11T11:01:30.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb7ceffd640 1 -- 172.21.15.145:0/1062175254 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40c5690 con 0x557d5b429c30 2024-09-11T11:01:30.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.040+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1062175254 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5b42d4a0 con 0x557d5b429c30 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb7ceffd640 1 -- 172.21.15.145:0/1062175254 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8e40ea030 con 0x557d5b429c30 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb7ceffd640 1 --2- 172.21.15.145:0/1062175254 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7c0034650 0x7fb7c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb7ceffd640 1 -- 172.21.15.145:0/1062175254 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fb8e40b9070 con 0x557d5b429c30 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/1062175254 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7c0034650 0x7fb7c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 Processor -- start 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- start start 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/1062175254 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7c0034650 0x7fb7c0036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x557d5b410420 tx=0x7fb8d400f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b4368d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d5b4054a0 con 0x557d5b4364d0 2024-09-11T11:01:30.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b4368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b4368d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50710/0 (socket says 172.21.15.145:50710) 2024-09-11T11:01:30.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e92eb640 1 -- 172.21.15.145:0/1009764069 learned_addr learned my addr 172.21.15.145:0/1009764069 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e92eb640 1 -- 172.21.15.145:0/1009764069 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5b436ea0 con 0x557d5b4364d0 2024-09-11T11:01:30.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/1009764069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b4368d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40cf4c0 tx=0x7fb8e40edf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f62034aba07471 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb7ccff9640 1 -- 172.21.15.145:0/1009764069 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40e4370 con 0x557d5b4364d0 2024-09-11T11:01:30.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb7ccff9640 1 -- 172.21.15.145:0/1009764069 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e40c4850 con 0x557d5b4364d0 2024-09-11T11:01:30.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb7ccff9640 1 -- 172.21.15.145:0/1009764069 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40e4510 con 0x557d5b4364d0 2024-09-11T11:01:30.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1009764069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 msgr2=0x557d5b4368d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/1009764069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b4368d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40cf4c0 tx=0x7fb8e40edf60 comp rx=0 tx=0).stop 2024-09-11T11:01:30.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1009764069 shutdown_connections 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/1009764069 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b4368d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1009764069 >> 172.21.15.145:0/1009764069 conn(0x557d5b432900 msgr2=0x557d5b430a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1009764069 shutdown_connections 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1009764069 wait complete. 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 Processor -- start 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- start start 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b43d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8eb7db980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557d5b436ea0 con 0x557d5b4364d0 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b43d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e92eb640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b43d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50712/0 (socket says 172.21.15.145:50712) 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.044+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 learned_addr learned my addr 172.21.15.145:0/2499844554 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5b43dac0 con 0x557d5b4364d0 2024-09-11T11:01:30.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b43d580 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40da580 tx=0x7fb8e40ccf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb7beffd640 1 -- 172.21.15.145:0/2499844554 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40c4640 con 0x557d5b4364d0 2024-09-11T11:01:30.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d5b43dac0 con 0x557d5b4364d0 2024-09-11T11:01:30.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb7beffd640 1 -- 172.21.15.145:0/2499844554 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e40cf630 con 0x557d5b4364d0 2024-09-11T11:01:30.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb7beffd640 1 -- 172.21.15.145:0/2499844554 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e40cf910 con 0x557d5b4364d0 2024-09-11T11:01:30.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5b43df30 con 0x557d5b4364d0 2024-09-11T11:01:30.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb7beffd640 1 -- 172.21.15.145:0/2499844554 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8e40c4070 con 0x557d5b4364d0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb7beffd640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7b4034650 0x7fb7b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb7beffd640 1 -- 172.21.15.145:0/2499844554 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fb8e4108070 con 0x557d5b4364d0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7b4034650 0x7fb7b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b4484c0 0x557d5b44a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b44b0b0 con 0x557d5b4484c0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8e9aec640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b4484c0 0x557d5b44a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7b4034650 0x7fb7b4036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x557d5b4184e0 tx=0x7fb8d4010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8e9aec640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b4484c0 0x557d5b44a960 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 20 realm 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4479b0 con 0x557d5b4484c0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.048+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b44bb80 con 0x557d5b4484c0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b44c960 0x557d5b44ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b44f3d0 con 0x557d5b44c960 2024-09-11T11:01:30.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b44c960 0x557d5b44ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b44c960 0x557d5b44ed50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b44fc20 con 0x557d5b44c960 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 20 searching for the correct realm 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557d5b451990 0x557d5b453d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b451990 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557d5b451990 0x557d5b453d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e8aea640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557d5b451990 0x557d5b453d80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.052+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e92eb640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8e410b030 0x7fb8e40f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x7fb8e410b030 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8e410b030 0x7fb8e40f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8e410b030 0x7fb8e40f68a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b451990 2024-09-11T11:01:30.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x7fb8e410b030 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.056+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x7fb8e410b030 2024-09-11T11:01:30.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b451990 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b451990 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b451990 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x7fb8e410b030 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.060+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b4484c0 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x7fb8e410b030 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b451990 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x7fb8e410b030 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b451990 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557d5b454400 con 0x557d5b44c960 2024-09-11T11:01:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:30.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4505d0 con 0x557d5b4484c0 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.064+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b450210 con 0x557d5b44c960 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b450220 con 0x7fb8e410b030 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 zone default found 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 4 Realm: () 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 zonegroup default 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b451070 con 0x7fb8e410b030 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b456c10 con 0x557d5b451990 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b456fb0 con 0x557d5b451990 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 started sync module instance, tier type = 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4560a0 con 0x557d5b44c960 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93996890547616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4560a0 con 0x557d5b44c960 2024-09-11T11:01:30.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.068+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b457a20 con 0x557d5b4484c0 2024-09-11T11:01:30.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93996890551600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4582c0 con 0x557d5b4484c0 2024-09-11T11:01:30.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b458d00 con 0x557d5b44c960 2024-09-11T11:01:30.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93996890547616] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93996890551600] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93996890556368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b457e10 con 0x557d5b44c960 2024-09-11T11:01:30.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4595a0 con 0x7fb8e410b030 2024-09-11T11:01:30.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.072+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93996890558704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b457e10 con 0x7fb8e410b030 2024-09-11T11:01:30.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45a060 con 0x557d5b44c960 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93996890556368] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93996890558704] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93996890559760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45a020 con 0x557d5b44c960 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45a450 con 0x557d5b451990 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93996890545136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45aca0 con 0x557d5b451990 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45b660 con 0x557d5b451990 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93996890559760] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93996890545136] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.076+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93996890567088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45ba50 con 0x557d5b451990 2024-09-11T11:01:30.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45c300 con 0x7fb8e410b030 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93996890567088] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93996890561328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45bf00 con 0x7fb8e410b030 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 20 add_watcher() i=0 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 20 add_watcher() i=1 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 20 add_watcher() i=2 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 20 add_watcher() i=3 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 20 add_watcher() i=4 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 20 add_watcher() i=5 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 20 add_watcher() i=6 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93996890561328] v32'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 20 add_watcher() i=7 2024-09-11T11:01:30.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:30.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45f780 con 0x557d5b4484c0 2024-09-11T11:01:30.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.080+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93996890569760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45cca0 con 0x557d5b4484c0 2024-09-11T11:01:30.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93996890569760] v32'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb79f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb8eb7db980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:30.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb8eb7db980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:30.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45f400 con 0x557d5b44c960 2024-09-11T11:01:30.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b45f470 con 0x7fb8e410b030 2024-09-11T11:01:30.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.084+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b468810 con 0x557d5b451990 2024-09-11T11:01:30.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.088+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.088+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4687d0 con 0x557d5b4484c0 2024-09-11T11:01:30.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.088+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'135 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.088+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b468ee0 con 0x557d5b44c960 2024-09-11T11:01:30.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.092+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.092+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b468fd0 con 0x557d5b451990 2024-09-11T11:01:30.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.092+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.092+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b469660 con 0x557d5b44c960 2024-09-11T11:01:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.096+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.096+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b469660 con 0x557d5b4484c0 2024-09-11T11:01:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.096+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.096+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b469bd0 con 0x557d5b44c960 2024-09-11T11:01:30.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.100+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.100+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b469bd0 con 0x557d5b44c960 2024-09-11T11:01:30.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.100+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.100+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b469bd0 con 0x557d5b44c960 2024-09-11T11:01:30.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.104+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.104+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b469bd0 con 0x557d5b451990 2024-09-11T11:01:30.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.104+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.104+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b469fd0 con 0x557d5b44c960 2024-09-11T11:01:30.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.108+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.108+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b469fd0 con 0x557d5b4484c0 2024-09-11T11:01:30.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.108+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'31 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.108+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b4484c0 2024-09-11T11:01:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.108+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.108+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b44c960 2024-09-11T11:01:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.112+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.112+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b44c960 2024-09-11T11:01:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.112+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.112+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b451990 2024-09-11T11:01:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.116+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.116+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b44c960 2024-09-11T11:01:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.116+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.116+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b4484c0 2024-09-11T11:01:30.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.120+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.120+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b44c960 2024-09-11T11:01:30.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.120+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.120+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b44c960 2024-09-11T11:01:30.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.124+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.124+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b451990 2024-09-11T11:01:30.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.124+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.124+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a480 con 0x557d5b44c960 2024-09-11T11:01:30.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.128+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.128+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46a530 con 0x557d5b451990 2024-09-11T11:01:30.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.128+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.128+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46aa10 con 0x557d5b451990 2024-09-11T11:01:30.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.128+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'26 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.128+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46aa10 con 0x557d5b451990 2024-09-11T11:01:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.132+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.132+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46aa10 con 0x557d5b44c960 2024-09-11T11:01:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.132+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.132+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46aa10 con 0x557d5b4484c0 2024-09-11T11:01:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.136+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.136+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46aa10 con 0x557d5b44c960 2024-09-11T11:01:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.136+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'34 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.136+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46aa10 con 0x557d5b4484c0 2024-09-11T11:01:30.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b46aa10 con 0x7fb8e410b030 2024-09-11T11:01:30.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb79e7e4640 20 reqs_thread_entry: start 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 20 Filter name: none 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb70ffff640 20 reqs_thread_entry: start 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b485a40 con 0x557d5b451990 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 20 rados_obj.operate() r=0 bl.length=419 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-11T11:01:30.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4680f0 con 0x557d5b4484c0 2024-09-11T11:01:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-11T11:01:30.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.140+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b4680f0 con 0x557d5b451990 2024-09-11T11:01:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v32'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8eb7db980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-11T11:01:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93996890742592 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b488910 con 0x557d5b44c960 2024-09-11T11:01:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== watch-notify(notify (1) cookie 93996890556368 notify 137438953499 ret 0) ==== 212+0+0 (crc 0 0 0) 0x557d5b469bd0 con 0x557d5b44c960 2024-09-11T11:01:30.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb7bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 93996890556368 notifier 4570 bl.length()=170 2024-09-11T11:01:30.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb7bffff640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb71c0032d0 con 0x557d5b44c960 2024-09-11T11:01:30.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(97 notify.2 [notify cookie 93996890742592 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== watch-notify(notify_complete (2) cookie 93996890742592 notify 137438953499 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb8e411c040 con 0x557d5b44c960 2024-09-11T11:01:30.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8eb7db980 10 removing email index: 2024-09-11T11:01:30.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8eb7db980 10 removing user buckets index 2024-09-11T11:01:30.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b485f40 con 0x557d5b4484c0 2024-09-11T11:01:30.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v32'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8eb7db980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93996890747984 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b485f40 con 0x557d5b44c960 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== watch-notify(notify (1) cookie 93996890559760 notify 137438953500 ret 0) ==== 217+0+0 (crc 0 0 0) 0x7fb8e411c040 con 0x557d5b44c960 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb7ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 93996890559760 notifier 4570 bl.length()=175 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb7ccff9640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb7ac003d70 con 0x557d5b44c960 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.144+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(100 notify.4 [notify cookie 93996890747984 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== watch-notify(notify_complete (2) cookie 93996890747984 notify 137438953500 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d5b42a590 con 0x557d5b44c960 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8eb7db980 10 removing user index: testx$tenanteduser 2024-09-11T11:01:30.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b48a930 con 0x557d5b451990 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v32'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8eb7db980 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8eb7db980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93996890743872 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557d5b487d20 con 0x7fb8e410b030 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== watch-notify(notify (1) cookie 93996890558704 notify 137438953489 ret 0) ==== 209+0+0 (crc 0 0 0) 0x557d5b469660 con 0x7fb8e410b030 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb7bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 93996890558704 notifier 4570 bl.length()=167 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb7bffff640 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fb71c003300 con 0x7fb8e410b030 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(103 notify.3 [notify cookie 93996890743872 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== watch-notify(notify_complete (2) cookie 93996890743872 notify 137438953489 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557d5b469a00 con 0x7fb8e410b030 2024-09-11T11:01:30.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb79f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.148+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93996890569760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x557d5b4484c0 2024-09-11T11:01:30.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.152+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93996890569760] v32'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.154 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.152+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93996890547616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x557d5b44c960 2024-09-11T11:01:30.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.152+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93996890547616] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.152+0000 7fb8eb7db980 20 remove_watcher() i=0 2024-09-11T11:01:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.152+0000 7fb8eb7db980 2 removed watcher, disabling cache 2024-09-11T11:01:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.152+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93996890551600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x557d5b4484c0 2024-09-11T11:01:30.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93996890551600] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x557d5b4484c0 2024-09-11T11:01:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8eb7db980 20 remove_watcher() i=1 2024-09-11T11:01:30.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93996890556368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x557d5b44c960 2024-09-11T11:01:30.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93996890556368] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8eb7db980 20 remove_watcher() i=2 2024-09-11T11:01:30.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93996890558704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x7fb8e410b030 2024-09-11T11:01:30.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93996890558704] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8eb7db980 20 remove_watcher() i=3 2024-09-11T11:01:30.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.156+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93996890559760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x557d5b44c960 2024-09-11T11:01:30.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.160+0000 7fb8e92eb640 1 -- 172.21.15.145:0/2499844554 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93996890559760] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e40f3070 con 0x557d5b44c960 2024-09-11T11:01:30.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.160+0000 7fb8eb7db980 20 remove_watcher() i=4 2024-09-11T11:01:30.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.160+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93996890545136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x557d5b451990 2024-09-11T11:01:30.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.160+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93996890545136] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.160+0000 7fb8eb7db980 20 remove_watcher() i=5 2024-09-11T11:01:30.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.160+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93996890567088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x557d5b451990 2024-09-11T11:01:30.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.160+0000 7fb8e8aea640 1 -- 172.21.15.145:0/2499844554 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93996890567088] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d400e6c0 con 0x557d5b451990 2024-09-11T11:01:30.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.160+0000 7fb8eb7db980 20 remove_watcher() i=6 2024-09-11T11:01:30.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93996890561328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557d5b464340 con 0x7fb8e410b030 2024-09-11T11:01:30.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93996890561328] v32'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8dc00a4d0 con 0x7fb8e410b030 2024-09-11T11:01:30.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 20 remove_watcher() i=7 2024-09-11T11:01:30.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b44c960 msgr2=0x557d5b44ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b44c960 0x557d5b44ed50 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b4484c0 msgr2=0x557d5b44a960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b4484c0 0x557d5b44a960 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8e410b030 msgr2=0x7fb8e40f68a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8e410b030 0x7fb8e40f68a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557d5b451990 msgr2=0x557d5b453d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557d5b451990 0x557d5b453d80 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7b4034650 msgr2=0x7fb7b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7b4034650 0x7fb7b4036b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x557d5b4184e0 tx=0x7fb8d4010000 comp rx=0 tx=0).stop 2024-09-11T11:01:30.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2499844554 reap_dead start 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 msgr2=0x557d5b43d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b43d580 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40da580 tx=0x7fb8e40ccf90 comp rx=0 tx=0).stop 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 shutdown_connections 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2499844554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b4364d0 0x557d5b43d580 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 >> 172.21.15.145:0/2499844554 conn(0x557d5b432900 msgr2=0x557d5b4309d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 shutdown_connections 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2499844554 wait complete. 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1062175254 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7c0034650 msgr2=0x7fb7c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/1062175254 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7c0034650 0x7fb7c0036b10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x557d5b410420 tx=0x7fb8d400f000 comp rx=0 tx=0).stop 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1062175254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b429c30 msgr2=0x557d5b42a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/1062175254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b429c30 0x557d5b42a050 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4003070 tx=0x7fb8e40cefa0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1062175254 shutdown_connections 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/1062175254 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7c0034650 0x7fb7c0036b10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/1062175254 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b429c30 0x557d5b42a050 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1062175254 >> 172.21.15.145:0/1062175254 conn(0x557d5b41ed80 msgr2=0x557d5b421800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1062175254 shutdown_connections 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/1062175254 wait complete. 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b4142d0 msgr2=0x557d5b4166c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557d5b4142d0 0x557d5b4166c0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b318440 msgr2=0x557d5b412f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557d5b318440 0x557d5b412f30 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557d5b419950 msgr2=0x557d5b41bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557d5b419950 0x557d5b41bd40 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7d0034650 msgr2=0x7fb7d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7d0034650 0x7fb7d0036b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4001da0 tx=0x7fb8d4001300 comp rx=0 tx=0).stop 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 msgr2=0x557d5b40be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 --2- 172.21.15.145:0/2649228633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557d5b315b10 0x557d5b40be30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40aa730 tx=0x7fb8e40180b0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8e9aec640 1 -- 172.21.15.145:0/2649228633 reap_dead start 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 shutdown_connections 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 >> 172.21.15.145:0/2649228633 conn(0x557d5b3117b0 msgr2=0x557d5b3ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 shutdown_connections 2024-09-11T11:01:30.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.164+0000 7fb8eb7db980 1 -- 172.21.15.145:0/2649228633 wait complete. 2024-09-11T11:01:30.183 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-11T11:01:30.186 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-11T11:01:30.229 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:30.230 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-11T11:01:30.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-11T11:01:30.230 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-11T11:01:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe24a5a2980 1 Processor -- start 2024-09-11T11:01:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe24a5a2980 1 -- start start 2024-09-11T11:01:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe24a5a2980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557fc1358ad0 0x557fc135aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe24a5a2980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557fc11dcae0 con 0x557fc12c92a0 2024-09-11T11:01:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe24a5a2980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x557fc1200e30 con 0x557fc1358ad0 2024-09-11T11:01:30.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe2478b1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557fc1358ad0 0x557fc135aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe2478b1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557fc1358ad0 0x557fc135aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50716/0 (socket says 172.21.15.145:50716) 2024-09-11T11:01:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe2478b1640 1 -- 172.21.15.145:0/678248067 learned_addr learned my addr 172.21.15.145:0/678248067 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe2478b1640 1 -- 172.21.15.145:0/678248067 >> v1:172.21.15.102:6789/0 conn(0x557fc12c92a0 legacy=0x557fc13573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe2478b1640 1 -- 172.21.15.145:0/678248067 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc12c9830 con 0x557fc1358ad0 2024-09-11T11:01:30.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.264+0000 7fe2478b1640 1 --2- 172.21.15.145:0/678248067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1358ad0 0x557fc135aec0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe23000a5c0 tx=0x7fe23001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7b791acaabeccd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe2470b0640 1 -- 172.21.15.145:0/678248067 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2300a6070 con 0x557fc1358ad0 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe2470b0640 1 -- 172.21.15.145:0/678248067 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2300af070 con 0x557fc1358ad0 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe2470b0640 1 -- 172.21.15.145:0/678248067 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2300aa5c0 con 0x557fc1358ad0 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe24a5a2980 1 -- 172.21.15.145:0/678248067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1358ad0 msgr2=0x557fc135aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/678248067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1358ad0 0x557fc135aec0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe23000a5c0 tx=0x7fe23001b340 comp rx=0 tx=0).stop 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe24a5a2980 1 -- 172.21.15.145:0/678248067 shutdown_connections 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/678248067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1358ad0 0x557fc135aec0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe24a5a2980 1 -- 172.21.15.145:0/678248067 >> 172.21.15.145:0/678248067 conn(0x557fc134f0a0 msgr2=0x557fc13514c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe24a5a2980 1 -- 172.21.15.145:0/678248067 shutdown_connections 2024-09-11T11:01:30.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.268+0000 7fe24a5a2980 1 -- 172.21.15.145:0/678248067 wait complete. 2024-09-11T11:01:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 Processor -- start 2024-09-11T11:01:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 -- start start 2024-09-11T11:01:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1354b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557fc1202200 con 0x557fc12c92a0 2024-09-11T11:01:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1354b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1354b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50728/0 (socket says 172.21.15.145:50728) 2024-09-11T11:01:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe2480b2640 1 -- 172.21.15.145:0/4089788618 learned_addr learned my addr 172.21.15.145:0/4089788618 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe2480b2640 1 -- 172.21.15.145:0/4089788618 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc13550e0 con 0x557fc12c92a0 2024-09-11T11:01:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe2480b2640 1 --2- 172.21.15.145:0/4089788618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1354b10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe240001ea0 tx=0x7fe24000b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f463fbf1d09d1b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe13660c640 1 -- 172.21.15.145:0/4089788618 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe24000a040 con 0x557fc12c92a0 2024-09-11T11:01:30.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe13660c640 1 -- 172.21.15.145:0/4089788618 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24000f620 con 0x557fc12c92a0 2024-09-11T11:01:30.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe13660c640 1 -- 172.21.15.145:0/4089788618 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe24000f890 con 0x557fc12c92a0 2024-09-11T11:01:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4089788618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 msgr2=0x557fc1354b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/4089788618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1354b10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe240001ea0 tx=0x7fe24000b680 comp rx=0 tx=0).stop 2024-09-11T11:01:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4089788618 shutdown_connections 2024-09-11T11:01:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/4089788618 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1354b10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4089788618 >> 172.21.15.145:0/4089788618 conn(0x557fc134f0a0 msgr2=0x557fc143b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.280+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4089788618 shutdown_connections 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4089788618 wait complete. 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe24a5a2980 1 Processor -- start 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe24a5a2980 1 -- start start 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe24a5a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1449100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe24a5a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557fc135bf10 con 0x557fc12c92a0 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1449100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1449100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50738/0 (socket says 172.21.15.145:50738) 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe2480b2640 1 -- 172.21.15.145:0/468981664 learned_addr learned my addr 172.21.15.145:0/468981664 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe2480b2640 1 -- 172.21.15.145:0/468981664 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc1449640 con 0x557fc12c92a0 2024-09-11T11:01:30.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe2480b2640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1449100 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe240001fd0 tx=0x7fe240000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe134e09640 1 -- 172.21.15.145:0/468981664 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe240001520 con 0x557fc12c92a0 2024-09-11T11:01:30.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe134e09640 1 -- 172.21.15.145:0/468981664 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24001ca10 con 0x557fc12c92a0 2024-09-11T11:01:30.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fc14498d0 con 0x557fc12c92a0 2024-09-11T11:01:30.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe134e09640 1 -- 172.21.15.145:0/468981664 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe24001cd50 con 0x557fc12c92a0 2024-09-11T11:01:30.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc144c5b0 con 0x557fc12c92a0 2024-09-11T11:01:30.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe134e09640 1 -- 172.21.15.145:0/468981664 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe240017050 con 0x557fc12c92a0 2024-09-11T11:01:30.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe134e09640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe130034650 0x7fe130036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe134e09640 1 -- 172.21.15.145:0/468981664 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe240015020 con 0x557fc12c92a0 2024-09-11T11:01:30.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.284+0000 7fe2478b1640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe130034650 0x7fe130036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc144e1f0 0x557fc14505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1450b20 con 0x557fc144e1f0 2024-09-11T11:01:30.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2488b3640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc144e1f0 0x557fc14505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2478b1640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe130034650 0x7fe130036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe2300ae000 tx=0x7fe2300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2488b3640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc144e1f0 0x557fc14505e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2488b3640 1 -- 172.21.15.145:0/468981664 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc144e1f0 2024-09-11T11:01:30.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc1451910 0x557fc1453d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1454330 con 0x557fc1451910 2024-09-11T11:01:30.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2480b2640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc1451910 0x557fc1453d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2480b2640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc1451910 0x557fc1453d00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2480b2640 1 -- 172.21.15.145:0/468981664 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe24002e070 con 0x557fc1451910 2024-09-11T11:01:30.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1455be0 con 0x557fc1451910 2024-09-11T11:01:30.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2480b2640 1 -- 172.21.15.145:0/468981664 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe24002e070 con 0x557fc1451910 2024-09-11T11:01:30.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1454e10 con 0x557fc1451910 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2480b2640 1 -- 172.21.15.145:0/468981664 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe24002e070 con 0x557fc1451910 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557fc1456f90 0x557fc1459380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc14598c0 con 0x557fc1456f90 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.288+0000 7fe2478b1640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557fc1456f90 0x557fc1459380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe2478b1640 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557fc1456f90 0x557fc1459380 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe2478b1640 1 -- 172.21.15.145:0/468981664 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc1456f90 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe24a5a2980 1 Processor -- start 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe24a5a2980 1 -- start start 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe24a5a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc14672c0 0x557fc14676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe24a5a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557fc125b800 con 0x557fc14672c0 2024-09-11T11:01:30.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc14672c0 0x557fc14676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc14672c0 0x557fc14676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50750/0 (socket says 172.21.15.145:50750) 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe2480b2640 1 -- 172.21.15.145:0/136294030 learned_addr learned my addr 172.21.15.145:0/136294030 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe2480b2640 1 -- 172.21.15.145:0/136294030 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc1467c20 con 0x557fc14672c0 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe2480b2640 1 --2- 172.21.15.145:0/136294030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc14672c0 0x557fc14676e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe2400188c0 tx=0x7fe240018d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe12dffb640 1 -- 172.21.15.145:0/136294030 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe24001a480 con 0x557fc14672c0 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe24a5a2980 1 -- 172.21.15.145:0/136294030 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fc1467eb0 con 0x557fc14672c0 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe12dffb640 1 -- 172.21.15.145:0/136294030 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24001a620 con 0x557fc14672c0 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe12dffb640 1 -- 172.21.15.145:0/136294030 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe24001a900 con 0x557fc14672c0 2024-09-11T11:01:30.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe24a5a2980 1 -- 172.21.15.145:0/136294030 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc1467eb0 con 0x557fc14672c0 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe12dffb640 1 -- 172.21.15.145:0/136294030 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe24004e030 con 0x557fc14672c0 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe12dffb640 1 --2- 172.21.15.145:0/136294030 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe120034650 0x7fe120036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe12dffb640 1 -- 172.21.15.145:0/136294030 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe24004c020 con 0x557fc14672c0 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.292+0000 7fe2478b1640 1 --2- 172.21.15.145:0/136294030 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe120034650 0x7fe120036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 Processor -- start 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- start start 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc1473e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557fc1353300 con 0x557fc1473a50 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2478b1640 1 --2- 172.21.15.145:0/136294030 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe120034650 0x7fe120036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x557fc144d6f0 tx=0x7fe230005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc1473e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc1473e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50760/0 (socket says 172.21.15.145:50760) 2024-09-11T11:01:30.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 -- 172.21.15.145:0/4070246680 learned_addr learned my addr 172.21.15.145:0/4070246680 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 -- 172.21.15.145:0/4070246680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc1474400 con 0x557fc1473a50 2024-09-11T11:01:30.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 --2- 172.21.15.145:0/4070246680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc1473e30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe240048860 tx=0x7fe240032b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c5cbd7047d3c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe1277fe640 1 -- 172.21.15.145:0/4070246680 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe240041240 con 0x557fc1473a50 2024-09-11T11:01:30.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe1277fe640 1 -- 172.21.15.145:0/4070246680 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24000ecb0 con 0x557fc1473a50 2024-09-11T11:01:30.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe1277fe640 1 -- 172.21.15.145:0/4070246680 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe240041f50 con 0x557fc1473a50 2024-09-11T11:01:30.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4070246680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 msgr2=0x557fc1473e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/4070246680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc1473e30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe240048860 tx=0x7fe240032b40 comp rx=0 tx=0).stop 2024-09-11T11:01:30.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4070246680 shutdown_connections 2024-09-11T11:01:30.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/4070246680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc1473e30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4070246680 >> 172.21.15.145:0/4070246680 conn(0x557fc146fe30 msgr2=0x557fc146df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4070246680 shutdown_connections 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- 172.21.15.145:0/4070246680 wait complete. 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 Processor -- start 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- start start 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc147abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe24a5a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557fc14748a0 con 0x557fc1473a50 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc147abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc147abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50768/0 (socket says 172.21.15.145:50768) 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 learned_addr learned my addr 172.21.15.145:0/3694927029 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fc147b0f0 con 0x557fc1473a50 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.296+0000 7fe2480b2640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc147abb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe24003ff90 tx=0x7fe24002aeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe125ffb640 1 -- 172.21.15.145:0/3694927029 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe24000ee60 con 0x557fc1473a50 2024-09-11T11:01:30.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe125ffb640 1 -- 172.21.15.145:0/3694927029 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe24006d030 con 0x557fc1473a50 2024-09-11T11:01:30.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fc147b0f0 con 0x557fc1473a50 2024-09-11T11:01:30.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe125ffb640 1 -- 172.21.15.145:0/3694927029 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe24003f590 con 0x557fc1473a50 2024-09-11T11:01:30.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fc147b0f0 con 0x557fc1473a50 2024-09-11T11:01:30.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe125ffb640 1 -- 172.21.15.145:0/3694927029 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe240063070 con 0x557fc1473a50 2024-09-11T11:01:30.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe125ffb640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe118034600 0x7fe118036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe125ffb640 1 -- 172.21.15.145:0/3694927029 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fe240061020 con 0x557fc1473a50 2024-09-11T11:01:30.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2478b1640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe118034600 0x7fe118036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc1485d30 0x557fc14881f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1488940 con 0x557fc1485d30 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2488b3640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc1485d30 0x557fc14881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2478b1640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe118034600 0x7fe118036ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe230018f70 tx=0x7fe2300c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2488b3640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc1485d30 0x557fc14881f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 20 realm 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1485160 con 0x557fc1485d30 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:30.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1489410 con 0x557fc1485d30 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc148a1f0 0x557fc148c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc148cc60 con 0x557fc148a1f0 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2480b2640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc148a1f0 0x557fc148c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.300+0000 7fe2480b2640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc148a1f0 0x557fc148c5e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe240079070 con 0x557fc148a1f0 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe24a5a2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc148d4b0 con 0x557fc148a1f0 2024-09-11T11:01:30.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe240079070 con 0x557fc148a1f0 2024-09-11T11:01:30.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe24a5a2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:30.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe24a5a2980 20 searching for the correct realm 2024-09-11T11:01:30.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557fc148f220 0x557fc1491610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148f220 2024-09-11T11:01:30.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2478b1640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557fc148f220 0x557fc1491610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2478b1640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557fc148f220 0x557fc1491610 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe240079070 con 0x557fc148a1f0 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2480b2640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe24005cb70 0x7fe240019920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x7fe24005cb70 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2488b3640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe24005cb70 0x7fe240019920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2488b3640 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe24005cb70 0x7fe240019920 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148f220 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.304+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe240079070 con 0x557fc148a1f0 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe240079070 con 0x557fc148a1f0 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x7fe24005cb70 2024-09-11T11:01:30.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x7fe24005cb70 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148f220 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.308+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148f220 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148f220 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x7fe24005cb70 2024-09-11T11:01:30.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc1485d30 2024-09-11T11:01:30.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x7fe24005cb70 2024-09-11T11:01:30.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148f220 2024-09-11T11:01:30.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x7fe24005cb70 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148f220 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.312+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557fc1491c90 con 0x557fc148a1f0 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc148de30 con 0x557fc1485d30 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc148da70 con 0x557fc148a1f0 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc148da80 con 0x7fe24005cb70 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 zone default found 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 4 Realm: () 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 zonegroup default 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc148e920 con 0x7fe24005cb70 2024-09-11T11:01:30.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1494480 con 0x557fc148f220 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc1494820 con 0x557fc148f220 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 started sync module instance, tier type = 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.316+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14938c0 con 0x557fc148a1f0 2024-09-11T11:01:30.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94007192010176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14938c0 con 0x557fc148a1f0 2024-09-11T11:01:30.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14951e0 con 0x557fc1485d30 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94007192014128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1495a30 con 0x557fc1485d30 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1496470 con 0x557fc148a1f0 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94007192010176] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94007192014128] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94007192018752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1495580 con 0x557fc148a1f0 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.320+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1496d10 con 0x7fe24005cb70 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94007192021088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1495580 con 0x7fe24005cb70 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14977b0 con 0x557fc148a1f0 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94007192021088] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94007192018752] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94007192007696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1497770 con 0x557fc148a1f0 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1497ba0 con 0x557fc148f220 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94007192022144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14983f0 con 0x557fc148f220 2024-09-11T11:01:30.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.324+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1498db0 con 0x557fc148f220 2024-09-11T11:01:30.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94007192007696] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94007192022144] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94007192029440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14991a0 con 0x557fc148f220 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1499a30 con 0x7fe24005cb70 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94007192029440] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94007192023712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1499650 con 0x7fe24005cb70 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 20 add_watcher() i=0 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 20 add_watcher() i=1 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 20 add_watcher() i=2 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 20 add_watcher() i=3 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 20 add_watcher() i=4 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 20 add_watcher() i=5 2024-09-11T11:01:30.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 20 add_watcher() i=6 2024-09-11T11:01:30.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94007192023712] v32'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 20 add_watcher() i=7 2024-09-11T11:01:30.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:30.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc149cf40 con 0x557fc1485d30 2024-09-11T11:01:30.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.328+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94007192032112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc149a460 con 0x557fc1485d30 2024-09-11T11:01:30.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.332+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94007192032112] v32'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.332+0000 7fe0fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.332+0000 7fe24a5a2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:30.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.332+0000 7fe24a5a2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:30.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.332+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a5840 con 0x557fc148a1f0 2024-09-11T11:01:30.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.332+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.332+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a5950 con 0x7fe24005cb70 2024-09-11T11:01:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.336+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.336+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a6060 con 0x557fc148f220 2024-09-11T11:01:30.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.336+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.336+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a6510 con 0x557fc1485d30 2024-09-11T11:01:30.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.340+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'140 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.340+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a3690 con 0x557fc148a1f0 2024-09-11T11:01:30.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.340+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.340+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a3690 con 0x557fc148f220 2024-09-11T11:01:30.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.340+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.340+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a3690 con 0x557fc148a1f0 2024-09-11T11:01:30.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.344+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.344+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a35b0 con 0x557fc1485d30 2024-09-11T11:01:30.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.348+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.348+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7430 con 0x557fc148a1f0 2024-09-11T11:01:30.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.348+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.348+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7430 con 0x557fc148a1f0 2024-09-11T11:01:30.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.352+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.352+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7430 con 0x557fc148a1f0 2024-09-11T11:01:30.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.352+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.352+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7430 con 0x557fc148f220 2024-09-11T11:01:30.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.352+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.352+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a79a0 con 0x557fc148a1f0 2024-09-11T11:01:30.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.356+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.356+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a79a0 con 0x557fc1485d30 2024-09-11T11:01:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.356+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'33 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.356+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a79a0 con 0x557fc1485d30 2024-09-11T11:01:30.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.360+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.360+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7a60 con 0x557fc148a1f0 2024-09-11T11:01:30.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.360+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.360+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7a60 con 0x557fc148a1f0 2024-09-11T11:01:30.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.364+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.364+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7a30 con 0x557fc148f220 2024-09-11T11:01:30.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.364+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.364+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7a30 con 0x557fc148a1f0 2024-09-11T11:01:30.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.368+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.368+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7a30 con 0x557fc1485d30 2024-09-11T11:01:30.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.368+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.368+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148a1f0 2024-09-11T11:01:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.372+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.372+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148a1f0 2024-09-11T11:01:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.376+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.376+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148f220 2024-09-11T11:01:30.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.376+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.376+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148a1f0 2024-09-11T11:01:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.376+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.376+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148f220 2024-09-11T11:01:30.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.380+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.380+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148f220 2024-09-11T11:01:30.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.380+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'28 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.380+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148f220 2024-09-11T11:01:30.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.384+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.384+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148a1f0 2024-09-11T11:01:30.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.384+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.384+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc1485d30 2024-09-11T11:01:30.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.388+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.388+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc148a1f0 2024-09-11T11:01:30.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.388+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'37 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.388+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x557fc1485d30 2024-09-11T11:01:30.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'34 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14a7f90 con 0x7fe24005cb70 2024-09-11T11:01:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe0fd7e2640 20 reqs_thread_entry: start 2024-09-11T11:01:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 Filter name: none 2024-09-11T11:01:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe06effd640 20 reqs_thread_entry: start 2024-09-11T11:01:30.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc14c33a0 con 0x7fe24005cb70 2024-09-11T11:01:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:30.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc14c4c80 con 0x557fc1485d30 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 get_obj_state: octx=0x7fe240013190 obj=myfoo:four state=0x557fc14c5a38 s->prefetch_data=0 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 3.9 3:90020fe7:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557fc14c6a90 con 0x557fc148f220 2024-09-11T11:01:30.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(96 27698d38-fc40-410e-96d8-191ffc71147c.4235.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 10 manifest: total_size = 4 2024-09-11T11:01:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 get_obj_state: setting s->obj_tag to 27698d38-fc40-410e-96d8-191ffc71147c.4235.9085217856578794881 2024-09-11T11:01:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 get_obj_state: octx=0x7fe240013190 obj=myfoo:four state=0x557fc14c5a38 s->prefetch_data=0 2024-09-11T11:01:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 prepare_atomic_modification: state is not atomic. state=0x557fc14c5a38 2024-09-11T11:01:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6 2024-09-11T11:01:30.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.392+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:97 4.e 4:71901f3b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14cb4f0 con 0x7fe24005cb70 2024-09-11T11:01:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.396+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(97 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6 [stat,call,call] v32'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.396+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:98 3.9 3:90020fe7:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14cb4f0 con 0x557fc148f220 2024-09-11T11:01:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.396+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(98 27698d38-fc40-410e-96d8-191ffc71147c.4235.1_four [call] v32'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.396+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 4.e 4:71901f3b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14cbf80 con 0x7fe24005cb70 2024-09-11T11:01:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.396+0000 7fe0fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.396+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94007192032112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14cbf80 con 0x557fc1485d30 2024-09-11T11:01:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.400+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(99 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6 [stat,call,call] v32'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.400+0000 7fe1277fe640 20 handle_completion(): completion ok for obj=four 2024-09-11T11:01:30.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.400+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94007192032112] v32'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.400+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94007192010176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc14cbf80 con 0x557fc148a1f0 2024-09-11T11:01:30.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.400+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94007192010176] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.400+0000 7fe24a5a2980 20 remove_watcher() i=0 2024-09-11T11:01:30.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.400+0000 7fe24a5a2980 2 removed watcher, disabling cache 2024-09-11T11:01:30.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.400+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94007192014128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1493dc0 con 0x557fc1485d30 2024-09-11T11:01:30.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94007192014128] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x557fc1485d30 2024-09-11T11:01:30.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe24a5a2980 20 remove_watcher() i=1 2024-09-11T11:01:30.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94007192018752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1493dc0 con 0x557fc148a1f0 2024-09-11T11:01:30.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94007192018752] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe24a5a2980 20 remove_watcher() i=2 2024-09-11T11:01:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94007192021088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1493dc0 con 0x7fe24005cb70 2024-09-11T11:01:30.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94007192021088] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe24a5a2980 20 remove_watcher() i=3 2024-09-11T11:01:30.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.404+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94007192007696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1496860 con 0x557fc148a1f0 2024-09-11T11:01:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe2480b2640 1 -- 172.21.15.145:0/3694927029 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94007192007696] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe24008d040 con 0x557fc148a1f0 2024-09-11T11:01:30.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe24a5a2980 20 remove_watcher() i=4 2024-09-11T11:01:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94007192022144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1493dc0 con 0x557fc148f220 2024-09-11T11:01:30.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94007192022144] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe24a5a2980 20 remove_watcher() i=5 2024-09-11T11:01:30.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94007192029440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1493dc0 con 0x557fc148f220 2024-09-11T11:01:30.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe2478b1640 1 -- 172.21.15.145:0/3694927029 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94007192029440] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2300aaa10 con 0x557fc148f220 2024-09-11T11:01:30.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe24a5a2980 20 remove_watcher() i=6 2024-09-11T11:01:30.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.408+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94007192023712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557fc1493dc0 con 0x7fe24005cb70 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94007192023712] v32'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe23800a4d0 con 0x7fe24005cb70 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 20 remove_watcher() i=7 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc148a1f0 msgr2=0x557fc148c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc148a1f0 0x557fc148c5e0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc1485d30 msgr2=0x557fc14881f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc1485d30 0x557fc14881f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe24005cb70 msgr2=0x7fe240019920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe24005cb70 0x7fe240019920 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557fc148f220 msgr2=0x557fc1491610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557fc148f220 0x557fc1491610 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe118034600 msgr2=0x7fe118036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe118034600 0x7fe118036ac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe230018f70 tx=0x7fe2300c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 msgr2=0x557fc147abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/3694927029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc1473a50 0x557fc147abb0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe24003ff90 tx=0x7fe24002aeb0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 reap_dead start 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe2488b3640 1 -- 172.21.15.145:0/3694927029 reap_dead start 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 shutdown_connections 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 >> 172.21.15.145:0/3694927029 conn(0x557fc146fe30 msgr2=0x557fc146df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 shutdown_connections 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/3694927029 wait complete. 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/136294030 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe120034650 msgr2=0x7fe120036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/136294030 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe120034650 0x7fe120036b10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x557fc144d6f0 tx=0x7fe230005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/136294030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc14672c0 msgr2=0x557fc14676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/136294030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc14672c0 0x557fc14676e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe2400188c0 tx=0x7fe240018d50 comp rx=0 tx=0).stop 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/136294030 shutdown_connections 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/136294030 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe120034650 0x7fe120036b10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/136294030 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc14672c0 0x557fc14676e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/136294030 >> 172.21.15.145:0/136294030 conn(0x557fc145c410 msgr2=0x557fc145ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/136294030 shutdown_connections 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/136294030 wait complete. 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc1451910 msgr2=0x557fc1453d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557fc1451910 0x557fc1453d00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc144e1f0 msgr2=0x557fc14505e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557fc144e1f0 0x557fc14505e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557fc1456f90 msgr2=0x557fc1459380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557fc1456f90 0x557fc1459380 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe130034650 msgr2=0x7fe130036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe130034650 0x7fe130036b10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe2300ae000 tx=0x7fe2300a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 msgr2=0x557fc1449100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 --2- 172.21.15.145:0/468981664 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557fc12c92a0 0x557fc1449100 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe240001fd0 tx=0x7fe240000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe2488b3640 1 -- 172.21.15.145:0/468981664 reap_dead start 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 shutdown_connections 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 >> 172.21.15.145:0/468981664 conn(0x557fc134f0a0 msgr2=0x557fc143b340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 shutdown_connections 2024-09-11T11:01:30.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.412+0000 7fe24a5a2980 1 -- 172.21.15.145:0/468981664 wait complete. 2024-09-11T11:01:30.425 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-11T11:01:30.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-11T11:01:30.425 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-11T11:01:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:30.504 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5c25ca980 1 Processor -- start 2024-09-11T11:01:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5c25ca980 1 -- start start 2024-09-11T11:01:30.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5c25ca980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564f4a9bda10 0x564f4a9bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5c25ca980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f4a841ae0 con 0x564f4a9b9690 2024-09-11T11:01:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5c25ca980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x564f4a865e30 con 0x564f4a9bda10 2024-09-11T11:01:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5bf8d9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564f4a9bda10 0x564f4a9bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5bf8d9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564f4a9bda10 0x564f4a9bfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50774/0 (socket says 172.21.15.145:50774) 2024-09-11T11:01:30.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/3393922036 learned_addr learned my addr 172.21.15.145:0/3393922036 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5c00da640 1 --1- 172.21.15.145:0/3393922036 >> v1:172.21.15.102:6789/0 conn(0x564f4a9b9690 0x564f4a9b9a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54716/0 (socket says 172.21.15.145:54716) 2024-09-11T11:01:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/3393922036 >> v1:172.21.15.102:6789/0 conn(0x564f4a9b9690 legacy=0x564f4a9b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/3393922036 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4a9c1350 con 0x564f4a9bda10 2024-09-11T11:01:30.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.504+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/3393922036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9bda10 0x564f4a9bfe00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800a5c0 tx=0x7fa5a801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da038ee5572a2ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5bf0d8640 1 -- 172.21.15.145:0/3393922036 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5a80a6070 con 0x564f4a9bda10 2024-09-11T11:01:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5bf0d8640 1 -- 172.21.15.145:0/3393922036 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a80af070 con 0x564f4a9bda10 2024-09-11T11:01:30.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5bf0d8640 1 -- 172.21.15.145:0/3393922036 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5a80aa5c0 con 0x564f4a9bda10 2024-09-11T11:01:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5c25ca980 1 -- 172.21.15.145:0/3393922036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9bda10 msgr2=0x564f4a9bfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/3393922036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9bda10 0x564f4a9bfe00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fa5a800a5c0 tx=0x7fa5a801b340 comp rx=0 tx=0).stop 2024-09-11T11:01:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5c25ca980 1 -- 172.21.15.145:0/3393922036 shutdown_connections 2024-09-11T11:01:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/3393922036 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9bda10 0x564f4a9bfe00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5c25ca980 1 -- 172.21.15.145:0/3393922036 >> 172.21.15.145:0/3393922036 conn(0x564f4a9b51b0 msgr2=0x564f4a9b75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5c25ca980 1 -- 172.21.15.145:0/3393922036 shutdown_connections 2024-09-11T11:01:30.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.508+0000 7fa5c25ca980 1 -- 172.21.15.145:0/3393922036 wait complete. 2024-09-11T11:01:30.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c25ca980 1 Processor -- start 2024-09-11T11:01:30.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c25ca980 1 -- start start 2024-09-11T11:01:30.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c25ca980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4a930370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c25ca980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564f4a867200 con 0x564f4a9b9690 2024-09-11T11:01:30.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4a930370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4a930370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50784/0 (socket says 172.21.15.145:50784) 2024-09-11T11:01:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c00da640 1 -- 172.21.15.145:0/536413917 learned_addr learned my addr 172.21.15.145:0/536413917 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c00da640 1 -- 172.21.15.145:0/536413917 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4a930940 con 0x564f4a9b9690 2024-09-11T11:01:30.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.520+0000 7fa5c00da640 1 --2- 172.21.15.145:0/536413917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4a930370 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80015f0 tx=0x7fa5b8001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330838b0f563adcf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa4ae60c640 1 -- 172.21.15.145:0/536413917 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8013420 con 0x564f4a9b9690 2024-09-11T11:01:30.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa4ae60c640 1 -- 172.21.15.145:0/536413917 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b80135e0 con 0x564f4a9b9690 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa4ae60c640 1 -- 172.21.15.145:0/536413917 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8013940 con 0x564f4a9b9690 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- 172.21.15.145:0/536413917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 msgr2=0x564f4a930370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/536413917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4a930370 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80015f0 tx=0x7fa5b8001ab0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- 172.21.15.145:0/536413917 shutdown_connections 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/536413917 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4a930370 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- 172.21.15.145:0/536413917 >> 172.21.15.145:0/536413917 conn(0x564f4a9b51b0 msgr2=0x564f4aaa0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- 172.21.15.145:0/536413917 shutdown_connections 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- 172.21.15.145:0/536413917 wait complete. 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 Processor -- start 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- start start 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4aaadf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564f4a9c0e50 con 0x564f4a9b9690 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4aaadf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4aaadf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50790/0 (socket says 172.21.15.145:50790) 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c00da640 1 -- 172.21.15.145:0/1732285297 learned_addr learned my addr 172.21.15.145:0/1732285297 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c00da640 1 -- 172.21.15.145:0/1732285297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4aaae4d0 con 0x564f4a9b9690 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c00da640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4aaadf90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006640 tx=0x7fa5b8000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa4ace09640 1 -- 172.21.15.145:0/1732285297 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8022020 con 0x564f4a9b9690 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f4aaae760 con 0x564f4a9b9690 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa4ace09640 1 -- 172.21.15.145:0/1732285297 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8006320 con 0x564f4a9b9690 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa4ace09640 1 -- 172.21.15.145:0/1732285297 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8004ab0 con 0x564f4a9b9690 2024-09-11T11:01:30.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.524+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4aab1440 con 0x564f4a9b9690 2024-09-11T11:01:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa4ace09640 1 -- 172.21.15.145:0/1732285297 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5b8025020 con 0x564f4a9b9690 2024-09-11T11:01:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa4ace09640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4a80346a0 0x7fa4a8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa4ace09640 1 -- 172.21.15.145:0/1732285297 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fa5b8018030 con 0x564f4a9b9690 2024-09-11T11:01:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4a80346a0 0x7fa4a8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4a9bda10 0x564f4aab4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aab5610 con 0x564f4a9bda10 2024-09-11T11:01:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c08db640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4a9bda10 0x564f4aab4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4a80346a0 0x7fa4a8036b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80ae000 tx=0x7fa5a80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c08db640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4a9bda10 0x564f4aab4fd0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c08db640 1 -- 172.21.15.145:0/1732285297 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4a9bda10 2024-09-11T11:01:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aab63e0 0x564f4aab87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aab8e10 con 0x564f4aab63e0 2024-09-11T11:01:30.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c00da640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aab63e0 0x564f4aab87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c00da640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aab63e0 0x564f4aab87d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c00da640 1 -- 172.21.15.145:0/1732285297 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5b801b070 con 0x564f4aab63e0 2024-09-11T11:01:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.528+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaba6c0 con 0x564f4aab63e0 2024-09-11T11:01:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c00da640 1 -- 172.21.15.145:0/1732285297 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa5b801b070 con 0x564f4aab63e0 2024-09-11T11:01:30.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aab98f0 con 0x564f4aab63e0 2024-09-11T11:01:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c00da640 1 -- 172.21.15.145:0/1732285297 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5b801b070 con 0x564f4aab63e0 2024-09-11T11:01:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564f4aabba70 0x564f4aabde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aabe3e0 con 0x564f4aabba70 2024-09-11T11:01:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564f4aabba70 0x564f4aabde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564f4aabba70 0x564f4aabde60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/1732285297 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aabba70 2024-09-11T11:01:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 Processor -- start 2024-09-11T11:01:30.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 -- start start 2024-09-11T11:01:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aacbe30 0x564f4aacc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564f4a8c0800 con 0x564f4aacbe30 2024-09-11T11:01:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aacbe30 0x564f4aacc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aacbe30 0x564f4aacc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50792/0 (socket says 172.21.15.145:50792) 2024-09-11T11:01:30.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c00da640 1 -- 172.21.15.145:0/1517385882 learned_addr learned my addr 172.21.15.145:0/1517385882 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c00da640 1 -- 172.21.15.145:0/1517385882 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4aacc790 con 0x564f4aacbe30 2024-09-11T11:01:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c00da640 1 --2- 172.21.15.145:0/1517385882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aacbe30 0x564f4aacc250 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8004fd0 tx=0x7fa5b8010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa4a5ffb640 1 -- 172.21.15.145:0/1517385882 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8010490 con 0x564f4aacbe30 2024-09-11T11:01:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1517385882 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f4aacca20 con 0x564f4aacbe30 2024-09-11T11:01:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa4a5ffb640 1 -- 172.21.15.145:0/1517385882 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b801d580 con 0x564f4aacbe30 2024-09-11T11:01:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1517385882 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4aacf6a0 con 0x564f4aacbe30 2024-09-11T11:01:30.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.532+0000 7fa4a5ffb640 1 -- 172.21.15.145:0/1517385882 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b801d860 con 0x564f4aacbe30 2024-09-11T11:01:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa4a5ffb640 1 -- 172.21.15.145:0/1517385882 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5b8010070 con 0x564f4aacbe30 2024-09-11T11:01:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa4a5ffb640 1 --2- 172.21.15.145:0/1517385882 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa498034650 0x7fa498036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa4a5ffb640 1 -- 172.21.15.145:0/1517385882 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fa5b80322b0 con 0x564f4aacbe30 2024-09-11T11:01:30.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/1517385882 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa498034650 0x7fa498036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 Processor -- start 2024-09-11T11:01:30.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 -- start start 2024-09-11T11:01:30.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aad8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564f4a92eb60 con 0x564f4aad8750 2024-09-11T11:01:30.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/1517385882 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa498034650 0x7fa498036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8000c10 tx=0x7fa5a8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aad8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aad8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50802/0 (socket says 172.21.15.145:50802) 2024-09-11T11:01:30.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c00da640 1 -- 172.21.15.145:0/992903607 learned_addr learned my addr 172.21.15.145:0/992903607 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c00da640 1 -- 172.21.15.145:0/992903607 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4aad9100 con 0x564f4aad8750 2024-09-11T11:01:30.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c00da640 1 --2- 172.21.15.145:0/992903607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aad8b30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80069a0 tx=0x7fa5b803ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308163f83b9319e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa49f7fe640 1 -- 172.21.15.145:0/992903607 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8033e00 con 0x564f4aad8750 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa49f7fe640 1 -- 172.21.15.145:0/992903607 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b8027400 con 0x564f4aad8750 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa49f7fe640 1 -- 172.21.15.145:0/992903607 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8012a20 con 0x564f4aad8750 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 -- 172.21.15.145:0/992903607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 msgr2=0x564f4aad8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/992903607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aad8b30 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80069a0 tx=0x7fa5b803ef20 comp rx=0 tx=0).stop 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 -- 172.21.15.145:0/992903607 shutdown_connections 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/992903607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aad8b30 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 -- 172.21.15.145:0/992903607 >> 172.21.15.145:0/992903607 conn(0x564f4aad4b30 msgr2=0x564f4aad2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 -- 172.21.15.145:0/992903607 shutdown_connections 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 -- 172.21.15.145:0/992903607 wait complete. 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 Processor -- start 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.536+0000 7fa5c25ca980 1 -- start start 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aadf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564f4aad95a0 con 0x564f4aad8750 2024-09-11T11:01:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aadf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c00da640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aadf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50810/0 (socket says 172.21.15.145:50810) 2024-09-11T11:01:30.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 learned_addr learned my addr 172.21.15.145:0/210064797 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f4aadfe10 con 0x564f4aad8750 2024-09-11T11:01:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c00da640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aadf8d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80484d0 tx=0x7fa5b800ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa49dffb640 1 -- 172.21.15.145:0/210064797 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b806d070 con 0x564f4aad8750 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f4aadfe10 con 0x564f4aad8750 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa49dffb640 1 -- 172.21.15.145:0/210064797 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b80320b0 con 0x564f4aad8750 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa49dffb640 1 -- 172.21.15.145:0/210064797 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa5b8005df0 con 0x564f4aad8750 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f4aae0280 con 0x564f4aad8750 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa49dffb640 1 -- 172.21.15.145:0/210064797 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa5b8070070 con 0x564f4aad8750 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa49dffb640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4900345b0 0x7fa490036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa49dffb640 1 -- 172.21.15.145:0/210064797 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fa5b8073af0 con 0x564f4aad8750 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4900345b0 0x7fa490036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4aaea8a0 0x564f4aaecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaed4b0 con 0x564f4aaea8a0 2024-09-11T11:01:30.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c08db640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4aaea8a0 0x564f4aaecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4900345b0 0x7fa490036a70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80aa910 tx=0x7fa5a80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c08db640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4aaea8a0 0x564f4aaecd60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 20 realm 2024-09-11T11:01:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.540+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aae9d50 con 0x564f4aaea8a0 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaedf70 con 0x564f4aaea8a0 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aaeed50 0x564f4aaf1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf17a0 con 0x564f4aaeed50 2024-09-11T11:01:30.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c00da640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aaeed50 0x564f4aaf1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c00da640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aaeed50 0x564f4aaf1140 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 20 searching for the correct realm 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564f4aaf3db0 0x564f4aaf61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf67b0 con 0x564f4aaf3db0 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564f4aaf3db0 0x564f4aaf61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5bf8d9640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564f4aaf3db0 0x564f4aaf61a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.544+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf67b0 con 0x564f4aaeed50 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c00da640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa5b8072060 0x7fa5b801a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x7fa5b8072060 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa5b8072060 0x7fa5b801a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa5b8072060 0x7fa5b801a260 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaf3db0 2024-09-11T11:01:30.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x7fa5b8072060 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.548+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x7fa5b8072060 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaf3db0 2024-09-11T11:01:30.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaf3db0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaf3db0 2024-09-11T11:01:30.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x7fa5b8072060 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaea8a0 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.552+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x7fa5b8072060 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaf3db0 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x7fa5b8072060 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaf3db0 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2040 con 0x564f4aaeed50 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:30.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2890 con 0x564f4aaea8a0 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.556+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2c80 con 0x564f4aaeed50 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf2c80 con 0x7fa5b8072060 2024-09-11T11:01:30.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 zone default found 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 4 Realm: () 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 zonegroup default 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf6c10 con 0x7fa5b8072060 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf8990 con 0x564f4aaf3db0 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf8d30 con 0x564f4aaf3db0 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 started sync module instance, tier type = 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:30.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf7e30 con 0x564f4aaeed50 2024-09-11T11:01:30.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94898555421568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf7e30 con 0x564f4aaeed50 2024-09-11T11:01:30.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.560+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf96f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94898555425344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aaf9660 con 0x564f4aaea8a0 2024-09-11T11:01:30.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafa610 con 0x564f4aaeed50 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94898555421568] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94898555425344] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94898555427552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafa5d0 con 0x564f4aaeed50 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafaa70 con 0x7fa5b8072060 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94898555419008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafaa30 con 0x7fa5b8072060 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.564+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafb970 con 0x564f4aaeed50 2024-09-11T11:01:30.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94898555427552] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94898555419008] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94898555431392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafae60 con 0x564f4aaeed50 2024-09-11T11:01:30.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafbd90 con 0x564f4aaf3db0 2024-09-11T11:01:30.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94898555429120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafc5e0 con 0x564f4aaf3db0 2024-09-11T11:01:30.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafcfe0 con 0x564f4aaf3db0 2024-09-11T11:01:30.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.568+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94898555431392] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94898555429120] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94898555434112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafd3d0 con 0x564f4aaf3db0 2024-09-11T11:01:30.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafdc20 con 0x7fa5b8072060 2024-09-11T11:01:30.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94898555434112] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94898555442128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafdca0 con 0x7fa5b8072060 2024-09-11T11:01:30.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 20 add_watcher() i=0 2024-09-11T11:01:30.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 20 add_watcher() i=1 2024-09-11T11:01:30.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 20 add_watcher() i=2 2024-09-11T11:01:30.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 20 add_watcher() i=3 2024-09-11T11:01:30.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 20 add_watcher() i=4 2024-09-11T11:01:30.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 20 add_watcher() i=5 2024-09-11T11:01:30.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 20 add_watcher() i=6 2024-09-11T11:01:30.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94898555442128] v32'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 20 add_watcher() i=7 2024-09-11T11:01:30.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:30.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab00ff0 con 0x564f4aaea8a0 2024-09-11T11:01:30.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.572+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94898555456000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4aafde10 con 0x564f4aaea8a0 2024-09-11T11:01:30.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94898555456000] v32'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa4767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:30.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:30.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 5 note: GC not initialized 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa4757e2640 20 reqs_thread_entry: start 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 Filter name: none 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa3e6ffd640 20 reqs_thread_entry: start 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab24830 con 0x7fa5b8072060 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab250c0 con 0x564f4aaea8a0 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(63 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab23bd0 con 0x7fa5b8072060 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab26700 con 0x564f4aaea8a0 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 4.27 4:e42effdc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab280b0 con 0x564f4aaea8a0 2024-09-11T11:01:30.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 4.19 4:99091213:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab2ac50 con 0x564f4aaf3db0 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 4.10 4:0b9800c4:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab2d7f0 con 0x564f4aaf3db0 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 4.34 4:2e421ecf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab2ac90 con 0x7fa5b8072060 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 4.32 4:4e8df1ce:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab32530 con 0x564f4aaeed50 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 4.13 4:c86f3d50:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab350e0 con 0x7fa5b8072060 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 4.e 4:71901f3b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab37fa0 con 0x7fa5b8072060 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 4.6 4:610448dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab3ae00 con 0x564f4aaf3db0 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:74 4.14 4:2b20de90:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab37fa0 con 0x564f4aaf3db0 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 4.4 4:215ab0bf:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab3fc60 con 0x564f4aaea8a0 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(67 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.576+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(69 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(71 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(68 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(72 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(74 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.8 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 4.2e 4:7645baa1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab37fa0 con 0x564f4aaf3db0 2024-09-11T11:01:30.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(75 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(70 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(76 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa4767e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94898555456000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x564f4aaea8a0 2024-09-11T11:01:30.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94898555456000] v32'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.580+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94898555421568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x564f4aaeed50 2024-09-11T11:01:30.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.584+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94898555421568] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.584+0000 7fa5c25ca980 20 remove_watcher() i=0 2024-09-11T11:01:30.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.584+0000 7fa5c25ca980 2 removed watcher, disabling cache 2024-09-11T11:01:30.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.584+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94898555425344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x564f4aaea8a0 2024-09-11T11:01:30.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.584+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94898555425344] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x564f4aaea8a0 2024-09-11T11:01:30.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.584+0000 7fa5c25ca980 20 remove_watcher() i=1 2024-09-11T11:01:30.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.584+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94898555427552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x564f4aaeed50 2024-09-11T11:01:30.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94898555427552] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c25ca980 20 remove_watcher() i=2 2024-09-11T11:01:30.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94898555419008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x7fa5b8072060 2024-09-11T11:01:30.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94898555419008] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c25ca980 20 remove_watcher() i=3 2024-09-11T11:01:30.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94898555431392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x564f4aaeed50 2024-09-11T11:01:30.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c00da640 1 -- 172.21.15.145:0/210064797 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94898555431392] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b806f030 con 0x564f4aaeed50 2024-09-11T11:01:30.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c25ca980 20 remove_watcher() i=4 2024-09-11T11:01:30.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.588+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94898555429120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x564f4aaf3db0 2024-09-11T11:01:30.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94898555429120] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a80aaae0 con 0x564f4aaf3db0 2024-09-11T11:01:30.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 20 remove_watcher() i=5 2024-09-11T11:01:30.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94898555434112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x564f4aaf3db0 2024-09-11T11:01:30.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5bf8d9640 1 -- 172.21.15.145:0/210064797 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94898555434112] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5a80e9040 con 0x564f4aaf3db0 2024-09-11T11:01:30.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 20 remove_watcher() i=6 2024-09-11T11:01:30.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94898555442128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x564f4ab221c0 con 0x7fa5b8072060 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94898555442128] v32'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa5b00083f0 con 0x7fa5b8072060 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 20 remove_watcher() i=7 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aaeed50 msgr2=0x564f4aaf1140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aaeed50 0x564f4aaf1140 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4aaea8a0 msgr2=0x564f4aaecd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4aaea8a0 0x564f4aaecd60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa5b8072060 msgr2=0x7fa5b801a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa5b8072060 0x7fa5b801a260 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564f4aaf3db0 msgr2=0x564f4aaf61a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564f4aaf3db0 0x564f4aaf61a0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4900345b0 msgr2=0x7fa490036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4900345b0 0x7fa490036a70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80aa910 tx=0x7fa5a80c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 msgr2=0x564f4aadf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c08db640 1 -- 172.21.15.145:0/210064797 reap_dead start 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aadf8d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80484d0 tx=0x7fa5b800ae70 comp rx=0 tx=0).stop 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 shutdown_connections 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/210064797 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aad8750 0x564f4aadf8d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 >> 172.21.15.145:0/210064797 conn(0x564f4aad4b30 msgr2=0x564f4aad2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 shutdown_connections 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/210064797 wait complete. 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1517385882 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa498034650 msgr2=0x7fa498036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1517385882 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa498034650 0x7fa498036b10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8000c10 tx=0x7fa5a8005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1517385882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aacbe30 msgr2=0x564f4aacc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1517385882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aacbe30 0x564f4aacc250 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8004fd0 tx=0x7fa5b8010ab0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1517385882 shutdown_connections 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1517385882 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa498034650 0x7fa498036b10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1517385882 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4aacbe30 0x564f4aacc250 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1517385882 >> 172.21.15.145:0/1517385882 conn(0x564f4aac0f80 msgr2=0x564f4aac3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1517385882 shutdown_connections 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1517385882 wait complete. 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aab63e0 msgr2=0x564f4aab87d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564f4aab63e0 0x564f4aab87d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4a9bda10 msgr2=0x564f4aab4fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564f4a9bda10 0x564f4aab4fd0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564f4aabba70 msgr2=0x564f4aabde60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564f4aabba70 0x564f4aabde60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4a80346a0 msgr2=0x7fa4a8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa4a80346a0 0x7fa4a8036b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80ae000 tx=0x7fa5a80a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:30.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 msgr2=0x564f4aaadf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 --2- 172.21.15.145:0/1732285297 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564f4a9b9690 0x564f4aaadf90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8006640 tx=0x7fa5b8000f50 comp rx=0 tx=0).stop 2024-09-11T11:01:30.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c08db640 1 -- 172.21.15.145:0/1732285297 reap_dead start 2024-09-11T11:01:30.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 shutdown_connections 2024-09-11T11:01:30.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 >> 172.21.15.145:0/1732285297 conn(0x564f4a9b51b0 msgr2=0x564f4aaa0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.592+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 shutdown_connections 2024-09-11T11:01:30.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.596+0000 7fa5c25ca980 1 -- 172.21.15.145:0/1732285297 wait complete. 2024-09-11T11:01:30.606 INFO:teuthology.orchestra.run.smithi145.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"2267e615-29e0-4503-94c5-a003ba7e8ee3","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","marker":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-11T11:01:29.901494Z","creation_time":"2024-09-11T11:01:26.276370Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-09-11T11:01:30.606 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-11T11:01:29.901494Z', 'creation_time': '2024-09-11T11:01:26.276370Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-11T11:01:30.607 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-11T11:01:30.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-11T11:01:30.607 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-11T11:01:30.680 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:30.680 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:30.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.676+0000 7ff1fa27e980 1 Processor -- start 2024-09-11T11:01:30.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.676+0000 7ff1fa27e980 1 -- start start 2024-09-11T11:01:30.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1fa27e980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8a522dc50 0x55f8a5230040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1fa27e980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8a50afae0 con 0x55f8a52298d0 2024-09-11T11:01:30.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1fa27e980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55f8a50d3e30 con 0x55f8a522dc50 2024-09-11T11:01:30.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f758d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8a522dc50 0x55f8a5230040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f758d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8a522dc50 0x55f8a5230040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50826/0 (socket says 172.21.15.145:50826) 2024-09-11T11:01:30.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f7d8e640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55f8a52298d0 0x55f8a5229cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54722/0 (socket says 172.21.15.145:54722) 2024-09-11T11:01:30.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f758d640 1 -- 172.21.15.145:0/1449338817 learned_addr learned my addr 172.21.15.145:0/1449338817 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f758d640 1 -- 172.21.15.145:0/1449338817 >> v1:172.21.15.102:6789/0 conn(0x55f8a52298d0 legacy=0x55f8a5229cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f758d640 1 -- 172.21.15.145:0/1449338817 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a5231590 con 0x55f8a522dc50 2024-09-11T11:01:30.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f758d640 1 --2- 172.21.15.145:0/1449338817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a522dc50 0x55f8a5230040 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00a5c0 tx=0x7ff1ec01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1366489af2baf24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f6d8c640 1 -- 172.21.15.145:0/1449338817 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec0a6070 con 0x55f8a522dc50 2024-09-11T11:01:30.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f6d8c640 1 -- 172.21.15.145:0/1449338817 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec0af070 con 0x55f8a522dc50 2024-09-11T11:01:30.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.680+0000 7ff1f6d8c640 1 -- 172.21.15.145:0/1449338817 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1ec0aa5c0 con 0x55f8a522dc50 2024-09-11T11:01:30.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.684+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1449338817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a522dc50 msgr2=0x55f8a5230040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.684+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1449338817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a522dc50 0x55f8a5230040 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00a5c0 tx=0x7ff1ec01b340 comp rx=0 tx=0).stop 2024-09-11T11:01:30.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.684+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1449338817 shutdown_connections 2024-09-11T11:01:30.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.684+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1449338817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a522dc50 0x55f8a5230040 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.684+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1449338817 >> 172.21.15.145:0/1449338817 conn(0x55f8a519d220 msgr2=0x55f8a519d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.684+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1449338817 shutdown_connections 2024-09-11T11:01:30.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.684+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1449338817 wait complete. 2024-09-11T11:01:30.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1fa27e980 1 Processor -- start 2024-09-11T11:01:30.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1fa27e980 1 -- start start 2024-09-11T11:01:30.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1fa27e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a5314c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1fa27e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8a50d5200 con 0x55f8a52298d0 2024-09-11T11:01:30.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a5314c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a5314c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50838/0 (socket says 172.21.15.145:50838) 2024-09-11T11:01:30.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/3610644573 learned_addr learned my addr 172.21.15.145:0/3610644573 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/3610644573 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a53151f0 con 0x55f8a52298d0 2024-09-11T11:01:30.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/3610644573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a5314c20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8001e50 tx=0x7ff1e8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6c3cb66e5ec75d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff0e5e0b640 1 -- 172.21.15.145:0/3610644573 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e800e5d0 con 0x55f8a52298d0 2024-09-11T11:01:30.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff0e5e0b640 1 -- 172.21.15.145:0/3610644573 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e800e770 con 0x55f8a52298d0 2024-09-11T11:01:30.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.696+0000 7ff0e5e0b640 1 -- 172.21.15.145:0/3610644573 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e800eab0 con 0x55f8a52298d0 2024-09-11T11:01:30.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3610644573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 msgr2=0x55f8a5314c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3610644573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a5314c20 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8001e50 tx=0x7ff1e8001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:30.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3610644573 shutdown_connections 2024-09-11T11:01:30.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3610644573 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a5314c20 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3610644573 >> 172.21.15.145:0/3610644573 conn(0x55f8a519d220 msgr2=0x55f8a5310850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3610644573 shutdown_connections 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3610644573 wait complete. 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 Processor -- start 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- start start 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a531bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8a5231090 con 0x55f8a52298d0 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a531bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a531bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50848/0 (socket says 172.21.15.145:50848) 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/3916426099 learned_addr learned my addr 172.21.15.145:0/3916426099 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/3916426099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a531c4d0 con 0x55f8a52298d0 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a531bf90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55f8a5315e00 tx=0x7ff1e8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff0dffff640 1 -- 172.21.15.145:0/3916426099 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e8001260 con 0x55f8a52298d0 2024-09-11T11:01:30.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8a531c760 con 0x55f8a52298d0 2024-09-11T11:01:30.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff0dffff640 1 -- 172.21.15.145:0/3916426099 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e800fa40 con 0x55f8a52298d0 2024-09-11T11:01:30.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8a531f440 con 0x55f8a52298d0 2024-09-11T11:01:30.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff0dffff640 1 -- 172.21.15.145:0/3916426099 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e802c060 con 0x55f8a52298d0 2024-09-11T11:01:30.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff0dffff640 1 -- 172.21.15.145:0/3916426099 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1e8017070 con 0x55f8a52298d0 2024-09-11T11:01:30.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff0dffff640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0e0034650 0x7ff0e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff0dffff640 1 -- 172.21.15.145:0/3916426099 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff1e8015020 con 0x55f8a52298d0 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1f758d640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0e0034650 0x7ff0e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a522dc50 0x55f8a5322f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.700+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53235d0 con 0x55f8a522dc50 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f858f640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a522dc50 0x55f8a5322f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f758d640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0e0034650 0x7ff0e0036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0ae000 tx=0x7ff1ec0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f858f640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a522dc50 0x55f8a5322f80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f858f640 1 -- 172.21.15.145:0/3916426099 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a522dc50 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a53243c0 0x55f8a53267b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5326df0 con 0x55f8a53243c0 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a53243c0 0x55f8a53267b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a53243c0 0x55f8a53267b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/3916426099 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1e802e070 con 0x55f8a53243c0 2024-09-11T11:01:30.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53286a0 con 0x55f8a53243c0 2024-09-11T11:01:30.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/3916426099 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1e802e070 con 0x55f8a53243c0 2024-09-11T11:01:30.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53278d0 con 0x55f8a53243c0 2024-09-11T11:01:30.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/3916426099 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1e802e070 con 0x55f8a53243c0 2024-09-11T11:01:30.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8a5329a50 0x55f8a532be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a532c380 con 0x55f8a5329a50 2024-09-11T11:01:30.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.704+0000 7ff1f758d640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8a5329a50 0x55f8a532be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1f758d640 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8a5329a50 0x55f8a532be40 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1f758d640 1 -- 172.21.15.145:0/3916426099 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5329a50 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1fa27e980 1 Processor -- start 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1fa27e980 1 -- start start 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1fa27e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5339e10 0x55f8a533a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1fa27e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8a512e800 con 0x55f8a5339e10 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5339e10 0x55f8a533a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5339e10 0x55f8a533a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50850/0 (socket says 172.21.15.145:50850) 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/688629792 learned_addr learned my addr 172.21.15.145:0/688629792 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/688629792 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a533a770 con 0x55f8a5339e10 2024-09-11T11:01:30.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/688629792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5339e10 0x55f8a533a230 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8048ed0 tx=0x7ff1e8019ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff0dd7fa640 1 -- 172.21.15.145:0/688629792 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e80421c0 con 0x55f8a5339e10 2024-09-11T11:01:30.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff0dd7fa640 1 -- 172.21.15.145:0/688629792 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e804aa60 con 0x55f8a5339e10 2024-09-11T11:01:30.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1fa27e980 1 -- 172.21.15.145:0/688629792 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8a533a9a0 con 0x55f8a5339e10 2024-09-11T11:01:30.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff0dd7fa640 1 -- 172.21.15.145:0/688629792 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e804ad40 con 0x55f8a5339e10 2024-09-11T11:01:30.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1fa27e980 1 -- 172.21.15.145:0/688629792 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8a533a9a0 con 0x55f8a5339e10 2024-09-11T11:01:30.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff0dd7fa640 1 -- 172.21.15.145:0/688629792 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1e804a2f0 con 0x55f8a5339e10 2024-09-11T11:01:30.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff0dd7fa640 1 --2- 172.21.15.145:0/688629792 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0d0034650 0x7ff0d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff0dd7fa640 1 -- 172.21.15.145:0/688629792 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff1e8054aa0 con 0x55f8a5339e10 2024-09-11T11:01:30.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.708+0000 7ff1f758d640 1 --2- 172.21.15.145:0/688629792 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0d0034650 0x7ff0d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 Processor -- start 2024-09-11T11:01:30.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- start start 2024-09-11T11:01:30.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f758d640 1 --2- 172.21.15.145:0/688629792 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0d0034650 0x7ff0d0036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000c10 tx=0x7ff1ec005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a5346750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8a5315570 con 0x55f8a5346370 2024-09-11T11:01:30.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a5346750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a5346750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50860/0 (socket says 172.21.15.145:50860) 2024-09-11T11:01:30.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/2139395613 learned_addr learned my addr 172.21.15.145:0/2139395613 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/2139395613 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a5346d20 con 0x55f8a5346370 2024-09-11T11:01:30.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/2139395613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a5346750 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff1e801bfd0 tx=0x7ff1e804a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff62fa7cf8ce373b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff0d6ffd640 1 -- 172.21.15.145:0/2139395613 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e8029e00 con 0x55f8a5346370 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff0d6ffd640 1 -- 172.21.15.145:0/2139395613 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e8062070 con 0x55f8a5346370 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff0d6ffd640 1 -- 172.21.15.145:0/2139395613 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e802f990 con 0x55f8a5346370 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- 172.21.15.145:0/2139395613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 msgr2=0x55f8a5346750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/2139395613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a5346750 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7ff1e801bfd0 tx=0x7ff1e804a710 comp rx=0 tx=0).stop 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- 172.21.15.145:0/2139395613 shutdown_connections 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/2139395613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a5346750 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- 172.21.15.145:0/2139395613 >> 172.21.15.145:0/2139395613 conn(0x55f8a5342750 msgr2=0x55f8a5340850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- 172.21.15.145:0/2139395613 shutdown_connections 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- 172.21.15.145:0/2139395613 wait complete. 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 Processor -- start 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- start start 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a534d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1fa27e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8a53471c0 con 0x55f8a5346370 2024-09-11T11:01:30.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a534d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a534d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50864/0 (socket says 172.21.15.145:50864) 2024-09-11T11:01:30.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 learned_addr learned my addr 172.21.15.145:0/1948739193 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a534dad0 con 0x55f8a5346370 2024-09-11T11:01:30.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.712+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a534d590 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8047d40 tx=0x7ff1e802eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff0d57fa640 1 -- 172.21.15.145:0/1948739193 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e801a480 con 0x55f8a5346370 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff0d57fa640 1 -- 172.21.15.145:0/1948739193 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1e801b9c0 con 0x55f8a5346370 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff0d57fa640 1 -- 172.21.15.145:0/1948739193 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1e801a620 con 0x55f8a5346370 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8a534dad0 con 0x55f8a5346370 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8a534dad0 con 0x55f8a5346370 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff0d57fa640 1 -- 172.21.15.145:0/1948739193 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff1e805c070 con 0x55f8a5346370 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff0d57fa640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0c0034650 0x7ff0c0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff0d57fa640 1 -- 172.21.15.145:0/1948739193 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7ff1e8059030 con 0x55f8a5346370 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f758d640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0c0034650 0x7ff0c0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a5358640 0x55f8a535aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a535b230 con 0x55f8a5358640 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f858f640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a5358640 0x55f8a535aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f758d640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0c0034650 0x7ff0c0036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0aa910 tx=0x7ff1ec0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f858f640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a5358640 0x55f8a535aae0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 20 realm 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5357b80 con 0x55f8a5358640 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a535bd50 con 0x55f8a5358640 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a535c930 0x55f8a535edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a535f560 con 0x55f8a535c930 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a535c930 0x55f8a535edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.716+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a535c930 0x55f8a535edf0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1fa27e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a535fe00 con 0x55f8a535c930 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1fa27e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1fa27e980 20 searching for the correct realm 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8a5361b70 0x55f8a5363f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5361b70 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f758d640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8a5361b70 0x55f8a5363f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f758d640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8a5361b70 0x55f8a5363f60 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f7d8e640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff1e802bc20 0x7ff1e80678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x7ff1e802bc20 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f858f640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff1e802bc20 0x7ff1e80678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f858f640 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff1e802bc20 0x7ff1e80678a0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.720+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5361b70 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x7ff1e802bc20 2024-09-11T11:01:30.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x7ff1e802bc20 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5361b70 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.724+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5361b70 2024-09-11T11:01:30.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5361b70 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x7ff1e802bc20 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5358640 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x7ff1e802bc20 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5361b70 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x7ff1e802bc20 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.728+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a5361b70 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364570 con 0x55f8a535c930 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5360780 con 0x55f8a5358640 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5360bd0 con 0x55f8a535c930 2024-09-11T11:01:30.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5361030 con 0x7ff1e802bc20 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 zone default found 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 4 Realm: () 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 zonegroup default 2024-09-11T11:01:30.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364ea0 con 0x7ff1e802bc20 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5366c20 con 0x55f8a5361b70 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5367100 con 0x55f8a5361b70 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 started sync module instance, tier type = 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.732+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53660c0 con 0x55f8a535c930 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.736+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.736+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94526412056032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53660c0 con 0x55f8a535c930 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.736+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5367c00 con 0x55f8a5358640 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.736+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.736+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94526412060368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5367bc0 con 0x55f8a5358640 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.736+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5368b30 con 0x55f8a535c930 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.736+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94526412056032] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.736+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94526412060368] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94526412062704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5368b30 con 0x55f8a535c930 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5368f60 con 0x7ff1e802bc20 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94526412053520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53693d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5369e20 con 0x55f8a535c930 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94526412062704] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94526412053520] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94526412069136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5368ed0 con 0x55f8a535c930 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.740+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536a6c0 con 0x55f8a5361b70 2024-09-11T11:01:30.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94526412071440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5368ed0 con 0x55f8a5361b70 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94526412069136] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94526412071440] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94526412075136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536ab70 con 0x55f8a5361b70 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536c020 con 0x7ff1e802bc20 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94526412075136] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94526412077808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536bfe0 con 0x7ff1e802bc20 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 20 add_watcher() i=0 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 20 add_watcher() i=1 2024-09-11T11:01:30.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 20 add_watcher() i=2 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 20 add_watcher() i=3 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 20 add_watcher() i=4 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 20 add_watcher() i=5 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.744+0000 7ff1fa27e980 20 add_watcher() i=6 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94526412077808] v32'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 20 add_watcher() i=7 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536f560 con 0x55f8a5358640 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94526412064320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536ca50 con 0x55f8a5358640 2024-09-11T11:01:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94526412064320] v32'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff0adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 5 note: GC not initialized 2024-09-11T11:01:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff0acfe1640 20 reqs_thread_entry: start 2024-09-11T11:01:30.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 20 Filter name: none 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff0267fc640 20 reqs_thread_entry: start 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53920f0 con 0x55f8a5358640 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 [pgnls start_epoch 32 out=254b] v32'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364ea0 con 0x55f8a5358640 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 [pgnls start_epoch 32 out=131b] v32'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.748+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364ea0 con 0x55f8a535c930 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5360bd0 con 0x7ff1e802bc20 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(65 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5360bd0 con 0x55f8a5358640 2024-09-11T11:01:30.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 [pgnls start_epoch 32 out=335b] v32'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5360bd0 con 0x7ff1e802bc20 2024-09-11T11:01:30.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(67 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5360bd0 con 0x55f8a5361b70 2024-09-11T11:01:30.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(68 [pgnls start_epoch 32 out=254b] v32'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(69 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 [pgnls start_epoch 32 out=213b] v32'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(71 [pgnls start_epoch 32 out=172b] v32'18 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.752+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(72 [pgnls start_epoch 32 out=336b] v32'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(73 [pgnls start_epoch 32 out=131b] v32'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(74 [pgnls start_epoch 32 out=254b] v32'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(75 [pgnls start_epoch 32 out=90b] v32'18 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(76 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(77 [pgnls start_epoch 32 out=254b] v32'11 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5358640 2024-09-11T11:01:30.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(78 [pgnls start_epoch 32 out=254b] v32'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(79 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(80 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.756+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(81 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(82 [pgnls start_epoch 32 out=276b] v32'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(83 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(84 [pgnls start_epoch 32 out=295b] v32'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5358640 2024-09-11T11:01:30.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(85 [pgnls start_epoch 32 out=172b] v32'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.760+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(86 [pgnls start_epoch 32 out=213b] v32'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(87 [pgnls start_epoch 32 out=172b] v32'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(88 [pgnls start_epoch 32 out=172b] v32'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(89 [pgnls start_epoch 32 out=90b] v32'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a535c930 2024-09-11T11:01:30.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(90 [pgnls start_epoch 32 out=90b] v32'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5358640 2024-09-11T11:01:30.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(91 [pgnls start_epoch 32 out=131b] v32'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x7ff1e802bc20 2024-09-11T11:01:30.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(92 [pgnls start_epoch 32 out=295b] v32'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55f8a536b530 con 0x55f8a5361b70 2024-09-11T11:01:30.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.764+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(93 [pgnls start_epoch 32 out=213b] v32'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.768 INFO:teuthology.orchestra.run.smithi145.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-11T11:01:30.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.768+0000 7ff0adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.768+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94526412064320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5364ea0 con 0x55f8a5358640 2024-09-11T11:01:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.768+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94526412064320] v32'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.768+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94526412056032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5395550 con 0x55f8a535c930 2024-09-11T11:01:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94526412056032] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1fa27e980 20 remove_watcher() i=0 2024-09-11T11:01:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1fa27e980 2 removed watcher, disabling cache 2024-09-11T11:01:30.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94526412060368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53665e0 con 0x55f8a5358640 2024-09-11T11:01:30.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94526412060368] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x55f8a5358640 2024-09-11T11:01:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1fa27e980 20 remove_watcher() i=1 2024-09-11T11:01:30.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94526412062704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53665e0 con 0x55f8a535c930 2024-09-11T11:01:30.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94526412062704] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1fa27e980 20 remove_watcher() i=2 2024-09-11T11:01:30.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.772+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94526412053520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5367ff0 con 0x7ff1e802bc20 2024-09-11T11:01:30.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94526412053520] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1fa27e980 20 remove_watcher() i=3 2024-09-11T11:01:30.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94526412069136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53665e0 con 0x55f8a535c930 2024-09-11T11:01:30.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1f7d8e640 1 -- 172.21.15.145:0/1948739193 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94526412069136] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e8078020 con 0x55f8a535c930 2024-09-11T11:01:30.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1fa27e980 20 remove_watcher() i=4 2024-09-11T11:01:30.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94526412071440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5367ff0 con 0x55f8a5361b70 2024-09-11T11:01:30.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94526412071440] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1fa27e980 20 remove_watcher() i=5 2024-09-11T11:01:30.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.776+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94526412075136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a53665e0 con 0x55f8a5361b70 2024-09-11T11:01:30.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1f758d640 1 -- 172.21.15.145:0/1948739193 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94526412075136] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1ec0aaae0 con 0x55f8a5361b70 2024-09-11T11:01:30.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 20 remove_watcher() i=6 2024-09-11T11:01:30.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94526412077808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55f8a5367ff0 con 0x7ff1e802bc20 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94526412077808] v32'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1f000a4d0 con 0x7ff1e802bc20 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 20 remove_watcher() i=7 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a535c930 msgr2=0x55f8a535edf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a535c930 0x55f8a535edf0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a5358640 msgr2=0x55f8a535aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a5358640 0x55f8a535aae0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff1e802bc20 msgr2=0x7ff1e80678a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff1e802bc20 0x7ff1e80678a0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8a5361b70 msgr2=0x55f8a5363f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8a5361b70 0x55f8a5363f60 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0c0034650 msgr2=0x7ff0c0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0c0034650 0x7ff0c0036b10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0aa910 tx=0x7ff1ec0c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 msgr2=0x55f8a534d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1f858f640 1 -- 172.21.15.145:0/1948739193 reap_dead start 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a534d590 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8047d40 tx=0x7ff1e802eec0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 shutdown_connections 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/1948739193 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5346370 0x55f8a534d590 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 >> 172.21.15.145:0/1948739193 conn(0x55f8a5342750 msgr2=0x55f8a5340820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 shutdown_connections 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/1948739193 wait complete. 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/688629792 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0d0034650 msgr2=0x7ff0d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/688629792 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0d0034650 0x7ff0d0036b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec000c10 tx=0x7ff1ec005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/688629792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5339e10 msgr2=0x55f8a533a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/688629792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5339e10 0x55f8a533a230 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8048ed0 tx=0x7ff1e8019ed0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/688629792 shutdown_connections 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/688629792 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0d0034650 0x7ff0d0036b10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/688629792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a5339e10 0x55f8a533a230 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/688629792 >> 172.21.15.145:0/688629792 conn(0x55f8a532ef60 msgr2=0x55f8a53319e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/688629792 shutdown_connections 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/688629792 wait complete. 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a53243c0 msgr2=0x55f8a53267b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8a53243c0 0x55f8a53267b0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a522dc50 msgr2=0x55f8a5322f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8a522dc50 0x55f8a5322f80 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8a5329a50 msgr2=0x55f8a532be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8a5329a50 0x55f8a532be40 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0e0034650 msgr2=0x7ff0e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff0e0034650 0x7ff0e0036b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec0ae000 tx=0x7ff1ec0a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 msgr2=0x55f8a531bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 --2- 172.21.15.145:0/3916426099 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8a52298d0 0x55f8a531bf90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55f8a5315e00 tx=0x7ff1e8000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1f858f640 1 -- 172.21.15.145:0/3916426099 reap_dead start 2024-09-11T11:01:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 shutdown_connections 2024-09-11T11:01:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 >> 172.21.15.145:0/3916426099 conn(0x55f8a519d220 msgr2=0x55f8a530f3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 shutdown_connections 2024-09-11T11:01:30.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.780+0000 7ff1fa27e980 1 -- 172.21.15.145:0/3916426099 wait complete. 2024-09-11T11:01:30.793 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-11T11:01:30.793 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-11T11:01:30.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-11T11:01:30.794 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-11T11:01:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:30.870 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:30.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee6631980 1 Processor -- start 2024-09-11T11:01:30.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee6631980 1 -- start start 2024-09-11T11:01:30.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee6631980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557bec97ac60 0x557bec97d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee6631980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557bec7fcae0 con 0x557bec9768e0 2024-09-11T11:01:30.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee6631980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x557bec820e30 con 0x557bec97ac60 2024-09-11T11:01:30.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee3940640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557bec97ac60 0x557bec97d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee3940640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557bec97ac60 0x557bec97d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50874/0 (socket says 172.21.15.145:50874) 2024-09-11T11:01:30.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee4141640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x557bec9768e0 0x557bec976cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54726/0 (socket says 172.21.15.145:54726) 2024-09-11T11:01:30.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee3940640 1 -- 172.21.15.145:0/3924462746 learned_addr learned my addr 172.21.15.145:0/3924462746 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee3940640 1 -- 172.21.15.145:0/3924462746 >> v1:172.21.15.102:6789/0 conn(0x557bec9768e0 legacy=0x557bec976cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.868+0000 7feee3940640 1 -- 172.21.15.145:0/3924462746 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bec97e5a0 con 0x557bec97ac60 2024-09-11T11:01:30.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee3940640 1 --2- 172.21.15.145:0/3924462746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec97ac60 0x557bec97d050 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7feed400a5c0 tx=0x7feed401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b3c67f668e07f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee313f640 1 -- 172.21.15.145:0/3924462746 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feed40a6070 con 0x557bec97ac60 2024-09-11T11:01:30.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee313f640 1 -- 172.21.15.145:0/3924462746 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed40af070 con 0x557bec97ac60 2024-09-11T11:01:30.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee313f640 1 -- 172.21.15.145:0/3924462746 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feed40aa5c0 con 0x557bec97ac60 2024-09-11T11:01:30.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee6631980 1 -- 172.21.15.145:0/3924462746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec97ac60 msgr2=0x557bec97d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee6631980 1 --2- 172.21.15.145:0/3924462746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec97ac60 0x557bec97d050 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7feed400a5c0 tx=0x7feed401b340 comp rx=0 tx=0).stop 2024-09-11T11:01:30.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee6631980 1 -- 172.21.15.145:0/3924462746 shutdown_connections 2024-09-11T11:01:30.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee6631980 1 --2- 172.21.15.145:0/3924462746 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec97ac60 0x557bec97d050 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee6631980 1 -- 172.21.15.145:0/3924462746 >> 172.21.15.145:0/3924462746 conn(0x557bec8ea230 msgr2=0x557bec8ea640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee6631980 1 -- 172.21.15.145:0/3924462746 shutdown_connections 2024-09-11T11:01:30.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.872+0000 7feee6631980 1 -- 172.21.15.145:0/3924462746 wait complete. 2024-09-11T11:01:30.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.884+0000 7feee6631980 1 Processor -- start 2024-09-11T11:01:30.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.884+0000 7feee6631980 1 -- start start 2024-09-11T11:01:30.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca61c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557bec822200 con 0x557bec9768e0 2024-09-11T11:01:30.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca61c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca61c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50888/0 (socket says 172.21.15.145:50888) 2024-09-11T11:01:30.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 -- 172.21.15.145:0/3412120179 learned_addr learned my addr 172.21.15.145:0/3412120179 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 -- 172.21.15.145:0/3412120179 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557beca62200 con 0x557bec9768e0 2024-09-11T11:01:30.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 --2- 172.21.15.145:0/3412120179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca61c30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7feecc001e50 tx=0x7feecc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d095a648df5cd28c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7fedd260c640 1 -- 172.21.15.145:0/3412120179 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc00e5d0 con 0x557bec9768e0 2024-09-11T11:01:30.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7fedd260c640 1 -- 172.21.15.145:0/3412120179 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feecc00e770 con 0x557bec9768e0 2024-09-11T11:01:30.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7fedd260c640 1 -- 172.21.15.145:0/3412120179 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc00eab0 con 0x557bec9768e0 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 -- 172.21.15.145:0/3412120179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 msgr2=0x557beca61c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 --2- 172.21.15.145:0/3412120179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca61c30 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7feecc001e50 tx=0x7feecc001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 -- 172.21.15.145:0/3412120179 shutdown_connections 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 --2- 172.21.15.145:0/3412120179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca61c30 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 -- 172.21.15.145:0/3412120179 >> 172.21.15.145:0/3412120179 conn(0x557bec8ea230 msgr2=0x557beca5d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 -- 172.21.15.145:0/3412120179 shutdown_connections 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 -- 172.21.15.145:0/3412120179 wait complete. 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 Processor -- start 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 -- start start 2024-09-11T11:01:30.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca68fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee6631980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557bec97e0a0 con 0x557bec9768e0 2024-09-11T11:01:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca68fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca68fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50894/0 (socket says 172.21.15.145:50894) 2024-09-11T11:01:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 -- 172.21.15.145:0/1905654690 learned_addr learned my addr 172.21.15.145:0/1905654690 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.888+0000 7feee4141640 1 -- 172.21.15.145:0/1905654690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557beca694e0 con 0x557bec9768e0 2024-09-11T11:01:30.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee4141640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca68fa0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x557beca62e10 tx=0x7feecc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7fedd0e09640 1 -- 172.21.15.145:0/1905654690 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc001260 con 0x557bec9768e0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557beca69770 con 0x557bec9768e0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7fedd0e09640 1 -- 172.21.15.145:0/1905654690 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feecc00fa40 con 0x557bec9768e0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7fedd0e09640 1 -- 172.21.15.145:0/1905654690 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc00fd80 con 0x557bec9768e0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557beca6c450 con 0x557bec9768e0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7fedd0e09640 1 -- 172.21.15.145:0/1905654690 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feecc017070 con 0x557bec9768e0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7fedd0e09640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedcc034650 0x7fedcc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7fedd0e09640 1 -- 172.21.15.145:0/1905654690 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7feecc015020 con 0x557bec9768e0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee3940640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedcc034650 0x7fedcc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee6631980 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557bec97ac60 0x557beca6ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557beca70600 con 0x557bec97ac60 2024-09-11T11:01:30.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee4942640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557bec97ac60 0x557beca6ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee4942640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557bec97ac60 0x557beca6ff90 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee3940640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedcc034650 0x7fedcc036b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feed40ae000 tx=0x7feed40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee4942640 1 -- 172.21.15.145:0/1905654690 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557bec97ac60 2024-09-11T11:01:30.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee6631980 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557beca713d0 0x557beca737c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557beca73e00 con 0x557beca713d0 2024-09-11T11:01:30.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.892+0000 7feee4141640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557beca713d0 0x557beca737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee4141640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557beca713d0 0x557beca737c0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee4141640 1 -- 172.21.15.145:0/1905654690 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feecc02e070 con 0x557beca713d0 2024-09-11T11:01:30.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557beca756b0 con 0x557beca713d0 2024-09-11T11:01:30.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee4141640 1 -- 172.21.15.145:0/1905654690 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feecc02e070 con 0x557beca713d0 2024-09-11T11:01:30.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557beca74820 con 0x557beca713d0 2024-09-11T11:01:30.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee4141640 1 -- 172.21.15.145:0/1905654690 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feecc02e070 con 0x557beca713d0 2024-09-11T11:01:30.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee6631980 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557beca76a60 0x557beca78e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557beca79390 con 0x557beca76a60 2024-09-11T11:01:30.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee3940640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557beca76a60 0x557beca78e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee3940640 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557beca76a60 0x557beca78e50 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee3940640 1 -- 172.21.15.145:0/1905654690 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feed40aaae0 con 0x557beca76a60 2024-09-11T11:01:30.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee6631980 1 Processor -- start 2024-09-11T11:01:30.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee6631980 1 -- start start 2024-09-11T11:01:30.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee6631980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca86d80 0x557beca871a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.896+0000 7feee6631980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557bec87b800 con 0x557beca86d80 2024-09-11T11:01:30.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca86d80 0x557beca871a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca86d80 0x557beca871a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50908/0 (socket says 172.21.15.145:50908) 2024-09-11T11:01:30.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee4141640 1 -- 172.21.15.145:0/1638766680 learned_addr learned my addr 172.21.15.145:0/1638766680 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee4141640 1 -- 172.21.15.145:0/1638766680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557beca876e0 con 0x557beca86d80 2024-09-11T11:01:30.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee4141640 1 --2- 172.21.15.145:0/1638766680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca86d80 0x557beca871a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feecc04aa50 tx=0x7feecc017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7fedc9ffb640 1 -- 172.21.15.145:0/1638766680 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc042120 con 0x557beca86d80 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7fedc9ffb640 1 -- 172.21.15.145:0/1638766680 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feecc0422c0 con 0x557beca86d80 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee6631980 1 -- 172.21.15.145:0/1638766680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557beca87970 con 0x557beca86d80 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7fedc9ffb640 1 -- 172.21.15.145:0/1638766680 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc04aac0 con 0x557beca86d80 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee6631980 1 -- 172.21.15.145:0/1638766680 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557beca87970 con 0x557beca86d80 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7fedc9ffb640 1 -- 172.21.15.145:0/1638766680 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feecc042510 con 0x557beca86d80 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7fedc9ffb640 1 --2- 172.21.15.145:0/1638766680 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedbc0346a0 0x7fedbc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7fedc9ffb640 1 -- 172.21.15.145:0/1638766680 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7feecc040ab0 con 0x557beca86d80 2024-09-11T11:01:30.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee3940640 1 --2- 172.21.15.145:0/1638766680 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedbc0346a0 0x7fedbc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee6631980 1 Processor -- start 2024-09-11T11:01:30.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee6631980 1 -- start start 2024-09-11T11:01:30.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee3940640 1 --2- 172.21.15.145:0/1638766680 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedbc0346a0 0x7fedbc036b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x557beca6d590 tx=0x7feed4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee6631980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca93830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee6631980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557beca62580 con 0x557beca93430 2024-09-11T11:01:30.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca93830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca93830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50912/0 (socket says 172.21.15.145:50912) 2024-09-11T11:01:30.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.900+0000 7feee4141640 1 -- 172.21.15.145:0/1477107318 learned_addr learned my addr 172.21.15.145:0/1477107318 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee4141640 1 -- 172.21.15.145:0/1477107318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557beca93e00 con 0x557beca93430 2024-09-11T11:01:30.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee4141640 1 --2- 172.21.15.145:0/1477107318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca93830 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7feecc017860 tx=0x7feecc047b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452ea06ddb93b5b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7fedc37fe640 1 -- 172.21.15.145:0/1477107318 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc019d50 con 0x557beca93430 2024-09-11T11:01:30.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7fedc37fe640 1 -- 172.21.15.145:0/1477107318 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feecc040d50 con 0x557beca93430 2024-09-11T11:01:30.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7fedc37fe640 1 -- 172.21.15.145:0/1477107318 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc01dda0 con 0x557beca93430 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- 172.21.15.145:0/1477107318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 msgr2=0x557beca93830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 --2- 172.21.15.145:0/1477107318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca93830 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7feecc017860 tx=0x7feecc047b40 comp rx=0 tx=0).stop 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- 172.21.15.145:0/1477107318 shutdown_connections 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 --2- 172.21.15.145:0/1477107318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca93830 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- 172.21.15.145:0/1477107318 >> 172.21.15.145:0/1477107318 conn(0x557beca8f860 msgr2=0x557beca8d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- 172.21.15.145:0/1477107318 shutdown_connections 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- 172.21.15.145:0/1477107318 wait complete. 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 Processor -- start 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- start start 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca9a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557beca942d0 con 0x557beca93430 2024-09-11T11:01:30.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca9a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee4141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca9a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50926/0 (socket says 172.21.15.145:50926) 2024-09-11T11:01:30.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 learned_addr learned my addr 172.21.15.145:0/1384684891 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:30.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557beca9abb0 con 0x557beca93430 2024-09-11T11:01:30.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee4141640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca9a670 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7feecc028e30 tx=0x7feecc0325b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7fedc1ffb640 1 -- 172.21.15.145:0/1384684891 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc06f070 con 0x557beca93430 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7fedc1ffb640 1 -- 172.21.15.145:0/1384684891 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feecc0470d0 con 0x557beca93430 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557beca9abb0 con 0x557beca93430 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7fedc1ffb640 1 -- 172.21.15.145:0/1384684891 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feecc032040 con 0x557beca93430 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.904+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557beca9abb0 con 0x557beca93430 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7fedc1ffb640 1 -- 172.21.15.145:0/1384684891 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7feecc072070 con 0x557beca93430 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7fedc1ffb640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedb4034650 0x7fedb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7fedc1ffb640 1 -- 172.21.15.145:0/1384684891 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7feecc05b030 con 0x557beca93430 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee3940640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedb4034650 0x7fedb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557becaa5790 0x557becaa7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becaa83a0 con 0x557becaa5790 2024-09-11T11:01:30.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee4942640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557becaa5790 0x557becaa7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee3940640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedb4034650 0x7fedb4036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feed4000c10 tx=0x7feed40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee4942640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557becaa5790 0x557becaa7c50 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 realm 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becaa4bc0 con 0x557becaa5790 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becaa8e60 con 0x557becaa5790 2024-09-11T11:01:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557becaa9c40 0x557becaac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becaac6e0 con 0x557becaa9c40 2024-09-11T11:01:30.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee4141640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557becaa9c40 0x557becaac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee4141640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557becaa9c40 0x557becaac030 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feecc071030 con 0x557becaa9c40 2024-09-11T11:01:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.908+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becaacf30 con 0x557becaa9c40 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feecc071030 con 0x557becaa9c40 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee6631980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee6631980 20 searching for the correct realm 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557becaaeca0 0x557becab1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaaeca0 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee3940640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557becaaeca0 0x557becab1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee3940640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557becaaeca0 0x557becab1090 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feecc071030 con 0x557becaa9c40 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4141640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7feecc074060 0x7feecc032700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:30.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x7feecc074060 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7feecc074060 0x7feecc032700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7feecc074060 0x7feecc032700 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaaeca0 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.912+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feecc071030 con 0x557becaa9c40 2024-09-11T11:01:30.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feecc071030 con 0x557becaa9c40 2024-09-11T11:01:30.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x7feecc074060 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x7feecc074060 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaaeca0 2024-09-11T11:01:30.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.916+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaaeca0 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaaeca0 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x7feecc074060 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa5790 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x7feecc074060 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaaeca0 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x7feecc074060 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.920+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaaeca0 2024-09-11T11:01:30.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x557becab1710 con 0x557becaa9c40 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becaad8b0 con 0x557becaa5790 2024-09-11T11:01:30.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becaad4f0 con 0x557becaa9c40 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becaae250 con 0x7feecc074060 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 zone default found 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 4 Realm: () 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:30.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 zonegroup default 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becab2020 con 0x7feecc074060 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.924+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becab42d0 con 0x557becaaeca0 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becab4670 con 0x557becaaeca0 2024-09-11T11:01:30.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:30.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 20 started sync module instance, tier type = 2024-09-11T11:01:30.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:30.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab3710 con 0x557becaa9c40 2024-09-11T11:01:30.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93990739983376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab3710 con 0x557becaa9c40 2024-09-11T11:01:30.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab5030 con 0x557becaa5790 2024-09-11T11:01:30.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.928+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93990739987328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab4fa0 con 0x557becaa5790 2024-09-11T11:01:30.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab5f60 con 0x557becaa9c40 2024-09-11T11:01:30.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93990739983376] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93990739987328] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93990739989536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab3260 con 0x557becaa9c40 2024-09-11T11:01:30.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab6410 con 0x7feecc074060 2024-09-11T11:01:30.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93990739992416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab6830 con 0x7feecc074060 2024-09-11T11:01:30.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab72e0 con 0x557becaa9c40 2024-09-11T11:01:30.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.932+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93990739989536] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93990739992416] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93990739991152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab6380 con 0x557becaa9c40 2024-09-11T11:01:30.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab7b80 con 0x557becaaeca0 2024-09-11T11:01:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93990739998416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab6380 con 0x557becaaeca0 2024-09-11T11:01:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab8900 con 0x557becaaeca0 2024-09-11T11:01:30.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93990739991152] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93990739998416] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93990740000544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab8d20 con 0x557becaaeca0 2024-09-11T11:01:30.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.936+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab9570 con 0x7feecc074060 2024-09-11T11:01:30.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93990740000544] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93990740004128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab9960 con 0x7feecc074060 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 20 add_watcher() i=0 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 20 add_watcher() i=1 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 20 add_watcher() i=2 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 20 add_watcher() i=3 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 20 add_watcher() i=4 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 20 add_watcher() i=5 2024-09-11T11:01:30.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 20 add_watcher() i=6 2024-09-11T11:01:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93990740004128] v32'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 20 add_watcher() i=7 2024-09-11T11:01:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becabc990 con 0x557becaa5790 2024-09-11T11:01:30.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.940+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93990740005648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab9e40 con 0x557becaa5790 2024-09-11T11:01:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93990740005648] v32'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7fed9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:30.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 5 note: GC not initialized 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7fed997e2640 20 reqs_thread_entry: start 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 Filter name: none 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7fed0affd640 20 reqs_thread_entry: start 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becae0050 con 0x557becaa5790 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:30.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becadfb70 con 0x7feecc074060 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 disabling bucket name=myfoo 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becae0ac0 con 0x7feecc074060 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:30.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 rados->read ofs=0 len=0 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becae23a0 con 0x557becaa5790 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:30.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becaead70 con 0x557becaa5790 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1, ofs0, ns] 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.944+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 93990740173200 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becae63d0 con 0x557becaa9c40 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 93990739991152 notify 137438953501 ret 0) ==== 794+0+0 (crc 0 0 0) 0x557beca876e0 con 0x557becaa9c40 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 93990739991152 notifier 4598 bl.length()=752 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.4 [notify cookie 93990740173200 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feda8003eb0 con 0x557becaa9c40 2024-09-11T11:01:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 93990740173200 notify 137438953501 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557beca6c450 con 0x557becaa9c40 2024-09-11T11:01:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_sources= new_sources= 2024-09-11T11:01:30.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential sources added=[] removed=[] 2024-09-11T11:01:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_dests= new_dests= 2024-09-11T11:01:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential dests added=[] removed=[] 2024-09-11T11:01:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becae2ed0 con 0x557becaa5790 2024-09-11T11:01:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:30.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 93990740178096 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x557becae2ed0 con 0x557becaa9c40 2024-09-11T11:01:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 93990739991152 notify 137438953502 ret 0) ==== 609+0+0 (crc 0 0 0) 0x557beca6c450 con 0x557becaa9c40 2024-09-11T11:01:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 93990739991152 notifier 4598 bl.length()=567 2024-09-11T11:01:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:30.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7fedc37fe640 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7feda8003eb0 con 0x557becaa9c40 2024-09-11T11:01:30.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(70 notify.4 [notify cookie 93990740178096 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.948+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.952+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 93990740178096 notify 137438953502 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557beca69770 con 0x557becaa9c40 2024-09-11T11:01:30.956 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:30.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.952+0000 7fed9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:30.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.952+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93990740005648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becadde80 con 0x557becaa5790 2024-09-11T11:01:30.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.952+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 93990740005648] v32'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.952+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93990739983376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becadde80 con 0x557becaa9c40 2024-09-11T11:01:30.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.956+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 93990739983376] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.956+0000 7feee6631980 20 remove_watcher() i=0 2024-09-11T11:01:30.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.956+0000 7feee6631980 2 removed watcher, disabling cache 2024-09-11T11:01:30.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.956+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93990739987328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becadde80 con 0x557becaa5790 2024-09-11T11:01:30.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.956+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 93990739987328] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x557becaa5790 2024-09-11T11:01:30.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.956+0000 7feee6631980 20 remove_watcher() i=1 2024-09-11T11:01:30.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.956+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93990739989536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab4b80 con 0x557becaa9c40 2024-09-11T11:01:30.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 93990739989536] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee6631980 20 remove_watcher() i=2 2024-09-11T11:01:30.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93990739992416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becadde80 con 0x7feecc074060 2024-09-11T11:01:30.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 93990739992416] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee6631980 20 remove_watcher() i=3 2024-09-11T11:01:30.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93990739991152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab4b80 con 0x557becaa9c40 2024-09-11T11:01:30.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee4141640 1 -- 172.21.15.145:0/1384684891 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 93990739991152] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feecc089040 con 0x557becaa9c40 2024-09-11T11:01:30.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee6631980 20 remove_watcher() i=4 2024-09-11T11:01:30.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.960+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93990739998416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab5f60 con 0x557becaaeca0 2024-09-11T11:01:30.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 93990739998416] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 20 remove_watcher() i=5 2024-09-11T11:01:30.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93990740000544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becadde80 con 0x557becaaeca0 2024-09-11T11:01:30.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee3940640 1 -- 172.21.15.145:0/1384684891 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 93990740000544] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feed40aaae0 con 0x557becaaeca0 2024-09-11T11:01:30.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 20 remove_watcher() i=6 2024-09-11T11:01:30.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93990740004128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x557becab5a70 con 0x7feecc074060 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 93990740004128] v32'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feedc00a4d0 con 0x7feecc074060 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 20 remove_watcher() i=7 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557becaa9c40 msgr2=0x557becaac030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557becaa9c40 0x557becaac030 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557becaa5790 msgr2=0x557becaa7c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557becaa5790 0x557becaa7c50 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7feecc074060 msgr2=0x7feecc032700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7feecc074060 0x7feecc032700 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557becaaeca0 msgr2=0x557becab1090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557becaaeca0 0x557becab1090 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedb4034650 msgr2=0x7fedb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedb4034650 0x7fedb4036b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feed4000c10 tx=0x7feed40c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 msgr2=0x557beca9a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca9a670 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7feecc028e30 tx=0x7feecc0325b0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee4942640 1 -- 172.21.15.145:0/1384684891 reap_dead start 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 shutdown_connections 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1384684891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca93430 0x557beca9a670 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 >> 172.21.15.145:0/1384684891 conn(0x557beca8f860 msgr2=0x557beca8d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 shutdown_connections 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1384684891 wait complete. 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1638766680 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedbc0346a0 msgr2=0x7fedbc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1638766680 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedbc0346a0 0x7fedbc036b60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x557beca6d590 tx=0x7feed4005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1638766680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca86d80 msgr2=0x557beca871a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1638766680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca86d80 0x557beca871a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7feecc04aa50 tx=0x7feecc017d50 comp rx=0 tx=0).stop 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1638766680 shutdown_connections 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1638766680 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedbc0346a0 0x7fedbc036b60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1638766680 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557beca86d80 0x557beca871a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1638766680 >> 172.21.15.145:0/1638766680 conn(0x557beca7bed0 msgr2=0x557beca7e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1638766680 shutdown_connections 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1638766680 wait complete. 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557beca713d0 msgr2=0x557beca737c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557beca713d0 0x557beca737c0 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557bec97ac60 msgr2=0x557beca6ff90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557bec97ac60 0x557beca6ff90 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557beca76a60 msgr2=0x557beca78e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557beca76a60 0x557beca78e50 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedcc034650 msgr2=0x7fedcc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fedcc034650 0x7fedcc036b10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feed40ae000 tx=0x7feed40a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 msgr2=0x557beca68fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 --2- 172.21.15.145:0/1905654690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557bec9768e0 0x557beca68fa0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x557beca62e10 tx=0x7feecc000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee4942640 1 -- 172.21.15.145:0/1905654690 reap_dead start 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 shutdown_connections 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 >> 172.21.15.145:0/1905654690 conn(0x557bec8ea230 msgr2=0x557beca5c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 shutdown_connections 2024-09-11T11:01:30.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:30.964+0000 7feee6631980 1 -- 172.21.15.145:0/1905654690 wait complete. 2024-09-11T11:01:30.978 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:30.980 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-11T11:01:30.980 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-11T11:01:30.980 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-11T11:01:31.049 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:31.050 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:31.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc653ca2980 1 Processor -- start 2024-09-11T11:01:31.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc653ca2980 1 -- start start 2024-09-11T11:01:31.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc653ca2980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55bc50c8f290 0x55bc50d1f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc653ca2980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bc50ba2ae0 con 0x55bc50d1fce0 2024-09-11T11:01:31.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc653ca2980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55bc50bc6e30 con 0x55bc50c8f290 2024-09-11T11:01:31.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc650fb1640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55bc50d1fce0 0x55bc50d220d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:54740/0 (socket says 172.21.15.145:54740) 2024-09-11T11:01:31.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc650fb1640 1 -- 172.21.15.145:0/1444215645 learned_addr learned my addr 172.21.15.145:0/1444215645 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:31.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc6517b2640 1 --2- 172.21.15.145:0/1444215645 >> v2:172.21.15.102:3300/0 conn(0x55bc50c8f290 0x55bc50d1f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc64bfff640 1 -- 172.21.15.145:0/1444215645 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382998598 0 0) 0x55bc50ba2ae0 con 0x55bc50d1fce0 2024-09-11T11:01:31.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc64bfff640 1 -- 172.21.15.145:0/1444215645 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc640001e20 con 0x55bc50d1fce0 2024-09-11T11:01:31.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc6517b2640 1 -- 172.21.15.145:0/1444215645 >> v1:172.21.15.102:6789/0 conn(0x55bc50d1fce0 legacy=0x55bc50d220d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.048+0000 7fc6517b2640 1 -- 172.21.15.145:0/1444215645 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc50c8f670 con 0x55bc50c8f290 2024-09-11T11:01:31.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc6517b2640 1 --2- 172.21.15.145:0/1444215645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50d1f7a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc64400a480 tx=0x7fc64401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108af68664526900 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc64bfff640 1 -- 172.21.15.145:0/1444215645 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440b0070 con 0x55bc50c8f290 2024-09-11T11:01:31.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc64bfff640 1 -- 172.21.15.145:0/1444215645 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6440ab540 con 0x55bc50c8f290 2024-09-11T11:01:31.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc64bfff640 1 -- 172.21.15.145:0/1444215645 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440ab820 con 0x55bc50c8f290 2024-09-11T11:01:31.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc653ca2980 1 -- 172.21.15.145:0/1444215645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 msgr2=0x55bc50d1f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc653ca2980 1 --2- 172.21.15.145:0/1444215645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50d1f7a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc64400a480 tx=0x7fc64401b280 comp rx=0 tx=0).stop 2024-09-11T11:01:31.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc653ca2980 1 -- 172.21.15.145:0/1444215645 shutdown_connections 2024-09-11T11:01:31.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc653ca2980 1 --2- 172.21.15.145:0/1444215645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50d1f7a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc653ca2980 1 -- 172.21.15.145:0/1444215645 >> 172.21.15.145:0/1444215645 conn(0x55bc50d15090 msgr2=0x55bc50d174b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:31.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc653ca2980 1 -- 172.21.15.145:0/1444215645 shutdown_connections 2024-09-11T11:01:31.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.052+0000 7fc653ca2980 1 -- 172.21.15.145:0/1444215645 wait complete. 2024-09-11T11:01:31.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.064+0000 7fc653ca2980 1 Processor -- start 2024-09-11T11:01:31.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.064+0000 7fc653ca2980 1 -- start start 2024-09-11T11:01:31.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e07a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bc50bc8200 con 0x55bc50c8f290 2024-09-11T11:01:31.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e07a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e07a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50940/0 (socket says 172.21.15.145:50940) 2024-09-11T11:01:31.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 -- 172.21.15.145:0/532838123 learned_addr learned my addr 172.21.15.145:0/532838123 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:31.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 -- 172.21.15.145:0/532838123 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc50e08040 con 0x55bc50c8f290 2024-09-11T11:01:31.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 --2- 172.21.15.145:0/532838123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e07a70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc644018eb0 tx=0x7fc644003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5148d82cc5aeddfc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc53f606640 1 -- 172.21.15.145:0/532838123 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440b0070 con 0x55bc50c8f290 2024-09-11T11:01:31.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc53f606640 1 -- 172.21.15.145:0/532838123 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6440bc070 con 0x55bc50c8f290 2024-09-11T11:01:31.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc53f606640 1 -- 172.21.15.145:0/532838123 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440abb00 con 0x55bc50c8f290 2024-09-11T11:01:31.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 -- 172.21.15.145:0/532838123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 msgr2=0x55bc50e07a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 --2- 172.21.15.145:0/532838123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e07a70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc644018eb0 tx=0x7fc644003030 comp rx=0 tx=0).stop 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 -- 172.21.15.145:0/532838123 shutdown_connections 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 --2- 172.21.15.145:0/532838123 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e07a70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 -- 172.21.15.145:0/532838123 >> 172.21.15.145:0/532838123 conn(0x55bc50d15090 msgr2=0x55bc50e036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 -- 172.21.15.145:0/532838123 shutdown_connections 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 -- 172.21.15.145:0/532838123 wait complete. 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 Processor -- start 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 -- start start 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e0ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc653ca2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bc50d26220 con 0x55bc50c8f290 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e0ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e0ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50942/0 (socket says 172.21.15.145:50942) 2024-09-11T11:01:31.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 -- 172.21.15.145:0/2305495091 learned_addr learned my addr 172.21.15.145:0/2305495091 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:31.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.068+0000 7fc6517b2640 1 -- 172.21.15.145:0/2305495091 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc50e0f180 con 0x55bc50c8f290 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc6517b2640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e0ec40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6440b9040 tx=0x7fc644018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc53de03640 1 -- 172.21.15.145:0/2305495091 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440b75b0 con 0x55bc50c8f290 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc50e0f410 con 0x55bc50c8f290 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc53de03640 1 -- 172.21.15.145:0/2305495091 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6440b1040 con 0x55bc50c8f290 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc53de03640 1 -- 172.21.15.145:0/2305495091 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440b7880 con 0x55bc50c8f290 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc50e120f0 con 0x55bc50c8f290 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc53de03640 1 -- 172.21.15.145:0/2305495091 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc6440b7a20 con 0x55bc50c8f290 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc53de03640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc538034650 0x7fc538036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc53de03640 1 -- 172.21.15.145:0/2305495091 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc6440a8070 con 0x55bc50c8f290 2024-09-11T11:01:31.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc650fb1640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc538034650 0x7fc538036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc653ca2980 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50d1fce0 0x55bc50e15bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e16210 con 0x55bc50d1fce0 2024-09-11T11:01:31.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc651fb3640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50d1fce0 0x55bc50e15bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc650fb1640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc538034650 0x7fc538036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc63c000f70 tx=0x7fc63c0010b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc651fb3640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50d1fce0 0x55bc50e15bd0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc651fb3640 1 -- 172.21.15.145:0/2305495091 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50d1fce0 2024-09-11T11:01:31.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc653ca2980 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e17000 0x55bc50e193f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e19a20 con 0x55bc50e17000 2024-09-11T11:01:31.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc6517b2640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e17000 0x55bc50e193f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.072+0000 7fc6517b2640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e17000 0x55bc50e193f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc6517b2640 1 -- 172.21.15.145:0/2305495091 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc6440d1020 con 0x55bc50e17000 2024-09-11T11:01:31.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e1b2d0 con 0x55bc50e17000 2024-09-11T11:01:31.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc6517b2640 1 -- 172.21.15.145:0/2305495091 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc6440d1020 con 0x55bc50e17000 2024-09-11T11:01:31.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e1a500 con 0x55bc50e17000 2024-09-11T11:01:31.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc6517b2640 1 -- 172.21.15.145:0/2305495091 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc6440d1020 con 0x55bc50e17000 2024-09-11T11:01:31.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc653ca2980 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bc50e1c680 0x55bc50e1ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e1efb0 con 0x55bc50e1c680 2024-09-11T11:01:31.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc650fb1640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bc50e1c680 0x55bc50e1ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc650fb1640 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bc50e1c680 0x55bc50e1ea70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.076+0000 7fc650fb1640 1 -- 172.21.15.145:0/2305495091 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e1c680 2024-09-11T11:01:31.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 Processor -- start 2024-09-11T11:01:31.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 -- start start 2024-09-11T11:01:31.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e2c970 0x55bc50e2cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bc50c21800 con 0x55bc50e2c970 2024-09-11T11:01:31.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e2c970 0x55bc50e2cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e2c970 0x55bc50e2cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50952/0 (socket says 172.21.15.145:50952) 2024-09-11T11:01:31.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc6517b2640 1 -- 172.21.15.145:0/3313377877 learned_addr learned my addr 172.21.15.145:0/3313377877 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:31.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc6517b2640 1 -- 172.21.15.145:0/3313377877 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc50e2d2d0 con 0x55bc50e2c970 2024-09-11T11:01:31.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc6517b2640 1 --2- 172.21.15.145:0/3313377877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e2c970 0x55bc50e2cd90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc6440e3860 tx=0x7fc6440b7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc536ffd640 1 -- 172.21.15.145:0/3313377877 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440e3480 con 0x55bc50e2c970 2024-09-11T11:01:31.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 -- 172.21.15.145:0/3313377877 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc50e2d560 con 0x55bc50e2c970 2024-09-11T11:01:31.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc536ffd640 1 -- 172.21.15.145:0/3313377877 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6440c09b0 con 0x55bc50e2c970 2024-09-11T11:01:31.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc536ffd640 1 -- 172.21.15.145:0/3313377877 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440f5060 con 0x55bc50e2c970 2024-09-11T11:01:31.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 -- 172.21.15.145:0/3313377877 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc50e301e0 con 0x55bc50e2c970 2024-09-11T11:01:31.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc536ffd640 1 -- 172.21.15.145:0/3313377877 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc6440c0b60 con 0x55bc50e2c970 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc536ffd640 1 --2- 172.21.15.145:0/3313377877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc528034650 0x7fc528036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc536ffd640 1 -- 172.21.15.145:0/3313377877 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc6440da040 con 0x55bc50e2c970 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc650fb1640 1 --2- 172.21.15.145:0/3313377877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc528034650 0x7fc528036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 Processor -- start 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 -- start start 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc650fb1640 1 --2- 172.21.15.145:0/3313377877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc528034650 0x7fc528036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55bc50e13230 tx=0x7fc63c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e39740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.080+0000 7fc653ca2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bc50e08300 con 0x55bc50e39360 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e39740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e39740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50966/0 (socket says 172.21.15.145:50966) 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 -- 172.21.15.145:0/1655383995 learned_addr learned my addr 172.21.15.145:0/1655383995 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 -- 172.21.15.145:0/1655383995 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc50e39d10 con 0x55bc50e39360 2024-09-11T11:01:31.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 --2- 172.21.15.145:0/1655383995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e39740 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc644006b30 tx=0x7fc644006d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=475780f3e649724f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc534ff9640 1 -- 172.21.15.145:0/1655383995 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440ca3d0 con 0x55bc50e39360 2024-09-11T11:01:31.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc534ff9640 1 -- 172.21.15.145:0/1655383995 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6440cb710 con 0x55bc50e39360 2024-09-11T11:01:31.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc534ff9640 1 -- 172.21.15.145:0/1655383995 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440ca570 con 0x55bc50e39360 2024-09-11T11:01:31.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- 172.21.15.145:0/1655383995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 msgr2=0x55bc50e39740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 --2- 172.21.15.145:0/1655383995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e39740 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc644006b30 tx=0x7fc644006d70 comp rx=0 tx=0).stop 2024-09-11T11:01:31.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- 172.21.15.145:0/1655383995 shutdown_connections 2024-09-11T11:01:31.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 --2- 172.21.15.145:0/1655383995 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e39740 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- 172.21.15.145:0/1655383995 >> 172.21.15.145:0/1655383995 conn(0x55bc50e35740 msgr2=0x55bc50e33840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:31.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- 172.21.15.145:0/1655383995 shutdown_connections 2024-09-11T11:01:31.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- 172.21.15.145:0/1655383995 wait complete. 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 Processor -- start 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- start start 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e40540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bc50e3a1b0 con 0x55bc50e39360 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e40540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e40540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:50980/0 (socket says 172.21.15.145:50980) 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 learned_addr learned my addr 172.21.15.145:0/3503963829 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc50e40a80 con 0x55bc50e39360 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc6517b2640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e40540 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc644006500 tx=0x7fc6440dcf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc526ffd640 1 -- 172.21.15.145:0/3503963829 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440de7e0 con 0x55bc50e39360 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bc50e40a80 con 0x55bc50e39360 2024-09-11T11:01:31.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc50e40a80 con 0x55bc50e39360 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc526ffd640 1 -- 172.21.15.145:0/3503963829 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6440a7d30 con 0x55bc50e39360 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.084+0000 7fc526ffd640 1 -- 172.21.15.145:0/3503963829 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6440d4a80 con 0x55bc50e39360 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc526ffd640 1 -- 172.21.15.145:0/3503963829 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc6440017d0 con 0x55bc50e39360 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc526ffd640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc51c0346a0 0x7fc51c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc526ffd640 1 -- 172.21.15.145:0/3503963829 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5706+0+0 (secure 0 0 0) 0x7fc644101070 con 0x55bc50e39360 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc650fb1640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc51c0346a0 0x7fc51c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50e4b500 0x55bc50e4d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e4e110 con 0x55bc50e4b500 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc651fb3640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50e4b500 0x55bc50e4d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc650fb1640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc51c0346a0 0x7fc51c036b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00c010 tx=0x7fc63c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc651fb3640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50e4b500 0x55bc50e4d9c0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 20 realm 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e4a930 con 0x55bc50e4b500 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e4ebd0 con 0x55bc50e4b500 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e4f9b0 0x55bc50e51da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52450 con 0x55bc50e4f9b0 2024-09-11T11:01:31.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc6517b2640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e4f9b0 0x55bc50e51da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.088+0000 7fc6517b2640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e4f9b0 0x55bc50e51da0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc653ca2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc653ca2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc653ca2980 20 searching for the correct realm 2024-09-11T11:01:31.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bc50e54a10 0x55bc50e56e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e57480 con 0x55bc50e54a10 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc650fb1640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bc50e54a10 0x55bc50e56e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc650fb1640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bc50e54a10 0x55bc50e56e00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e57480 con 0x55bc50e4f9b0 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 32 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc6517b2640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc6440ab030 0x7fc6440a7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x7fc6440ab030 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc651fb3640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc6440ab030 0x7fc6440a7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc651fb3640 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc6440ab030 0x7fc6440a7370 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.092+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e54a10 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x7fc6440ab030 2024-09-11T11:01:31.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x7fc6440ab030 2024-09-11T11:01:31.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e54a10 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.096+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e54a10 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e54a10 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x7fc6440ab030 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4b500 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x7fc6440ab030 2024-09-11T11:01:31.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e54a10 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x7fc6440ab030 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.100+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e54a10 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e52ca0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:31.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:31.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:31.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:31.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:31.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:31.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e534f0 con 0x55bc50e4b500 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e538e0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e538e0 con 0x7fc6440ab030 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:31.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 zone default found 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 4 Realm: () 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 zonegroup default 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e57900 con 0x7fc6440ab030 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.104+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e596b0 con 0x55bc50e54a10 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e59b80 con 0x55bc50e54a10 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 20 started sync module instance, tier type = 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e58b20 con 0x55bc50e4f9b0 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94267299434576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e58b20 con 0x55bc50e4f9b0 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5a640 con 0x55bc50e4b500 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.108+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94267299438928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5a570 con 0x55bc50e4b500 2024-09-11T11:01:31.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5b570 con 0x55bc50e4f9b0 2024-09-11T11:01:31.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94267299438928] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94267299434576] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94267299432048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5b080 con 0x55bc50e4f9b0 2024-09-11T11:01:31.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5be10 con 0x7fc6440ab030 2024-09-11T11:01:31.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94267299445088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5b080 con 0x7fc6440ab030 2024-09-11T11:01:31.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.112+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5c8e0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94267299432048] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94267299445088] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94267299446144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5c8a0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5ccd0 con 0x55bc50e54a10 2024-09-11T11:01:31.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94267299441248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5d520 con 0x55bc50e54a10 2024-09-11T11:01:31.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5df20 con 0x55bc50e54a10 2024-09-11T11:01:31.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94267299446144] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94267299447760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5e7c0 con 0x55bc50e54a10 2024-09-11T11:01:31.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94267299441248] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.116+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5ecd0 con 0x7fc6440ab030 2024-09-11T11:01:31.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94267299447760] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v32'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94267299455760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5e730 con 0x7fc6440ab030 2024-09-11T11:01:31.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 20 add_watcher() i=0 2024-09-11T11:01:31.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 20 add_watcher() i=1 2024-09-11T11:01:31.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 20 add_watcher() i=2 2024-09-11T11:01:31.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 20 add_watcher() i=3 2024-09-11T11:01:31.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 20 add_watcher() i=4 2024-09-11T11:01:31.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 20 add_watcher() i=5 2024-09-11T11:01:31.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 20 add_watcher() i=6 2024-09-11T11:01:31.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94267299455760] v32'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 20 add_watcher() i=7 2024-09-11T11:01:31.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:31.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e621b0 con 0x55bc50e4b500 2024-09-11T11:01:31.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94267299458256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5f6f0 con 0x55bc50e4b500 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.120+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94267299458256] v32'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc5077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 5 note: GC not initialized 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc5067e4640 20 reqs_thread_entry: start 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 Filter name: none 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc477fff640 20 reqs_thread_entry: start 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:31.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e857a0 con 0x55bc50e4b500 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e88230 con 0x7fc6440ab030 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 enabling bucket name=myfoo 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e86210 con 0x7fc6440ab030 2024-09-11T11:01:31.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:31.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-11T11:01:31.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:31.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 : miss 2024-09-11T11:01:31.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:31.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e88a80 con 0x55bc50e4b500 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 8.a 8:57864aa0:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e904b0 con 0x55bc50e4b500 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v32'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1, ofs0, ns] 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.124+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify cookie 94267299627776 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e8bb60 con 0x55bc50e4f9b0 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94267299446144 notify 137438953503 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55bc50e2d560 con 0x55bc50e4f9b0 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc534ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 94267299446144 notifier 4605 bl.length()=752 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc534ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 info.flags=0x17 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc534ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.1 to cache LRU end 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc534ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc534ff9640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc514003eb0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.4 [notify cookie 94267299627776 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94267299627776 notify 137438953503 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bc50e2d2d0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_sources= new_sources= 2024-09-11T11:01:31.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential sources added=[] removed=[] 2024-09-11T11:01:31.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): orig_dests= new_dests= 2024-09-11T11:01:31.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 20 handle_bi_update(): bucket=:myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.1]): potential dests added=[] removed=[] 2024-09-11T11:01:31.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e892d0 con 0x55bc50e4b500 2024-09-11T11:01:31.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v32'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:31.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:31.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:31.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94267299627728 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e892d0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 94267299446144 notify 137438953504 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55bc50e2d2d0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc527fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94267299446144 notifier 4605 bl.length()=567 2024-09-11T11:01:31.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc527fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:31.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc527fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:31.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc527fff640 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) -- 0x7fc484003440 con 0x55bc50e4f9b0 2024-09-11T11:01:31.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(70 notify.4 [notify cookie 94267299627728 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.128+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 94267299627728 notify 137438953504 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bc50e120f0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.135 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:31.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.132+0000 7fc5077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:31.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.132+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94267299458256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e835d0 con 0x55bc50e4b500 2024-09-11T11:01:31.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.132+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94267299458256] v32'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.132+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94267299434576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e835d0 con 0x55bc50e4f9b0 2024-09-11T11:01:31.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.136+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94267299434576] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.136+0000 7fc653ca2980 20 remove_watcher() i=0 2024-09-11T11:01:31.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.136+0000 7fc653ca2980 2 removed watcher, disabling cache 2024-09-11T11:01:31.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.136+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94267299438928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e835d0 con 0x55bc50e4b500 2024-09-11T11:01:31.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.136+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94267299438928] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x55bc50e4b500 2024-09-11T11:01:31.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.136+0000 7fc653ca2980 20 remove_watcher() i=1 2024-09-11T11:01:31.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.136+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94267299432048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5a150 con 0x55bc50e4f9b0 2024-09-11T11:01:31.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94267299432048] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc653ca2980 20 remove_watcher() i=2 2024-09-11T11:01:31.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94267299445088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e835d0 con 0x7fc6440ab030 2024-09-11T11:01:31.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94267299445088] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc653ca2980 20 remove_watcher() i=3 2024-09-11T11:01:31.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94267299446144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e58670 con 0x55bc50e4f9b0 2024-09-11T11:01:31.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc6517b2640 1 -- 172.21.15.145:0/3503963829 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94267299446144] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64410d070 con 0x55bc50e4f9b0 2024-09-11T11:01:31.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc653ca2980 20 remove_watcher() i=4 2024-09-11T11:01:31.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94267299441248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e5a150 con 0x55bc50e54a10 2024-09-11T11:01:31.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94267299441248] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc653ca2980 20 remove_watcher() i=5 2024-09-11T11:01:31.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.140+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94267299447760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e835d0 con 0x55bc50e54a10 2024-09-11T11:01:31.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc650fb1640 1 -- 172.21.15.145:0/3503963829 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94267299447760] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc63c00e6c0 con 0x55bc50e54a10 2024-09-11T11:01:31.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 20 remove_watcher() i=6 2024-09-11T11:01:31.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94267299455760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) -- 0x55bc50e58670 con 0x7fc6440ab030 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94267299455760] v32'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc64c00a4d0 con 0x7fc6440ab030 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 20 remove_watcher() i=7 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e4f9b0 msgr2=0x55bc50e51da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e4f9b0 0x55bc50e51da0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50e4b500 msgr2=0x55bc50e4d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50e4b500 0x55bc50e4d9c0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc6440ab030 msgr2=0x7fc6440a7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc6440ab030 0x7fc6440a7370 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bc50e54a10 msgr2=0x55bc50e56e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bc50e54a10 0x55bc50e56e00 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc51c0346a0 msgr2=0x7fc51c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc51c0346a0 0x7fc51c036b60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00c010 tx=0x7fc63c010000 comp rx=0 tx=0).stop 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 msgr2=0x55bc50e40540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc651fb3640 1 -- 172.21.15.145:0/3503963829 reap_dead start 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e40540 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fc644006500 tx=0x7fc6440dcf40 comp rx=0 tx=0).stop 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 shutdown_connections 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3503963829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e39360 0x55bc50e40540 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 >> 172.21.15.145:0/3503963829 conn(0x55bc50e35740 msgr2=0x55bc50e33810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 shutdown_connections 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3503963829 wait complete. 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3313377877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc528034650 msgr2=0x7fc528036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3313377877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc528034650 0x7fc528036b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55bc50e13230 tx=0x7fc63c00f000 comp rx=0 tx=0).stop 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3313377877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e2c970 msgr2=0x55bc50e2cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3313377877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e2c970 0x55bc50e2cd90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc6440e3860 tx=0x7fc6440b7f90 comp rx=0 tx=0).stop 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3313377877 shutdown_connections 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3313377877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc528034650 0x7fc528036b10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/3313377877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50e2c970 0x55bc50e2cd90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3313377877 >> 172.21.15.145:0/3313377877 conn(0x55bc50e21ac0 msgr2=0x55bc50e24540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3313377877 shutdown_connections 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/3313377877 wait complete. 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e17000 msgr2=0x55bc50e193f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bc50e17000 0x55bc50e193f0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50d1fce0 msgr2=0x55bc50e15bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bc50d1fce0 0x55bc50e15bd0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bc50e1c680 msgr2=0x55bc50e1ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bc50e1c680 0x55bc50e1ea70 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc538034650 msgr2=0x7fc538036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc538034650 0x7fc538036b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc63c000f70 tx=0x7fc63c0010b0 comp rx=0 tx=0).stop 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 msgr2=0x55bc50e0ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 --2- 172.21.15.145:0/2305495091 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bc50c8f290 0x55bc50e0ec40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6440b9040 tx=0x7fc644018020 comp rx=0 tx=0).stop 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc651fb3640 1 -- 172.21.15.145:0/2305495091 reap_dead start 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 shutdown_connections 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 >> 172.21.15.145:0/2305495091 conn(0x55bc50d15090 msgr2=0x55bc50e02220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 shutdown_connections 2024-09-11T11:01:31.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:31.144+0000 7fc653ca2980 1 -- 172.21.15.145:0/2305495091 wait complete. 2024-09-11T11:01:31.157 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:31.168 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-11T11:01:31.518 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-11T11:01:31.536 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:46.537 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-11T11:01:46.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-11T11:01:46.538 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-11T11:01:46.576 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:46.577 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:46.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe305f71980 1 Processor -- start 2024-09-11T11:01:46.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe305f71980 1 -- start start 2024-09-11T11:01:46.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe305f71980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8aa006ac0 0x55f8aa006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe305f71980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8a9e90ae0 con 0x55f8aa0073e0 2024-09-11T11:01:46.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe305f71980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55f8a9eb4e30 con 0x55f8aa006ac0 2024-09-11T11:01:46.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe303a81640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8aa006ac0 0x55f8aa006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe303a81640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f8aa006ac0 0x55f8aa006ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60602/0 (socket says 172.21.15.145:60602) 2024-09-11T11:01:46.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe303280640 1 --1- 172.21.15.145:0/2650831759 >> v1:172.21.15.102:6789/0 conn(0x55f8aa0073e0 0x55f8aa00db90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:60892/0 (socket says 172.21.15.145:60892) 2024-09-11T11:01:46.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe303a81640 1 -- 172.21.15.145:0/2650831759 learned_addr learned my addr 172.21.15.145:0/2650831759 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe303a81640 1 -- 172.21.15.145:0/2650831759 >> v1:172.21.15.102:6789/0 conn(0x55f8aa0073e0 legacy=0x55f8aa00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe303a81640 1 -- 172.21.15.145:0/2650831759 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8aa0102c0 con 0x55f8aa006ac0 2024-09-11T11:01:46.579 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.576+0000 7fe302a7f640 1 -- 172.21.15.145:0/2650831759 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757600215 0 0) 0x55f8a9e90ae0 con 0x55f8aa0073e0 2024-09-11T11:01:46.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe303a81640 1 --2- 172.21.15.145:0/2650831759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa006ea0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400a5c0 tx=0x7fe2f401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdf785b91314789 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe302a7f640 1 -- 172.21.15.145:0/2650831759 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40a6070 con 0x55f8aa006ac0 2024-09-11T11:01:46.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe302a7f640 1 -- 172.21.15.145:0/2650831759 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f40af070 con 0x55f8aa006ac0 2024-09-11T11:01:46.583 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe302a7f640 1 -- 172.21.15.145:0/2650831759 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40aa5c0 con 0x55f8aa006ac0 2024-09-11T11:01:46.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe305f71980 1 -- 172.21.15.145:0/2650831759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 msgr2=0x55f8aa006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe305f71980 1 --2- 172.21.15.145:0/2650831759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa006ea0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe2f400a5c0 tx=0x7fe2f401b340 comp rx=0 tx=0).stop 2024-09-11T11:01:46.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe305f71980 1 -- 172.21.15.145:0/2650831759 shutdown_connections 2024-09-11T11:01:46.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe305f71980 1 --2- 172.21.15.145:0/2650831759 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa006ea0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe305f71980 1 -- 172.21.15.145:0/2650831759 >> 172.21.15.145:0/2650831759 conn(0x55f8aa0027a0 msgr2=0x55f8aa004bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe305f71980 1 -- 172.21.15.145:0/2650831759 shutdown_connections 2024-09-11T11:01:46.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.580+0000 7fe305f71980 1 -- 172.21.15.145:0/2650831759 wait complete. 2024-09-11T11:01:46.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.596+0000 7fe305f71980 1 Processor -- start 2024-09-11T11:01:46.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.596+0000 7fe305f71980 1 -- start start 2024-09-11T11:01:46.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.596+0000 7fe305f71980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.596+0000 7fe305f71980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8a9eb6200 con 0x55f8aa006ac0 2024-09-11T11:01:46.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.596+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.596+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60608/0 (socket says 172.21.15.145:60608) 2024-09-11T11:01:46.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.596+0000 7fe303a81640 1 -- 172.21.15.145:0/2915210098 learned_addr learned my addr 172.21.15.145:0/2915210098 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe303a81640 1 -- 172.21.15.145:0/2915210098 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8aa0098b0 con 0x55f8aa006ac0 2024-09-11T11:01:46.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe303a81640 1 --2- 172.21.15.145:0/2915210098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0092e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4017f50 tx=0x7fe2f4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2481a17ce3444f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe1f1e0b640 1 -- 172.21.15.145:0/2915210098 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40aa9c0 con 0x55f8aa006ac0 2024-09-11T11:01:46.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe1f1e0b640 1 -- 172.21.15.145:0/2915210098 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f40aab60 con 0x55f8aa006ac0 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe1f1e0b640 1 -- 172.21.15.145:0/2915210098 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40aae40 con 0x55f8aa006ac0 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 -- 172.21.15.145:0/2915210098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 msgr2=0x55f8aa0092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 --2- 172.21.15.145:0/2915210098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0092e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe2f4017f50 tx=0x7fe2f4003030 comp rx=0 tx=0).stop 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 -- 172.21.15.145:0/2915210098 shutdown_connections 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 --2- 172.21.15.145:0/2915210098 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0092e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 -- 172.21.15.145:0/2915210098 >> 172.21.15.145:0/2915210098 conn(0x55f8aa0027a0 msgr2=0x55f8aa0ef3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 -- 172.21.15.145:0/2915210098 shutdown_connections 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 -- 172.21.15.145:0/2915210098 wait complete. 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 Processor -- start 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 -- start start 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe305f71980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8aa00fdc0 con 0x55f8aa006ac0 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60618/0 (socket says 172.21.15.145:60618) 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe303a81640 1 -- 172.21.15.145:0/3837617452 learned_addr learned my addr 172.21.15.145:0/3837617452 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe303a81640 1 -- 172.21.15.145:0/3837617452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8aa0fd180 con 0x55f8aa006ac0 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.600+0000 7fe303a81640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0fcc40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe2f401b170 tx=0x7fe2f40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe1ebfff640 1 -- 172.21.15.145:0/3837617452 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40ca020 con 0x55f8aa006ac0 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe1ebfff640 1 -- 172.21.15.145:0/3837617452 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f40bd6a0 con 0x55f8aa006ac0 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe1ebfff640 1 -- 172.21.15.145:0/3837617452 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40bd9c0 con 0x55f8aa006ac0 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8aa0fd410 con 0x55f8aa006ac0 2024-09-11T11:01:46.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8aa1000f0 con 0x55f8aa006ac0 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe1ebfff640 1 -- 172.21.15.145:0/3837617452 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2f40cd020 con 0x55f8aa006ac0 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe1ebfff640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1ec0346a0 0x7fe1ec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe1ebfff640 1 -- 172.21.15.145:0/3837617452 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fe2f40e5070 con 0x55f8aa006ac0 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe303280640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1ec0346a0 0x7fe1ec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe305f71980 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa0073e0 0x55f8aa103d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1042c0 con 0x55f8aa0073e0 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe304282640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa0073e0 0x55f8aa103d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe303280640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1ec0346a0 0x7fe1ec036b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000f90 tx=0x7fe2f8006590 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe304282640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa0073e0 0x55f8aa103d40 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe304282640 1 -- 172.21.15.145:0/3837617452 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa0073e0 2024-09-11T11:01:46.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe305f71980 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa105050 0x55f8aa107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.604+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa107a70 con 0x55f8aa105050 2024-09-11T11:01:46.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe303a81640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa105050 0x55f8aa107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe303a81640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa105050 0x55f8aa107440 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe303a81640 1 -- 172.21.15.145:0/3837617452 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2f40c6440 con 0x55f8aa105050 2024-09-11T11:01:46.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa109320 con 0x55f8aa105050 2024-09-11T11:01:46.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe303a81640 1 -- 172.21.15.145:0/3837617452 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe2f40c6440 con 0x55f8aa105050 2024-09-11T11:01:46.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa108490 con 0x55f8aa105050 2024-09-11T11:01:46.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe303a81640 1 -- 172.21.15.145:0/3837617452 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2f40c6440 con 0x55f8aa105050 2024-09-11T11:01:46.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe305f71980 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8aa10a6d0 0x55f8aa10cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa10d000 con 0x55f8aa10a6d0 2024-09-11T11:01:46.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe303280640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8aa10a6d0 0x55f8aa10cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe303280640 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8aa10a6d0 0x55f8aa10cac0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.608+0000 7fe303280640 1 -- 172.21.15.145:0/3837617452 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa10a6d0 2024-09-11T11:01:46.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe305f71980 1 Processor -- start 2024-09-11T11:01:46.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe305f71980 1 -- start start 2024-09-11T11:01:46.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe305f71980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa11a9f0 0x55f8aa11ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe305f71980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8a9f0f800 con 0x55f8aa11a9f0 2024-09-11T11:01:46.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa11a9f0 0x55f8aa11ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa11a9f0 0x55f8aa11ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60626/0 (socket says 172.21.15.145:60626) 2024-09-11T11:01:46.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe303a81640 1 -- 172.21.15.145:0/2078944393 learned_addr learned my addr 172.21.15.145:0/2078944393 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe303a81640 1 -- 172.21.15.145:0/2078944393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8aa11b350 con 0x55f8aa11a9f0 2024-09-11T11:01:46.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe303a81640 1 --2- 172.21.15.145:0/2078944393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa11a9f0 0x55f8aa11ae10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40a6fd0 tx=0x7fe2f40e3430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe1e97fa640 1 -- 172.21.15.145:0/2078944393 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f4006590 con 0x55f8aa11a9f0 2024-09-11T11:01:46.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe1e97fa640 1 -- 172.21.15.145:0/2078944393 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f4006730 con 0x55f8aa11a9f0 2024-09-11T11:01:46.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe305f71980 1 -- 172.21.15.145:0/2078944393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8aa11b5e0 con 0x55f8aa11a9f0 2024-09-11T11:01:46.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe1e97fa640 1 -- 172.21.15.145:0/2078944393 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f4006a10 con 0x55f8aa11a9f0 2024-09-11T11:01:46.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe305f71980 1 -- 172.21.15.145:0/2078944393 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8aa11e260 con 0x55f8aa11a9f0 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe1e97fa640 1 -- 172.21.15.145:0/2078944393 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2f40e3580 con 0x55f8aa11a9f0 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe1e97fa640 1 --2- 172.21.15.145:0/2078944393 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1dc034650 0x7fe1dc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe1e97fa640 1 -- 172.21.15.145:0/2078944393 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fe2f40dd520 con 0x55f8aa11a9f0 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe303280640 1 --2- 172.21.15.145:0/2078944393 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1dc034650 0x7fe1dc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe305f71980 1 Processor -- start 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.612+0000 7fe305f71980 1 -- start start 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303280640 1 --2- 172.21.15.145:0/2078944393 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1dc034650 0x7fe1dc036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80062e0 tx=0x7fe2f800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa1276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8aa007a10 con 0x55f8aa127310 2024-09-11T11:01:46.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa1276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa1276f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60642/0 (socket says 172.21.15.145:60642) 2024-09-11T11:01:46.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 -- 172.21.15.145:0/686868930 learned_addr learned my addr 172.21.15.145:0/686868930 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 -- 172.21.15.145:0/686868930 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8aa127cc0 con 0x55f8aa127310 2024-09-11T11:01:46.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 --2- 172.21.15.145:0/686868930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa1276f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40edfd0 tx=0x7fe2f40c4e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30169158f2e7435a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe1e2ffd640 1 -- 172.21.15.145:0/686868930 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f4006bb0 con 0x55f8aa127310 2024-09-11T11:01:46.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe1e2ffd640 1 -- 172.21.15.145:0/686868930 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f40da7f0 con 0x55f8aa127310 2024-09-11T11:01:46.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe1e2ffd640 1 -- 172.21.15.145:0/686868930 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40dacd0 con 0x55f8aa127310 2024-09-11T11:01:46.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 -- 172.21.15.145:0/686868930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 msgr2=0x55f8aa1276f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 --2- 172.21.15.145:0/686868930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa1276f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40edfd0 tx=0x7fe2f40c4e20 comp rx=0 tx=0).stop 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 -- 172.21.15.145:0/686868930 shutdown_connections 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 --2- 172.21.15.145:0/686868930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa1276f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 -- 172.21.15.145:0/686868930 >> 172.21.15.145:0/686868930 conn(0x55f8aa1236f0 msgr2=0x55f8aa1217f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 -- 172.21.15.145:0/686868930 shutdown_connections 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 -- 172.21.15.145:0/686868930 wait complete. 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 Processor -- start 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 -- start start 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa12e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe305f71980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f8aa128160 con 0x55f8aa127310 2024-09-11T11:01:46.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa12e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa12e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60658/0 (socket says 172.21.15.145:60658) 2024-09-11T11:01:46.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 learned_addr learned my addr 172.21.15.145:0/1389845151 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.616+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8aa12e990 con 0x55f8aa127310 2024-09-11T11:01:46.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe303a81640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa12e450 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40da9c0 tx=0x7fe2f40dd220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe1e17fa640 1 -- 172.21.15.145:0/1389845151 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40da430 con 0x55f8aa127310 2024-09-11T11:01:46.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe1e17fa640 1 -- 172.21.15.145:0/1389845151 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2f40da5d0 con 0x55f8aa127310 2024-09-11T11:01:46.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8aa12e990 con 0x55f8aa127310 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe1e17fa640 1 -- 172.21.15.145:0/1389845151 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2f40e39e0 con 0x55f8aa127310 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8aa12e990 con 0x55f8aa127310 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe1e17fa640 1 -- 172.21.15.145:0/1389845151 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe2f40ce890 con 0x55f8aa127310 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe1e17fa640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1cc034600 0x7fe1cc036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe1e17fa640 1 -- 172.21.15.145:0/1389845151 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fe2f4114bc0 con 0x55f8aa127310 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe303280640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1cc034600 0x7fe1cc036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa139400 0x55f8aa13b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa13c010 con 0x55f8aa139400 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe304282640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa139400 0x55f8aa13b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe303280640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1cc034600 0x7fe1cc036ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55f8aa101230 tx=0x7fe2f8024000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe304282640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa139400 0x55f8aa13b8c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 20 realm 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa138830 con 0x55f8aa139400 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa13cad0 con 0x55f8aa139400 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa13d8b0 0x55f8aa13fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.620+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa140300 con 0x55f8aa13d8b0 2024-09-11T11:01:46.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303a81640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa13d8b0 0x55f8aa13fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303a81640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa13d8b0 0x55f8aa13fca0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe305f71980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa140ba0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe305f71980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe305f71980 20 searching for the correct realm 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8aa142910 0x55f8aa144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa142910 2024-09-11T11:01:46.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303280640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8aa142910 0x55f8aa144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303280640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8aa142910 0x55f8aa144d00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303a81640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe2f40cf020 0x7fe2f40e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x7fe2f40cf020 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe304282640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe2f40cf020 0x7fe2f40e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.624+0000 7fe304282640 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe2f40cf020 0x7fe2f40e63f0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa142910 2024-09-11T11:01:46.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x7fe2f40cf020 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x7fe2f40cf020 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.628+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa142910 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa142910 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa142910 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x7fe2f40cf020 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.632+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa139400 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x7fe2f40cf020 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa142910 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x7fe2f40cf020 2024-09-11T11:01:46.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa142910 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145310 con 0x55f8aa13d8b0 2024-09-11T11:01:46.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:46.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:46.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:46.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:46.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1414f0 con 0x55f8aa139400 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.636+0000 7fe305f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa141970 con 0x55f8aa13d8b0 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa141e10 con 0x7fe2f40cf020 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:46.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 zone default found 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 4 Realm: () 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 zonegroup default 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa145c20 con 0x7fe2f40cf020 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa147a30 con 0x55f8aa142910 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa147ec0 con 0x55f8aa142910 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 started sync module instance, tier type = 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.640+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa146e40 con 0x55f8aa13d8b0 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.644+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.644+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94526493717312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa146e40 con 0x55f8aa13d8b0 2024-09-11T11:01:46.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.644+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa148980 con 0x55f8aa139400 2024-09-11T11:01:46.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.644+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.644+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94526493721744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1488b0 con 0x55f8aa139400 2024-09-11T11:01:46.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.644+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1498a0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.644+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94526493717312] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.644+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94526493721744] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.648+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.648+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94526493724016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa149860 con 0x55f8aa13d8b0 2024-09-11T11:01:46.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.648+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14a140 con 0x7fe2f40cf020 2024-09-11T11:01:46.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.648+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.648+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94526493727888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa149860 con 0x7fe2f40cf020 2024-09-11T11:01:46.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.648+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14abe0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.648+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94526493724016] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.652+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94526493727888] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.652+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.652+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94526493728944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14aba0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.652+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14afd0 con 0x55f8aa142910 2024-09-11T11:01:46.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.652+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.652+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94526493725584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14b820 con 0x55f8aa142910 2024-09-11T11:01:46.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.652+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14c220 con 0x55f8aa142910 2024-09-11T11:01:46.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.652+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94526493728944] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94526493725584] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94526493730512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14c610 con 0x55f8aa142910 2024-09-11T11:01:46.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14cea0 con 0x7fe2f40cf020 2024-09-11T11:01:46.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94526493730512] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94526493736240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14d290 con 0x7fe2f40cf020 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 20 add_watcher() i=0 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 20 add_watcher() i=1 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 20 add_watcher() i=2 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 20 add_watcher() i=3 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 20 add_watcher() i=4 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 20 add_watcher() i=5 2024-09-11T11:01:46.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 20 add_watcher() i=6 2024-09-11T11:01:46.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94526493736240] v34'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 20 add_watcher() i=7 2024-09-11T11:01:46.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:46.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa150720 con 0x55f8aa139400 2024-09-11T11:01:46.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.656+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94526493739440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa14dc10 con 0x55f8aa139400 2024-09-11T11:01:46.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.660+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94526493739440] v34'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.660+0000 7fe1b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:46.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.660+0000 7fe305f71980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:46.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.660+0000 7fe305f71980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:46.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.660+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa150010 con 0x55f8aa13d8b0 2024-09-11T11:01:46.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.664+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.664+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1506c0 con 0x7fe2f40cf020 2024-09-11T11:01:46.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.664+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.664+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1506c0 con 0x55f8aa142910 2024-09-11T11:01:46.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.664+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.664+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa159940 con 0x55f8aa139400 2024-09-11T11:01:46.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.668+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'153 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.668+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa159eb0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.668+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'44 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.668+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa159eb0 con 0x55f8aa142910 2024-09-11T11:01:46.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.672+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'29 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.672+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15a360 con 0x55f8aa13d8b0 2024-09-11T11:01:46.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.672+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.672+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15a360 con 0x55f8aa139400 2024-09-11T11:01:46.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.676+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.676+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15a8d0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.676+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.676+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15a8d0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.680+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.680+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15a8d0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.680+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.680+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15a8d0 con 0x55f8aa142910 2024-09-11T11:01:46.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.684+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.684+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15ae40 con 0x55f8aa13d8b0 2024-09-11T11:01:46.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.684+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.684+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15ae40 con 0x55f8aa139400 2024-09-11T11:01:46.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.688+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'35 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.688+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa139400 2024-09-11T11:01:46.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.688+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.688+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa13d8b0 2024-09-11T11:01:46.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.692+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.692+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa13d8b0 2024-09-11T11:01:46.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.696+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.696+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa142910 2024-09-11T11:01:46.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.696+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.696+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa13d8b0 2024-09-11T11:01:46.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.700+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.700+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa139400 2024-09-11T11:01:46.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.704+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.704+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa13d8b0 2024-09-11T11:01:46.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.704+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.704+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa13d8b0 2024-09-11T11:01:46.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.708+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.708+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa142910 2024-09-11T11:01:46.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.708+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.708+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b220 con 0x55f8aa13d8b0 2024-09-11T11:01:46.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.712+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.712+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b2b0 con 0x55f8aa142910 2024-09-11T11:01:46.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.716+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.716+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b2b0 con 0x55f8aa142910 2024-09-11T11:01:46.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.716+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'30 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.716+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b2b0 con 0x55f8aa142910 2024-09-11T11:01:46.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.720+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.720+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b2d0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.720+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.720+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b2d0 con 0x55f8aa139400 2024-09-11T11:01:46.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.724+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.724+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b2d0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.728+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'40 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.728+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b2d0 con 0x55f8aa139400 2024-09-11T11:01:46.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.728+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'36 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.728+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa15b2d0 con 0x7fe2f40cf020 2024-09-11T11:01:46.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe1b8fe1640 20 reqs_thread_entry: start 2024-09-11T11:01:46.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe305f71980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:46.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe305f71980 20 Filter name: none 2024-09-11T11:01:46.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe1327fc640 20 reqs_thread_entry: start 2024-09-11T11:01:46.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.732+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x7fe2f40cf020 2024-09-11T11:01:46.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x7fe2f40cf020 2024-09-11T11:01:46.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x7fe2f40cf020 2024-09-11T11:01:46.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x7fe2f40cf020 2024-09-11T11:01:46.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.736+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa142910 2024-09-11T11:01:46.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa142910 2024-09-11T11:01:46.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.740+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa139400 2024-09-11T11:01:46.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa139400 2024-09-11T11:01:46.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.744+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.748+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.748+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.748+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 45 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.748+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.748+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 46 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.748+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.748+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 47 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.748+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.752+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 48 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.752+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.752+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 49 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.752+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.752+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 50 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.752+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa13d8b0 2024-09-11T11:01:46.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.752+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 51 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.752+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa176d80 con 0x55f8aa142910 2024-09-11T11:01:46.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 52 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 53 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 54 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.756+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv8 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv8 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 55 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 56 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.760+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.764+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 57 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.764+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.764+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.764+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.764+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 59 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.764+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.764+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 60 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.764+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 61 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 62 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 63 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.768+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc0083f0 con 0x55f8aa139400 2024-09-11T11:01:46.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 64 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 65 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 66 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 67 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.772+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.776+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 68 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.776+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.776+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 69 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.776+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.776+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.776+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.776+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.776+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.780+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.780+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.780+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 70 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.780+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.780+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 71 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.780+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.780+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 72 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.780+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 37 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 38 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 39 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 40 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 41 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 42 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 43 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 44 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa142910 2024-09-11T11:01:46.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 45 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.784+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.788+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 73 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.788+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.788+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 74 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.788+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.788+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 75 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.788+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc03f040 con 0x55f8aa139400 2024-09-11T11:01:46.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2fc03f040 con 0x55f8aa139400 2024-09-11T11:01:46.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc03f040 con 0x55f8aa139400 2024-09-11T11:01:46.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 76 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 77 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 78 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.792+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc03f040 con 0x55f8aa139400 2024-09-11T11:01:46.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2fc03f040 con 0x55f8aa139400 2024-09-11T11:01:46.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x55f8aa139400 2024-09-11T11:01:46.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc03f040 con 0x55f8aa139400 2024-09-11T11:01:46.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x7fe2f40cf020 2024-09-11T11:01:46.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe2fc03f040 con 0x7fe2f40cf020 2024-09-11T11:01:46.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x7fe2f40cf020 2024-09-11T11:01:46.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe2fc03f040 con 0x7fe2f40cf020 2024-09-11T11:01:46.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa158ac0 con 0x7fe2f40cf020 2024-09-11T11:01:46.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.796+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(189 gc.31 [call out=1701b] v0'0 uv24 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fe2fc03f040 con 0x7fe2f40cf020 2024-09-11T11:01:46.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.800+0000 7fe1b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:46.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.800+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94526493739440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x55f8aa139400 2024-09-11T11:01:46.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.800+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94526493739440] v34'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe2fc03f040 con 0x55f8aa139400 2024-09-11T11:01:46.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.800+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94526493717312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.804+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 79 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94526493717312] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.804+0000 7fe305f71980 20 remove_watcher() i=0 2024-09-11T11:01:46.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.804+0000 7fe305f71980 2 removed watcher, disabling cache 2024-09-11T11:01:46.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.804+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94526493721744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x55f8aa139400 2024-09-11T11:01:46.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.804+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.1 v2:172.21.15.145:6808/1879781812 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94526493721744] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc03f040 con 0x55f8aa139400 2024-09-11T11:01:46.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.804+0000 7fe305f71980 20 remove_watcher() i=1 2024-09-11T11:01:46.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.804+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94526493724016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.808+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 80 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94526493724016] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.808+0000 7fe305f71980 20 remove_watcher() i=2 2024-09-11T11:01:46.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.808+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94526493727888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x7fe2f40cf020 2024-09-11T11:01:46.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.808+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94526493727888] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc03f040 con 0x7fe2f40cf020 2024-09-11T11:01:46.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.808+0000 7fe305f71980 20 remove_watcher() i=3 2024-09-11T11:01:46.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.808+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94526493728944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x55f8aa13d8b0 2024-09-11T11:01:46.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.812+0000 7fe303a81640 1 -- 172.21.15.145:0/1389845151 <== osd.0 v2:172.21.15.102:6800/3035634142 81 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94526493728944] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f411c020 con 0x55f8aa13d8b0 2024-09-11T11:01:46.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.812+0000 7fe305f71980 20 remove_watcher() i=4 2024-09-11T11:01:46.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.812+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94526493725584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x55f8aa142910 2024-09-11T11:01:46.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.812+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94526493725584] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.812+0000 7fe305f71980 20 remove_watcher() i=5 2024-09-11T11:01:46.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.812+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94526493730512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x55f8aa142910 2024-09-11T11:01:46.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe303280640 1 -- 172.21.15.145:0/1389845151 <== osd.3 v2:172.21.15.145:6800/493661776 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94526493730512] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2f800f070 con 0x55f8aa142910 2024-09-11T11:01:46.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 20 remove_watcher() i=6 2024-09-11T11:01:46.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94526493736240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55f8aa1593b0 con 0x7fe2f40cf020 2024-09-11T11:01:46.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94526493736240] v34'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe2fc03f040 con 0x7fe2f40cf020 2024-09-11T11:01:46.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 20 remove_watcher() i=7 2024-09-11T11:01:46.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa13d8b0 msgr2=0x55f8aa13fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa13d8b0 0x55f8aa13fca0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa139400 msgr2=0x55f8aa13b8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa139400 0x55f8aa13b8c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe2f40cf020 msgr2=0x7fe2f40e63f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe2f40cf020 0x7fe2f40e63f0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8aa142910 msgr2=0x55f8aa144d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55f8aa142910 0x55f8aa144d00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1cc034600 msgr2=0x7fe1cc036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1cc034600 0x7fe1cc036ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x55f8aa101230 tx=0x7fe2f8024000 comp rx=0 tx=0).stop 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe304282640 1 -- 172.21.15.145:0/1389845151 reap_dead start 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 msgr2=0x55f8aa12e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa12e450 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40da9c0 tx=0x7fe2f40dd220 comp rx=0 tx=0).stop 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 shutdown_connections 2024-09-11T11:01:46.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 --2- 172.21.15.145:0/1389845151 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa127310 0x55f8aa12e450 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 >> 172.21.15.145:0/1389845151 conn(0x55f8aa1236f0 msgr2=0x55f8aa1217c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 shutdown_connections 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.816+0000 7fe305f71980 1 -- 172.21.15.145:0/1389845151 wait complete. 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/2078944393 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1dc034650 msgr2=0x7fe1dc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/2078944393 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1dc034650 0x7fe1dc036b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80062e0 tx=0x7fe2f800f000 comp rx=0 tx=0).stop 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/2078944393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa11a9f0 msgr2=0x55f8aa11ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/2078944393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa11a9f0 0x55f8aa11ae10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe2f40a6fd0 tx=0x7fe2f40e3430 comp rx=0 tx=0).stop 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/2078944393 shutdown_connections 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/2078944393 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1dc034650 0x7fe1dc036b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/2078944393 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa11a9f0 0x55f8aa11ae10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/2078944393 >> 172.21.15.145:0/2078944393 conn(0x55f8aa10fb40 msgr2=0x55f8aa1125c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/2078944393 shutdown_connections 2024-09-11T11:01:46.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/2078944393 wait complete. 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa105050 msgr2=0x55f8aa107440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f8aa105050 0x55f8aa107440 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa0073e0 msgr2=0x55f8aa103d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f8aa0073e0 0x55f8aa103d40 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8aa10a6d0 msgr2=0x55f8aa10cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f8aa10a6d0 0x55f8aa10cac0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1ec0346a0 msgr2=0x7fe1ec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe1ec0346a0 0x7fe1ec036b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000f90 tx=0x7fe2f8006590 comp rx=0 tx=0).stop 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 msgr2=0x55f8aa0fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 --2- 172.21.15.145:0/3837617452 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f8aa006ac0 0x55f8aa0fcc40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe2f401b170 tx=0x7fe2f40180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe304282640 1 -- 172.21.15.145:0/3837617452 reap_dead start 2024-09-11T11:01:46.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 shutdown_connections 2024-09-11T11:01:46.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 >> 172.21.15.145:0/3837617452 conn(0x55f8aa0027a0 msgr2=0x55f8aa007f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 shutdown_connections 2024-09-11T11:01:46.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.820+0000 7fe305f71980 1 -- 172.21.15.145:0/3837617452 wait complete. 2024-09-11T11:01:46.837 INFO:teuthology.orchestra.run.smithi145.stdout:[{"tag":"27698d38-fc40-410e-96d8-191ffc71147c.4235.8548611956100210878\u0000","time":"2024-09-11T11:01:46.534509+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_7","key":"","instance":""}]}] 2024-09-11T11:01:46.840 DEBUG:tasks.util.rgw: json result: [{'tag': '27698d38-fc40-410e-96d8-191ffc71147c.4235.8548611956100210878\x00', 'time': '2024-09-11T11:01:46.534509+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_7', 'key': '', 'instance': ''}]}] 2024-09-11T11:01:46.840 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-11T11:01:46.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-11T11:01:46.841 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-11T11:01:46.915 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:46.916 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:46.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.912+0000 7f09ff91d980 1 Processor -- start 2024-09-11T11:01:46.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.912+0000 7f09ff91d980 1 -- start start 2024-09-11T11:01:46.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09ff91d980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x563012093a00 0x563012095df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09ff91d980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563011f17ae0 con 0x56301208f680 2024-09-11T11:01:46.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09ff91d980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x563011f3be30 con 0x563012093a00 2024-09-11T11:01:46.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09f4c2c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x563012093a00 0x563012095df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09f4c2c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x563012093a00 0x563012095df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60660/0 (socket says 172.21.15.145:60660) 2024-09-11T11:01:46.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09f4c2c640 1 -- 172.21.15.145:0/1123405095 learned_addr learned my addr 172.21.15.145:0/1123405095 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09f4c2c640 1 -- 172.21.15.145:0/1123405095 >> v1:172.21.15.102:6789/0 conn(0x56301208f680 legacy=0x56301208fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09f4c2c640 1 -- 172.21.15.145:0/1123405095 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563012097340 con 0x563012093a00 2024-09-11T11:01:46.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09fcc2c640 1 -- 172.21.15.145:0/1123405095 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156066042 0 0) 0x563011f17ae0 con 0x56301208f680 2024-09-11T11:01:46.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/1123405095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563012093a00 0x563012095df0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f09e800a5c0 tx=0x7f09e801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92e3cae906e9743 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.916+0000 7f09fcc2c640 1 -- 172.21.15.145:0/1123405095 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e80a6070 con 0x563012093a00 2024-09-11T11:01:46.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09fcc2c640 1 -- 172.21.15.145:0/1123405095 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e80af070 con 0x563012093a00 2024-09-11T11:01:46.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09fcc2c640 1 -- 172.21.15.145:0/1123405095 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09e80aa5c0 con 0x563012093a00 2024-09-11T11:01:46.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09ff91d980 1 -- 172.21.15.145:0/1123405095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563012093a00 msgr2=0x563012095df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09ff91d980 1 --2- 172.21.15.145:0/1123405095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563012093a00 0x563012095df0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f09e800a5c0 tx=0x7f09e801b340 comp rx=0 tx=0).stop 2024-09-11T11:01:46.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09ff91d980 1 -- 172.21.15.145:0/1123405095 shutdown_connections 2024-09-11T11:01:46.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09ff91d980 1 --2- 172.21.15.145:0/1123405095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563012093a00 0x563012095df0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09ff91d980 1 -- 172.21.15.145:0/1123405095 >> 172.21.15.145:0/1123405095 conn(0x56301208b1a0 msgr2=0x56301208d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09ff91d980 1 -- 172.21.15.145:0/1123405095 shutdown_connections 2024-09-11T11:01:46.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.920+0000 7f09ff91d980 1 -- 172.21.15.145:0/1123405095 wait complete. 2024-09-11T11:01:46.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 Processor -- start 2024-09-11T11:01:46.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- start start 2024-09-11T11:01:46.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012006360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563011f3d200 con 0x56301208f680 2024-09-11T11:01:46.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012006360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012006360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60674/0 (socket says 172.21.15.145:60674) 2024-09-11T11:01:46.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09fd42d640 1 -- 172.21.15.145:0/396301792 learned_addr learned my addr 172.21.15.145:0/396301792 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09fd42d640 1 -- 172.21.15.145:0/396301792 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563012006930 con 0x56301208f680 2024-09-11T11:01:46.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09fd42d640 1 --2- 172.21.15.145:0/396301792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012006360 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f09f000b200 tx=0x7f09f000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305c6ec4c76788da server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f08eb606640 1 -- 172.21.15.145:0/396301792 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f0016070 con 0x56301208f680 2024-09-11T11:01:46.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f08eb606640 1 -- 172.21.15.145:0/396301792 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f000d5f0 con 0x56301208f680 2024-09-11T11:01:46.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f08eb606640 1 -- 172.21.15.145:0/396301792 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f000d950 con 0x56301208f680 2024-09-11T11:01:46.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- 172.21.15.145:0/396301792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 msgr2=0x563012006360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 --2- 172.21.15.145:0/396301792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012006360 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f09f000b200 tx=0x7f09f000b6c0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- 172.21.15.145:0/396301792 shutdown_connections 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 --2- 172.21.15.145:0/396301792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012006360 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- 172.21.15.145:0/396301792 >> 172.21.15.145:0/396301792 conn(0x56301208b1a0 msgr2=0x563012176420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- 172.21.15.145:0/396301792 shutdown_connections 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- 172.21.15.145:0/396301792 wait complete. 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 Processor -- start 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- start start 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012183de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.936+0000 7f09ff91d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563012096e40 con 0x56301208f680 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012183de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012183de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60678/0 (socket says 172.21.15.145:60678) 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09fd42d640 1 -- 172.21.15.145:0/3119439981 learned_addr learned my addr 172.21.15.145:0/3119439981 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09fd42d640 1 -- 172.21.15.145:0/3119439981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563012184320 con 0x56301208f680 2024-09-11T11:01:46.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09fd42d640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012183de0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f09f000c010 tx=0x7f09f0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f08e9e03640 1 -- 172.21.15.145:0/3119439981 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f0016070 con 0x56301208f680 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f08e9e03640 1 -- 172.21.15.145:0/3119439981 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f0023070 con 0x56301208f680 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630121845b0 con 0x56301208f680 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f08e9e03640 1 -- 172.21.15.145:0/3119439981 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f00012e0 con 0x56301208f680 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563012187290 con 0x56301208f680 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f08e9e03640 1 -- 172.21.15.145:0/3119439981 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f09f0011a40 con 0x56301208f680 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f08e9e03640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08e4034650 0x7f08e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f08e9e03640 1 -- 172.21.15.145:0/3119439981 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f09f0009030 con 0x56301208f680 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08e4034650 0x7f08e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563012093a00 0x56301218adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301218b420 con 0x563012093a00 2024-09-11T11:01:46.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09fdc2e640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563012093a00 0x56301218adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08e4034650 0x7f08e4036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09e80ae000 tx=0x7f09e80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09fdc2e640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563012093a00 0x56301218adb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09fdc2e640 1 -- 172.21.15.145:0/3119439981 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x563012093a00 2024-09-11T11:01:46.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56301218c210 0x56301218e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.940+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301218ec30 con 0x56301218c210 2024-09-11T11:01:46.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09fd42d640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56301218c210 0x56301218e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09fd42d640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56301218c210 0x56301218e600 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09fd42d640 1 -- 172.21.15.145:0/3119439981 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09f000f3b0 con 0x56301218c210 2024-09-11T11:01:46.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121904e0 con 0x56301218c210 2024-09-11T11:01:46.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09fd42d640 1 -- 172.21.15.145:0/3119439981 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f09f000f3b0 con 0x56301218c210 2024-09-11T11:01:46.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301218f650 con 0x56301218c210 2024-09-11T11:01:46.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09fd42d640 1 -- 172.21.15.145:0/3119439981 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09f000f3b0 con 0x56301218c210 2024-09-11T11:01:46.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563012191890 0x563012193c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121941c0 con 0x563012191890 2024-09-11T11:01:46.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563012191890 0x563012193c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563012191890 0x563012193c80 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.944+0000 7f09f4c2c640 1 -- 172.21.15.145:0/3119439981 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f09e80aa9e0 con 0x563012191890 2024-09-11T11:01:46.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 Processor -- start 2024-09-11T11:01:46.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 -- start start 2024-09-11T11:01:46.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121a1b70 0x5630121a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563011f96800 con 0x5630121a1b70 2024-09-11T11:01:46.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121a1b70 0x5630121a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121a1b70 0x5630121a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60692/0 (socket says 172.21.15.145:60692) 2024-09-11T11:01:46.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09fd42d640 1 -- 172.21.15.145:0/1764991414 learned_addr learned my addr 172.21.15.145:0/1764991414 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09fd42d640 1 -- 172.21.15.145:0/1764991414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630121a24d0 con 0x5630121a1b70 2024-09-11T11:01:46.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09fd42d640 1 --2- 172.21.15.145:0/1764991414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121a1b70 0x5630121a1f90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f09f001dfd0 tx=0x7f09f000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f08e2ffd640 1 -- 172.21.15.145:0/1764991414 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f0038070 con 0x5630121a1b70 2024-09-11T11:01:46.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 -- 172.21.15.145:0/1764991414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630121a2760 con 0x5630121a1b70 2024-09-11T11:01:46.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 -- 172.21.15.145:0/1764991414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630121a53e0 con 0x5630121a1b70 2024-09-11T11:01:46.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f08e2ffd640 1 -- 172.21.15.145:0/1764991414 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f0017040 con 0x5630121a1b70 2024-09-11T11:01:46.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f08e2ffd640 1 -- 172.21.15.145:0/1764991414 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f003b040 con 0x5630121a1b70 2024-09-11T11:01:46.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f08e2ffd640 1 -- 172.21.15.145:0/1764991414 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f09f0050020 con 0x5630121a1b70 2024-09-11T11:01:46.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f08e2ffd640 1 --2- 172.21.15.145:0/1764991414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08d4034650 0x7f08d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f08e2ffd640 1 -- 172.21.15.145:0/1764991414 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f09f000c040 con 0x5630121a1b70 2024-09-11T11:01:46.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/1764991414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08d4034650 0x7f08d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 Processor -- start 2024-09-11T11:01:46.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 -- start start 2024-09-11T11:01:46.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/1764991414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08d4034650 0x7f08d4036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5630121883d0 tx=0x7f09e8005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.948+0000 7f09ff91d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121aea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563012004b50 con 0x5630121ae650 2024-09-11T11:01:46.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121aea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60702/0 (socket says 172.21.15.145:60702) 2024-09-11T11:01:46.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 -- 172.21.15.145:0/3297947846 learned_addr learned my addr 172.21.15.145:0/3297947846 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 -- 172.21.15.145:0/3297947846 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630121af000 con 0x5630121ae650 2024-09-11T11:01:46.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 --2- 172.21.15.145:0/3297947846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121aea30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f09f000ef70 tx=0x7f09f0032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=599131503035d53e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f08e0ff9640 1 -- 172.21.15.145:0/3297947846 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f0062070 con 0x5630121ae650 2024-09-11T11:01:46.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f08e0ff9640 1 -- 172.21.15.145:0/3297947846 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f0044dd0 con 0x5630121ae650 2024-09-11T11:01:46.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f08e0ff9640 1 -- 172.21.15.145:0/3297947846 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f0027c40 con 0x5630121ae650 2024-09-11T11:01:46.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 -- 172.21.15.145:0/3297947846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 msgr2=0x5630121aea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:46.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3297947846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121aea30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f09f000ef70 tx=0x7f09f0032b20 comp rx=0 tx=0).stop 2024-09-11T11:01:46.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 -- 172.21.15.145:0/3297947846 shutdown_connections 2024-09-11T11:01:46.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3297947846 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121aea30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 -- 172.21.15.145:0/3297947846 >> 172.21.15.145:0/3297947846 conn(0x5630121aaa30 msgr2=0x5630121a8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 -- 172.21.15.145:0/3297947846 shutdown_connections 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 -- 172.21.15.145:0/3297947846 wait complete. 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 Processor -- start 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 -- start start 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121b5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09ff91d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5630121af4a0 con 0x5630121ae650 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121b5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121b5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60712/0 (socket says 172.21.15.145:60712) 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 learned_addr learned my addr 172.21.15.145:0/961186374 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630121b5d50 con 0x5630121ae650 2024-09-11T11:01:46.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.952+0000 7f09fd42d640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121b5810 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f09f0060040 tx=0x7f09f000feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f08d2ffd640 1 -- 172.21.15.145:0/961186374 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f006c070 con 0x5630121ae650 2024-09-11T11:01:46.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f08d2ffd640 1 -- 172.21.15.145:0/961186374 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f0041640 con 0x5630121ae650 2024-09-11T11:01:46.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630121b5d50 con 0x5630121ae650 2024-09-11T11:01:46.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f08d2ffd640 1 -- 172.21.15.145:0/961186374 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f09f0062040 con 0x5630121ae650 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630121b5d50 con 0x5630121ae650 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f08d2ffd640 1 -- 172.21.15.145:0/961186374 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f09f006f070 con 0x5630121ae650 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f08d2ffd640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08c8034600 0x7f08c8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f08d2ffd640 1 -- 172.21.15.145:0/961186374 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f09f0072c40 con 0x5630121ae650 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08c8034600 0x7f08c8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5630121c0990 0x5630121c2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121c35a0 con 0x5630121c0990 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09fdc2e640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5630121c0990 0x5630121c2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08c8034600 0x7f08c8036ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09e80c8fd0 tx=0x7f09e80c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09fdc2e640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5630121c0990 0x5630121c2e50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 20 realm 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121bfe10 con 0x5630121c0990 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121c4030 con 0x5630121c0990 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5630121c4e10 0x5630121c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121c7890 con 0x5630121c4e10 2024-09-11T11:01:46.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.956+0000 7f09fd42d640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5630121c4e10 0x5630121c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09fd42d640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5630121c4e10 0x5630121c7200 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09ff91d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:46.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121c80e0 con 0x5630121c4e10 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09ff91d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09ff91d980 20 searching for the correct realm 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5630121c9e50 0x5630121cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c9e50 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5630121c9e50 0x5630121cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09f4c2c640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5630121c9e50 0x5630121cc240 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09fd42d640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f09f0071070 0x7f09f005d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:46.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x7f09f0071070 2024-09-11T11:01:46.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09fdc2e640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f09f0071070 0x7f09f005d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:46.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.960+0000 7f09fdc2e640 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f09f0071070 0x7f09f005d460 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:46.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c9e50 2024-09-11T11:01:46.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x7f09f0071070 2024-09-11T11:01:46.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x7f09f0071070 2024-09-11T11:01:46.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.964+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c9e50 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c9e50 2024-09-11T11:01:46.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c9e50 2024-09-11T11:01:46.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.968+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x7f09f0071070 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c0990 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x7f09f0071070 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c9e50 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x7f09f0071070 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c9e50 2024-09-11T11:01:46.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.972+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5630121cc8c0 con 0x5630121c4e10 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121c8a30 con 0x5630121c0990 2024-09-11T11:01:46.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121c92d0 con 0x5630121c4e10 2024-09-11T11:01:46.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:46.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121c8670 con 0x7f09f0071070 2024-09-11T11:01:46.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:46.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 zone default found 2024-09-11T11:01:46.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 4 Realm: () 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 zonegroup default 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121c9270 con 0x7f09f0071070 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121cf0d0 con 0x5630121c9e50 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados->read ofs=0 len=0 2024-09-11T11:01:46.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121cf470 con 0x5630121c9e50 2024-09-11T11:01:46.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:46.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 started sync module instance, tier type = 2024-09-11T11:01:46.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:46.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.976+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ce510 con 0x5630121c4e10 2024-09-11T11:01:46.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.980+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.980+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94764462303792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ce510 con 0x5630121c4e10 2024-09-11T11:01:46.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.980+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121cfe30 con 0x5630121c0990 2024-09-11T11:01:46.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.980+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.980+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94764462307712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d0250 con 0x5630121c0990 2024-09-11T11:01:46.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.980+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d0d40 con 0x5630121c4e10 2024-09-11T11:01:46.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.980+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94764462303792] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.984+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94764462307712] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.984+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.984+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94764462311440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121cfda0 con 0x5630121c4e10 2024-09-11T11:01:46.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.984+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d15e0 con 0x7f09f0071070 2024-09-11T11:01:46.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.984+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.984+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94764462313776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121cfda0 con 0x7f09f0071070 2024-09-11T11:01:46.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.984+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d20b0 con 0x5630121c4e10 2024-09-11T11:01:46.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.984+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94764462311440] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94764462313776] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94764462314832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d2070 con 0x5630121c4e10 2024-09-11T11:01:46.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d24a0 con 0x5630121c9e50 2024-09-11T11:01:46.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94764462301280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d2d40 con 0x5630121c9e50 2024-09-11T11:01:46.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d3700 con 0x5630121c9e50 2024-09-11T11:01:46.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94764462314832] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:46.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94764462301280] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94764462322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d3af0 con 0x5630121c9e50 2024-09-11T11:01:46.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.988+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d4340 con 0x7f09f0071070 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94764462322256] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94764462325392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d42b0 con 0x7f09f0071070 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 20 add_watcher() i=0 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 20 add_watcher() i=1 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 20 add_watcher() i=2 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 20 add_watcher() i=3 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 20 add_watcher() i=4 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 20 add_watcher() i=5 2024-09-11T11:01:46.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 20 add_watcher() i=6 2024-09-11T11:01:46.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94764462325392] v34'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:46.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 20 add_watcher() i=7 2024-09-11T11:01:46.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:46.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121d7c10 con 0x5630121c0990 2024-09-11T11:01:46.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.992+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94764462327520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d5080 con 0x5630121c0990 2024-09-11T11:01:46.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.996+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94764462327520] v34'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:46.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.996+0000 7f08b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:46.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.996+0000 7f09ff91d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:46.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.996+0000 7f09ff91d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:46.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.996+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d78c0 con 0x5630121c4e10 2024-09-11T11:01:47.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.996+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:46.996+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d7980 con 0x7f09f0071070 2024-09-11T11:01:47.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.000+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.000+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e0ca0 con 0x5630121c9e50 2024-09-11T11:01:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.000+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.000+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e10c0 con 0x5630121c0990 2024-09-11T11:01:47.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.004+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'158 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.004+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e1630 con 0x5630121c4e10 2024-09-11T11:01:47.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.004+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'47 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.004+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e1630 con 0x5630121c9e50 2024-09-11T11:01:47.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.008+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'31 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.008+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e1a70 con 0x5630121c4e10 2024-09-11T11:01:47.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.008+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.008+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e1a70 con 0x5630121c0990 2024-09-11T11:01:47.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.012+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.012+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e1fe0 con 0x5630121c4e10 2024-09-11T11:01:47.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.016+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.016+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e1fe0 con 0x5630121c4e10 2024-09-11T11:01:47.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.016+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.016+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e1fe0 con 0x5630121c4e10 2024-09-11T11:01:47.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.020+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.020+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e1fe0 con 0x5630121c9e50 2024-09-11T11:01:47.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.020+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.020+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e2550 con 0x5630121c4e10 2024-09-11T11:01:47.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.024+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.024+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e2550 con 0x5630121c0990 2024-09-11T11:01:47.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.024+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'37 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.024+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e2a00 con 0x5630121c0990 2024-09-11T11:01:47.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.028+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.028+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e2a00 con 0x5630121c4e10 2024-09-11T11:01:47.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.028+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.028+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e2a00 con 0x5630121c4e10 2024-09-11T11:01:47.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.032+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.032+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e2a00 con 0x5630121c9e50 2024-09-11T11:01:47.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.036+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.036+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e02b0 con 0x5630121c4e10 2024-09-11T11:01:47.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.036+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.036+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e02b0 con 0x5630121c0990 2024-09-11T11:01:47.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.040+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.040+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e02b0 con 0x5630121c4e10 2024-09-11T11:01:47.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.044+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.044+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c4e10 2024-09-11T11:01:47.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.044+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.044+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c9e50 2024-09-11T11:01:47.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.048+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.048+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c4e10 2024-09-11T11:01:47.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.052+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.052+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c9e50 2024-09-11T11:01:47.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.052+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.052+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c9e50 2024-09-11T11:01:47.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.056+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'32 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.056+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c9e50 2024-09-11T11:01:47.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.056+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.056+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c4e10 2024-09-11T11:01:47.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.060+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.060+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c0990 2024-09-11T11:01:47.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.064+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.064+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c4e10 2024-09-11T11:01:47.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.064+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'43 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.064+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x5630121c0990 2024-09-11T11:01:47.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.068+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'38 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.068+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121e00e0 con 0x7f09f0071070 2024-09-11T11:01:47.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.072+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.072+0000 7f08b27e4640 20 reqs_thread_entry: start 2024-09-11T11:01:47.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.072+0000 7f09ff91d980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:47.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.072+0000 7f09ff91d980 20 Filter name: none 2024-09-11T11:01:47.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.072+0000 7f0823fff640 20 reqs_thread_entry: start 2024-09-11T11:01:47.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.072+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-11T11:01:47.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.072+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:94 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(94 gc.20 [call] v34'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(95 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:96 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(96 gc.20 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(97 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.076+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:98 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.080+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(98 gc.20 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.080+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.080+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.080+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(99 gc.20 [call] v34'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.080+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-11T11:01:47.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.080+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:100 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.084+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(100 gc.21 [call] v34'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.084+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.084+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(101 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.084+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.084+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:102 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.084+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(102 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.084+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:103 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.088+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(103 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.088+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.088+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:104 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.088+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(104 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.088+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.088+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:105 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 45 ==== osd_op_reply(105 gc.21 [call] v34'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-11T11:01:47.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:106 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(106 gc.22 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:107 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(107 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:108 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(108 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:109 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(109 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.092+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.096+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:110 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.096+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(110 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.096+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.096+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:111 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.096+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(111 gc.22 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.096+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-11T11:01:47.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.096+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:112 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.100+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 46 ==== osd_op_reply(112 gc.23 [call] v34'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.100+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:113 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.100+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 47 ==== osd_op_reply(113 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.100+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.100+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:114 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.100+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 48 ==== osd_op_reply(114 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.100+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:115 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 49 ==== osd_op_reply(115 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:116 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 50 ==== osd_op_reply(116 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:117 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 51 ==== osd_op_reply(117 gc.23 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-11T11:01:47.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.104+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:118 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(118 gc.24 [call] v34'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:119 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(119 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:120 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== osd_op_reply(120 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:121 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(121 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:122 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(122 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.108+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:123 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.112+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== osd_op_reply(123 gc.24 [call] v34'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.112+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-11T11:01:47.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.112+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:124 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.112+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== osd_op_reply(124 gc.25 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:125 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== osd_op_reply(125 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:126 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== osd_op_reply(126 gc.25 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:127 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 37 ==== osd_op_reply(127 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:128 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 38 ==== osd_op_reply(128 gc.25 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:129 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 39 ==== osd_op_reply(129 gc.25 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-11T11:01:47.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.116+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:130 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.120+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 40 ==== osd_op_reply(130 gc.26 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.120+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:131 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.120+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 41 ==== osd_op_reply(131 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.120+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.120+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:132 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 42 ==== osd_op_reply(132 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:133 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 43 ==== osd_op_reply(133 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:134 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 44 ==== osd_op_reply(134 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:135 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c9e50 2024-09-11T11:01:47.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 45 ==== osd_op_reply(135 gc.26 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-11T11:01:47.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.124+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:136 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.128+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 52 ==== osd_op_reply(136 gc.27 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.128+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:137 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 53 ==== osd_op_reply(137 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:138 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 54 ==== osd_op_reply(138 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:139 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 55 ==== osd_op_reply(139 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:140 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 56 ==== osd_op_reply(140 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.132+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:141 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.136+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 57 ==== osd_op_reply(141 gc.27 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.136+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-11T11:01:47.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.136+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:142 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(142 gc.28 [call] v34'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:143 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(143 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:144 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(144 gc.28 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:145 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(145 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:146 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(146 gc.28 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.140+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:147 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.144+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(147 gc.28 [call] v34'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.144+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-11T11:01:47.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.144+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:148 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 58 ==== osd_op_reply(148 gc.29 [call] v34'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.149 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:149 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 59 ==== osd_op_reply(149 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:150 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 60 ==== osd_op_reply(150 gc.29 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:151 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 61 ==== osd_op_reply(151 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:152 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 62 ==== osd_op_reply(152 gc.29 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.148+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:153 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c4e10 2024-09-11T11:01:47.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.152+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 63 ==== osd_op_reply(153 gc.29 [call] v34'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.152+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-11T11:01:47.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.152+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:154 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.152+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 32 ==== osd_op_reply(154 gc.30 [call] v34'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.152+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:155 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 33 ==== osd_op_reply(155 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:156 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 34 ==== osd_op_reply(156 gc.30 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:157 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 35 ==== osd_op_reply(157 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:158 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 36 ==== osd_op_reply(158 gc.30 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.156+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:159 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x5630121c0990 2024-09-11T11:01:47.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 37 ==== osd_op_reply(159 gc.30 [call] v34'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-11T11:01:47.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:160 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x7f09f0071070 2024-09-11T11:01:47.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(160 gc.31 [call] v34'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:161 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x7f09f0071070 2024-09-11T11:01:47.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(161 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:162 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x7f09f0071070 2024-09-11T11:01:47.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(162 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:163 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x7f09f0071070 2024-09-11T11:01:47.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(163 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:164 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121dfec0 con 0x7f09f0071070 2024-09-11T11:01:47.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(164 gc.31 [call out=1701b] v0'0 uv27 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-11T11:01:47.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 20 garbage collection: RGWGC::process iterating over entry tag='27698d38-fc40-410e-96d8-191ffc71147c.4235.8548611956100210878', time=2024-09-11T11:01:46.534509+0000, chain.objs.size()=7 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_1 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:165 3.15 3:a9eec516:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ff7f0 con 0x7f09f0071070 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_2 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:166 3.2f 3:f74ac6fd:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630122020c0 con 0x5630121c9e50 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_3 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:167 3.21 3:8782d964:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630122049e0 con 0x7f09f0071070 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_4 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:168 3.3b 3:df872f2c:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630122074a0 con 0x5630121c4e10 2024-09-11T11:01:47.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.160+0000 7f09ff91d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_5 2024-09-11T11:01:47.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.164+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:169 3.19 3:9ba16099:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630122049e0 con 0x5630121c0990 2024-09-11T11:01:47.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.164+0000 7f09ff91d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_6 2024-09-11T11:01:47.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.164+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:170 3.12 3:4a6cd9c0:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220c4a0 con 0x7f09f0071070 2024-09-11T11:01:47.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.164+0000 7f09ff91d980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_7 2024-09-11T11:01:47.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.164+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:171 3.36 3:6d409a40:::27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220edb0 con 0x7f09f0071070 2024-09-11T11:01:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.168+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(167 27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_3 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.168+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(171 27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_7 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.168+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(165 27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_1 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.168+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 46 ==== osd_op_reply(166 27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_2 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.168+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 23 ==== osd_op_reply(170 27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_6 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.168+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 38 ==== osd_op_reply(169 27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_5 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.172+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 64 ==== osd_op_reply(168 27698d38-fc40-410e-96d8-191ffc71147c.4235.1__shadow_.9nlV62W9mM-bo4O7BNEjaOcId5T1G9n_4 [call] v34'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.172+0000 7f09ff91d980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-11T11:01:47.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.172+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:172 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x7f09f0071070 2024-09-11T11:01:47.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.172+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 24 ==== osd_op_reply(172 gc.31 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.172+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:173 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x7f09f0071070 2024-09-11T11:01:47.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.176+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 25 ==== osd_op_reply(173 gc.31 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.176+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-11T11:01:47.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.176+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:174 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x5630121c4e10 2024-09-11T11:01:47.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.176+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 65 ==== osd_op_reply(174 gc.0 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.176+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:175 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x5630121c4e10 2024-09-11T11:01:47.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 66 ==== osd_op_reply(175 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:176 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x5630121c4e10 2024-09-11T11:01:47.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 67 ==== osd_op_reply(176 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:177 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x5630121c4e10 2024-09-11T11:01:47.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 68 ==== osd_op_reply(177 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:178 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x5630121c4e10 2024-09-11T11:01:47.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 69 ==== osd_op_reply(178 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.180+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:179 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x5630121c4e10 2024-09-11T11:01:47.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.184+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 70 ==== osd_op_reply(179 gc.0 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.184+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-11T11:01:47.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.184+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:180 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x7f09f0071070 2024-09-11T11:01:47.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.184+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 26 ==== osd_op_reply(180 gc.1 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.184+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:181 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x7f09f0071070 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 27 ==== osd_op_reply(181 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:182 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x7f09f0071070 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 28 ==== osd_op_reply(182 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:183 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x7f09f0071070 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 29 ==== osd_op_reply(183 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:184 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x7f09f0071070 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 30 ==== osd_op_reply(184 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:185 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x7f09f0071070 2024-09-11T11:01:47.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 31 ==== osd_op_reply(185 gc.1 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-11T11:01:47.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.188+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:186 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x5630121c9e50 2024-09-11T11:01:47.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 47 ==== osd_op_reply(186 gc.2 [call] v34'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:187 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56301220c400 con 0x5630121c9e50 2024-09-11T11:01:47.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 48 ==== osd_op_reply(187 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:188 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c9e50 2024-09-11T11:01:47.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 49 ==== osd_op_reply(188 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:189 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffaa0 con 0x5630121c9e50 2024-09-11T11:01:47.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 50 ==== osd_op_reply(189 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:190 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffaa0 con 0x5630121c9e50 2024-09-11T11:01:47.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 51 ==== osd_op_reply(190 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.192+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:191 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffaa0 con 0x5630121c9e50 2024-09-11T11:01:47.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.196+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 52 ==== osd_op_reply(191 gc.2 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.196+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-11T11:01:47.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.196+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:192 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffaa0 con 0x5630121c0990 2024-09-11T11:01:47.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 39 ==== osd_op_reply(192 gc.3 [call] v34'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:193 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffaa0 con 0x5630121c0990 2024-09-11T11:01:47.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 40 ==== osd_op_reply(193 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:194 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 41 ==== osd_op_reply(194 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:195 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 42 ==== osd_op_reply(195 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.200+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:196 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.204+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 43 ==== osd_op_reply(196 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.204+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.204+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:197 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.204+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 44 ==== osd_op_reply(197 gc.3 [call] v34'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.204+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-11T11:01:47.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.204+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:198 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.208+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 71 ==== osd_op_reply(198 gc.4 [call] v34'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.208+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:199 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.208+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 72 ==== osd_op_reply(199 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.208+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.208+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:200 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.212+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 73 ==== osd_op_reply(200 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.212+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:201 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.212+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 74 ==== osd_op_reply(201 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.212+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.212+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:202 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.212+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 75 ==== osd_op_reply(202 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.212+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.212+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:203 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.216+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 76 ==== osd_op_reply(203 gc.4 [call] v34'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.216+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-11T11:01:47.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.216+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:204 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 53 ==== osd_op_reply(204 gc.5 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:205 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 54 ==== osd_op_reply(205 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:206 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 55 ==== osd_op_reply(206 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:207 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 56 ==== osd_op_reply(207 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:208 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 57 ==== osd_op_reply(208 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.220+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:209 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.224+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 58 ==== osd_op_reply(209 gc.5 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.224+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-11T11:01:47.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.224+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:210 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.224+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 77 ==== osd_op_reply(210 gc.6 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.224+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:211 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.224+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 78 ==== osd_op_reply(211 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.224+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.224+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:212 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c4e10 2024-09-11T11:01:47.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.228+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 79 ==== osd_op_reply(212 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.228+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:213 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c4e10 2024-09-11T11:01:47.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.228+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 80 ==== osd_op_reply(213 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.228+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.228+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:214 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c4e10 2024-09-11T11:01:47.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.228+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 81 ==== osd_op_reply(214 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.228+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.228+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:215 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.232+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 82 ==== osd_op_reply(215 gc.6 [call] v34'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.232+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-11T11:01:47.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.232+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:216 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 45 ==== osd_op_reply(216 gc.7 [call] v34'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:217 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 46 ==== osd_op_reply(217 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:218 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 47 ==== osd_op_reply(218 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:219 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 48 ==== osd_op_reply(219 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:220 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 49 ==== osd_op_reply(220 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:221 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.236+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 50 ==== osd_op_reply(221 gc.7 [call] v34'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.240+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-11T11:01:47.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.240+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:222 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.240+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 83 ==== osd_op_reply(222 gc.8 [call] v34'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.240+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:223 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.240+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 84 ==== osd_op_reply(223 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.240+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.240+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:224 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c4e10 2024-09-11T11:01:47.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.244+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 85 ==== osd_op_reply(224 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.244+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:225 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c4e10 2024-09-11T11:01:47.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.244+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 86 ==== osd_op_reply(225 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.244+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.244+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:226 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c4e10 2024-09-11T11:01:47.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.244+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 87 ==== osd_op_reply(226 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.244+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.244+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:227 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c4e10 2024-09-11T11:01:47.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.248+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 88 ==== osd_op_reply(227 gc.8 [call] v34'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.248+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-11T11:01:47.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.248+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:228 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121fe7e0 con 0x5630121c4e10 2024-09-11T11:01:47.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 89 ==== osd_op_reply(228 gc.9 [call] v34'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:229 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 90 ==== osd_op_reply(229 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:230 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 91 ==== osd_op_reply(230 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:231 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 92 ==== osd_op_reply(231 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.252+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:232 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.256+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 93 ==== osd_op_reply(232 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.256+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.256+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:233 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.256+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 94 ==== osd_op_reply(233 gc.9 [call] v34'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.256+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-11T11:01:47.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.256+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:234 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.260+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 95 ==== osd_op_reply(234 gc.10 [call] v34'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.260+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:235 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.260+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 96 ==== osd_op_reply(235 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.260+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.260+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:236 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.264+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 97 ==== osd_op_reply(236 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.264+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:237 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.264+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 98 ==== osd_op_reply(237 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.264+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.264+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:238 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.264+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 99 ==== osd_op_reply(238 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.264+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.264+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:239 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.268+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 100 ==== osd_op_reply(239 gc.10 [call] v34'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.268+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-11T11:01:47.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.268+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:240 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 59 ==== osd_op_reply(240 gc.11 [call] v34'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:241 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 60 ==== osd_op_reply(241 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:242 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 61 ==== osd_op_reply(242 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:243 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 62 ==== osd_op_reply(243 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:244 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 63 ==== osd_op_reply(244 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.272+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:245 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.276+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 64 ==== osd_op_reply(245 gc.11 [call] v34'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.276+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-11T11:01:47.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.276+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:246 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 101 ==== osd_op_reply(246 gc.12 [call] v34'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:247 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 102 ==== osd_op_reply(247 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:248 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 103 ==== osd_op_reply(248 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:249 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 104 ==== osd_op_reply(249 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.280+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:250 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.284+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 105 ==== osd_op_reply(250 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.284+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.284+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:251 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.288+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 106 ==== osd_op_reply(251 gc.12 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.288+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-11T11:01:47.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.288+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:252 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.288+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 51 ==== osd_op_reply(252 gc.13 [call] v34'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.288+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:253 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.288+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 52 ==== osd_op_reply(253 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.288+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.288+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:254 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.292+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 53 ==== osd_op_reply(254 gc.13 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.292+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:255 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.292+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 54 ==== osd_op_reply(255 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.292+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.292+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:256 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.292+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 55 ==== osd_op_reply(256 gc.13 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.292+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.292+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:257 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.296+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 56 ==== osd_op_reply(257 gc.13 [call] v34'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.296+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-11T11:01:47.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.296+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:258 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.296+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 57 ==== osd_op_reply(258 gc.14 [call] v34'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.296+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:259 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 58 ==== osd_op_reply(259 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:260 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 59 ==== osd_op_reply(260 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:261 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 60 ==== osd_op_reply(261 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:262 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 61 ==== osd_op_reply(262 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.300+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:263 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.304+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 62 ==== osd_op_reply(263 gc.14 [call] v34'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.304+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-11T11:01:47.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.304+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:264 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 107 ==== osd_op_reply(264 gc.15 [call] v34'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:265 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 108 ==== osd_op_reply(265 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:266 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 109 ==== osd_op_reply(266 gc.15 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.311 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:267 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 110 ==== osd_op_reply(267 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.308+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:268 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.312+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 111 ==== osd_op_reply(268 gc.15 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.312+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.312+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:269 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.312+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 112 ==== osd_op_reply(269 gc.15 [call] v34'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.312+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-11T11:01:47.317 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.312+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:270 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.316+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 113 ==== osd_op_reply(270 gc.16 [call] v34'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.316+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:271 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 114 ==== osd_op_reply(271 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:272 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 115 ==== osd_op_reply(272 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:273 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 116 ==== osd_op_reply(273 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:274 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 117 ==== osd_op_reply(274 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.320+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:275 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.324+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 118 ==== osd_op_reply(275 gc.16 [call] v34'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.324+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-11T11:01:47.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.324+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:276 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 65 ==== osd_op_reply(276 gc.17 [call] v34'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:277 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 66 ==== osd_op_reply(277 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:278 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 67 ==== osd_op_reply(278 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:279 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 68 ==== osd_op_reply(279 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.328+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:280 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.332+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 69 ==== osd_op_reply(280 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.332+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.332+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:281 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c9e50 2024-09-11T11:01:47.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.332+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 70 ==== osd_op_reply(281 gc.17 [call] v34'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.332+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-11T11:01:47.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.332+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:282 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.336+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 119 ==== osd_op_reply(282 gc.18 [call] v34'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.336+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:283 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.336+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 120 ==== osd_op_reply(283 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.336+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.336+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:284 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.340+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 121 ==== osd_op_reply(284 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.340+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:285 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.340+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 122 ==== osd_op_reply(285 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.340+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.340+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:286 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.340+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 123 ==== osd_op_reply(286 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.340+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.343 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.340+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:287 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c4e10 2024-09-11T11:01:47.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.344+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 124 ==== osd_op_reply(287 gc.18 [call] v34'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.344+0000 7f09ff91d980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-11T11:01:47.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.344+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:288 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.344+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 63 ==== osd_op_reply(288 gc.19 [call] v34'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.344+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:289 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 64 ==== osd_op_reply(289 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:290 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 65 ==== osd_op_reply(290 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:291 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 66 ==== osd_op_reply(291 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:01:47.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:292 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 67 ==== osd_op_reply(292 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09ff91d980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:01:47.351 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.348+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:293 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121ffa40 con 0x5630121c0990 2024-09-11T11:01:47.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.352+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 68 ==== osd_op_reply(293 gc.19 [call] v34'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.352+0000 7f08b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:47.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.352+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94764462327520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121db300 con 0x5630121c0990 2024-09-11T11:01:47.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.356+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 69 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94764462327520] v34'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.356+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94764462303792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d46e0 con 0x5630121c4e10 2024-09-11T11:01:47.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.360+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 125 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94764462303792] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.360+0000 7f09ff91d980 20 remove_watcher() i=0 2024-09-11T11:01:47.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.360+0000 7f09ff91d980 2 removed watcher, disabling cache 2024-09-11T11:01:47.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.360+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94764462307712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d46e0 con 0x5630121c0990 2024-09-11T11:01:47.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.360+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.1 v2:172.21.15.145:6808/1879781812 70 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94764462307712] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x5630121c0990 2024-09-11T11:01:47.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.360+0000 7f09ff91d980 20 remove_watcher() i=1 2024-09-11T11:01:47.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.360+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94764462311440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121cf980 con 0x5630121c4e10 2024-09-11T11:01:47.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.364+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 126 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94764462311440] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.364+0000 7f09ff91d980 20 remove_watcher() i=2 2024-09-11T11:01:47.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.364+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94764462313776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d46e0 con 0x7f09f0071070 2024-09-11T11:01:47.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.364+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 32 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94764462313776] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.364+0000 7f09ff91d980 20 remove_watcher() i=3 2024-09-11T11:01:47.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.364+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94764462314832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d0810 con 0x5630121c4e10 2024-09-11T11:01:47.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.368+0000 7f09fd42d640 1 -- 172.21.15.145:0/961186374 <== osd.0 v2:172.21.15.102:6800/3035634142 127 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94764462314832] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f0078070 con 0x5630121c4e10 2024-09-11T11:01:47.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.368+0000 7f09ff91d980 20 remove_watcher() i=4 2024-09-11T11:01:47.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.368+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94764462301280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121cf980 con 0x5630121c9e50 2024-09-11T11:01:47.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.368+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 71 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94764462301280] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.368+0000 7f09ff91d980 20 remove_watcher() i=5 2024-09-11T11:01:47.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.368+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94764462322256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d46e0 con 0x5630121c9e50 2024-09-11T11:01:47.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09f4c2c640 1 -- 172.21.15.145:0/961186374 <== osd.3 v2:172.21.15.145:6800/493661776 72 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94764462322256] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09e80df040 con 0x5630121c9e50 2024-09-11T11:01:47.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 20 remove_watcher() i=6 2024-09-11T11:01:47.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94764462325392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5630121d0810 con 0x7f09f0071070 2024-09-11T11:01:47.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 <== osd.2 v2:172.21.15.145:6816/446921044 33 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94764462325392] v34'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09f800a4d0 con 0x7f09f0071070 2024-09-11T11:01:47.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 20 remove_watcher() i=7 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5630121c4e10 msgr2=0x5630121c7200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5630121c4e10 0x5630121c7200 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5630121c0990 msgr2=0x5630121c2e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5630121c0990 0x5630121c2e50 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f09f0071070 msgr2=0x7f09f005d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f09f0071070 0x7f09f005d460 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5630121c9e50 msgr2=0x5630121cc240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5630121c9e50 0x5630121cc240 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08c8034600 msgr2=0x7f08c8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08c8034600 0x7f08c8036ac0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09e80c8fd0 tx=0x7f09e80c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 msgr2=0x5630121b5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09fdc2e640 1 -- 172.21.15.145:0/961186374 reap_dead start 2024-09-11T11:01:47.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.372+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121b5810 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f09f0060040 tx=0x7f09f000feb0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 shutdown_connections 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/961186374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121ae650 0x5630121b5810 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 >> 172.21.15.145:0/961186374 conn(0x5630121aaa30 msgr2=0x5630121a8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 shutdown_connections 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/961186374 wait complete. 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/1764991414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08d4034650 msgr2=0x7f08d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/1764991414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08d4034650 0x7f08d4036b10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x5630121883d0 tx=0x7f09e8005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/1764991414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121a1b70 msgr2=0x5630121a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/1764991414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121a1b70 0x5630121a1f90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f09f001dfd0 tx=0x7f09f000ed60 comp rx=0 tx=0).stop 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/1764991414 shutdown_connections 2024-09-11T11:01:47.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/1764991414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08d4034650 0x7f08d4036b10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/1764991414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5630121a1b70 0x5630121a1f90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/1764991414 >> 172.21.15.145:0/1764991414 conn(0x563012196cc0 msgr2=0x563012199740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/1764991414 shutdown_connections 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/1764991414 wait complete. 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56301218c210 msgr2=0x56301218e600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56301218c210 0x56301218e600 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563012093a00 msgr2=0x56301218adb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563012093a00 0x56301218adb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563012191890 msgr2=0x563012193c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563012191890 0x563012193c80 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08e4034650 msgr2=0x7f08e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f08e4034650 0x7f08e4036b10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09e80ae000 tx=0x7f09e80a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:47.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 msgr2=0x563012183de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 --2- 172.21.15.145:0/3119439981 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56301208f680 0x563012183de0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f09f000c010 tx=0x7f09f0000ee0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09fdc2e640 1 -- 172.21.15.145:0/3119439981 reap_dead start 2024-09-11T11:01:47.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 shutdown_connections 2024-09-11T11:01:47.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 >> 172.21.15.145:0/3119439981 conn(0x56301208b1a0 msgr2=0x563012176060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 shutdown_connections 2024-09-11T11:01:47.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.376+0000 7f09ff91d980 1 -- 172.21.15.145:0/3119439981 wait complete. 2024-09-11T11:01:47.394 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-11T11:01:47.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-11T11:01:47.394 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-11T11:01:47.472 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:47.473 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:47.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581ed53980 1 Processor -- start 2024-09-11T11:01:47.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581ed53980 1 -- start start 2024-09-11T11:01:47.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581ed53980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56098efebac0 0x56098efedeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581ed53980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56098ee75ae0 con 0x56098efee3f0 2024-09-11T11:01:47.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581ed53980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x56098ee99e30 con 0x56098efebac0 2024-09-11T11:01:47.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581c863640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56098efebac0 0x56098efedeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581c863640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56098efebac0 0x56098efedeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60720/0 (socket says 172.21.15.145:60720) 2024-09-11T11:01:47.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581c863640 1 -- 172.21.15.145:0/1584694291 learned_addr learned my addr 172.21.15.145:0/1584694291 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581c062640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x56098efee3f0 0x56098eff0810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:60904/0 (socket says 172.21.15.145:60904) 2024-09-11T11:01:47.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581c863640 1 -- 172.21.15.145:0/1584694291 >> v1:172.21.15.102:6789/0 conn(0x56098efee3f0 legacy=0x56098eff0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.472+0000 7f581c863640 1 -- 172.21.15.145:0/1584694291 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56098eff1ff0 con 0x56098efebac0 2024-09-11T11:01:47.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581c863640 1 --2- 172.21.15.145:0/1584694291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098efedeb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f580c00a4e0 tx=0x7f580c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e6567ddcd88819 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581b861640 1 -- 172.21.15.145:0/1584694291 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0aa540 con 0x56098efebac0 2024-09-11T11:01:47.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581b861640 1 -- 172.21.15.145:0/1584694291 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c0aa6e0 con 0x56098efebac0 2024-09-11T11:01:47.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581b861640 1 -- 172.21.15.145:0/1584694291 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0aaa40 con 0x56098efebac0 2024-09-11T11:01:47.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581ed53980 1 -- 172.21.15.145:0/1584694291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 msgr2=0x56098efedeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581ed53980 1 --2- 172.21.15.145:0/1584694291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098efedeb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f580c00a4e0 tx=0x7f580c01b090 comp rx=0 tx=0).stop 2024-09-11T11:01:47.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581ed53980 1 -- 172.21.15.145:0/1584694291 shutdown_connections 2024-09-11T11:01:47.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581ed53980 1 --2- 172.21.15.145:0/1584694291 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098efedeb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581ed53980 1 -- 172.21.15.145:0/1584694291 >> 172.21.15.145:0/1584694291 conn(0x56098efe77a0 msgr2=0x56098efe9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581ed53980 1 -- 172.21.15.145:0/1584694291 shutdown_connections 2024-09-11T11:01:47.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.476+0000 7f581ed53980 1 -- 172.21.15.145:0/1584694291 wait complete. 2024-09-11T11:01:47.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581ed53980 1 Processor -- start 2024-09-11T11:01:47.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581ed53980 1 -- start start 2024-09-11T11:01:47.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581ed53980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0deff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581ed53980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56098ee9b200 con 0x56098efebac0 2024-09-11T11:01:47.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0deff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0deff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60726/0 (socket says 172.21.15.145:60726) 2024-09-11T11:01:47.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581c863640 1 -- 172.21.15.145:0/1092673086 learned_addr learned my addr 172.21.15.145:0/1092673086 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581c863640 1 -- 172.21.15.145:0/1092673086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56098f0df5c0 con 0x56098efebac0 2024-09-11T11:01:47.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f581c863640 1 --2- 172.21.15.145:0/1092673086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0deff0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f580c017ca0 tx=0x7f580c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c36dbe15a64bec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f570ae0d640 1 -- 172.21.15.145:0/1092673086 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0b9030 con 0x56098efebac0 2024-09-11T11:01:47.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f570ae0d640 1 -- 172.21.15.145:0/1092673086 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c0aaac0 con 0x56098efebac0 2024-09-11T11:01:47.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.492+0000 7f570ae0d640 1 -- 172.21.15.145:0/1092673086 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0aada0 con 0x56098efebac0 2024-09-11T11:01:47.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- 172.21.15.145:0/1092673086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 msgr2=0x56098f0deff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 --2- 172.21.15.145:0/1092673086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0deff0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f580c017ca0 tx=0x7f580c0033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- 172.21.15.145:0/1092673086 shutdown_connections 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 --2- 172.21.15.145:0/1092673086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0deff0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- 172.21.15.145:0/1092673086 >> 172.21.15.145:0/1092673086 conn(0x56098efe77a0 msgr2=0x56098f0dac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- 172.21.15.145:0/1092673086 shutdown_connections 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- 172.21.15.145:0/1092673086 wait complete. 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 Processor -- start 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- start start 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56098eff2d90 con 0x56098efebac0 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0e62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60736/0 (socket says 172.21.15.145:60736) 2024-09-11T11:01:47.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581c863640 1 -- 172.21.15.145:0/3628518524 learned_addr learned my addr 172.21.15.145:0/3628518524 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581c863640 1 -- 172.21.15.145:0/3628518524 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56098f0e67e0 con 0x56098efebac0 2024-09-11T11:01:47.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581c863640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0e62a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f580c005cc0 tx=0x7f580c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f570960a640 1 -- 172.21.15.145:0/3628518524 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0b9030 con 0x56098efebac0 2024-09-11T11:01:47.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56098f0e6a70 con 0x56098efebac0 2024-09-11T11:01:47.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f570960a640 1 -- 172.21.15.145:0/3628518524 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c0c3070 con 0x56098efebac0 2024-09-11T11:01:47.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f570960a640 1 -- 172.21.15.145:0/3628518524 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0bf750 con 0x56098efebac0 2024-09-11T11:01:47.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.496+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56098f0e9750 con 0x56098efebac0 2024-09-11T11:01:47.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f570960a640 1 -- 172.21.15.145:0/3628518524 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f580c0c5030 con 0x56098efebac0 2024-09-11T11:01:47.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f570960a640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5704034650 0x7f5704036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f570960a640 1 -- 172.21.15.145:0/3628518524 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f580c0ba070 con 0x56098efebac0 2024-09-11T11:01:47.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581c062640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5704034650 0x7f5704036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581ed53980 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098efee3f0 0x56098f0ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f0ed8e0 con 0x56098efee3f0 2024-09-11T11:01:47.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581d064640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098efee3f0 0x56098f0ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581c062640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5704034650 0x7f5704036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5810000f70 tx=0x7f5810001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581d064640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098efee3f0 0x56098f0ed3a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581d064640 1 -- 172.21.15.145:0/3628518524 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098efee3f0 2024-09-11T11:01:47.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581ed53980 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f0ee6c0 0x56098f0f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f0f10f0 con 0x56098f0ee6c0 2024-09-11T11:01:47.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581c863640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f0ee6c0 0x56098f0f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581c863640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f0ee6c0 0x56098f0f0ab0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581c863640 1 -- 172.21.15.145:0/3628518524 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f580c0ce070 con 0x56098f0ee6c0 2024-09-11T11:01:47.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.500+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f0f29a0 con 0x56098f0ee6c0 2024-09-11T11:01:47.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c863640 1 -- 172.21.15.145:0/3628518524 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f580c0ce070 con 0x56098f0ee6c0 2024-09-11T11:01:47.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f0f1bd0 con 0x56098f0ee6c0 2024-09-11T11:01:47.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c863640 1 -- 172.21.15.145:0/3628518524 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f580c0ce070 con 0x56098f0ee6c0 2024-09-11T11:01:47.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581ed53980 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56098f0f3d50 0x56098f0f6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f0f6680 con 0x56098f0f3d50 2024-09-11T11:01:47.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c062640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56098f0f3d50 0x56098f0f6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c062640 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56098f0f3d50 0x56098f0f6140 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c062640 1 -- 172.21.15.145:0/3628518524 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f581000f6a0 con 0x56098f0f3d50 2024-09-11T11:01:47.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581ed53980 1 Processor -- start 2024-09-11T11:01:47.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581ed53980 1 -- start start 2024-09-11T11:01:47.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581ed53980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f104040 0x56098f104460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581ed53980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56098eef4800 con 0x56098f104040 2024-09-11T11:01:47.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f104040 0x56098f104460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f104040 0x56098f104460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60738/0 (socket says 172.21.15.145:60738) 2024-09-11T11:01:47.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c863640 1 -- 172.21.15.145:0/848782434 learned_addr learned my addr 172.21.15.145:0/848782434 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c863640 1 -- 172.21.15.145:0/848782434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56098f1049a0 con 0x56098f104040 2024-09-11T11:01:47.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.504+0000 7f581c863640 1 --2- 172.21.15.145:0/848782434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f104040 0x56098f104460 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f580c0bf010 tx=0x7f580c0c6d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f57027fc640 1 -- 172.21.15.145:0/848782434 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0bfdc0 con 0x56098f104040 2024-09-11T11:01:47.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581ed53980 1 -- 172.21.15.145:0/848782434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56098f104c30 con 0x56098f104040 2024-09-11T11:01:47.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f57027fc640 1 -- 172.21.15.145:0/848782434 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c0e38b0 con 0x56098f104040 2024-09-11T11:01:47.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f57027fc640 1 -- 172.21.15.145:0/848782434 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0e3b90 con 0x56098f104040 2024-09-11T11:01:47.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581ed53980 1 -- 172.21.15.145:0/848782434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56098f1078b0 con 0x56098f104040 2024-09-11T11:01:47.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f57027fc640 1 -- 172.21.15.145:0/848782434 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f580c0b3040 con 0x56098f104040 2024-09-11T11:01:47.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f57027fc640 1 --2- 172.21.15.145:0/848782434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56f4034650 0x7f56f4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f57027fc640 1 -- 172.21.15.145:0/848782434 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f580c0e9bf0 con 0x56098f104040 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581c062640 1 --2- 172.21.15.145:0/848782434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56f4034650 0x7f56f4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581ed53980 1 Processor -- start 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581ed53980 1 -- start start 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581ed53980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f110e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581ed53980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56098f0df880 con 0x56098f110a20 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581c062640 1 --2- 172.21.15.145:0/848782434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56f4034650 0x7f56f4036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x56098f0ea890 tx=0x7f581000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60740/0 (socket says 172.21.15.145:60740) 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581c863640 1 -- 172.21.15.145:0/1536753539 learned_addr learned my addr 172.21.15.145:0/1536753539 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581c863640 1 -- 172.21.15.145:0/1536753539 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56098f1113d0 con 0x56098f110a20 2024-09-11T11:01:47.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f581c863640 1 --2- 172.21.15.145:0/1536753539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f110e00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f580c0b9000 tx=0x7f580c0e3df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9051198f37ce76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f56f3fff640 1 -- 172.21.15.145:0/1536753539 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c100070 con 0x56098f110a20 2024-09-11T11:01:47.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f56f3fff640 1 -- 172.21.15.145:0/1536753539 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c0f1d10 con 0x56098f110a20 2024-09-11T11:01:47.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.508+0000 7f56f3fff640 1 -- 172.21.15.145:0/1536753539 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c0e03e0 con 0x56098f110a20 2024-09-11T11:01:47.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- 172.21.15.145:0/1536753539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 msgr2=0x56098f110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 --2- 172.21.15.145:0/1536753539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f110e00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f580c0b9000 tx=0x7f580c0e3df0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- 172.21.15.145:0/1536753539 shutdown_connections 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 --2- 172.21.15.145:0/1536753539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f110e00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- 172.21.15.145:0/1536753539 >> 172.21.15.145:0/1536753539 conn(0x56098f10ce00 msgr2=0x56098f10af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- 172.21.15.145:0/1536753539 shutdown_connections 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- 172.21.15.145:0/1536753539 wait complete. 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 Processor -- start 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- start start 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f117ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56098f111870 con 0x56098f110a20 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f117ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581c863640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f117ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60746/0 (socket says 172.21.15.145:60746) 2024-09-11T11:01:47.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 learned_addr learned my addr 172.21.15.145:0/2464416526 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56098f1180e0 con 0x56098f110a20 2024-09-11T11:01:47.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581c863640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f117ba0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f580c0e0e70 tx=0x7f580c0f0f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f56f27fc640 1 -- 172.21.15.145:0/2464416526 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c10b020 con 0x56098f110a20 2024-09-11T11:01:47.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56098f1180e0 con 0x56098f110a20 2024-09-11T11:01:47.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f56f27fc640 1 -- 172.21.15.145:0/2464416526 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580c0e1f20 con 0x56098f110a20 2024-09-11T11:01:47.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f56f27fc640 1 -- 172.21.15.145:0/2464416526 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f580c100030 con 0x56098f110a20 2024-09-11T11:01:47.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56098f1185b0 con 0x56098f110a20 2024-09-11T11:01:47.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f56f27fc640 1 -- 172.21.15.145:0/2464416526 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f580c10e020 con 0x56098f110a20 2024-09-11T11:01:47.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.512+0000 7f56f27fc640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56e8034650 0x7f56e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f56f27fc640 1 -- 172.21.15.145:0/2464416526 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f580c101070 con 0x56098f110a20 2024-09-11T11:01:47.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581c062640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56e8034650 0x7f56e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098f122c70 0x56098f125110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f125860 con 0x56098f122c70 2024-09-11T11:01:47.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581d064640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098f122c70 0x56098f125110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581c062640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56e8034650 0x7f56e8036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f581000ffd0 tx=0x7f5810010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581d064640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098f122c70 0x56098f125110 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 realm 2024-09-11T11:01:47.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f122160 con 0x56098f122c70 2024-09-11T11:01:47.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:47.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f126330 con 0x56098f122c70 2024-09-11T11:01:47.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f126f10 0x56098f1293d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f129b40 con 0x56098f126f10 2024-09-11T11:01:47.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581c863640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f126f10 0x56098f1293d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581c863640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f126f10 0x56098f1293d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:47.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:47.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 20 searching for the correct realm 2024-09-11T11:01:47.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56098f12c150 0x56098f12e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.516+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12eb50 con 0x56098f12c150 2024-09-11T11:01:47.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c062640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56098f12c150 0x56098f12e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c062640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56098f12c150 0x56098f12e540 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12eb50 con 0x56098f126f10 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c863640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f580c11b040 0x7f580c0e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x7f580c11b040 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f580c11b040 0x7f580c0e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f580c11b040 0x7f580c0e94b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f12c150 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.520+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x7f580c11b040 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x7f580c11b040 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f12c150 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.524+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f12c150 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f12c150 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x7f580c11b040 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f122c70 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x7f580c11b040 2024-09-11T11:01:47.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f12c150 2024-09-11T11:01:47.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x7f580c11b040 2024-09-11T11:01:47.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.528+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f12c150 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x56098f12a3e0 con 0x56098f126f10 2024-09-11T11:01:47.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f12ac30 con 0x56098f122c70 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f12b020 con 0x56098f126f10 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.532+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f12b020 con 0x7f580c11b040 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 zone default found 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 4 Realm: () 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 zonegroup default 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f12efb0 con 0x7f580c11b040 2024-09-11T11:01:47.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f130d30 con 0x56098f12c150 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f1310d0 con 0x56098f12c150 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 started sync module instance, tier type = 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f1301d0 con 0x56098f126f10 2024-09-11T11:01:47.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94599055083248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f1301d0 con 0x56098f126f10 2024-09-11T11:01:47.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.536+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f131b70 con 0x56098f122c70 2024-09-11T11:01:47.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.540+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.540+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94599055087200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f131b30 con 0x56098f122c70 2024-09-11T11:01:47.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.540+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f132aa0 con 0x56098f126f10 2024-09-11T11:01:47.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.540+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94599055083248] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.540+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94599055087200] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.540+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.540+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94599055089504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f132aa0 con 0x56098f126f10 2024-09-11T11:01:47.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.540+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f132ef0 con 0x7f580c11b040 2024-09-11T11:01:47.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94599055080736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f133360 con 0x7f580c11b040 2024-09-11T11:01:47.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f133da0 con 0x56098f126f10 2024-09-11T11:01:47.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94599055089504] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94599055080736] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94599055095920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f132eb0 con 0x56098f126f10 2024-09-11T11:01:47.548 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f134640 con 0x56098f12c150 2024-09-11T11:01:47.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94599055098256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f132eb0 con 0x56098f12c150 2024-09-11T11:01:47.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.544+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f1353c0 con 0x56098f12c150 2024-09-11T11:01:47.549 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94599055095920] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94599055098256] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94599055100384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f1357b0 con 0x56098f12c150 2024-09-11T11:01:47.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f136040 con 0x7f580c11b040 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94599055103920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f135c30 con 0x7f580c11b040 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 20 add_watcher() i=0 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 20 add_watcher() i=1 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 20 add_watcher() i=2 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 20 add_watcher() i=3 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 20 add_watcher() i=4 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 20 add_watcher() i=5 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94599055100384] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.548+0000 7f581ed53980 20 add_watcher() i=6 2024-09-11T11:01:47.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94599055103920] v34'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581ed53980 20 add_watcher() i=7 2024-09-11T11:01:47.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581ed53980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:47.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f134e00 con 0x56098f122c70 2024-09-11T11:01:47.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.554 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94599055101440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f136a00 con 0x56098f122c70 2024-09-11T11:01:47.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94599055101440] v34'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f56d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:47.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581ed53980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:47.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581ed53980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:47.556 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.552+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f141b30 con 0x56098f126f10 2024-09-11T11:01:47.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.556+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.556+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f141c20 con 0x7f580c11b040 2024-09-11T11:01:47.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.556+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.560 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.556+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f142350 con 0x56098f12c150 2024-09-11T11:01:47.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.560+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.560+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f142800 con 0x56098f122c70 2024-09-11T11:01:47.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.560+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.563 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.560+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f13fb10 con 0x56098f126f10 2024-09-11T11:01:47.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.564+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.564+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f1412e0 con 0x56098f12c150 2024-09-11T11:01:47.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.564+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.564+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f1412e0 con 0x56098f126f10 2024-09-11T11:01:47.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.568+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.568+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143360 con 0x56098f122c70 2024-09-11T11:01:47.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.568+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'37 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.568+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143810 con 0x56098f126f10 2024-09-11T11:01:47.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.572+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.572+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143810 con 0x56098f126f10 2024-09-11T11:01:47.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.572+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.572+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143810 con 0x56098f126f10 2024-09-11T11:01:47.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.576+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.577 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.576+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143810 con 0x56098f12c150 2024-09-11T11:01:47.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.576+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.578 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.576+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f1438a0 con 0x56098f126f10 2024-09-11T11:01:47.580 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.576+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.581 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.576+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143d50 con 0x56098f122c70 2024-09-11T11:01:47.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.580+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'43 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.582 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.580+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143d50 con 0x56098f122c70 2024-09-11T11:01:47.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.580+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.580+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143d50 con 0x56098f126f10 2024-09-11T11:01:47.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.584+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'50 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.586 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.584+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143d50 con 0x56098f126f10 2024-09-11T11:01:47.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.584+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.584+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143d50 con 0x56098f12c150 2024-09-11T11:01:47.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.588+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.588+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143de0 con 0x56098f126f10 2024-09-11T11:01:47.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.592+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.592+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143de0 con 0x56098f122c70 2024-09-11T11:01:47.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.592+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.592+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143de0 con 0x56098f126f10 2024-09-11T11:01:47.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.596+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'51 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.596+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143de0 con 0x56098f126f10 2024-09-11T11:01:47.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.596+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.596+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143de0 con 0x56098f12c150 2024-09-11T11:01:47.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.600+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.600+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143ea0 con 0x56098f126f10 2024-09-11T11:01:47.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.600+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.600+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143ea0 con 0x56098f12c150 2024-09-11T11:01:47.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.604+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.604+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143e70 con 0x56098f12c150 2024-09-11T11:01:47.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.604+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.604+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f143de0 con 0x56098f12c150 2024-09-11T11:01:47.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.608+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.610 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.608+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f144450 con 0x56098f126f10 2024-09-11T11:01:47.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.608+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.608+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f144450 con 0x56098f122c70 2024-09-11T11:01:47.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.612+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'38 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.612+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f144450 con 0x56098f126f10 2024-09-11T11:01:47.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.612+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'52 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.612+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f144450 con 0x56098f122c70 2024-09-11T11:01:47.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.616+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'44 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.616+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f144450 con 0x7f580c11b040 2024-09-11T11:01:47.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.616+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.616+0000 7f56d27e4640 20 reqs_thread_entry: start 2024-09-11T11:01:47.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.616+0000 7f581ed53980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:47.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581ed53980 20 Filter name: none 2024-09-11T11:01:47.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f56cbfff640 20 reqs_thread_entry: start 2024-09-11T11:01:47.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f15f930 con 0x56098f126f10 2024-09-11T11:01:47.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f15f930 con 0x56098f126f10 2024-09-11T11:01:47.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f15f930 con 0x56098f126f10 2024-09-11T11:01:47.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f15f930 con 0x7f580c11b040 2024-09-11T11:01:47.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.620+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13d850 con 0x7f580c11b040 2024-09-11T11:01:47.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13d3a0 con 0x7f580c11b040 2024-09-11T11:01:47.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13d3a0 con 0x56098f12c150 2024-09-11T11:01:47.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13d3a0 con 0x56098f12c150 2024-09-11T11:01:47.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13d3a0 con 0x56098f12c150 2024-09-11T11:01:47.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13d3a0 con 0x56098f122c70 2024-09-11T11:01:47.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e8b0 con 0x56098f122c70 2024-09-11T11:01:47.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e400 con 0x56098f122c70 2024-09-11T11:01:47.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e400 con 0x56098f126f10 2024-09-11T11:01:47.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.624+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.628+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv36 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv36 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.632+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 45 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 46 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 47 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 48 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.636+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 49 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 50 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 51 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.640+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 52 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 53 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 54 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 32 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 33 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.644+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 34 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 35 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 36 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 37 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 55 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 56 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.648+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 57 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 58 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 59 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 60 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.652+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 61 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 62 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 63 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 38 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 39 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.656+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 40 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 64 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 65 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 66 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.660+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 67 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 68 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 69 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.664+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 70 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 71 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 72 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 37 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 38 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 39 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 40 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 41 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.668+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 42 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5810037040 con 0x56098f12c150 2024-09-11T11:01:47.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 43 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f581004f040 con 0x56098f12c150 2024-09-11T11:01:47.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 44 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f581004f040 con 0x56098f12c150 2024-09-11T11:01:47.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f12c150 2024-09-11T11:01:47.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 45 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f581004f040 con 0x56098f12c150 2024-09-11T11:01:47.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 73 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 74 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 75 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.672+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 41 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 42 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 43 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 76 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 77 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.676+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f126f10 2024-09-11T11:01:47.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 78 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 44 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 45 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 46 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x7f580c11b040 2024-09-11T11:01:47.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x7f580c11b040 2024-09-11T11:01:47.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x7f580c11b040 2024-09-11T11:01:47.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.680+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.684+0000 7f56d37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:47.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.684+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94599055101440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f13e3b0 con 0x56098f122c70 2024-09-11T11:01:47.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.684+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 47 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94599055101440] v34'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.684+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94599055083248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f134e00 con 0x56098f126f10 2024-09-11T11:01:47.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.688+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 79 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94599055083248] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.688+0000 7f581ed53980 20 remove_watcher() i=0 2024-09-11T11:01:47.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.688+0000 7f581ed53980 2 removed watcher, disabling cache 2024-09-11T11:01:47.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.688+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94599055087200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f134e00 con 0x56098f122c70 2024-09-11T11:01:47.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.692+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.1 v2:172.21.15.145:6808/1879781812 48 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94599055087200] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x56098f122c70 2024-09-11T11:01:47.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.692+0000 7f581ed53980 20 remove_watcher() i=1 2024-09-11T11:01:47.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.692+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94599055089504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f134e00 con 0x56098f126f10 2024-09-11T11:01:47.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.692+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 80 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94599055089504] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.692+0000 7f581ed53980 20 remove_watcher() i=2 2024-09-11T11:01:47.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.692+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94599055080736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f131f60 con 0x7f580c11b040 2024-09-11T11:01:47.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.696+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94599055080736] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.696+0000 7f581ed53980 20 remove_watcher() i=3 2024-09-11T11:01:47.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.696+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94599055095920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f131f60 con 0x56098f126f10 2024-09-11T11:01:47.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.696+0000 7f581c863640 1 -- 172.21.15.145:0/2464416526 <== osd.0 v2:172.21.15.102:6800/3035634142 81 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94599055095920] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f580c0dd020 con 0x56098f126f10 2024-09-11T11:01:47.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.696+0000 7f581ed53980 20 remove_watcher() i=4 2024-09-11T11:01:47.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.696+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94599055098256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f131f60 con 0x56098f12c150 2024-09-11T11:01:47.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.700+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94599055098256] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581004f040 con 0x56098f12c150 2024-09-11T11:01:47.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.700+0000 7f581ed53980 20 remove_watcher() i=5 2024-09-11T11:01:47.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.700+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94599055100384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f131f60 con 0x56098f12c150 2024-09-11T11:01:47.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.700+0000 7f581c062640 1 -- 172.21.15.145:0/2464416526 <== osd.3 v2:172.21.15.145:6800/493661776 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94599055100384] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f581004f040 con 0x56098f12c150 2024-09-11T11:01:47.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.700+0000 7f581ed53980 20 remove_watcher() i=6 2024-09-11T11:01:47.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.700+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94599055103920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x56098f131f60 con 0x7f580c11b040 2024-09-11T11:01:47.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.700+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94599055103920] v34'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f58140083f0 con 0x7f580c11b040 2024-09-11T11:01:47.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.700+0000 7f581ed53980 20 remove_watcher() i=7 2024-09-11T11:01:47.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f126f10 msgr2=0x56098f1293d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f126f10 0x56098f1293d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098f122c70 msgr2=0x56098f125110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098f122c70 0x56098f125110 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f580c11b040 msgr2=0x7f580c0e94b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f580c11b040 0x7f580c0e94b0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56098f12c150 msgr2=0x56098f12e540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56098f12c150 0x56098f12e540 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56e8034650 msgr2=0x7f56e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56e8034650 0x7f56e8036b10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f581000ffd0 tx=0x7f5810010000 comp rx=0 tx=0).stop 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581d064640 1 -- 172.21.15.145:0/2464416526 reap_dead start 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 msgr2=0x56098f117ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f117ba0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f580c0e0e70 tx=0x7f580c0f0f00 comp rx=0 tx=0).stop 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 shutdown_connections 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/2464416526 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f110a20 0x56098f117ba0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 >> 172.21.15.145:0/2464416526 conn(0x56098f10ce00 msgr2=0x56098f10aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.710 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 shutdown_connections 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/2464416526 wait complete. 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/848782434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56f4034650 msgr2=0x7f56f4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/848782434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56f4034650 0x7f56f4036b10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x56098f0ea890 tx=0x7f581000f000 comp rx=0 tx=0).stop 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/848782434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f104040 msgr2=0x56098f104460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/848782434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f104040 0x56098f104460 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f580c0bf010 tx=0x7f580c0c6d30 comp rx=0 tx=0).stop 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/848782434 shutdown_connections 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/848782434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f56f4034650 0x7f56f4036b10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/848782434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098f104040 0x56098f104460 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/848782434 >> 172.21.15.145:0/848782434 conn(0x56098f0f9190 msgr2=0x56098f0fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/848782434 shutdown_connections 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/848782434 wait complete. 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f0ee6c0 msgr2=0x56098f0f0ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56098f0ee6c0 0x56098f0f0ab0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098efee3f0 msgr2=0x56098f0ed3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56098efee3f0 0x56098f0ed3a0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56098f0f3d50 msgr2=0x56098f0f6140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56098f0f3d50 0x56098f0f6140 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5704034650 msgr2=0x7f5704036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5704034650 0x7f5704036b10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5810000f70 tx=0x7f5810001380 comp rx=0 tx=0).stop 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 msgr2=0x56098f0e62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 --2- 172.21.15.145:0/3628518524 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56098efebac0 0x56098f0e62a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f580c005cc0 tx=0x7f580c017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:47.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581d064640 1 -- 172.21.15.145:0/3628518524 reap_dead start 2024-09-11T11:01:47.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 shutdown_connections 2024-09-11T11:01:47.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 >> 172.21.15.145:0/3628518524 conn(0x56098efe77a0 msgr2=0x56098f0d97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 shutdown_connections 2024-09-11T11:01:47.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.704+0000 7f581ed53980 1 -- 172.21.15.145:0/3628518524 wait complete. 2024-09-11T11:01:47.720 INFO:teuthology.orchestra.run.smithi145.stdout:[] 2024-09-11T11:01:47.720 DEBUG:tasks.util.rgw: json result: [] 2024-09-11T11:01:47.721 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-11T11:01:47.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-11T11:01:47.721 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-11T11:01:47.801 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:47.801 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:47.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af38c1980 1 Processor -- start 2024-09-11T11:01:47.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af38c1980 1 -- start start 2024-09-11T11:01:47.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af38c1980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5559c17078e0 0x5559c1707cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af38c1980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5559c158dae0 con 0x5559c1708230 2024-09-11T11:01:47.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af38c1980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5559c15b1e30 con 0x5559c17078e0 2024-09-11T11:01:47.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af13d1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5559c17078e0 0x5559c1707cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af13d1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5559c17078e0 0x5559c1707cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60752/0 (socket says 172.21.15.145:60752) 2024-09-11T11:01:47.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af13d1640 1 -- 172.21.15.145:0/1225613478 learned_addr learned my addr 172.21.15.145:0/1225613478 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af13d1640 1 -- 172.21.15.145:0/1225613478 >> v1:172.21.15.102:6789/0 conn(0x5559c1708230 legacy=0x5559c170cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.800+0000 7f2af13d1640 1 -- 172.21.15.145:0/1225613478 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c170f4b0 con 0x5559c17078e0 2024-09-11T11:01:47.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2af13d1640 1 --2- 172.21.15.145:0/1225613478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c1707cc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400a5c0 tx=0x7f2ae401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842a2e0c49c3c694 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2ae3fff640 1 -- 172.21.15.145:0/1225613478 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40a6070 con 0x5559c17078e0 2024-09-11T11:01:47.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2ae3fff640 1 -- 172.21.15.145:0/1225613478 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae40af070 con 0x5559c17078e0 2024-09-11T11:01:47.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2ae3fff640 1 -- 172.21.15.145:0/1225613478 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40aa5c0 con 0x5559c17078e0 2024-09-11T11:01:47.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2af38c1980 1 -- 172.21.15.145:0/1225613478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 msgr2=0x5559c1707cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2af38c1980 1 --2- 172.21.15.145:0/1225613478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c1707cc0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2ae400a5c0 tx=0x7f2ae401b340 comp rx=0 tx=0).stop 2024-09-11T11:01:47.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2af38c1980 1 -- 172.21.15.145:0/1225613478 shutdown_connections 2024-09-11T11:01:47.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2af38c1980 1 --2- 172.21.15.145:0/1225613478 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c1707cc0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2af38c1980 1 -- 172.21.15.145:0/1225613478 >> 172.21.15.145:0/1225613478 conn(0x5559c167b230 msgr2=0x5559c167b640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.804+0000 7f2af38c1980 1 -- 172.21.15.145:0/1225613478 shutdown_connections 2024-09-11T11:01:47.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.808+0000 7f2af38c1980 1 -- 172.21.15.145:0/1225613478 wait complete. 2024-09-11T11:01:47.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.820+0000 7f2af38c1980 1 Processor -- start 2024-09-11T11:01:47.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.820+0000 7f2af38c1980 1 -- start start 2024-09-11T11:01:47.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5559c15b3200 con 0x5559c17078e0 2024-09-11T11:01:47.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60760/0 (socket says 172.21.15.145:60760) 2024-09-11T11:01:47.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af13d1640 1 -- 172.21.15.145:0/3000320996 learned_addr learned my addr 172.21.15.145:0/3000320996 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af13d1640 1 -- 172.21.15.145:0/3000320996 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c17f31a0 con 0x5559c17078e0 2024-09-11T11:01:47.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3000320996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f2bd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40199f0 tx=0x7f2ae4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00e9394b9bf5e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f29df606640 1 -- 172.21.15.145:0/3000320996 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40aaa00 con 0x5559c17078e0 2024-09-11T11:01:47.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f29df606640 1 -- 172.21.15.145:0/3000320996 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae40aaba0 con 0x5559c17078e0 2024-09-11T11:01:47.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f29df606640 1 -- 172.21.15.145:0/3000320996 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40bd3f0 con 0x5559c17078e0 2024-09-11T11:01:47.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 -- 172.21.15.145:0/3000320996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 msgr2=0x5559c17f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3000320996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f2bd0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40199f0 tx=0x7f2ae4003030 comp rx=0 tx=0).stop 2024-09-11T11:01:47.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 -- 172.21.15.145:0/3000320996 shutdown_connections 2024-09-11T11:01:47.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3000320996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f2bd0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 -- 172.21.15.145:0/3000320996 >> 172.21.15.145:0/3000320996 conn(0x5559c167b230 msgr2=0x5559c17ee800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 -- 172.21.15.145:0/3000320996 shutdown_connections 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 -- 172.21.15.145:0/3000320996 wait complete. 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 Processor -- start 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 -- start start 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af38c1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5559c170eef0 con 0x5559c17078e0 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60774/0 (socket says 172.21.15.145:60774) 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.824+0000 7f2af13d1640 1 -- 172.21.15.145:0/3397030821 learned_addr learned my addr 172.21.15.145:0/3397030821 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af13d1640 1 -- 172.21.15.145:0/3397030821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c17fa3c0 con 0x5559c17078e0 2024-09-11T11:01:47.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f9e80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2ae401b380 tx=0x7f2ae40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f29dde03640 1 -- 172.21.15.145:0/3397030821 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40bd7c0 con 0x5559c17078e0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f29dde03640 1 -- 172.21.15.145:0/3397030821 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae40cc070 con 0x5559c17078e0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559c17fa650 con 0x5559c17078e0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f29dde03640 1 -- 172.21.15.145:0/3397030821 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40bda90 con 0x5559c17078e0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c17fd330 con 0x5559c17078e0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f29dde03640 1 -- 172.21.15.145:0/3397030821 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ae40bdc30 con 0x5559c17078e0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f29dde03640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29d8034650 0x7f29d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f29dde03640 1 -- 172.21.15.145:0/3397030821 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f2ae40e56e0 con 0x5559c17078e0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29d8034650 0x7f29d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1708230 0x5559c1800e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1801460 con 0x5559c1708230 2024-09-11T11:01:47.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af1bd2640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1708230 0x5559c1800e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29d8034650 0x7f29d8036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000f70 tx=0x7f2ae8001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af1bd2640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1708230 0x5559c1800e10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3397030821 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1708230 2024-09-11T11:01:47.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c1802280 0x5559c1804670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.828+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1804cd0 con 0x5559c1802280 2024-09-11T11:01:47.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c1802280 0x5559c1804670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c1802280 0x5559c1804670 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af13d1640 1 -- 172.21.15.145:0/3397030821 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ae40c5d00 con 0x5559c1802280 2024-09-11T11:01:47.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1806580 con 0x5559c1802280 2024-09-11T11:01:47.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af13d1640 1 -- 172.21.15.145:0/3397030821 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2ae40c5d00 con 0x5559c1802280 2024-09-11T11:01:47.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c18057b0 con 0x5559c1802280 2024-09-11T11:01:47.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af13d1640 1 -- 172.21.15.145:0/3397030821 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ae40c5d00 con 0x5559c1802280 2024-09-11T11:01:47.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5559c1807930 0x5559c1809d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c180a260 con 0x5559c1807930 2024-09-11T11:01:47.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5559c1807930 0x5559c1809d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5559c1807930 0x5559c1809d20 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.832+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3397030821 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f2ae800d040 con 0x5559c1807930 2024-09-11T11:01:47.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 Processor -- start 2024-09-11T11:01:47.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 -- start start 2024-09-11T11:01:47.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1817c20 0x5559c1818040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5559c160c800 con 0x5559c1817c20 2024-09-11T11:01:47.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1817c20 0x5559c1818040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1817c20 0x5559c1818040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60776/0 (socket says 172.21.15.145:60776) 2024-09-11T11:01:47.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af13d1640 1 -- 172.21.15.145:0/1528062819 learned_addr learned my addr 172.21.15.145:0/1528062819 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af13d1640 1 -- 172.21.15.145:0/1528062819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c1818580 con 0x5559c1817c20 2024-09-11T11:01:47.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af13d1640 1 --2- 172.21.15.145:0/1528062819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1817c20 0x5559c1818040 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40e5a50 tx=0x7f2ae40c56d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f29d6ffd640 1 -- 172.21.15.145:0/1528062819 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40e7db0 con 0x5559c1817c20 2024-09-11T11:01:47.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f29d6ffd640 1 -- 172.21.15.145:0/1528062819 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae40e5ac0 con 0x5559c1817c20 2024-09-11T11:01:47.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 -- 172.21.15.145:0/1528062819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559c1818810 con 0x5559c1817c20 2024-09-11T11:01:47.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f29d6ffd640 1 -- 172.21.15.145:0/1528062819 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40e5da0 con 0x5559c1817c20 2024-09-11T11:01:47.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 -- 172.21.15.145:0/1528062819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c181b490 con 0x5559c1817c20 2024-09-11T11:01:47.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f29d6ffd640 1 -- 172.21.15.145:0/1528062819 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ae40c5770 con 0x5559c1817c20 2024-09-11T11:01:47.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f29d6ffd640 1 --2- 172.21.15.145:0/1528062819 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29c8034650 0x7f29c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f29d6ffd640 1 -- 172.21.15.145:0/1528062819 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f2ae40ed070 con 0x5559c1817c20 2024-09-11T11:01:47.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/1528062819 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29c8034650 0x7f29c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 Processor -- start 2024-09-11T11:01:47.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 -- start start 2024-09-11T11:01:47.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/1528062819 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29c8034650 0x7f29c8036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5559c17fe470 tx=0x7f2ae8006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c1824a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.836+0000 7f2af38c1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5559c17f3460 con 0x5559c1824650 2024-09-11T11:01:47.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c1824a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c1824a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60782/0 (socket says 172.21.15.145:60782) 2024-09-11T11:01:47.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 -- 172.21.15.145:0/3044981010 learned_addr learned my addr 172.21.15.145:0/3044981010 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 -- 172.21.15.145:0/3044981010 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c1825000 con 0x5559c1824650 2024-09-11T11:01:47.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3044981010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c1824a30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40aab70 tx=0x7f2ae40a87b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66815f17d54bb32 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f29d4ff9640 1 -- 172.21.15.145:0/3044981010 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae4109070 con 0x5559c1824650 2024-09-11T11:01:47.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f29d4ff9640 1 -- 172.21.15.145:0/3044981010 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae40e1570 con 0x5559c1824650 2024-09-11T11:01:47.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f29d4ff9640 1 -- 172.21.15.145:0/3044981010 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae4100040 con 0x5559c1824650 2024-09-11T11:01:47.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 -- 172.21.15.145:0/3044981010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 msgr2=0x5559c1824a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3044981010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c1824a30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40aab70 tx=0x7f2ae40a87b0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 -- 172.21.15.145:0/3044981010 shutdown_connections 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3044981010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c1824a30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 -- 172.21.15.145:0/3044981010 >> 172.21.15.145:0/3044981010 conn(0x5559c1820980 msgr2=0x5559c181ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 -- 172.21.15.145:0/3044981010 shutdown_connections 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 -- 172.21.15.145:0/3044981010 wait complete. 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 Processor -- start 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 -- start start 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c182b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af38c1980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5559c1825390 con 0x5559c1824650 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c182b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c182b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60792/0 (socket says 172.21.15.145:60792) 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 learned_addr learned my addr 172.21.15.145:0/3578858879 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:47.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c182bc70 con 0x5559c1824650 2024-09-11T11:01:47.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.840+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c182b730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40aab70 tx=0x7f2ae40f9f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f29c6ffd640 1 -- 172.21.15.145:0/3578858879 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae4109040 con 0x5559c1824650 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f29c6ffd640 1 -- 172.21.15.145:0/3578858879 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ae40c6480 con 0x5559c1824650 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5559c182bc70 con 0x5559c1824650 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f29c6ffd640 1 -- 172.21.15.145:0/3578858879 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ae40e52a0 con 0x5559c1824650 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c182bc70 con 0x5559c1824650 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f29c6ffd640 1 -- 172.21.15.145:0/3578858879 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f2ae40e37e0 con 0x5559c1824650 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f29c6ffd640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29bc034650 0x7f29bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f29c6ffd640 1 -- 172.21.15.145:0/3578858879 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f2ae41148f0 con 0x5559c1824650 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29bc034650 0x7f29bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1836840 0x5559c1838d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1839450 con 0x5559c1836840 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af1bd2640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1836840 0x5559c1838d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29bc034650 0x7f29bc036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5559c18064d0 tx=0x7f2ae8011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af1bd2640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1836840 0x5559c1838d00 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 20 realm 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1835c70 con 0x5559c1836840 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:47.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1839ee0 con 0x5559c1836840 2024-09-11T11:01:47.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c183acc0 0x5559c183d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c183d740 con 0x5559c183acc0 2024-09-11T11:01:47.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.844+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c183acc0 0x5559c183d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c183acc0 0x5559c183d0b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af38c1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af38c1980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af38c1980 20 searching for the correct realm 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5559c183fd00 0x5559c18420f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c1842720 con 0x5559c183fd00 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5559c183fd00 0x5559c18420f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af0bd0640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5559c183fd00 0x5559c18420f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c1842720 con 0x5559c183acc0 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af13d1640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2ae4009040 0x7f2ae40f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x7f2ae4009040 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.848+0000 7f2af1bd2640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2ae4009040 0x7f2ae40f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2ae4009040 0x7f2ae40f48d0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183fd00 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x7f2ae4009040 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.852+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x7f2ae4009040 2024-09-11T11:01:47.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183fd00 2024-09-11T11:01:47.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183fd00 2024-09-11T11:01:47.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183fd00 2024-09-11T11:01:47.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x7f2ae4009040 2024-09-11T11:01:47.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.856+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c1836840 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x7f2ae4009040 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183fd00 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x7f2ae4009040 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183fd00 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5559c183df90 con 0x5559c183acc0 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af38c1980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af38c1980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af38c1980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af38c1980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af38c1980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af38c1980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:47.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.860+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c183e7e0 con 0x5559c1836840 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c183ebd0 con 0x5559c183acc0 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c183ebd0 con 0x7f2ae4009040 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:47.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 zone default found 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 4 Realm: () 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 zonegroup default 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1842ba0 con 0x7f2ae4009040 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.875 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c183f170 con 0x5559c183fd00 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1845320 con 0x5559c183fd00 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 started sync module instance, tier type = 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.864+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1843dc0 con 0x5559c183acc0 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.868+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.868+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93843987120608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1843dc0 con 0x5559c183acc0 2024-09-11T11:01:47.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.868+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1845b70 con 0x5559c1836840 2024-09-11T11:01:47.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.868+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.868+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93843987125952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1845f90 con 0x5559c1836840 2024-09-11T11:01:47.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.868+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1846950 con 0x5559c183acc0 2024-09-11T11:01:47.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.868+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93843987120608] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.868+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93843987125952] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93843987127008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1845f00 con 0x5559c183acc0 2024-09-11T11:01:47.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1846e00 con 0x7f2ae4009040 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93843987130704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1846d70 con 0x7f2ae4009040 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1847d20 con 0x5559c183acc0 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93843987127008] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93843987130704] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93843987132912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1847ce0 con 0x5559c183acc0 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.872+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1848110 con 0x5559c183fd00 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.876+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.876+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93843987129504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18489b0 con 0x5559c183fd00 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.876+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849370 con 0x5559c183fd00 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.876+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93843987132912] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.876+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93843987129504] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.876+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.876+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93843987137792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1848920 con 0x5559c183fd00 2024-09-11T11:01:47.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.876+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849990 con 0x7f2ae4009040 2024-09-11T11:01:47.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93843987141856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849db0 con 0x7f2ae4009040 2024-09-11T11:01:47.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 add_watcher() i=0 2024-09-11T11:01:47.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 add_watcher() i=1 2024-09-11T11:01:47.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 add_watcher() i=2 2024-09-11T11:01:47.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 add_watcher() i=3 2024-09-11T11:01:47.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 add_watcher() i=4 2024-09-11T11:01:47.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 add_watcher() i=5 2024-09-11T11:01:47.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93843987137792] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 add_watcher() i=6 2024-09-11T11:01:47.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93843987141856] v34'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 add_watcher() i=7 2024-09-11T11:01:47.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:47.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849db0 con 0x5559c1836840 2024-09-11T11:01:47.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.883 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93843987142912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849d20 con 0x5559c1836840 2024-09-11T11:01:47.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93843987142912] v34'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f29a7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:47.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:47.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:47.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.880+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18556f0 con 0x5559c183acc0 2024-09-11T11:01:47.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.884+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.884+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18557e0 con 0x7f2ae4009040 2024-09-11T11:01:47.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.884+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.884+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1855f10 con 0x5559c183fd00 2024-09-11T11:01:47.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.888+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.888+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18563c0 con 0x5559c1836840 2024-09-11T11:01:47.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.888+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.888+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18535e0 con 0x5559c183acc0 2024-09-11T11:01:47.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.892+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.892+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18535e0 con 0x5559c183fd00 2024-09-11T11:01:47.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.892+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.892+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1856f20 con 0x5559c183acc0 2024-09-11T11:01:47.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.896+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.896+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1856f20 con 0x5559c1836840 2024-09-11T11:01:47.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.896+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'39 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.896+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18573d0 con 0x5559c183acc0 2024-09-11T11:01:47.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.900+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.900+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18573d0 con 0x5559c183acc0 2024-09-11T11:01:47.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.904+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.904+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18573d0 con 0x5559c183acc0 2024-09-11T11:01:47.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.904+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.904+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18573d0 con 0x5559c183fd00 2024-09-11T11:01:47.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.908+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.908+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857630 con 0x5559c183acc0 2024-09-11T11:01:47.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.908+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.908+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c1836840 2024-09-11T11:01:47.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.912+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'45 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.912+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c1836840 2024-09-11T11:01:47.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.912+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.912+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c183acc0 2024-09-11T11:01:47.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.916+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'53 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.916+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c183acc0 2024-09-11T11:01:47.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.916+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.916+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c183fd00 2024-09-11T11:01:47.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.920+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.920+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c183acc0 2024-09-11T11:01:47.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.924+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.924+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c1836840 2024-09-11T11:01:47.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.924+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.924+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c183acc0 2024-09-11T11:01:47.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.928+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'54 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.928+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c183acc0 2024-09-11T11:01:47.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.928+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.928+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ae0 con 0x5559c183fd00 2024-09-11T11:01:47.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.932+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.932+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x5559c183acc0 2024-09-11T11:01:47.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.932+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.932+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x5559c183fd00 2024-09-11T11:01:47.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.936+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.936+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x5559c183fd00 2024-09-11T11:01:47.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.936+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.936+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x5559c183fd00 2024-09-11T11:01:47.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.940+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.940+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x5559c183acc0 2024-09-11T11:01:47.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.940+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.940+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x5559c1836840 2024-09-11T11:01:47.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.944+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'40 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.944+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x5559c183acc0 2024-09-11T11:01:47.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.944+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'55 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.944+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x5559c1836840 2024-09-11T11:01:47.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.948+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'46 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.948+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1857ec0 con 0x7f2ae4009040 2024-09-11T11:01:47.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.948+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.948+0000 7f29a6fe5640 20 reqs_thread_entry: start 2024-09-11T11:01:47.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.948+0000 7f2af38c1980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:47.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 20 Filter name: none 2024-09-11T11:01:47.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f29a4fe1640 20 reqs_thread_entry: start 2024-09-11T11:01:47.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:47.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 20 rados->read ofs=0 len=0 2024-09-11T11:01:47.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1872ef0 con 0x5559c1836840 2024-09-11T11:01:47.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:47.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:47.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:47.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:47.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5559c1852750 con 0x7f2ae4009040 2024-09-11T11:01:47.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.955 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-11T11:01:47.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f29a7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:47.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.952+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93843987142912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1833fb0 con 0x5559c1836840 2024-09-11T11:01:47.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.956+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93843987142912] v34'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.956+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93843987120608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849900 con 0x5559c183acc0 2024-09-11T11:01:47.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.956+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93843987120608] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af38c1980 20 remove_watcher() i=0 2024-09-11T11:01:47.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af38c1980 2 removed watcher, disabling cache 2024-09-11T11:01:47.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93843987125952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849900 con 0x5559c1836840 2024-09-11T11:01:47.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93843987125952] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x5559c1836840 2024-09-11T11:01:47.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af38c1980 20 remove_watcher() i=1 2024-09-11T11:01:47.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93843987127008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c18456c0 con 0x5559c183acc0 2024-09-11T11:01:47.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93843987127008] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af38c1980 20 remove_watcher() i=2 2024-09-11T11:01:47.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.960+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93843987130704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849900 con 0x7f2ae4009040 2024-09-11T11:01:47.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.964+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93843987130704] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.964+0000 7f2af38c1980 20 remove_watcher() i=3 2024-09-11T11:01:47.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.964+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93843987132912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1846950 con 0x5559c183acc0 2024-09-11T11:01:47.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.964+0000 7f2af13d1640 1 -- 172.21.15.145:0/3578858879 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93843987132912] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae4119020 con 0x5559c183acc0 2024-09-11T11:01:47.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.964+0000 7f2af38c1980 20 remove_watcher() i=4 2024-09-11T11:01:47.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.964+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93843987129504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849900 con 0x5559c183fd00 2024-09-11T11:01:47.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.968+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93843987129504] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.968+0000 7f2af38c1980 20 remove_watcher() i=5 2024-09-11T11:01:47.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.968+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93843987137792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849900 con 0x5559c183fd00 2024-09-11T11:01:47.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.968+0000 7f2af0bd0640 1 -- 172.21.15.145:0/3578858879 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93843987137792] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2ae8036040 con 0x5559c183fd00 2024-09-11T11:01:47.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.968+0000 7f2af38c1980 20 remove_watcher() i=6 2024-09-11T11:01:47.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.968+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93843987141856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5559c1849900 con 0x7f2ae4009040 2024-09-11T11:01:47.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.968+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93843987141856] v34'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2aec00a4d0 con 0x7f2ae4009040 2024-09-11T11:01:47.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.968+0000 7f2af38c1980 20 remove_watcher() i=7 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c183acc0 msgr2=0x5559c183d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c183acc0 0x5559c183d0b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1836840 msgr2=0x5559c1838d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1836840 0x5559c1838d00 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2ae4009040 msgr2=0x7f2ae40f48d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f2ae4009040 0x7f2ae40f48d0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5559c183fd00 msgr2=0x5559c18420f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5559c183fd00 0x5559c18420f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29bc034650 msgr2=0x7f29bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29bc034650 0x7f29bc036b10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x5559c18064d0 tx=0x7f2ae8011000 comp rx=0 tx=0).stop 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3578858879 reap_dead start 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 msgr2=0x5559c182b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c182b730 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40aab70 tx=0x7f2ae40f9f30 comp rx=0 tx=0).stop 2024-09-11T11:01:47.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 shutdown_connections 2024-09-11T11:01:47.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3578858879 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1824650 0x5559c182b730 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 >> 172.21.15.145:0/3578858879 conn(0x5559c1820980 msgr2=0x5559c181ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 shutdown_connections 2024-09-11T11:01:47.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3578858879 wait complete. 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/1528062819 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29c8034650 msgr2=0x7f29c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/1528062819 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29c8034650 0x7f29c8036b10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x5559c17fe470 tx=0x7f2ae8006000 comp rx=0 tx=0).stop 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/1528062819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1817c20 msgr2=0x5559c1818040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/1528062819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1817c20 0x5559c1818040 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2ae40e5a50 tx=0x7f2ae40c56d0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/1528062819 shutdown_connections 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/1528062819 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29c8034650 0x7f29c8036b10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/1528062819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c1817c20 0x5559c1818040 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/1528062819 >> 172.21.15.145:0/1528062819 conn(0x5559c180cd70 msgr2=0x5559c180f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/1528062819 shutdown_connections 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/1528062819 wait complete. 2024-09-11T11:01:47.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c1802280 msgr2=0x5559c1804670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5559c1802280 0x5559c1804670 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1708230 msgr2=0x5559c1800e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5559c1708230 0x5559c1800e10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5559c1807930 msgr2=0x5559c1809d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5559c1807930 0x5559c1809d20 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29d8034650 msgr2=0x7f29d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f29d8034650 0x7f29d8036b10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8000f70 tx=0x7f2ae8001420 comp rx=0 tx=0).stop 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 msgr2=0x5559c17f9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 --2- 172.21.15.145:0/3397030821 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5559c17078e0 0x5559c17f9e80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2ae401b380 tx=0x7f2ae40180e0 comp rx=0 tx=0).stop 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af1bd2640 1 -- 172.21.15.145:0/3397030821 reap_dead start 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 shutdown_connections 2024-09-11T11:01:47.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 >> 172.21.15.145:0/3397030821 conn(0x5559c167b230 msgr2=0x5559c17ed380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:47.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 shutdown_connections 2024-09-11T11:01:47.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:47.972+0000 7f2af38c1980 1 -- 172.21.15.145:0/3397030821 wait complete. 2024-09-11T11:01:47.992 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-11T11:01:48.004 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-11T11:01:48.012 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:48.056 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:48.078 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:48.121 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-11T11:01:48.131 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:48.131 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-11T11:01:48.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-11T11:01:48.131 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-11T11:01:48.170 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:48.170 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:48.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc8761b2980 1 Processor -- start 2024-09-11T11:01:48.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc8761b2980 1 -- start start 2024-09-11T11:01:48.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc8761b2980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5616e01a2e00 0x5616e01a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc8761b2980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616e0028ae0 con 0x5616e01a5760 2024-09-11T11:01:48.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc8761b2980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5616e004ce30 con 0x5616e01a2e00 2024-09-11T11:01:48.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc873cc2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5616e01a2e00 0x5616e01a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc8734c1640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x5616e01a5760 0x5616e01a7b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:60912/0 (socket says 172.21.15.145:60912) 2024-09-11T11:01:48.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc873cc2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5616e01a2e00 0x5616e01a51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60804/0 (socket says 172.21.15.145:60804) 2024-09-11T11:01:48.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc8734c1640 1 -- 172.21.15.145:0/1075230018 learned_addr learned my addr 172.21.15.145:0/1075230018 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:48.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc873cc2640 1 -- 172.21.15.145:0/1075230018 >> v1:172.21.15.102:6789/0 conn(0x5616e01a5760 legacy=0x5616e01a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.168+0000 7fc873cc2640 1 -- 172.21.15.145:0/1075230018 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e01aa400 con 0x5616e01a2e00 2024-09-11T11:01:48.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc873cc2640 1 --2- 172.21.15.145:0/1075230018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e01a51f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc86400a480 tx=0x7fc86401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150e6385f316adfc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc872cc0640 1 -- 172.21.15.145:0/1075230018 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640b0070 con 0x5616e01a2e00 2024-09-11T11:01:48.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc872cc0640 1 -- 172.21.15.145:0/1075230018 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8640ab540 con 0x5616e01a2e00 2024-09-11T11:01:48.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc872cc0640 1 -- 172.21.15.145:0/1075230018 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640ab840 con 0x5616e01a2e00 2024-09-11T11:01:48.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc8761b2980 1 -- 172.21.15.145:0/1075230018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 msgr2=0x5616e01a51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc8761b2980 1 --2- 172.21.15.145:0/1075230018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e01a51f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc86400a480 tx=0x7fc86401b280 comp rx=0 tx=0).stop 2024-09-11T11:01:48.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc8761b2980 1 -- 172.21.15.145:0/1075230018 shutdown_connections 2024-09-11T11:01:48.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc8761b2980 1 --2- 172.21.15.145:0/1075230018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e01a51f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc8761b2980 1 -- 172.21.15.145:0/1075230018 >> 172.21.15.145:0/1075230018 conn(0x5616e0116290 msgr2=0x5616e01166a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc8761b2980 1 -- 172.21.15.145:0/1075230018 shutdown_connections 2024-09-11T11:01:48.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.172+0000 7fc8761b2980 1 -- 172.21.15.145:0/1075230018 wait complete. 2024-09-11T11:01:48.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.188+0000 7fc8761b2980 1 Processor -- start 2024-09-11T11:01:48.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.188+0000 7fc8761b2980 1 -- start start 2024-09-11T11:01:48.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.188+0000 7fc8761b2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e028dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.188+0000 7fc8761b2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5616e004e200 con 0x5616e01a2e00 2024-09-11T11:01:48.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e028dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e028dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60820/0 (socket says 172.21.15.145:60820) 2024-09-11T11:01:48.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 -- 172.21.15.145:0/3895010624 learned_addr learned my addr 172.21.15.145:0/3895010624 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 -- 172.21.15.145:0/3895010624 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e028e330 con 0x5616e01a2e00 2024-09-11T11:01:48.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 --2- 172.21.15.145:0/3895010624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e028dd60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc8640ae040 tx=0x7fc864003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1908322e7145f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc761e0b640 1 -- 172.21.15.145:0/3895010624 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640b0040 con 0x5616e01a2e00 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc761e0b640 1 -- 172.21.15.145:0/3895010624 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8640ab9d0 con 0x5616e01a2e00 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc761e0b640 1 -- 172.21.15.145:0/3895010624 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640abcf0 con 0x5616e01a2e00 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 -- 172.21.15.145:0/3895010624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 msgr2=0x5616e028dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3895010624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e028dd60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc8640ae040 tx=0x7fc864003030 comp rx=0 tx=0).stop 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 -- 172.21.15.145:0/3895010624 shutdown_connections 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3895010624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e028dd60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 -- 172.21.15.145:0/3895010624 >> 172.21.15.145:0/3895010624 conn(0x5616e0116290 msgr2=0x5616e0289990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 -- 172.21.15.145:0/3895010624 shutdown_connections 2024-09-11T11:01:48.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 -- 172.21.15.145:0/3895010624 wait complete. 2024-09-11T11:01:48.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 Processor -- start 2024-09-11T11:01:48.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 -- start start 2024-09-11T11:01:48.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e0294ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc8761b2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5616e01a9e40 con 0x5616e01a2e00 2024-09-11T11:01:48.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e0294ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e0294ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60822/0 (socket says 172.21.15.145:60822) 2024-09-11T11:01:48.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 -- 172.21.15.145:0/2665516131 learned_addr learned my addr 172.21.15.145:0/2665516131 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.192+0000 7fc873cc2640 1 -- 172.21.15.145:0/2665516131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e0295430 con 0x5616e01a2e00 2024-09-11T11:01:48.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc873cc2640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e0294ef0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc864019930 tx=0x7fc864018020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc75bfff640 1 -- 172.21.15.145:0/2665516131 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640b0070 con 0x5616e01a2e00 2024-09-11T11:01:48.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc75bfff640 1 -- 172.21.15.145:0/2665516131 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8640b68b0 con 0x5616e01a2e00 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616e02956c0 con 0x5616e01a2e00 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc75bfff640 1 -- 172.21.15.145:0/2665516131 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640b6b90 con 0x5616e01a2e00 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e02983a0 con 0x5616e01a2e00 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc75bfff640 1 -- 172.21.15.145:0/2665516131 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8640bf3f0 con 0x5616e01a2e00 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc75bfff640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc75c034650 0x7fc75c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc75bfff640 1 -- 172.21.15.145:0/2665516131 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fc8640bc070 con 0x5616e01a2e00 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8734c1640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc75c034650 0x7fc75c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e01a5760 0x5616e029be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e029c4a0 con 0x5616e01a5760 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8744c3640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e01a5760 0x5616e029be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8734c1640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc75c034650 0x7fc75c036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc868000f70 tx=0x7fc8680012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8744c3640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e01a5760 0x5616e029be80 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8744c3640 1 -- 172.21.15.145:0/2665516131 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e01a5760 2024-09-11T11:01:48.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e029d290 0x5616e029f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e029fcc0 con 0x5616e029d290 2024-09-11T11:01:48.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.196+0000 7fc873cc2640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e029d290 0x5616e029f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc873cc2640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e029d290 0x5616e029f680 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc873cc2640 1 -- 172.21.15.145:0/2665516131 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e029d290 2024-09-11T11:01:48.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02a1570 con 0x5616e029d290 2024-09-11T11:01:48.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc873cc2640 1 -- 172.21.15.145:0/2665516131 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e029d290 2024-09-11T11:01:48.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02a06b0 con 0x5616e029d290 2024-09-11T11:01:48.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc873cc2640 1 -- 172.21.15.145:0/2665516131 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e029d290 2024-09-11T11:01:48.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5616e02a1170 0x5616e02a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02a5170 con 0x5616e02a1170 2024-09-11T11:01:48.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8734c1640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5616e02a1170 0x5616e02a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8734c1640 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5616e02a1170 0x5616e02a49e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8734c1640 1 -- 172.21.15.145:0/2665516131 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02a1170 2024-09-11T11:01:48.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8761b2980 1 Processor -- start 2024-09-11T11:01:48.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8761b2980 1 -- start start 2024-09-11T11:01:48.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8761b2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02b2c00 0x5616e02b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.200+0000 7fc8761b2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5616e00a7800 con 0x5616e02b2c00 2024-09-11T11:01:48.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02b2c00 0x5616e02b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02b2c00 0x5616e02b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60830/0 (socket says 172.21.15.145:60830) 2024-09-11T11:01:48.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc873cc2640 1 -- 172.21.15.145:0/911091790 learned_addr learned my addr 172.21.15.145:0/911091790 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc873cc2640 1 -- 172.21.15.145:0/911091790 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e02b3560 con 0x5616e02b2c00 2024-09-11T11:01:48.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc873cc2640 1 --2- 172.21.15.145:0/911091790 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02b2c00 0x5616e02b3020 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc8640ad020 tx=0x7fc864006ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc7597fa640 1 -- 172.21.15.145:0/911091790 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640b4d90 con 0x5616e02b2c00 2024-09-11T11:01:48.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc8761b2980 1 -- 172.21.15.145:0/911091790 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616e02b37f0 con 0x5616e02b2c00 2024-09-11T11:01:48.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc7597fa640 1 -- 172.21.15.145:0/911091790 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8640e0070 con 0x5616e02b2c00 2024-09-11T11:01:48.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc7597fa640 1 -- 172.21.15.145:0/911091790 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640bf860 con 0x5616e02b2c00 2024-09-11T11:01:48.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc8761b2980 1 -- 172.21.15.145:0/911091790 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e02b6470 con 0x5616e02b2c00 2024-09-11T11:01:48.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc7597fa640 1 -- 172.21.15.145:0/911091790 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc8640bfa00 con 0x5616e02b2c00 2024-09-11T11:01:48.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc7597fa640 1 --2- 172.21.15.145:0/911091790 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc74c034650 0x7fc74c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc7597fa640 1 -- 172.21.15.145:0/911091790 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fc8640a8070 con 0x5616e02b2c00 2024-09-11T11:01:48.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc8734c1640 1 --2- 172.21.15.145:0/911091790 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc74c034650 0x7fc74c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc8761b2980 1 Processor -- start 2024-09-11T11:01:48.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc8761b2980 1 -- start start 2024-09-11T11:01:48.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc8734c1640 1 --2- 172.21.15.145:0/911091790 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc74c034650 0x7fc74c036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc86800bf60 tx=0x7fc86800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc8761b2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02bf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc8761b2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5616e028e5f0 con 0x5616e02bf530 2024-09-11T11:01:48.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02bf910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60840/0 (socket says 172.21.15.145:60840) 2024-09-11T11:01:48.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.204+0000 7fc873cc2640 1 -- 172.21.15.145:0/2144407634 learned_addr learned my addr 172.21.15.145:0/2144407634 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc873cc2640 1 -- 172.21.15.145:0/2144407634 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e02bfee0 con 0x5616e02bf530 2024-09-11T11:01:48.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc873cc2640 1 --2- 172.21.15.145:0/2144407634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02bf910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc8640b6dd0 tx=0x7fc8640b5760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1d50db8adc70b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc752ffd640 1 -- 172.21.15.145:0/2144407634 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640e9040 con 0x5616e02bf530 2024-09-11T11:01:48.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc752ffd640 1 -- 172.21.15.145:0/2144407634 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8640e4090 con 0x5616e02bf530 2024-09-11T11:01:48.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc752ffd640 1 -- 172.21.15.145:0/2144407634 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640c03a0 con 0x5616e02bf530 2024-09-11T11:01:48.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 -- 172.21.15.145:0/2144407634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 msgr2=0x5616e02bf910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2144407634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02bf910 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc8640b6dd0 tx=0x7fc8640b5760 comp rx=0 tx=0).stop 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 -- 172.21.15.145:0/2144407634 shutdown_connections 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2144407634 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02bf910 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 -- 172.21.15.145:0/2144407634 >> 172.21.15.145:0/2144407634 conn(0x5616e02bb910 msgr2=0x5616e02b9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 -- 172.21.15.145:0/2144407634 shutdown_connections 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 -- 172.21.15.145:0/2144407634 wait complete. 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 Processor -- start 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 -- start start 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5616e02c0380 con 0x5616e02bf530 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc873cc2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60846/0 (socket says 172.21.15.145:60846) 2024-09-11T11:01:48.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 learned_addr learned my addr 172.21.15.145:0/3639658897 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e02c6bf0 con 0x5616e02bf530 2024-09-11T11:01:48.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc873cc2640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02c66b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc8640b6e50 tx=0x7fc864002380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc7517fa640 1 -- 172.21.15.145:0/3639658897 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640fc040 con 0x5616e02bf530 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616e02c6bf0 con 0x5616e02bf530 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc7517fa640 1 -- 172.21.15.145:0/3639658897 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8640aa6f0 con 0x5616e02bf530 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.208+0000 7fc7517fa640 1 -- 172.21.15.145:0/3639658897 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8640e9040 con 0x5616e02bf530 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e02c7060 con 0x5616e02bf530 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc7517fa640 1 -- 172.21.15.145:0/3639658897 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fc864109020 con 0x5616e02bf530 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc7517fa640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc73c0345b0 0x7fc73c036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc7517fa640 1 -- 172.21.15.145:0/3639658897 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fc864107020 con 0x5616e02bf530 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8734c1640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc73c0345b0 0x7fc73c036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e02d15b0 0x5616e02d3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d41c0 con 0x5616e02d15b0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8744c3640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e02d15b0 0x5616e02d3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8734c1640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc73c0345b0 0x7fc73c036a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5616e02a5570 tx=0x7fc868010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8744c3640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e02d15b0 0x5616e02d3a70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 20 realm 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d09e0 con 0x5616e02d15b0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d4c80 con 0x5616e02d15b0 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e02d5a60 0x5616e02d7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8500 con 0x5616e02d5a60 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.212+0000 7fc873cc2640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e02d5a60 0x5616e02d7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc873cc2640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e02d5a60 0x5616e02d7e50 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8761b2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:48.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8761b2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8761b2980 20 searching for the correct realm 2024-09-11T11:01:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5616e02daac0 0x5616e02dceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02dd530 con 0x5616e02daac0 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8734c1640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5616e02daac0 0x5616e02dceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8734c1640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5616e02daac0 0x5616e02dceb0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02dd530 con 0x5616e02d5a60 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc873cc2640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc8640c07f0 0x7fc8640027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x7fc8640c07f0 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8744c3640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc8640c07f0 0x7fc8640027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8744c3640 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc8640c07f0 0x7fc8640027d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.216+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02daac0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x7fc8640c07f0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x7fc8640c07f0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.220+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02daac0 2024-09-11T11:01:48.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02daac0 2024-09-11T11:01:48.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02daac0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x7fc8640c07f0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d15b0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x7fc8640c07f0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02daac0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.224+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x7fc8640c07f0 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02daac0 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d8d50 con 0x5616e02d5a60 2024-09-11T11:01:48.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d95a0 con 0x5616e02d15b0 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d9990 con 0x5616e02d5a60 2024-09-11T11:01:48.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.228+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d9990 con 0x7fc8640c07f0 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 zone default found 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 4 Realm: () 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 zonegroup default 2024-09-11T11:01:48.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02dd990 con 0x7fc8640c07f0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02d9ed0 con 0x5616e02daac0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02dfd50 con 0x5616e02daac0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 started sync module instance, tier type = 2024-09-11T11:01:48.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:48.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02df050 con 0x5616e02d5a60 2024-09-11T11:01:48.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94656250377584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02df050 con 0x5616e02d5a60 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.232+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e07d0 con 0x5616e02d15b0 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.236+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.236+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94656250381088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e0740 con 0x5616e02d15b0 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.236+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e16d0 con 0x5616e02d5a60 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.236+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94656250377584] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.236+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94656250381088] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.236+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.236+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94656250383296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e11e0 con 0x5616e02d5a60 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.236+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e1f70 con 0x7fc8640c07f0 2024-09-11T11:01:48.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94656250387136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e11e0 con 0x7fc8640c07f0 2024-09-11T11:01:48.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e2a30 con 0x5616e02d5a60 2024-09-11T11:01:48.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94656250383296] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94656250387136] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94656250388192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e29f0 con 0x5616e02d5a60 2024-09-11T11:01:48.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e2e20 con 0x5616e02daac0 2024-09-11T11:01:48.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94656250375072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e3670 con 0x5616e02daac0 2024-09-11T11:01:48.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.240+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e4070 con 0x5616e02daac0 2024-09-11T11:01:48.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94656250388192] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94656250375072] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94656250389760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e4460 con 0x5616e02daac0 2024-09-11T11:01:48.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e4cb0 con 0x7fc8640c07f0 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94656250389760] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94656250397792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e50a0 con 0x7fc8640c07f0 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 20 add_watcher() i=0 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 20 add_watcher() i=1 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 20 add_watcher() i=2 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 20 add_watcher() i=3 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 20 add_watcher() i=4 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 20 add_watcher() i=5 2024-09-11T11:01:48.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 20 add_watcher() i=6 2024-09-11T11:01:48.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94656250397792] v34'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 20 add_watcher() i=7 2024-09-11T11:01:48.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.244+0000 7fc8761b2980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:48.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e8140 con 0x5616e02d15b0 2024-09-11T11:01:48.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94656250398848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e02e54e0 con 0x5616e02d15b0 2024-09-11T11:01:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94656250398848] v34'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc729fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:48.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 5 note: GC not initialized 2024-09-11T11:01:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc728fe1640 20 reqs_thread_entry: start 2024-09-11T11:01:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 20 Filter name: none 2024-09-11T11:01:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc6a27fc640 20 reqs_thread_entry: start 2024-09-11T11:01:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.248+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e030be20 con 0x7fc8640c07f0 2024-09-11T11:01:48.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 : miss 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1b762154:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e030d880 con 0x5616e02d15b0 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(63 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv14 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 info.flags=0x17 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 to cache LRU end 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:48.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:48.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 2024-09-11T11:01:48.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 20 get_obj_state: octx=0x7fc8640f78c0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5616e030ff48 s->prefetch_data=0 2024-09-11T11:01:48.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 3.38 3:1e6903ef:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x5616e02daac0 2024-09-11T11:01:48.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 10 manifest: total_size = 5 2024-09-11T11:01:48.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 20 get_obj_state: setting s->obj_tag to _GUt7_dkfiGhiu9nH2fhrCACfSFXkXpU 2024-09-11T11:01:48.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc729fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:48.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.252+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94656250398848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0309690 con 0x5616e02d15b0 2024-09-11T11:01:48.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94656250398848] v34'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94656250377584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x5616e02d5a60 2024-09-11T11:01:48.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94656250377584] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc8761b2980 20 remove_watcher() i=0 2024-09-11T11:01:48.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc8761b2980 2 removed watcher, disabling cache 2024-09-11T11:01:48.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94656250381088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x5616e02d15b0 2024-09-11T11:01:48.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94656250381088] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x5616e02d15b0 2024-09-11T11:01:48.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc8761b2980 20 remove_watcher() i=1 2024-09-11T11:01:48.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.256+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94656250383296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x5616e02d5a60 2024-09-11T11:01:48.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.260+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94656250383296] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.260+0000 7fc8761b2980 20 remove_watcher() i=2 2024-09-11T11:01:48.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.260+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94656250387136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x7fc8640c07f0 2024-09-11T11:01:48.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.260+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94656250387136] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.260+0000 7fc8761b2980 20 remove_watcher() i=3 2024-09-11T11:01:48.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.260+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94656250388192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x5616e02d5a60 2024-09-11T11:01:48.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc873cc2640 1 -- 172.21.15.145:0/3639658897 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94656250388192] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8640b3040 con 0x5616e02d5a60 2024-09-11T11:01:48.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc8761b2980 20 remove_watcher() i=4 2024-09-11T11:01:48.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94656250375072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x5616e02daac0 2024-09-11T11:01:48.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94656250375072] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc8761b2980 20 remove_watcher() i=5 2024-09-11T11:01:48.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94656250389760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x5616e02daac0 2024-09-11T11:01:48.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc8734c1640 1 -- 172.21.15.145:0/3639658897 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94656250389760] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86800e620 con 0x5616e02daac0 2024-09-11T11:01:48.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc8761b2980 20 remove_watcher() i=6 2024-09-11T11:01:48.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.264+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94656250397792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5616e0310e90 con 0x7fc8640c07f0 2024-09-11T11:01:48.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94656250397792] v34'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc86c00a4d0 con 0x7fc8640c07f0 2024-09-11T11:01:48.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 20 remove_watcher() i=7 2024-09-11T11:01:48.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e02d5a60 msgr2=0x5616e02d7e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e02d5a60 0x5616e02d7e50 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e02d15b0 msgr2=0x5616e02d3a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e02d15b0 0x5616e02d3a70 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc8640c07f0 msgr2=0x7fc8640027d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fc8640c07f0 0x7fc8640027d0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5616e02daac0 msgr2=0x5616e02dceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5616e02daac0 0x5616e02dceb0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc73c0345b0 msgr2=0x7fc73c036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc73c0345b0 0x7fc73c036a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x5616e02a5570 tx=0x7fc868010000 comp rx=0 tx=0).stop 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 msgr2=0x5616e02c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02c66b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc8640b6e50 tx=0x7fc864002380 comp rx=0 tx=0).stop 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8744c3640 1 -- 172.21.15.145:0/3639658897 reap_dead start 2024-09-11T11:01:48.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 shutdown_connections 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/3639658897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02bf530 0x5616e02c66b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 >> 172.21.15.145:0/3639658897 conn(0x5616e02bb910 msgr2=0x5616e02b99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 shutdown_connections 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/3639658897 wait complete. 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/911091790 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc74c034650 msgr2=0x7fc74c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/911091790 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc74c034650 0x7fc74c036b10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc86800bf60 tx=0x7fc86800f000 comp rx=0 tx=0).stop 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/911091790 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02b2c00 msgr2=0x5616e02b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/911091790 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02b2c00 0x5616e02b3020 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc8640ad020 tx=0x7fc864006ea0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/911091790 shutdown_connections 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/911091790 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc74c034650 0x7fc74c036b10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/911091790 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e02b2c00 0x5616e02b3020 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/911091790 >> 172.21.15.145:0/911091790 conn(0x5616e02a7d50 msgr2=0x5616e02aa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/911091790 shutdown_connections 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/911091790 wait complete. 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e029d290 msgr2=0x5616e029f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5616e029d290 0x5616e029f680 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e01a5760 msgr2=0x5616e029be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5616e01a5760 0x5616e029be80 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5616e02a1170 msgr2=0x5616e02a49e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5616e02a1170 0x5616e02a49e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc75c034650 msgr2=0x7fc75c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc75c034650 0x7fc75c036b10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc868000f70 tx=0x7fc8680012c0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 msgr2=0x5616e0294ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 --2- 172.21.15.145:0/2665516131 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5616e01a2e00 0x5616e0294ef0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc864019930 tx=0x7fc864018020 comp rx=0 tx=0).stop 2024-09-11T11:01:48.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8744c3640 1 -- 172.21.15.145:0/2665516131 reap_dead start 2024-09-11T11:01:48.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 shutdown_connections 2024-09-11T11:01:48.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 >> 172.21.15.145:0/2665516131 conn(0x5616e0116290 msgr2=0x5616e0288510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 shutdown_connections 2024-09-11T11:01:48.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.268+0000 7fc8761b2980 1 -- 172.21.15.145:0/2665516131 wait complete. 2024-09-11T11:01:48.282 INFO:teuthology.orchestra.run.smithi145.stdout:fooFoofooFooFULL_CONTROL 2024-09-11T11:01:48.283 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-11T11:01:48.285 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-11T11:01:48.292 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:48.292 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-11T11:01:48.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-11T11:01:48.292 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-11T11:01:48.358 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:48.358 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:48.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01af60a980 1 Processor -- start 2024-09-11T11:01:48.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01af60a980 1 -- start start 2024-09-11T11:01:48.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01af60a980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5600951e2550 0x5600951e2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01af60a980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56009506bae0 con 0x5600951e2ea0 2024-09-11T11:01:48.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01af60a980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x56009508fe30 con 0x5600951e2550 2024-09-11T11:01:48.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01ad11a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5600951e2550 0x5600951e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01ad11a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5600951e2550 0x5600951e2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60850/0 (socket says 172.21.15.145:60850) 2024-09-11T11:01:48.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01ad11a640 1 -- 172.21.15.145:0/54822253 learned_addr learned my addr 172.21.15.145:0/54822253 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.360 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01ad11a640 1 -- 172.21.15.145:0/54822253 >> v1:172.21.15.102:6789/0 conn(0x5600951e2ea0 legacy=0x5600951e7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.356+0000 7f01ad11a640 1 -- 172.21.15.145:0/54822253 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600951ea170 con 0x5600951e2550 2024-09-11T11:01:48.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01ad11a640 1 --2- 172.21.15.145:0/54822253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600951e2930 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f01a800a7a0 tx=0x7f01a801d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb1607fb9aa86d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01a7fff640 1 -- 172.21.15.145:0/54822253 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80b3070 con 0x5600951e2550 2024-09-11T11:01:48.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01a7fff640 1 -- 172.21.15.145:0/54822253 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80a6820 con 0x5600951e2550 2024-09-11T11:01:48.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01a7fff640 1 -- 172.21.15.145:0/54822253 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80a6b20 con 0x5600951e2550 2024-09-11T11:01:48.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01af60a980 1 -- 172.21.15.145:0/54822253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 msgr2=0x5600951e2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01af60a980 1 --2- 172.21.15.145:0/54822253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600951e2930 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f01a800a7a0 tx=0x7f01a801d800 comp rx=0 tx=0).stop 2024-09-11T11:01:48.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01af60a980 1 -- 172.21.15.145:0/54822253 shutdown_connections 2024-09-11T11:01:48.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01af60a980 1 --2- 172.21.15.145:0/54822253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600951e2930 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01af60a980 1 -- 172.21.15.145:0/54822253 >> 172.21.15.145:0/54822253 conn(0x5600951de070 msgr2=0x5600951e0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01af60a980 1 -- 172.21.15.145:0/54822253 shutdown_connections 2024-09-11T11:01:48.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.360+0000 7f01af60a980 1 -- 172.21.15.145:0/54822253 wait complete. 2024-09-11T11:01:48.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01af60a980 1 Processor -- start 2024-09-11T11:01:48.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01af60a980 1 -- start start 2024-09-11T11:01:48.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01af60a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01af60a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x560095091200 con 0x5600951e2550 2024-09-11T11:01:48.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60864/0 (socket says 172.21.15.145:60864) 2024-09-11T11:01:48.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01ad11a640 1 -- 172.21.15.145:0/3452918986 learned_addr learned my addr 172.21.15.145:0/3452918986 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01ad11a640 1 -- 172.21.15.145:0/3452918986 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600952ccf30 con 0x5600951e2550 2024-09-11T11:01:48.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.376+0000 7f01ad11a640 1 --2- 172.21.15.145:0/3452918986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952cc960 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f01a801b430 tx=0x7f01a80033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce90d823d492589 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f009b606640 1 -- 172.21.15.145:0/3452918986 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80b3070 con 0x5600951e2550 2024-09-11T11:01:48.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f009b606640 1 -- 172.21.15.145:0/3452918986 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80b4040 con 0x5600951e2550 2024-09-11T11:01:48.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f009b606640 1 -- 172.21.15.145:0/3452918986 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80a6cd0 con 0x5600951e2550 2024-09-11T11:01:48.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- 172.21.15.145:0/3452918986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 msgr2=0x5600952cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 --2- 172.21.15.145:0/3452918986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952cc960 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f01a801b430 tx=0x7f01a80033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- 172.21.15.145:0/3452918986 shutdown_connections 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 --2- 172.21.15.145:0/3452918986 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952cc960 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- 172.21.15.145:0/3452918986 >> 172.21.15.145:0/3452918986 conn(0x5600951de070 msgr2=0x5600952c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- 172.21.15.145:0/3452918986 shutdown_connections 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- 172.21.15.145:0/3452918986 wait complete. 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 Processor -- start 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- start start 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952d3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5600951e9bb0 con 0x5600951e2550 2024-09-11T11:01:48.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952d3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952d3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60876/0 (socket says 172.21.15.145:60876) 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01ad11a640 1 -- 172.21.15.145:0/3426949236 learned_addr learned my addr 172.21.15.145:0/3426949236 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01ad11a640 1 -- 172.21.15.145:0/3426949236 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600952d40d0 con 0x5600951e2550 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01ad11a640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952d3b90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f01a801beb0 tx=0x7f01a801a5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f0099e03640 1 -- 172.21.15.145:0/3426949236 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80aeda0 con 0x5600951e2550 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600952d4360 con 0x5600951e2550 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f0099e03640 1 -- 172.21.15.145:0/3426949236 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80c2470 con 0x5600951e2550 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f0099e03640 1 -- 172.21.15.145:0/3426949236 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80c2790 con 0x5600951e2550 2024-09-11T11:01:48.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.380+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600952d7040 con 0x5600951e2550 2024-09-11T11:01:48.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f0099e03640 1 -- 172.21.15.145:0/3426949236 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01a80c2930 con 0x5600951e2550 2024-09-11T11:01:48.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f0099e03640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0094034650 0x7f0094036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f0099e03640 1 -- 172.21.15.145:0/3426949236 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f01a80bd070 con 0x5600951e2550 2024-09-11T11:01:48.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01ac919640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0094034650 0x7f0094036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01af60a980 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5600951e2ea0 0x5600952dab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600952db170 con 0x5600951e2ea0 2024-09-11T11:01:48.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01ad91b640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5600951e2ea0 0x5600952dab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01ac919640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0094034650 0x7f0094036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0198001e20 tx=0x7f01980013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01ad91b640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5600951e2ea0 0x5600952dab20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01ad91b640 1 -- 172.21.15.145:0/3426949236 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x5600951e2ea0 2024-09-11T11:01:48.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01af60a980 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5600952dbf60 0x5600952de350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600952de990 con 0x5600952dbf60 2024-09-11T11:01:48.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01ad11a640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5600952dbf60 0x5600952de350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01ad11a640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5600952dbf60 0x5600952de350 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01ad11a640 1 -- 172.21.15.145:0/3426949236 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01a80b6070 con 0x5600952dbf60 2024-09-11T11:01:48.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.384+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600952e0240 con 0x5600952dbf60 2024-09-11T11:01:48.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01ad11a640 1 -- 172.21.15.145:0/3426949236 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f01a80b6070 con 0x5600952dbf60 2024-09-11T11:01:48.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600952df470 con 0x5600952dbf60 2024-09-11T11:01:48.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01ad11a640 1 -- 172.21.15.145:0/3426949236 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01a80b6070 con 0x5600952dbf60 2024-09-11T11:01:48.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01af60a980 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5600952e15f0 0x5600952e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600952e3f20 con 0x5600952e15f0 2024-09-11T11:01:48.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01ac919640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5600952e15f0 0x5600952e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01ac919640 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5600952e15f0 0x5600952e39e0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01ac919640 1 -- 172.21.15.145:0/3426949236 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f019800d040 con 0x5600952e15f0 2024-09-11T11:01:48.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01af60a980 1 Processor -- start 2024-09-11T11:01:48.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01af60a980 1 -- start start 2024-09-11T11:01:48.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01af60a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600952f18e0 0x5600952f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01af60a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5600950ea800 con 0x5600952f18e0 2024-09-11T11:01:48.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600952f18e0 0x5600952f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600952f18e0 0x5600952f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60878/0 (socket says 172.21.15.145:60878) 2024-09-11T11:01:48.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.388+0000 7f01ad11a640 1 -- 172.21.15.145:0/745148910 learned_addr learned my addr 172.21.15.145:0/745148910 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01ad11a640 1 -- 172.21.15.145:0/745148910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5600952f2240 con 0x5600952f18e0 2024-09-11T11:01:48.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01ad11a640 1 --2- 172.21.15.145:0/745148910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600952f18e0 0x5600952f1d00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f01a80c1fd0 tx=0x7f01a80d73b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f0092ffd640 1 -- 172.21.15.145:0/745148910 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80acdb0 con 0x5600952f18e0 2024-09-11T11:01:48.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f0092ffd640 1 -- 172.21.15.145:0/745148910 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80bf540 con 0x5600952f18e0 2024-09-11T11:01:48.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01af60a980 1 -- 172.21.15.145:0/745148910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5600952f24d0 con 0x5600952f18e0 2024-09-11T11:01:48.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f0092ffd640 1 -- 172.21.15.145:0/745148910 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80bf820 con 0x5600952f18e0 2024-09-11T11:01:48.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01af60a980 1 -- 172.21.15.145:0/745148910 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600952f5150 con 0x5600952f18e0 2024-09-11T11:01:48.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f0092ffd640 1 -- 172.21.15.145:0/745148910 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01a80c0360 con 0x5600952f18e0 2024-09-11T11:01:48.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f0092ffd640 1 --2- 172.21.15.145:0/745148910 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f00840346a0 0x7f0084036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f0092ffd640 1 -- 172.21.15.145:0/745148910 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f01a80f1c10 con 0x5600952f18e0 2024-09-11T11:01:48.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01ac919640 1 --2- 172.21.15.145:0/745148910 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f00840346a0 0x7f0084036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01af60a980 1 Processor -- start 2024-09-11T11:01:48.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01af60a980 1 -- start start 2024-09-11T11:01:48.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01ac919640 1 --2- 172.21.15.145:0/745148910 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f00840346a0 0x7f0084036b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x5600952d8180 tx=0x7f0198006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01af60a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x560095302a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01af60a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5600952cd1f0 con 0x560095302660 2024-09-11T11:01:48.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x560095302a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x560095302a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60886/0 (socket says 172.21.15.145:60886) 2024-09-11T11:01:48.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01ad11a640 1 -- 172.21.15.145:0/1385885674 learned_addr learned my addr 172.21.15.145:0/1385885674 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.392+0000 7f01ad11a640 1 -- 172.21.15.145:0/1385885674 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560095303030 con 0x560095302660 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01ad11a640 1 --2- 172.21.15.145:0/1385885674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x560095302a60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f01a80cb5c0 tx=0x7f01a80ad3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df8309d0a9fbaf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f0090ff9640 1 -- 172.21.15.145:0/1385885674 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80fd070 con 0x560095302660 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f0090ff9640 1 -- 172.21.15.145:0/1385885674 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80d7dd0 con 0x560095302660 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f0090ff9640 1 -- 172.21.15.145:0/1385885674 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80b8ab0 con 0x560095302660 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- 172.21.15.145:0/1385885674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 msgr2=0x560095302a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 --2- 172.21.15.145:0/1385885674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x560095302a60 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f01a80cb5c0 tx=0x7f01a80ad3a0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- 172.21.15.145:0/1385885674 shutdown_connections 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 --2- 172.21.15.145:0/1385885674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x560095302a60 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- 172.21.15.145:0/1385885674 >> 172.21.15.145:0/1385885674 conn(0x5600952fa5e0 msgr2=0x5600952f86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- 172.21.15.145:0/1385885674 shutdown_connections 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- 172.21.15.145:0/1385885674 wait complete. 2024-09-11T11:01:48.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 Processor -- start 2024-09-11T11:01:48.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- start start 2024-09-11T11:01:48.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x5600953097d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x560095303580 con 0x560095302660 2024-09-11T11:01:48.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x5600953097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01ad11a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x5600953097d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60898/0 (socket says 172.21.15.145:60898) 2024-09-11T11:01:48.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 learned_addr learned my addr 172.21.15.145:0/4212149201 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560095309d10 con 0x560095302660 2024-09-11T11:01:48.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01ad11a640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x5600953097d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f01a801d630 tx=0x7f01a80bfa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f0082ffd640 1 -- 172.21.15.145:0/4212149201 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80fd050 con 0x560095302660 2024-09-11T11:01:48.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f0082ffd640 1 -- 172.21.15.145:0/4212149201 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01a80fe040 con 0x560095302660 2024-09-11T11:01:48.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560095309d10 con 0x560095302660 2024-09-11T11:01:48.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f0082ffd640 1 -- 172.21.15.145:0/4212149201 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a80b8ab0 con 0x560095302660 2024-09-11T11:01:48.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.396+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560095309d10 con 0x560095302660 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f0082ffd640 1 -- 172.21.15.145:0/4212149201 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f01a810b020 con 0x560095302660 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f0082ffd640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0078034650 0x7f0078036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f0082ffd640 1 -- 172.21.15.145:0/4212149201 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f01a8109020 con 0x560095302660 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ac919640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0078034650 0x7f0078036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560095314920 0x560095316de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560095317530 con 0x560095314920 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ad91b640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560095314920 0x560095316de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ac919640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0078034650 0x7f0078036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5600952e0190 tx=0x7f0198011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ad91b640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560095314920 0x560095316de0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 20 realm 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560095313d50 con 0x560095314920 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560095317fc0 con 0x560095314920 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560095318da0 0x56009531b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56009531b820 con 0x560095318da0 2024-09-11T11:01:48.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ad11a640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560095318da0 0x56009531b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.400+0000 7f01ad11a640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560095318da0 0x56009531b190 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01af60a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56009531c070 con 0x560095318da0 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01af60a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01af60a980 20 searching for the correct realm 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56009531dde0 0x5600953201d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x56009531dde0 2024-09-11T11:01:48.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ac919640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56009531dde0 0x5600953201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ac919640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56009531dde0 0x5600953201d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad11a640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f01a8104070 0x7f01a80f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x7f01a8104070 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad91b640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f01a8104070 0x7f01a80f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad91b640 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f01a8104070 0x7f01a80f1070 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.404+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x56009531dde0 2024-09-11T11:01:48.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x7f01a8104070 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x7f01a8104070 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.408+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x56009531dde0 2024-09-11T11:01:48.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x56009531dde0 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x56009531dde0 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x7f01a8104070 2024-09-11T11:01:48.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.412+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095314920 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x7f01a8104070 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x56009531dde0 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x7f01a8104070 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x56009531dde0 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.416+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x560095320850 con 0x560095318da0 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:48.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56009531c9f0 con 0x560095314920 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56009531d290 con 0x560095318da0 2024-09-11T11:01:48.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:48.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56009531c630 con 0x7f01a8104070 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 zone default found 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 4 Realm: () 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 zonegroup default 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560095321160 con 0x7f01a8104070 2024-09-11T11:01:48.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560095322ee0 con 0x56009531dde0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560095323360 con 0x56009531dde0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 started sync module instance, tier type = 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:48.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.420+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095322380 con 0x560095318da0 2024-09-11T11:01:48.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.424+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.424+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94560503081168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095322380 con 0x560095318da0 2024-09-11T11:01:48.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.424+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095323e20 con 0x560095314920 2024-09-11T11:01:48.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.424+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.424+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94560503085360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095323d50 con 0x560095314920 2024-09-11T11:01:48.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.424+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095324d20 con 0x560095318da0 2024-09-11T11:01:48.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.424+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94560503081168] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.428+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94560503085360] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.428+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.428+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94560503087632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095324830 con 0x560095318da0 2024-09-11T11:01:48.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.428+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953255c0 con 0x7f01a8104070 2024-09-11T11:01:48.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.428+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.428+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94560503091472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095324830 con 0x7f01a8104070 2024-09-11T11:01:48.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.428+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095326080 con 0x560095318da0 2024-09-11T11:01:48.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.428+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94560503087632] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94560503091472] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94560503092528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095326040 con 0x560095318da0 2024-09-11T11:01:48.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095326470 con 0x56009531dde0 2024-09-11T11:01:48.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94560503078608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095326cc0 con 0x56009531dde0 2024-09-11T11:01:48.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095327680 con 0x56009531dde0 2024-09-11T11:01:48.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94560503092528] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.432+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94560503078608] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94560503099856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095326cc0 con 0x56009531dde0 2024-09-11T11:01:48.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095327670 con 0x7f01a8104070 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94560503099856] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94560503097360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x560095326c30 con 0x7f01a8104070 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 20 add_watcher() i=0 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 20 add_watcher() i=1 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 20 add_watcher() i=2 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 20 add_watcher() i=3 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 20 add_watcher() i=4 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 20 add_watcher() i=5 2024-09-11T11:01:48.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 20 add_watcher() i=6 2024-09-11T11:01:48.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94560503097360] v34'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 20 add_watcher() i=7 2024-09-11T11:01:48.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:48.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56009532b450 con 0x560095314920 2024-09-11T11:01:48.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.436+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94560503103264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953288c0 con 0x560095314920 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94560503103264] v34'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f0063fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 5 note: GC not initialized 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f0062fe5640 20 reqs_thread_entry: start 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 Filter name: none 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f0060fe1640 20 reqs_thread_entry: start 2024-09-11T11:01:48.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x56009534f080 con 0x7f01a8104070 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 : miss 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1b762154:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560095350ae0 con 0x560095314920 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(63 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv14 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 info.flags=0x17 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 to cache LRU end 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 get_obj_state: octx=0x7f01a80b88e0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5600953531a8 s->prefetch_data=0 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 3.38 3:1e6903ef:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x56009531dde0 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 10 manifest: total_size = 5 2024-09-11T11:01:48.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.440+0000 7f01af60a980 20 get_obj_state: setting s->obj_tag to _brhg_-VylQb6EUniKQhS7tPzj6cn2X7 2024-09-11T11:01:48.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.444+0000 7f0063fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:48.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.444+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94560503103264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x560095314920 2024-09-11T11:01:48.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.444+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94560503103264] v34'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.444+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94560503081168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x560095318da0 2024-09-11T11:01:48.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.448+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94560503081168] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.448+0000 7f01af60a980 20 remove_watcher() i=0 2024-09-11T11:01:48.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.448+0000 7f01af60a980 2 removed watcher, disabling cache 2024-09-11T11:01:48.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.448+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94560503085360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x560095314920 2024-09-11T11:01:48.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.448+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94560503085360] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x560095314920 2024-09-11T11:01:48.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.448+0000 7f01af60a980 20 remove_watcher() i=1 2024-09-11T11:01:48.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.448+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94560503087632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x560095318da0 2024-09-11T11:01:48.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94560503087632] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01af60a980 20 remove_watcher() i=2 2024-09-11T11:01:48.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94560503091472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x7f01a8104070 2024-09-11T11:01:48.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94560503091472] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01af60a980 20 remove_watcher() i=3 2024-09-11T11:01:48.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94560503092528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x560095318da0 2024-09-11T11:01:48.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01ad11a640 1 -- 172.21.15.145:0/4212149201 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94560503092528] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a8100070 con 0x560095318da0 2024-09-11T11:01:48.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01af60a980 20 remove_watcher() i=4 2024-09-11T11:01:48.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.452+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94560503078608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x56009531dde0 2024-09-11T11:01:48.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94560503078608] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 20 remove_watcher() i=5 2024-09-11T11:01:48.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94560503099856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x56009531dde0 2024-09-11T11:01:48.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01ac919640 1 -- 172.21.15.145:0/4212149201 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94560503099856] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0198036040 con 0x56009531dde0 2024-09-11T11:01:48.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 20 remove_watcher() i=6 2024-09-11T11:01:48.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94560503097360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5600953540b0 con 0x7f01a8104070 2024-09-11T11:01:48.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94560503097360] v34'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f01a00083f0 con 0x7f01a8104070 2024-09-11T11:01:48.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 20 remove_watcher() i=7 2024-09-11T11:01:48.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560095318da0 msgr2=0x56009531b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560095318da0 0x56009531b190 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560095314920 msgr2=0x560095316de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x560095314920 0x560095316de0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f01a8104070 msgr2=0x7f01a80f1070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f01a8104070 0x7f01a80f1070 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56009531dde0 msgr2=0x5600953201d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56009531dde0 0x5600953201d0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0078034650 msgr2=0x7f0078036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0078034650 0x7f0078036b10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5600952e0190 tx=0x7f0198011000 comp rx=0 tx=0).stop 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 msgr2=0x5600953097d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01ad91b640 1 -- 172.21.15.145:0/4212149201 reap_dead start 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x5600953097d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f01a801d630 tx=0x7f01a80bfa50 comp rx=0 tx=0).stop 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 shutdown_connections 2024-09-11T11:01:48.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 --2- 172.21.15.145:0/4212149201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560095302660 0x5600953097d0 secure :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f01a801d630 tx=0x7f01a80bfa50 comp rx=0 tx=0).stop 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.456+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 >> 172.21.15.145:0/4212149201 conn(0x5600952fa5e0 msgr2=0x5600952f86b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 shutdown_connections 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/4212149201 wait complete. 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/745148910 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f00840346a0 msgr2=0x7f0084036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/745148910 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f00840346a0 0x7f0084036b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x5600952d8180 tx=0x7f0198006000 comp rx=0 tx=0).stop 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/745148910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600952f18e0 msgr2=0x5600952f1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/745148910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600952f18e0 0x5600952f1d00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f01a80c1fd0 tx=0x7f01a80d73b0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/745148910 shutdown_connections 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/745148910 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f00840346a0 0x7f0084036b60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/745148910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600952f18e0 0x5600952f1d00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/745148910 >> 172.21.15.145:0/745148910 conn(0x5600952e6a30 msgr2=0x5600952e94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/745148910 shutdown_connections 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/745148910 wait complete. 2024-09-11T11:01:48.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5600952dbf60 msgr2=0x5600952de350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5600952dbf60 0x5600952de350 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5600951e2ea0 msgr2=0x5600952dab20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5600951e2ea0 0x5600952dab20 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5600952e15f0 msgr2=0x5600952e39e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5600952e15f0 0x5600952e39e0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0094034650 msgr2=0x7f0094036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0094034650 0x7f0094036b10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0198001e20 tx=0x7f01980013a0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 msgr2=0x5600952d3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 --2- 172.21.15.145:0/3426949236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5600951e2550 0x5600952d3b90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f01a801beb0 tx=0x7f01a801a5a0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01ad91b640 1 -- 172.21.15.145:0/3426949236 reap_dead start 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 shutdown_connections 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 >> 172.21.15.145:0/3426949236 conn(0x5600951de070 msgr2=0x5600952c7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 shutdown_connections 2024-09-11T11:01:48.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.460+0000 7f01af60a980 1 -- 172.21.15.145:0/3426949236 wait complete. 2024-09-11T11:01:48.473 INFO:teuthology.orchestra.run.smithi145.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-11T11:01:48.473 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-11T11:01:48.475 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-11T11:01:48.504 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:48.609 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-11T11:01:48.609 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-11T11:01:48.610 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-11T11:01:48.610 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-11T11:01:48.610 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-11T11:01:48.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-11T11:01:48.610 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-11T11:01:48.649 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:48.650 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:48.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2022b12980 1 Processor -- start 2024-09-11T11:01:48.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2022b12980 1 -- start start 2024-09-11T11:01:48.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2022b12980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e72b9138f0 0x55e72b913cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2022b12980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e72b799ae0 con 0x55e72b914240 2024-09-11T11:01:48.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2022b12980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55e72b7bde30 con 0x55e72b9138f0 2024-09-11T11:01:48.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2020622640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e72b9138f0 0x55e72b913cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2020622640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e72b9138f0 0x55e72b913cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60900/0 (socket says 172.21.15.145:60900) 2024-09-11T11:01:48.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2020622640 1 -- 172.21.15.145:0/203964077 learned_addr learned my addr 172.21.15.145:0/203964077 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2020622640 1 -- 172.21.15.145:0/203964077 >> v1:172.21.15.102:6789/0 conn(0x55e72b914240 legacy=0x55e72b918c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.648+0000 7f2020622640 1 -- 172.21.15.145:0/203964077 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72b91b4c0 con 0x55e72b9138f0 2024-09-11T11:01:48.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f2020622640 1 --2- 172.21.15.145:0/203964077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b913cd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f201000a4e0 tx=0x7f201001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70ae176fa87da58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f201f620640 1 -- 172.21.15.145:0/203964077 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100aa540 con 0x55e72b9138f0 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f201f620640 1 -- 172.21.15.145:0/203964077 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20100aa6e0 con 0x55e72b9138f0 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f201f620640 1 -- 172.21.15.145:0/203964077 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100aaa40 con 0x55e72b9138f0 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f2022b12980 1 -- 172.21.15.145:0/203964077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 msgr2=0x55e72b913cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f2022b12980 1 --2- 172.21.15.145:0/203964077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b913cd0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f201000a4e0 tx=0x7f201001b090 comp rx=0 tx=0).stop 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f2022b12980 1 -- 172.21.15.145:0/203964077 shutdown_connections 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f2022b12980 1 --2- 172.21.15.145:0/203964077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b913cd0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f2022b12980 1 -- 172.21.15.145:0/203964077 >> 172.21.15.145:0/203964077 conn(0x55e72b887240 msgr2=0x55e72b887650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f2022b12980 1 -- 172.21.15.145:0/203964077 shutdown_connections 2024-09-11T11:01:48.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.652+0000 7f2022b12980 1 -- 172.21.15.145:0/203964077 wait complete. 2024-09-11T11:01:48.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.668+0000 7f2022b12980 1 Processor -- start 2024-09-11T11:01:48.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.668+0000 7f2022b12980 1 -- start start 2024-09-11T11:01:48.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.668+0000 7f2022b12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b9febe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.668+0000 7f2022b12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e72b7bf200 con 0x55e72b9138f0 2024-09-11T11:01:48.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.668+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b9febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.668+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b9febe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60904/0 (socket says 172.21.15.145:60904) 2024-09-11T11:01:48.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.668+0000 7f2020622640 1 -- 172.21.15.145:0/1254486147 learned_addr learned my addr 172.21.15.145:0/1254486147 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2020622640 1 -- 172.21.15.145:0/1254486147 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72b9ff1b0 con 0x55e72b9138f0 2024-09-11T11:01:48.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2020622640 1 --2- 172.21.15.145:0/1254486147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b9febe0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2010017ca0 tx=0x7f20100033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97914c2f2a38afd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f1f0e60c640 1 -- 172.21.15.145:0/1254486147 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100b9070 con 0x55e72b9138f0 2024-09-11T11:01:48.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f1f0e60c640 1 -- 172.21.15.145:0/1254486147 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20100aaa80 con 0x55e72b9138f0 2024-09-11T11:01:48.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f1f0e60c640 1 -- 172.21.15.145:0/1254486147 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100aad60 con 0x55e72b9138f0 2024-09-11T11:01:48.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- 172.21.15.145:0/1254486147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 msgr2=0x55e72b9febe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 --2- 172.21.15.145:0/1254486147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b9febe0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2010017ca0 tx=0x7f20100033b0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- 172.21.15.145:0/1254486147 shutdown_connections 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 --2- 172.21.15.145:0/1254486147 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72b9febe0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- 172.21.15.145:0/1254486147 >> 172.21.15.145:0/1254486147 conn(0x55e72b887240 msgr2=0x55e72b9fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- 172.21.15.145:0/1254486147 shutdown_connections 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- 172.21.15.145:0/1254486147 wait complete. 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 Processor -- start 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- start start 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72ba05e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e72b91af00 con 0x55e72b9138f0 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72ba05e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72ba05e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60912/0 (socket says 172.21.15.145:60912) 2024-09-11T11:01:48.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2020622640 1 -- 172.21.15.145:0/56532188 learned_addr learned my addr 172.21.15.145:0/56532188 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2020622640 1 -- 172.21.15.145:0/56532188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72ba06350 con 0x55e72b9138f0 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2020622640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72ba05e10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f201001aec0 tx=0x7f2010017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f1f0ce09640 1 -- 172.21.15.145:0/56532188 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100cc070 con 0x55e72b9138f0 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e72ba065e0 con 0x55e72b9138f0 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f1f0ce09640 1 -- 172.21.15.145:0/56532188 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20100c7410 con 0x55e72b9138f0 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f1f0ce09640 1 -- 172.21.15.145:0/56532188 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100b9070 con 0x55e72b9138f0 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.672+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e72ba092c0 con 0x55e72b9138f0 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f1f0ce09640 1 -- 172.21.15.145:0/56532188 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20100b3040 con 0x55e72b9138f0 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f1f0ce09640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f08034650 0x7f1f08036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f1f0ce09640 1 -- 172.21.15.145:0/56532188 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f20100c4070 con 0x55e72b9138f0 2024-09-11T11:01:48.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f201fe21640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f08034650 0x7f1f08036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2022b12980 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72b914240 0x55e72ba0cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba0d4e0 con 0x55e72b914240 2024-09-11T11:01:48.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2020e23640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72b914240 0x55e72ba0cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f201fe21640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f08034650 0x7f1f08036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2014000f70 tx=0x7f2014001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2020e23640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72b914240 0x55e72ba0cf10 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2020e23640 1 -- 172.21.15.145:0/56532188 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72b914240 2024-09-11T11:01:48.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2022b12980 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba0e2e0 0x55e72ba106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba10d30 con 0x55e72ba0e2e0 2024-09-11T11:01:48.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2020622640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba0e2e0 0x55e72ba106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.676+0000 7f2020622640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba0e2e0 0x55e72ba106d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2020622640 1 -- 172.21.15.145:0/56532188 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba0e2e0 2024-09-11T11:01:48.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba125e0 con 0x55e72ba0e2e0 2024-09-11T11:01:48.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2020622640 1 -- 172.21.15.145:0/56532188 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba0e2e0 2024-09-11T11:01:48.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba11810 con 0x55e72ba0e2e0 2024-09-11T11:01:48.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2020622640 1 -- 172.21.15.145:0/56532188 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba0e2e0 2024-09-11T11:01:48.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2022b12980 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e72ba13990 0x55e72ba15d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba162c0 con 0x55e72ba13990 2024-09-11T11:01:48.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f201fe21640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e72ba13990 0x55e72ba15d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f201fe21640 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e72ba13990 0x55e72ba15d80 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f201fe21640 1 -- 172.21.15.145:0/56532188 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f201400d040 con 0x55e72ba13990 2024-09-11T11:01:48.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2022b12980 1 Processor -- start 2024-09-11T11:01:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2022b12980 1 -- start start 2024-09-11T11:01:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2022b12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba23c80 0x55e72ba240a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2022b12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e72b818800 con 0x55e72ba23c80 2024-09-11T11:01:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba23c80 0x55e72ba240a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba23c80 0x55e72ba240a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60918/0 (socket says 172.21.15.145:60918) 2024-09-11T11:01:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2020622640 1 -- 172.21.15.145:0/2899325367 learned_addr learned my addr 172.21.15.145:0/2899325367 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.680+0000 7f2020622640 1 -- 172.21.15.145:0/2899325367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72ba245e0 con 0x55e72ba23c80 2024-09-11T11:01:48.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2020622640 1 --2- 172.21.15.145:0/2899325367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba23c80 0x55e72ba240a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f20100e2e90 tx=0x7f20100cfe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f1f05ffb640 1 -- 172.21.15.145:0/2899325367 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100cf590 con 0x55e72ba23c80 2024-09-11T11:01:48.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2022b12980 1 -- 172.21.15.145:0/2899325367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e72ba24870 con 0x55e72ba23c80 2024-09-11T11:01:48.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f1f05ffb640 1 -- 172.21.15.145:0/2899325367 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20100e8070 con 0x55e72ba23c80 2024-09-11T11:01:48.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2022b12980 1 -- 172.21.15.145:0/2899325367 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e72ba274f0 con 0x55e72ba23c80 2024-09-11T11:01:48.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f1f05ffb640 1 -- 172.21.15.145:0/2899325367 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100cf860 con 0x55e72ba23c80 2024-09-11T11:01:48.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f1f05ffb640 1 -- 172.21.15.145:0/2899325367 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20100ea020 con 0x55e72ba23c80 2024-09-11T11:01:48.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f1f05ffb640 1 --2- 172.21.15.145:0/2899325367 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef8034600 0x7f1ef8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f1f05ffb640 1 -- 172.21.15.145:0/2899325367 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f20100d6040 con 0x55e72ba23c80 2024-09-11T11:01:48.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f201fe21640 1 --2- 172.21.15.145:0/2899325367 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef8034600 0x7f1ef8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2022b12980 1 Processor -- start 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2022b12980 1 -- start start 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f201fe21640 1 --2- 172.21.15.145:0/2899325367 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef8034600 0x7f1ef8036ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55e72ba0a400 tx=0x7f2014006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2022b12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba309a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2022b12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e72b9ff470 con 0x55e72ba305c0 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba309a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba309a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60930/0 (socket says 172.21.15.145:60930) 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2020622640 1 -- 172.21.15.145:0/3846209146 learned_addr learned my addr 172.21.15.145:0/3846209146 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2020622640 1 -- 172.21.15.145:0/3846209146 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72ba30f70 con 0x55e72ba305c0 2024-09-11T11:01:48.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.684+0000 7f2020622640 1 --2- 172.21.15.145:0/3846209146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba309a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f20100e1c60 tx=0x7f20100d1b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7a17a43f66d299 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f1eff7fe640 1 -- 172.21.15.145:0/3846209146 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100c7e30 con 0x55e72ba305c0 2024-09-11T11:01:48.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f1eff7fe640 1 -- 172.21.15.145:0/3846209146 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20100fa070 con 0x55e72ba305c0 2024-09-11T11:01:48.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f1eff7fe640 1 -- 172.21.15.145:0/3846209146 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100cebe0 con 0x55e72ba305c0 2024-09-11T11:01:48.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- 172.21.15.145:0/3846209146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 msgr2=0x55e72ba309a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 --2- 172.21.15.145:0/3846209146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba309a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f20100e1c60 tx=0x7f20100d1b50 comp rx=0 tx=0).stop 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- 172.21.15.145:0/3846209146 shutdown_connections 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 --2- 172.21.15.145:0/3846209146 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba309a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- 172.21.15.145:0/3846209146 >> 172.21.15.145:0/3846209146 conn(0x55e72ba2c9a0 msgr2=0x55e72ba2aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- 172.21.15.145:0/3846209146 shutdown_connections 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- 172.21.15.145:0/3846209146 wait complete. 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 Processor -- start 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- start start 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba37750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e72ba31410 con 0x55e72ba305c0 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba37750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2020622640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba37750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60944/0 (socket says 172.21.15.145:60944) 2024-09-11T11:01:48.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 learned_addr learned my addr 172.21.15.145:0/1343330298 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e72ba37c90 con 0x55e72ba305c0 2024-09-11T11:01:48.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2020622640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba37750 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f20100a7fb0 tx=0x7f20100a7f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f1efdffb640 1 -- 172.21.15.145:0/1343330298 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100c7e30 con 0x55e72ba305c0 2024-09-11T11:01:48.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e72ba37c90 con 0x55e72ba305c0 2024-09-11T11:01:48.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f1efdffb640 1 -- 172.21.15.145:0/1343330298 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20100e44c0 con 0x55e72ba305c0 2024-09-11T11:01:48.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f1efdffb640 1 -- 172.21.15.145:0/1343330298 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20100e47e0 con 0x55e72ba305c0 2024-09-11T11:01:48.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.688+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e72ba37c90 con 0x55e72ba305c0 2024-09-11T11:01:48.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f1efdffb640 1 -- 172.21.15.145:0/1343330298 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f20100a9590 con 0x55e72ba305c0 2024-09-11T11:01:48.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f1efdffb640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef0034650 0x7f1ef0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f1efdffb640 1 -- 172.21.15.145:0/1343330298 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f2010116bd0 con 0x55e72ba305c0 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f201fe21640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef0034650 0x7f1ef0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72ba425f0 0x55e72ba44ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba45200 con 0x55e72ba425f0 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2020e23640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72ba425f0 0x55e72ba44ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f201fe21640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef0034650 0x7f1ef0036b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55e72ba12530 tx=0x7f2014011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2020e23640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72ba425f0 0x55e72ba44ab0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 realm 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba41a20 con 0x55e72ba425f0 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba45cc0 con 0x55e72ba425f0 2024-09-11T11:01:48.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba46aa0 0x55e72ba48e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49520 con 0x55e72ba46aa0 2024-09-11T11:01:48.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2020622640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba46aa0 0x55e72ba48e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2020622640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba46aa0 0x55e72ba48e90 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:48.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.692+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2022b12980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2022b12980 20 searching for the correct realm 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e72ba4bae0 0x55e72ba4ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba4e550 con 0x55e72ba4bae0 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f201fe21640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e72ba4bae0 0x55e72ba4ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f201fe21640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e72ba4bae0 0x55e72ba4ded0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba4e550 con 0x55e72ba46aa0 2024-09-11T11:01:48.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020622640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20100e7a40 0x7f201012a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x7f20100e7a40 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20100e7a40 0x7f201012a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20100e7a40 0x7f201012a7c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba4bae0 2024-09-11T11:01:48.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.696+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x7f20100e7a40 2024-09-11T11:01:48.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x7f20100e7a40 2024-09-11T11:01:48.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba4bae0 2024-09-11T11:01:48.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.700+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba4bae0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba4bae0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x7f20100e7a40 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba425f0 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x7f20100e7a40 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba4bae0 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x7f20100e7a40 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.704+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba4bae0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba49d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba4a5c0 con 0x55e72ba425f0 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba4a9b0 con 0x55e72ba46aa0 2024-09-11T11:01:48.718 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba4a9b0 con 0x7f20100e7a40 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 zone default found 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 4 Realm: () 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 zonegroup default 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba4e9b0 con 0x7f20100e7a40 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.708+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba50730 con 0x55e72ba4bae0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba50c80 con 0x55e72ba4bae0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 20 started sync module instance, tier type = 2024-09-11T11:01:48.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:48.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba4fbd0 con 0x55e72ba46aa0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94451358040304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba4fbd0 con 0x55e72ba46aa0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.712+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba51800 con 0x55e72ba425f0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94451358044880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba517c0 con 0x55e72ba425f0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba52730 con 0x55e72ba46aa0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94451358040304] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94451358044880] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94451358047216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba52730 con 0x55e72ba46aa0 2024-09-11T11:01:48.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba52b80 con 0x7f20100e7a40 2024-09-11T11:01:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94451358037792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba52b40 con 0x7f20100e7a40 2024-09-11T11:01:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.716+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba53a60 con 0x55e72ba46aa0 2024-09-11T11:01:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94451358047216] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94451358037792] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94451358052208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba53a60 con 0x55e72ba46aa0 2024-09-11T11:01:48.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba53e50 con 0x55e72ba4bae0 2024-09-11T11:01:48.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94451358048832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba546a0 con 0x55e72ba4bae0 2024-09-11T11:01:48.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba550a0 con 0x55e72ba4bae0 2024-09-11T11:01:48.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.720+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94451358052208] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94451358048832] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94451358053776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba541f0 con 0x55e72ba4bae0 2024-09-11T11:01:48.726 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba55940 con 0x7f20100e7a40 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94451358053776] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94451358059440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba541f0 con 0x7f20100e7a40 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 20 add_watcher() i=0 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 20 add_watcher() i=1 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 20 add_watcher() i=2 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 20 add_watcher() i=3 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 20 add_watcher() i=4 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 20 add_watcher() i=5 2024-09-11T11:01:48.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 20 add_watcher() i=6 2024-09-11T11:01:48.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94451358059440] v34'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 20 add_watcher() i=7 2024-09-11T11:01:48.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:48.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba58a60 con 0x55e72ba425f0 2024-09-11T11:01:48.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.724+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94451358061712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba55f80 con 0x55e72ba425f0 2024-09-11T11:01:48.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.728+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94451358061712] v34'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.728+0000 7f1ed67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:48.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.728+0000 7f2022b12980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:48.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.728+0000 7f2022b12980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:48.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.728+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba58730 con 0x55e72ba46aa0 2024-09-11T11:01:48.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.732+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.732+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba58820 con 0x7f20100e7a40 2024-09-11T11:01:48.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.732+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.732+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba61c80 con 0x55e72ba4bae0 2024-09-11T11:01:48.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.732+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.732+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba62130 con 0x55e72ba425f0 2024-09-11T11:01:48.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.736+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.736+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba61120 con 0x55e72ba46aa0 2024-09-11T11:01:48.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.736+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.736+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba61120 con 0x55e72ba4bae0 2024-09-11T11:01:48.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.740+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.740+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba61120 con 0x55e72ba46aa0 2024-09-11T11:01:48.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.740+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.740+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba62c90 con 0x55e72ba425f0 2024-09-11T11:01:48.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.744+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'41 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.744+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63140 con 0x55e72ba46aa0 2024-09-11T11:01:48.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.744+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.744+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63140 con 0x55e72ba46aa0 2024-09-11T11:01:48.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.748+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.748+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63140 con 0x55e72ba46aa0 2024-09-11T11:01:48.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.748+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.748+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63140 con 0x55e72ba4bae0 2024-09-11T11:01:48.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.752+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.754 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.752+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba633a0 con 0x55e72ba46aa0 2024-09-11T11:01:48.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.752+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.752+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba633a0 con 0x55e72ba425f0 2024-09-11T11:01:48.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.756+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'47 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.756+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63990 con 0x55e72ba425f0 2024-09-11T11:01:48.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.756+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.756+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63950 con 0x55e72ba46aa0 2024-09-11T11:01:48.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.760+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'56 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.760+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63950 con 0x55e72ba46aa0 2024-09-11T11:01:48.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.760+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.760+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63950 con 0x55e72ba4bae0 2024-09-11T11:01:48.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.764+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.764+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba639e0 con 0x55e72ba46aa0 2024-09-11T11:01:48.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.764+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.764+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba639e0 con 0x55e72ba425f0 2024-09-11T11:01:48.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.768+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.768+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63a70 con 0x55e72ba46aa0 2024-09-11T11:01:48.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.772+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'57 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.772+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63a70 con 0x55e72ba46aa0 2024-09-11T11:01:48.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.772+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.772+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63a70 con 0x55e72ba4bae0 2024-09-11T11:01:48.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.772+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.772+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x55e72ba46aa0 2024-09-11T11:01:48.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.776+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.776+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x55e72ba4bae0 2024-09-11T11:01:48.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.780+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.780+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x55e72ba4bae0 2024-09-11T11:01:48.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.780+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.780+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x55e72ba4bae0 2024-09-11T11:01:48.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.784+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.784+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x55e72ba46aa0 2024-09-11T11:01:48.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.784+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.784+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x55e72ba425f0 2024-09-11T11:01:48.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.788+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'42 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.788+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x55e72ba46aa0 2024-09-11T11:01:48.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.788+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'58 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.788+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x55e72ba425f0 2024-09-11T11:01:48.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'48 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba63b70 con 0x7f20100e7a40 2024-09-11T11:01:48.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f1ed57e2640 20 reqs_thread_entry: start 2024-09-11T11:01:48.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:48.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 20 Filter name: none 2024-09-11T11:01:48.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f1e46ffd640 20 reqs_thread_entry: start 2024-09-11T11:01:48.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:01:48.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba606f0 con 0x7f20100e7a40 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 : miss 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.792+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 8.18 8:1b762154:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba80cf0 con 0x55e72ba425f0 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv14 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 info.flags=0x17 2024-09-11T11:01:48.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 to cache LRU end 2024-09-11T11:01:48.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:48.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:01:48.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 2024-09-11T11:01:48.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:96 4.34 4:2d3c46d7:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe1d0 con 0x7f20100e7a40 2024-09-11T11:01:48.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(96 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:97 4.22 4:458c57ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe1d0 con 0x55e72ba425f0 2024-09-11T11:01:48.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(97 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 4.31 4:8c065590:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe250 con 0x7f20100e7a40 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(98 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:99 4.17 4:eb3331f3:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe250 con 0x55e72ba4bae0 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(99 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 4.1d 4:b9b6e26e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe250 con 0x55e72ba4bae0 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(100 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:101 4.34 4:2ea4556b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe250 con 0x7f20100e7a40 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(101 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.796+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:102 4.5 4:a03158aa:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe8c0 con 0x55e72ba46aa0 2024-09-11T11:01:48.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(102 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6 [call out=425b] v0'0 uv7 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-11T11:01:48.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:103 4.3a 4:5c9326ab:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe8c0 con 0x55e72ba4bae0 2024-09-11T11:01:48.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(103 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:104 4.12 4:4bca3826:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe8c0 con 0x55e72ba425f0 2024-09-11T11:01:48.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(104 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-11T11:01:48.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 4.2a 4:54879807:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe8c0 con 0x55e72ba425f0 2024-09-11T11:01:48.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(105 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:106 4.34 4:2ed2c87d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafe8c0 con 0x7f20100e7a40 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(106 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 [call out=697b] v0'0 uv17 ondisk = 0) ==== 195+0+697 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:107 3.37 3:ec8bfa88:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafbd30 con 0x55e72ba425f0 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(107 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 10 manifest: total_size = 6 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 20 get_obj_state: setting s->obj_tag to 27698d38-fc40-410e-96d8-191ffc71147c.4235.14711614765709485950 2024-09-11T11:01:48.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 20 prepare_atomic_modification: state is not atomic. state=0x55e72ba81598 2024-09-11T11:01:48.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2 2024-09-11T11:01:48.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.800+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:108 4.31 4:8c065590:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba86050 con 0x7f20100e7a40 2024-09-11T11:01:48.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(108 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:109 3.37 3:ec8bfa88:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba86050 con 0x55e72ba425f0 2024-09-11T11:01:48.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(109 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_9c8454ddf7aa50116496bac348d7550d [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:110 4.31 4:8c065590:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba86ae0 con 0x7f20100e7a40 2024-09-11T11:01:48.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:111 3.28 3:155eccab:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba86ae0 con 0x55e72ba4bae0 2024-09-11T11:01:48.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(111 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 10 manifest: total_size = 3 2024-09-11T11:01:48.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 20 get_obj_state: setting s->obj_tag to 27698d38-fc40-410e-96d8-191ffc71147c.4235.1580643010124759413 2024-09-11T11:01:48.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 20 prepare_atomic_modification: state is not atomic. state=0x55e72ba81598 2024-09-11T11:01:48.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6 2024-09-11T11:01:48.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.804+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:112 4.5 4:a03158aa:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba86ae0 con 0x55e72ba46aa0 2024-09-11T11:01:48.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.808+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(110 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x7f20100e7a40 2024-09-11T11:01:48.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.808+0000 7f1eff7fe640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-11T11:01:48.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.808+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(112 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6 [stat,call,call] v34'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.808+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:113 3.28 3:155eccab:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba86ae0 con 0x55e72ba4bae0 2024-09-11T11:01:48.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.808+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(113 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_b1b9a972ccd8c962a473909b97007eb4 [call] v34'3 uv3 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.808+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:114 4.5 4:a03158aa:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba87720 con 0x55e72ba46aa0 2024-09-11T11:01:48.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.808+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.808+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:115 3.28 3:150eb837:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba882b0 con 0x55e72ba4bae0 2024-09-11T11:01:48.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(115 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2022b12980 10 manifest: total_size = 4 2024-09-11T11:01:48.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2022b12980 20 get_obj_state: setting s->obj_tag to 27698d38-fc40-410e-96d8-191ffc71147c.4235.16543108188534722683 2024-09-11T11:01:48.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2022b12980 20 prepare_atomic_modification: state is not atomic. state=0x55e72ba81598 2024-09-11T11:01:48.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2022b12980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8 2024-09-11T11:01:48.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:116 4.12 4:4bca3826:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba87720 con 0x55e72ba425f0 2024-09-11T11:01:48.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(114 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6 [stat,call,call] v34'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f1efeffd640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-11T11:01:48.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 32 ==== osd_op_reply(116 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f20180083f0 con 0x55e72ba425f0 2024-09-11T11:01:48.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.812+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:117 3.28 3:150eb837:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba87720 con 0x55e72ba4bae0 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(117 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:118 4.12 4:4bca3826:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba876a0 con 0x55e72ba425f0 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:119 3.25 3:a72c7aff:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8b2e0 con 0x55e72ba425f0 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 33 ==== osd_op_reply(119 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 10 manifest: total_size = 5 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 20 get_obj_state: setting s->obj_tag to 27698d38-fc40-410e-96d8-191ffc71147c.4235.9694007560938477489 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 20 prepare_atomic_modification: state is not atomic. state=0x55e72ba81598 2024-09-11T11:01:48.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 2024-09-11T11:01:48.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:120 4.34 4:2ed2c87d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8b2e0 con 0x7f20100e7a40 2024-09-11T11:01:48.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 34 ==== osd_op_reply(118 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f1eff7fe640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-11T11:01:48.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(120 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 [stat,call,call] v34'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.816+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:121 3.25 3:a72c7aff:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba88e10 con 0x55e72ba425f0 2024-09-11T11:01:48.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 35 ==== osd_op_reply(121 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_24d27c169c2c881eb09a065116f2aa5c [call] v34'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:122 4.34 4:2ed2c87d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8b2e0 con 0x7f20100e7a40 2024-09-11T11:01:48.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:123 3.38 3:1e6903ef:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8b2e0 con 0x55e72ba4bae0 2024-09-11T11:01:48.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(123 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 10 manifest: total_size = 5 2024-09-11T11:01:48.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 20 get_obj_state: setting s->obj_tag to _brhg_-VylQb6EUniKQhS7tPzj6cn2X7 2024-09-11T11:01:48.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 20 get_obj_state: octx=0x7f20100e6bc0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55e72ba81598 s->prefetch_data=0 2024-09-11T11:01:48.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 20 prepare_atomic_modification: state is not atomic. state=0x55e72ba81598 2024-09-11T11:01:48.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 2024-09-11T11:01:48.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:124 4.34 4:2ed2c87d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8b2e0 con 0x7f20100e7a40 2024-09-11T11:01:48.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 23 ==== osd_op_reply(122 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 [stat,call,call] v34'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f1efeffd640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-11T11:01:48.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 24 ==== osd_op_reply(124 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 [stat,call,call] v34'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.820+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:125 3.38 3:1e6903ef:::27698d38-fc40-410e-96d8-191ffc71147c.4235.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba88e10 con 0x55e72ba4bae0 2024-09-11T11:01:48.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== osd_op_reply(125 27698d38-fc40-410e-96d8-191ffc71147c.4235.5_bb3aec0fdcdbc2974890f805c585d432 [call] v34'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:126 4.34 4:2ed2c87d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8b2e0 con 0x7f20100e7a40 2024-09-11T11:01:48.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 20 list_objects_ordered: starting attempt 1 2024-09-11T11:01:48.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-11T11:01:48.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:127 4.34 4:2d3c46d7:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8b2e0 con 0x7f20100e7a40 2024-09-11T11:01:48.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:128 4.22 4:458c57ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba858a0 con 0x55e72ba425f0 2024-09-11T11:01:48.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:129 4.31 4:8c065590:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8fbb0 con 0x7f20100e7a40 2024-09-11T11:01:48.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:130 4.17 4:eb3331f3:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba92510 con 0x55e72ba4bae0 2024-09-11T11:01:48.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:131 4.1d 4:b9b6e26e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8fbb0 con 0x55e72ba4bae0 2024-09-11T11:01:48.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:132 4.34 4:2ea4556b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979a0 con 0x7f20100e7a40 2024-09-11T11:01:48.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:133 4.5 4:a03158aa:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979a0 con 0x55e72ba46aa0 2024-09-11T11:01:48.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:134 4.3a 4:5c9326ab:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba9cc20 con 0x55e72ba4bae0 2024-09-11T11:01:48.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:135 4.12 4:4bca3826:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba9f730 con 0x55e72ba425f0 2024-09-11T11:01:48.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:136 4.2a 4:54879807:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72baa2100 con 0x55e72ba425f0 2024-09-11T11:01:48.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:137 4.34 4:2ed2c87d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72baa49d0 con 0x7f20100e7a40 2024-09-11T11:01:48.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 25 ==== osd_op_reply(129 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 36 ==== osd_op_reply(128 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 37 ==== osd_op_reply(136 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 38 ==== osd_op_reply(135 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 26 ==== osd_op_reply(127 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(133 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(130 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(131 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== osd_op_reply(134 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.824+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 27 ==== osd_op_reply(132 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 28 ==== osd_op_reply(126 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 [stat,call,call] v34'21 uv21 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f1eff7fe640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 29 ==== osd_op_reply(137 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 [call out=124b] v0'0 uv21 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.5])"; uploads.size()=0; is_truncated=0 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:138 4.34 4:2d3c46d7:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x7f20100e7a40 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:139 4.22 4:458c57ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba9f730 con 0x55e72ba425f0 2024-09-11T11:01:48.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:140 4.31 4:8c065590:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafbe80 con 0x7f20100e7a40 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:141 4.17 4:eb3331f3:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x55e72ba4bae0 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:142 4.1d 4:b9b6e26e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafbe80 con 0x55e72ba4bae0 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:143 4.34 4:2ea4556b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba9f730 con 0x7f20100e7a40 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:144 4.5 4:a03158aa:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba97530 con 0x55e72ba46aa0 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:145 4.3a 4:5c9326ab:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x55e72ba4bae0 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:146 4.12 4:4bca3826:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba9f730 con 0x55e72ba425f0 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:147 4.2a 4:54879807:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafbe80 con 0x55e72ba425f0 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:148 4.34 4:2ed2c87d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x7f20100e7a40 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== osd_op_reply(141 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.3 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 30 ==== osd_op_reply(138 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.0 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 31 ==== osd_op_reply(140 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== osd_op_reply(145 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 39 ==== osd_op_reply(139 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== osd_op_reply(142 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 32 ==== osd_op_reply(143 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.5 [call out=85b] v0'0 uv6 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 40 ==== osd_op_reply(146 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 41 ==== osd_op_reply(147 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 33 ==== osd_op_reply(148 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 [call out=124b] v0'0 uv21 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(144 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6 [call out=124b] v0'0 uv9 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.828+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x7f20100e7a40 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 34 ==== osd_op_reply(149 foo.buckets [call] v34'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f2022b12980 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x7f20100e7a40 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 35 ==== osd_op_reply(150 myfoo [call,call,delete] v34'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f2022b12980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f2022b12980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94451358333408 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafbe40 con 0x55e72ba4bae0 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 37 ==== watch-notify(notify (1) cookie 94451358053776 notify 146028888076 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55e72ba63030 con 0x55e72ba4bae0 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f1eff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888076 cookie 94451358053776 notifier 4654 bl.length()=149 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 38 ==== osd_op_reply(151 notify.6 [notify cookie 94451358333408 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f1eff7fe640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1ee4003d70 con 0x55e72ba4bae0 2024-09-11T11:01:48.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 39 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 40 ==== watch-notify(notify_complete (2) cookie 94451358333408 notify 146028888076 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e72ba614c0 con 0x55e72ba4bae0 2024-09-11T11:01:48.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.832+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:153 8.18 8:1b762154:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x55e72ba425f0 2024-09-11T11:01:48.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 42 ==== osd_op_reply(153 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 [call,call,delete] v34'15 uv15 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5 from cache 2024-09-11T11:01:48.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.5, ofs0, ns] 2024-09-11T11:01:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:154 7.d 7:b4812045:::notify.4:head [notify cookie 94451358744128 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x55e72ba46aa0 2024-09-11T11:01:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== watch-notify(notify (1) cookie 94451358052208 notify 146028888101 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55e72ba64020 con 0x55e72ba46aa0 2024-09-11T11:01:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f1eff7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888101 cookie 94451358052208 notifier 4654 bl.length()=206 2024-09-11T11:01:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(154 notify.4 [notify cookie 94451358744128 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f1eff7fe640 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:155 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f1ee4003d70 con 0x55e72ba46aa0 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(155 notify.4 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== watch-notify(notify_complete (2) cookie 94451358744128 notify 146028888101 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e72ba245e0 con 0x55e72ba46aa0 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:156 4.34 4:2d3c46d7:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x7f20100e7a40 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:157 4.22 4:458c57ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72bafbe40 con 0x55e72ba425f0 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:158 4.31 4:8c065590:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba9ca90 con 0x7f20100e7a40 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:159 4.17 4:eb3331f3:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8bd70 con 0x55e72ba4bae0 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:160 4.1d 4:b9b6e26e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba7f2e0 con 0x55e72ba4bae0 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:161 4.34 4:2ea4556b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x7f20100e7a40 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:162 4.5 4:a03158aa:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba5ef40 con 0x55e72ba46aa0 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:163 4.3a 4:5c9326ab:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba8bd70 con 0x55e72ba4bae0 2024-09-11T11:01:48.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.836+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:164 4.12 4:4bca3826:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba5ef40 con 0x55e72ba425f0 2024-09-11T11:01:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 36 ==== osd_op_reply(158 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.2 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:165 4.2a 4:54879807:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba7f2e0 con 0x55e72ba425f0 2024-09-11T11:01:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:166 4.34 4:2ed2c87d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba979e0 con 0x7f20100e7a40 2024-09-11T11:01:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 41 ==== osd_op_reply(159 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.3 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 42 ==== osd_op_reply(160 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.4 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 43 ==== osd_op_reply(163 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.7 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 43 ==== osd_op_reply(157 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.1 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 44 ==== osd_op_reply(164 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.8 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 37 ==== osd_op_reply(156 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.0 [delete] v34'22 uv22 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(162 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.6 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 38 ==== osd_op_reply(161 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.5 [delete] v34'23 uv23 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 39 ==== osd_op_reply(166 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.10 [delete] v34'24 uv24 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 45 ==== osd_op_reply(165 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.5.9 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.5 : miss 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 20 rados->read ofs=0 len=0 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:167 6.0 6:00dffcd2:::pubsub..bucket.myfoo%2f27698d38-fc40-410e-96d8-191ffc71147c.4235.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba7f2e0 con 0x55e72ba425f0 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 46 ==== osd_op_reply(167 pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.5 info.flags=0x0 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 10 adding default.rgw.log++pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.5 to cache LRU end 2024-09-11T11:01:48.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.840+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:168 6.0 6:00dffcd2:::pubsub..bucket.myfoo%2f27698d38-fc40-410e-96d8-191ffc71147c.4235.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba7f2e0 con 0x55e72ba425f0 2024-09-11T11:01:48.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.844+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 47 ==== osd_op_reply(168 pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.5 [delete] v34'49 uv42 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.844+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba7f2e0 con 0x7f20100e7a40 2024-09-11T11:01:48.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.844+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 40 ==== osd_op_reply(169 foo.buckets [call] v34'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.848+0000 7f1ed67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:48.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.848+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94451358061712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba7f2b0 con 0x55e72ba425f0 2024-09-11T11:01:48.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.848+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 48 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94451358061712] v34'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.848+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94451358040304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba7f2b0 con 0x55e72ba46aa0 2024-09-11T11:01:48.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.852+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94451358040304] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.852+0000 7f2022b12980 20 remove_watcher() i=0 2024-09-11T11:01:48.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.852+0000 7f2022b12980 2 removed watcher, disabling cache 2024-09-11T11:01:48.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.852+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94451358044880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba62130 con 0x55e72ba425f0 2024-09-11T11:01:48.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.852+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.1 v2:172.21.15.145:6808/1879781812 49 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94451358044880] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2018048390 con 0x55e72ba425f0 2024-09-11T11:01:48.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.852+0000 7f2022b12980 20 remove_watcher() i=1 2024-09-11T11:01:48.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.852+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94451358047216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba62130 con 0x55e72ba46aa0 2024-09-11T11:01:48.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.856+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 45 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94451358047216] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.856+0000 7f2022b12980 20 remove_watcher() i=2 2024-09-11T11:01:48.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.856+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94451358037792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba62130 con 0x7f20100e7a40 2024-09-11T11:01:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.856+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 41 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94451358037792] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.856+0000 7f2022b12980 20 remove_watcher() i=3 2024-09-11T11:01:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.856+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94451358052208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba62130 con 0x55e72ba46aa0 2024-09-11T11:01:48.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.860+0000 7f2020622640 1 -- 172.21.15.145:0/1343330298 <== osd.0 v2:172.21.15.102:6800/3035634142 46 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94451358052208] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20100d1c90 con 0x55e72ba46aa0 2024-09-11T11:01:48.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.860+0000 7f2022b12980 20 remove_watcher() i=4 2024-09-11T11:01:48.862 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.860+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94451358048832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba52f70 con 0x55e72ba4bae0 2024-09-11T11:01:48.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.860+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 44 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94451358048832] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.860+0000 7f2022b12980 20 remove_watcher() i=5 2024-09-11T11:01:48.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.860+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94451358053776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba62130 con 0x55e72ba4bae0 2024-09-11T11:01:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f201fe21640 1 -- 172.21.15.145:0/1343330298 <== osd.3 v2:172.21.15.145:6800/493661776 45 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94451358053776] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2014036040 con 0x55e72ba4bae0 2024-09-11T11:01:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 20 remove_watcher() i=6 2024-09-11T11:01:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94451358059440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e72ba52240 con 0x7f20100e7a40 2024-09-11T11:01:48.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 <== osd.2 v2:172.21.15.145:6816/446921044 42 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94451358059440] v34'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2018048390 con 0x7f20100e7a40 2024-09-11T11:01:48.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 20 remove_watcher() i=7 2024-09-11T11:01:48.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba46aa0 msgr2=0x55e72ba48e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba46aa0 0x55e72ba48e90 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72ba425f0 msgr2=0x55e72ba44ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72ba425f0 0x55e72ba44ab0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20100e7a40 msgr2=0x7f201012a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f20100e7a40 0x7f201012a7c0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e72ba4bae0 msgr2=0x55e72ba4ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e72ba4bae0 0x55e72ba4ded0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef0034650 msgr2=0x7f1ef0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef0034650 0x7f1ef0036b10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55e72ba12530 tx=0x7f2014011000 comp rx=0 tx=0).stop 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2020e23640 1 -- 172.21.15.145:0/1343330298 reap_dead start 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 msgr2=0x55e72ba37750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba37750 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f20100a7fb0 tx=0x7f20100a7f40 comp rx=0 tx=0).stop 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 shutdown_connections 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/1343330298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba305c0 0x55e72ba37750 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 >> 172.21.15.145:0/1343330298 conn(0x55e72ba2c9a0 msgr2=0x55e72ba2aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 shutdown_connections 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/1343330298 wait complete. 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/2899325367 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef8034600 msgr2=0x7f1ef8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/2899325367 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef8034600 0x7f1ef8036ac0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x55e72ba0a400 tx=0x7f2014006000 comp rx=0 tx=0).stop 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/2899325367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba23c80 msgr2=0x55e72ba240a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/2899325367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba23c80 0x55e72ba240a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f20100e2e90 tx=0x7f20100cfe00 comp rx=0 tx=0).stop 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/2899325367 shutdown_connections 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/2899325367 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1ef8034600 0x7f1ef8036ac0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/2899325367 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72ba23c80 0x55e72ba240a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/2899325367 >> 172.21.15.145:0/2899325367 conn(0x55e72ba18dd0 msgr2=0x55e72ba1b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/2899325367 shutdown_connections 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/2899325367 wait complete. 2024-09-11T11:01:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba0e2e0 msgr2=0x55e72ba106d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e72ba0e2e0 0x55e72ba106d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72b914240 msgr2=0x55e72ba0cf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e72b914240 0x55e72ba0cf10 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e72ba13990 msgr2=0x55e72ba15d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.864+0000 7f2022b12980 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e72ba13990 0x55e72ba15d80 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f08034650 msgr2=0x7f1f08036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2022b12980 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1f08034650 0x7f1f08036b10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2014000f70 tx=0x7f2014001420 comp rx=0 tx=0).stop 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 msgr2=0x55e72ba05e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2022b12980 1 --2- 172.21.15.145:0/56532188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e72b9138f0 0x55e72ba05e10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f201001aec0 tx=0x7f2010017e30 comp rx=0 tx=0).stop 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2020e23640 1 -- 172.21.15.145:0/56532188 reap_dead start 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 shutdown_connections 2024-09-11T11:01:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 >> 172.21.15.145:0/56532188 conn(0x55e72b887240 msgr2=0x55e72b9f9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 shutdown_connections 2024-09-11T11:01:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.868+0000 7f2022b12980 1 -- 172.21.15.145:0/56532188 wait complete. 2024-09-11T11:01:48.881 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-11T11:01:48.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-11T11:01:48.882 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-11T11:01:48.963 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:48.963 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:48.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.960+0000 7f0a81080980 1 Processor -- start 2024-09-11T11:01:48.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.960+0000 7f0a81080980 1 -- start start 2024-09-11T11:01:48.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.960+0000 7f0a81080980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55a04cb3ca90 0x55a04cb3ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.960+0000 7f0a81080980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a04c9c0ae0 con 0x55a04caad2e0 2024-09-11T11:01:48.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.960+0000 7f0a81080980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55a04c9e4e30 con 0x55a04cb3ca90 2024-09-11T11:01:48.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7e38f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55a04cb3ca90 0x55a04cb3ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7eb90640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55a04caad2e0 0x55a04cb3b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:60952/0 (socket says 172.21.15.145:60952) 2024-09-11T11:01:48.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7eb90640 1 -- 172.21.15.145:0/737550611 learned_addr learned my addr 172.21.15.145:0/737550611 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:01:48.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7e38f640 1 -- 172.21.15.145:0/737550611 >> v1:172.21.15.102:6789/0 conn(0x55a04caad2e0 legacy=0x55a04cb3b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7e38f640 1 -- 172.21.15.145:0/737550611 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04cb403d0 con 0x55a04cb3ca90 2024-09-11T11:01:48.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7db8e640 1 -- 172.21.15.145:0/737550611 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 129056475 0 0) 0x55a04c9c0ae0 con 0x55a04caad2e0 2024-09-11T11:01:48.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/737550611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cb3ca90 0x55a04cb3ee80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400a480 tx=0x7f0a7401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c68dcfa5f646eb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7db8e640 1 -- 172.21.15.145:0/737550611 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a740b0070 con 0x55a04cb3ca90 2024-09-11T11:01:48.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7db8e640 1 -- 172.21.15.145:0/737550611 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a740ab540 con 0x55a04cb3ca90 2024-09-11T11:01:48.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.964+0000 7f0a7db8e640 1 -- 172.21.15.145:0/737550611 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a740ab840 con 0x55a04cb3ca90 2024-09-11T11:01:48.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.968+0000 7f0a81080980 1 -- 172.21.15.145:0/737550611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cb3ca90 msgr2=0x55a04cb3ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.968+0000 7f0a81080980 1 --2- 172.21.15.145:0/737550611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cb3ca90 0x55a04cb3ee80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400a480 tx=0x7f0a7401b280 comp rx=0 tx=0).stop 2024-09-11T11:01:48.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.968+0000 7f0a81080980 1 -- 172.21.15.145:0/737550611 shutdown_connections 2024-09-11T11:01:48.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.968+0000 7f0a81080980 1 --2- 172.21.15.145:0/737550611 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cb3ca90 0x55a04cb3ee80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.968+0000 7f0a81080980 1 -- 172.21.15.145:0/737550611 >> 172.21.15.145:0/737550611 conn(0x55a04cb330a0 msgr2=0x55a04cb354c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.968+0000 7f0a81080980 1 -- 172.21.15.145:0/737550611 shutdown_connections 2024-09-11T11:01:48.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.968+0000 7f0a81080980 1 -- 172.21.15.145:0/737550611 wait complete. 2024-09-11T11:01:48.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 Processor -- start 2024-09-11T11:01:48.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- start start 2024-09-11T11:01:48.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc237e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a04c9e6200 con 0x55a04caad2e0 2024-09-11T11:01:48.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc237e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc237e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60960/0 (socket says 172.21.15.145:60960) 2024-09-11T11:01:48.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a7eb90640 1 -- 172.21.15.145:0/314509927 learned_addr learned my addr 172.21.15.145:0/314509927 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a7eb90640 1 -- 172.21.15.145:0/314509927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04cc23db0 con 0x55a04caad2e0 2024-09-11T11:01:48.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/314509927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc237e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0a780016c0 tx=0x7f0a78001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fd0dad4128889f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f096ce09640 1 -- 172.21.15.145:0/314509927 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a78003460 con 0x55a04caad2e0 2024-09-11T11:01:48.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f096ce09640 1 -- 172.21.15.145:0/314509927 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a78003600 con 0x55a04caad2e0 2024-09-11T11:01:48.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f096ce09640 1 -- 172.21.15.145:0/314509927 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a78003920 con 0x55a04caad2e0 2024-09-11T11:01:48.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- 172.21.15.145:0/314509927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 msgr2=0x55a04cc237e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:48.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 --2- 172.21.15.145:0/314509927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc237e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f0a780016c0 tx=0x7f0a78001b80 comp rx=0 tx=0).stop 2024-09-11T11:01:48.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- 172.21.15.145:0/314509927 shutdown_connections 2024-09-11T11:01:48.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 --2- 172.21.15.145:0/314509927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc237e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- 172.21.15.145:0/314509927 >> 172.21.15.145:0/314509927 conn(0x55a04cb330a0 msgr2=0x55a04cc1f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- 172.21.15.145:0/314509927 shutdown_connections 2024-09-11T11:01:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- 172.21.15.145:0/314509927 wait complete. 2024-09-11T11:01:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 Processor -- start 2024-09-11T11:01:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- start start 2024-09-11T11:01:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc2aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a81080980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a04cb3fe40 con 0x55a04caad2e0 2024-09-11T11:01:48.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc2aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc2aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60966/0 (socket says 172.21.15.145:60966) 2024-09-11T11:01:48.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.984+0000 7f0a7eb90640 1 -- 172.21.15.145:0/2473016130 learned_addr learned my addr 172.21.15.145:0/2473016130 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a7eb90640 1 -- 172.21.15.145:0/2473016130 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04cc2b0e0 con 0x55a04caad2e0 2024-09-11T11:01:48.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc2aba0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0a780012f0 tx=0x7f0a78001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f096b606640 1 -- 172.21.15.145:0/2473016130 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a78013760 con 0x55a04caad2e0 2024-09-11T11:01:48.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a04cc2b370 con 0x55a04caad2e0 2024-09-11T11:01:48.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f096b606640 1 -- 172.21.15.145:0/2473016130 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a78023070 con 0x55a04caad2e0 2024-09-11T11:01:48.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f096b606640 1 -- 172.21.15.145:0/2473016130 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a78013a30 con 0x55a04caad2e0 2024-09-11T11:01:48.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a04cc2e050 con 0x55a04caad2e0 2024-09-11T11:01:48.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f096b606640 1 -- 172.21.15.145:0/2473016130 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a78010070 con 0x55a04caad2e0 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f096b606640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0964034650 0x7f0964036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f096b606640 1 -- 172.21.15.145:0/2473016130 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f0a78049b00 con 0x55a04caad2e0 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0964034650 0x7f0964036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a81080980 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cb3ca90 0x55a04cc31ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc32220 con 0x55a04cb3ca90 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a7f391640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cb3ca90 0x55a04cc31ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0964034650 0x7f0964036b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a740ad000 tx=0x7f0a740a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a7f391640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cb3ca90 0x55a04cc31ca0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a7f391640 1 -- 172.21.15.145:0/2473016130 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cb3ca90 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a81080980 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc33040 0x55a04cc35430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.988+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc35a70 con 0x55a04cc33040 2024-09-11T11:01:48.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc33040 0x55a04cc35430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc33040 0x55a04cc35430 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a7eb90640 1 -- 172.21.15.145:0/2473016130 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a7800f030 con 0x55a04cc33040 2024-09-11T11:01:48.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc37320 con 0x55a04cc33040 2024-09-11T11:01:48.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a7eb90640 1 -- 172.21.15.145:0/2473016130 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a7800f030 con 0x55a04cc33040 2024-09-11T11:01:48.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc36550 con 0x55a04cc33040 2024-09-11T11:01:48.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a7eb90640 1 -- 172.21.15.145:0/2473016130 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a7800f030 con 0x55a04cc33040 2024-09-11T11:01:48.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a81080980 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a04cc386d0 0x55a04cc3aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc3b000 con 0x55a04cc386d0 2024-09-11T11:01:48.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a04cc386d0 0x55a04cc3aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a04cc386d0 0x55a04cc3aac0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a7e38f640 1 -- 172.21.15.145:0/2473016130 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a740b3040 con 0x55a04cc386d0 2024-09-11T11:01:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.992+0000 7f0a81080980 1 Processor -- start 2024-09-11T11:01:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 -- start start 2024-09-11T11:01:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc489b0 0x55a04cc48dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a04ca3f800 con 0x55a04cc489b0 2024-09-11T11:01:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc489b0 0x55a04cc48dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc489b0 0x55a04cc48dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60972/0 (socket says 172.21.15.145:60972) 2024-09-11T11:01:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a7eb90640 1 -- 172.21.15.145:0/1260465284 learned_addr learned my addr 172.21.15.145:0/1260465284 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a7eb90640 1 -- 172.21.15.145:0/1260465284 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04cc49310 con 0x55a04cc489b0 2024-09-11T11:01:48.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/1260465284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc489b0 0x55a04cc48dd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0a78047fe0 tx=0x7f0a78028c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:48.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0968e01640 1 -- 172.21.15.145:0/1260465284 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7804e070 con 0x55a04cc489b0 2024-09-11T11:01:48.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 -- 172.21.15.145:0/1260465284 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a04cc495a0 con 0x55a04cc489b0 2024-09-11T11:01:48.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0968e01640 1 -- 172.21.15.145:0/1260465284 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a78019040 con 0x55a04cc489b0 2024-09-11T11:01:48.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 -- 172.21.15.145:0/1260465284 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a04cc4c220 con 0x55a04cc489b0 2024-09-11T11:01:48.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0968e01640 1 -- 172.21.15.145:0/1260465284 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a78058060 con 0x55a04cc489b0 2024-09-11T11:01:49.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0968e01640 1 -- 172.21.15.145:0/1260465284 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a78051070 con 0x55a04cc489b0 2024-09-11T11:01:49.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0968e01640 1 --2- 172.21.15.145:0/1260465284 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0958034600 0x7f0958036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0968e01640 1 -- 172.21.15.145:0/1260465284 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f0a780353e0 con 0x55a04cc489b0 2024-09-11T11:01:49.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/1260465284 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0958034600 0x7f0958036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 Processor -- start 2024-09-11T11:01:49.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 -- start start 2024-09-11T11:01:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/1260465284 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0958034600 0x7f0958036ac0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55a04cc2f190 tx=0x7f0a74005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cc558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:48.996+0000 7f0a81080980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a04cc24130 con 0x55a04cc554d0 2024-09-11T11:01:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cc558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cc558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60986/0 (socket says 172.21.15.145:60986) 2024-09-11T11:01:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3762142205 learned_addr learned my addr 172.21.15.145:0/3762142205 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3762142205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04cc55e80 con 0x55a04cc554d0 2024-09-11T11:01:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/3762142205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cc558b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0a78027c00 tx=0x7f0a78022e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6d049f9ee30134 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f09627fc640 1 -- 172.21.15.145:0/3762142205 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a78062070 con 0x55a04cc554d0 2024-09-11T11:01:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f09627fc640 1 -- 172.21.15.145:0/3762142205 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a78045e10 con 0x55a04cc554d0 2024-09-11T11:01:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f09627fc640 1 -- 172.21.15.145:0/3762142205 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a780497d0 con 0x55a04cc554d0 2024-09-11T11:01:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 -- 172.21.15.145:0/3762142205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 msgr2=0x55a04cc558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 --2- 172.21.15.145:0/3762142205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cc558b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0a78027c00 tx=0x7f0a78022e60 comp rx=0 tx=0).stop 2024-09-11T11:01:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 -- 172.21.15.145:0/3762142205 shutdown_connections 2024-09-11T11:01:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 --2- 172.21.15.145:0/3762142205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cc558b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 -- 172.21.15.145:0/3762142205 >> 172.21.15.145:0/3762142205 conn(0x55a04cc518b0 msgr2=0x55a04cc4f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 -- 172.21.15.145:0/3762142205 shutdown_connections 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 -- 172.21.15.145:0/3762142205 wait complete. 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 Processor -- start 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 -- start start 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cb38c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a81080980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a04cc56320 con 0x55a04cc554d0 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cb38c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cb38c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:60998/0 (socket says 172.21.15.145:60998) 2024-09-11T11:01:49.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 learned_addr learned my addr 172.21.15.145:0/3523804208 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.000+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a04cb39190 con 0x55a04cc554d0 2024-09-11T11:01:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cb38c50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0a780415a0 tx=0x7f0a780350b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0960ff9640 1 -- 172.21.15.145:0/3523804208 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a78077070 con 0x55a04cc554d0 2024-09-11T11:01:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0960ff9640 1 -- 172.21.15.145:0/3523804208 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a78041a20 con 0x55a04cc554d0 2024-09-11T11:01:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a04cb39190 con 0x55a04cc554d0 2024-09-11T11:01:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0960ff9640 1 -- 172.21.15.145:0/3523804208 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a780264b0 con 0x55a04cc554d0 2024-09-11T11:01:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a04cb39190 con 0x55a04cc554d0 2024-09-11T11:01:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0960ff9640 1 -- 172.21.15.145:0/3523804208 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a7807a070 con 0x55a04cc554d0 2024-09-11T11:01:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0960ff9640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0948034650 0x7f0948036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0960ff9640 1 -- 172.21.15.145:0/3523804208 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f0a7806e030 con 0x55a04cc554d0 2024-09-11T11:01:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0948034650 0x7f0948036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cc69980 0x55a04cc6be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc6c540 con 0x55a04cc69980 2024-09-11T11:01:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a7f391640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cc69980 0x55a04cc6be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0948034650 0x7f0948036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0a740ae040 tx=0x7f0a740a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a7f391640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cc69980 0x55a04cc6be40 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 20 realm 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc68e00 con 0x55a04cc69980 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc6cfd0 con 0x55a04cc69980 2024-09-11T11:01:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc6ddb0 0x55a04cc701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.004+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc6ddb0 0x55a04cc701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc6ddb0 0x55a04cc701a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a81080980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:49.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc71080 con 0x55a04cc6ddb0 2024-09-11T11:01:49.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a81080980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:49.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a81080980 20 searching for the correct realm 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a04cc728f0 0x55a04cc74db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc75480 con 0x55a04cc728f0 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a04cc728f0 0x55a04cc74db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a7e38f640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a04cc728f0 0x55a04cc74db0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.008+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc75480 con 0x55a04cc6ddb0 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7eb90640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0a7807c060 0x7f0a780356b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x7f0a7807c060 2024-09-11T11:01:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0a7807c060 0x7f0a780356b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0a7807c060 0x7f0a780356b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc728f0 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.012+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x7f0a7807c060 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x7f0a7807c060 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc728f0 2024-09-11T11:01:49.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc728f0 2024-09-11T11:01:49.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.016+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc728f0 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x7f0a7807c060 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc69980 2024-09-11T11:01:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x7f0a7807c060 2024-09-11T11:01:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc728f0 2024-09-11T11:01:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x7f0a7807c060 2024-09-11T11:01:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc728f0 2024-09-11T11:01:49.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.020+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70830 con 0x55a04cc6ddb0 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc70d20 con 0x55a04cc69980 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc71110 con 0x55a04cc6ddb0 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc71110 con 0x7f0a7807c060 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 zone default found 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 4 Realm: () 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 zonegroup default 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc75900 con 0x7f0a7807c060 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc77710 con 0x55a04cc728f0 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc77b80 con 0x55a04cc728f0 2024-09-11T11:01:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 started sync module instance, tier type = 2024-09-11T11:01:49.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:49.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.024+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc76b20 con 0x55a04cc6ddb0 2024-09-11T11:01:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.028+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.028+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94146971267136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc76b20 con 0x55a04cc6ddb0 2024-09-11T11:01:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.028+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc78640 con 0x55a04cc69980 2024-09-11T11:01:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.028+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.028+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94146971271504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc78570 con 0x55a04cc69980 2024-09-11T11:01:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.028+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc79560 con 0x55a04cc6ddb0 2024-09-11T11:01:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.028+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94146971267136] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.032+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94146971271504] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.032+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.032+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94146971273776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc79520 con 0x55a04cc6ddb0 2024-09-11T11:01:49.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.032+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc79e00 con 0x7f0a7807c060 2024-09-11T11:01:49.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.032+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.032+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94146971277648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc79520 con 0x7f0a7807c060 2024-09-11T11:01:49.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.032+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7a8c0 con 0x55a04cc6ddb0 2024-09-11T11:01:49.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.032+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94146971273776] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.036+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94146971277648] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.036+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.036+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94146971278704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7a880 con 0x55a04cc6ddb0 2024-09-11T11:01:49.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.036+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7acb0 con 0x55a04cc728f0 2024-09-11T11:01:49.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.036+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.036+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94146971275344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7b500 con 0x55a04cc728f0 2024-09-11T11:01:49.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.036+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7bf00 con 0x55a04cc728f0 2024-09-11T11:01:49.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.036+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94146971278704] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94146971275344] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94146971280272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7c2f0 con 0x55a04cc728f0 2024-09-11T11:01:49.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7cb80 con 0x7f0a7807c060 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94146971288304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7c7b0 con 0x7f0a7807c060 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 20 add_watcher() i=0 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 20 add_watcher() i=1 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 20 add_watcher() i=2 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 20 add_watcher() i=3 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 20 add_watcher() i=4 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 20 add_watcher() i=5 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94146971280272] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 20 add_watcher() i=6 2024-09-11T11:01:49.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94146971288304] v34'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 20 add_watcher() i=7 2024-09-11T11:01:49.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:49.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7ba10 con 0x55a04cc69980 2024-09-11T11:01:49.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.040+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94146971291424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc7ba10 con 0x55a04cc69980 2024-09-11T11:01:49.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94146971291424] v34'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:49.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:49.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:49.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 5 note: GC not initialized 2024-09-11T11:01:49.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0934fe1640 20 reqs_thread_entry: start 2024-09-11T11:01:49.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:49.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 20 Filter name: none 2024-09-11T11:01:49.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f092dffb640 20 reqs_thread_entry: start 2024-09-11T11:01:49.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca3790 con 0x55a04cc69980 2024-09-11T11:01:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.044+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca98c0 con 0x55a04cc69980 2024-09-11T11:01:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v34'16 uv16 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a81080980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a81080980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a81080980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94146971472688 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca5210 con 0x55a04cc6ddb0 2024-09-11T11:01:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94146971278704 notify 146028888102 ret 0) ==== 621+0+0 (crc 0 0 0) 0x55a04cc4c220 con 0x55a04cc6ddb0 2024-09-11T11:01:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f09627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888102 cookie 94146971278704 notifier 4661 bl.length()=579 2024-09-11T11:01:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94146971472688 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f09627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f09627fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f09627fc640 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0944003eb0 con 0x55a04cc6ddb0 2024-09-11T11:01:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94146971472688 notify 146028888102 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a04cc495a0 con 0x55a04cc6ddb0 2024-09-11T11:01:49.052 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:49.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0935fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:49.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.048+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94146971291424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca15c0 con 0x55a04cc69980 2024-09-11T11:01:49.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.052+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94146971291424] v34'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.052+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94146971267136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca15c0 con 0x55a04cc6ddb0 2024-09-11T11:01:49.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.052+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94146971267136] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.052+0000 7f0a81080980 20 remove_watcher() i=0 2024-09-11T11:01:49.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.052+0000 7f0a81080980 2 removed watcher, disabling cache 2024-09-11T11:01:49.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.052+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94146971271504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca15c0 con 0x55a04cc69980 2024-09-11T11:01:49.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.056+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94146971271504] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x55a04cc69980 2024-09-11T11:01:49.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.056+0000 7f0a81080980 20 remove_watcher() i=1 2024-09-11T11:01:49.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.056+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94146971273776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca15c0 con 0x55a04cc6ddb0 2024-09-11T11:01:49.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.056+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94146971273776] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.056+0000 7f0a81080980 20 remove_watcher() i=2 2024-09-11T11:01:49.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.056+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94146971277648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cc78a30 con 0x7f0a7807c060 2024-09-11T11:01:49.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94146971277648] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a81080980 20 remove_watcher() i=3 2024-09-11T11:01:49.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94146971278704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca15c0 con 0x55a04cc6ddb0 2024-09-11T11:01:49.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a7eb90640 1 -- 172.21.15.145:0/3523804208 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94146971278704] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a78079030 con 0x55a04cc6ddb0 2024-09-11T11:01:49.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a81080980 20 remove_watcher() i=4 2024-09-11T11:01:49.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94146971275344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca15c0 con 0x55a04cc728f0 2024-09-11T11:01:49.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94146971275344] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a81080980 20 remove_watcher() i=5 2024-09-11T11:01:49.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.060+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94146971280272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca15c0 con 0x55a04cc728f0 2024-09-11T11:01:49.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a7e38f640 1 -- 172.21.15.145:0/3523804208 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94146971280272] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a740cb070 con 0x55a04cc728f0 2024-09-11T11:01:49.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 20 remove_watcher() i=6 2024-09-11T11:01:49.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94146971288304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55a04cca15c0 con 0x7f0a7807c060 2024-09-11T11:01:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94146971288304] v34'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a700083f0 con 0x7f0a7807c060 2024-09-11T11:01:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 20 remove_watcher() i=7 2024-09-11T11:01:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc6ddb0 msgr2=0x55a04cc701a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc6ddb0 0x55a04cc701a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cc69980 msgr2=0x55a04cc6be40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cc69980 0x55a04cc6be40 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0a7807c060 msgr2=0x7f0a780356b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0a7807c060 0x7f0a780356b0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a04cc728f0 msgr2=0x55a04cc74db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a04cc728f0 0x55a04cc74db0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0948034650 msgr2=0x7f0948036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0948034650 0x7f0948036b10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0a740ae040 tx=0x7f0a740a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a7f391640 1 -- 172.21.15.145:0/3523804208 reap_dead start 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 msgr2=0x55a04cb38c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cb38c50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0a780415a0 tx=0x7f0a780350b0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 shutdown_connections 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/3523804208 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc554d0 0x55a04cb38c50 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 >> 172.21.15.145:0/3523804208 conn(0x55a04cc518b0 msgr2=0x55a04cc4f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 shutdown_connections 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/3523804208 wait complete. 2024-09-11T11:01:49.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/1260465284 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0958034600 msgr2=0x7f0958036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/1260465284 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0958034600 0x7f0958036ac0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55a04cc2f190 tx=0x7f0a74005a10 comp rx=0 tx=0).stop 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/1260465284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc489b0 msgr2=0x55a04cc48dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/1260465284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc489b0 0x55a04cc48dd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0a78047fe0 tx=0x7f0a78028c20 comp rx=0 tx=0).stop 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/1260465284 shutdown_connections 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/1260465284 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0958034600 0x7f0958036ac0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/1260465284 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04cc489b0 0x55a04cc48dd0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/1260465284 >> 172.21.15.145:0/1260465284 conn(0x55a04cc3dab0 msgr2=0x55a04cc40580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/1260465284 shutdown_connections 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/1260465284 wait complete. 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc33040 msgr2=0x55a04cc35430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a04cc33040 0x55a04cc35430 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cb3ca90 msgr2=0x55a04cc31ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a04cb3ca90 0x55a04cc31ca0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a04cc386d0 msgr2=0x55a04cc3aac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a04cc386d0 0x55a04cc3aac0 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0964034650 msgr2=0x7f0964036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0964034650 0x7f0964036b10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a740ad000 tx=0x7f0a740a5040 comp rx=0 tx=0).stop 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 msgr2=0x55a04cc2aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 --2- 172.21.15.145:0/2473016130 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a04caad2e0 0x55a04cc2aba0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0a780012f0 tx=0x7f0a78001260 comp rx=0 tx=0).stop 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a7f391640 1 -- 172.21.15.145:0/2473016130 reap_dead start 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 shutdown_connections 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 >> 172.21.15.145:0/2473016130 conn(0x55a04cb330a0 msgr2=0x55a04cc1df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 shutdown_connections 2024-09-11T11:01:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.064+0000 7f0a81080980 1 -- 172.21.15.145:0/2473016130 wait complete. 2024-09-11T11:01:49.079 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:49.080 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-11T11:01:49.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-11T11:01:49.080 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-11T11:01:49.155 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:49.155 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:49.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.152+0000 7ff9df131980 1 Processor -- start 2024-09-11T11:01:49.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.152+0000 7ff9df131980 1 -- start start 2024-09-11T11:01:49.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.152+0000 7ff9df131980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e8c4561ed0 0x55e8c45642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.152+0000 7ff9df131980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e8c43e3ae0 con 0x55e8c44d02a0 2024-09-11T11:01:49.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.152+0000 7ff9df131980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55e8c4407e30 con 0x55e8c4561ed0 2024-09-11T11:01:49.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.152+0000 7ff9dc440640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e8c4561ed0 0x55e8c45642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dc440640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55e8c4561ed0 0x55e8c45642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32780/0 (socket says 172.21.15.145:32780) 2024-09-11T11:01:49.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dcc41640 1 --1- 172.21.15.145:0/2057446813 >> v1:172.21.15.102:6789/0 conn(0x55e8c44d02a0 0x55e8c45607b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:60968/0 (socket says 172.21.15.145:60968) 2024-09-11T11:01:49.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dc440640 1 -- 172.21.15.145:0/2057446813 learned_addr learned my addr 172.21.15.145:0/2057446813 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dc440640 1 -- 172.21.15.145:0/2057446813 >> v1:172.21.15.102:6789/0 conn(0x55e8c44d02a0 legacy=0x55e8c45607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dc440640 1 -- 172.21.15.145:0/2057446813 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c44d0680 con 0x55e8c4561ed0 2024-09-11T11:01:49.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dc440640 1 --2- 172.21.15.145:0/2057446813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 0x55e8c45642c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400a5c0 tx=0x7ff9c401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dedfbea8eed71b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dbc3f640 1 -- 172.21.15.145:0/2057446813 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9c40a6070 con 0x55e8c4561ed0 2024-09-11T11:01:49.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dbc3f640 1 -- 172.21.15.145:0/2057446813 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c40af070 con 0x55e8c4561ed0 2024-09-11T11:01:49.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9dbc3f640 1 -- 172.21.15.145:0/2057446813 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9c40aa5c0 con 0x55e8c4561ed0 2024-09-11T11:01:49.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9df131980 1 -- 172.21.15.145:0/2057446813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 msgr2=0x55e8c45642c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9df131980 1 --2- 172.21.15.145:0/2057446813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 0x55e8c45642c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400a5c0 tx=0x7ff9c401b340 comp rx=0 tx=0).stop 2024-09-11T11:01:49.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9df131980 1 -- 172.21.15.145:0/2057446813 shutdown_connections 2024-09-11T11:01:49.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9df131980 1 --2- 172.21.15.145:0/2057446813 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 0x55e8c45642c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9df131980 1 -- 172.21.15.145:0/2057446813 >> 172.21.15.145:0/2057446813 conn(0x55e8c45560a0 msgr2=0x55e8c45584c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9df131980 1 -- 172.21.15.145:0/2057446813 shutdown_connections 2024-09-11T11:01:49.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.156+0000 7ff9df131980 1 -- 172.21.15.145:0/2057446813 wait complete. 2024-09-11T11:01:49.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.172+0000 7ff9df131980 1 Processor -- start 2024-09-11T11:01:49.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.172+0000 7ff9df131980 1 -- start start 2024-09-11T11:01:49.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.172+0000 7ff9df131980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c44d02a0 0x55e8c4648c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.172+0000 7ff9df131980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e8c4409200 con 0x55e8c44d02a0 2024-09-11T11:01:49.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c44d02a0 0x55e8c4648c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c44d02a0 0x55e8c4648c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32796/0 (socket says 172.21.15.145:32796) 2024-09-11T11:01:49.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 -- 172.21.15.145:0/3226330782 learned_addr learned my addr 172.21.15.145:0/3226330782 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 -- 172.21.15.145:0/3226330782 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c4649240 con 0x55e8c44d02a0 2024-09-11T11:01:49.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/3226330782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c44d02a0 0x55e8c4648c70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4001e50 tx=0x7ff9d4001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1029d31c1356d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff8cae0d640 1 -- 172.21.15.145:0/3226330782 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d400e5d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff8cae0d640 1 -- 172.21.15.145:0/3226330782 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d400e770 con 0x55e8c44d02a0 2024-09-11T11:01:49.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff8cae0d640 1 -- 172.21.15.145:0/3226330782 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d400eab0 con 0x55e8c44d02a0 2024-09-11T11:01:49.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 -- 172.21.15.145:0/3226330782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c44d02a0 msgr2=0x55e8c4648c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 --2- 172.21.15.145:0/3226330782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c44d02a0 0x55e8c4648c70 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4001e50 tx=0x7ff9d4001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:49.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 -- 172.21.15.145:0/3226330782 shutdown_connections 2024-09-11T11:01:49.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 --2- 172.21.15.145:0/3226330782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c44d02a0 0x55e8c4648c70 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 -- 172.21.15.145:0/3226330782 >> 172.21.15.145:0/3226330782 conn(0x55e8c45560a0 msgr2=0x55e8c46448a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 -- 172.21.15.145:0/3226330782 shutdown_connections 2024-09-11T11:01:49.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 -- 172.21.15.145:0/3226330782 wait complete. 2024-09-11T11:01:49.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 Processor -- start 2024-09-11T11:01:49.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 -- start start 2024-09-11T11:01:49.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 0x55e8c4650210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9df131980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e8c4567230 con 0x55e8c4561ed0 2024-09-11T11:01:49.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 0x55e8c4650210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 0x55e8c4650210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32802/0 (socket says 172.21.15.145:32802) 2024-09-11T11:01:49.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 -- 172.21.15.145:0/1662254448 learned_addr learned my addr 172.21.15.145:0/1662254448 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 -- 172.21.15.145:0/1662254448 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c4650750 con 0x55e8c4561ed0 2024-09-11T11:01:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.176+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 0x55e8c4650210 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4004000 tx=0x7ff9d4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff8c960a640 1 -- 172.21.15.145:0/1662254448 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d4001260 con 0x55e8c4561ed0 2024-09-11T11:01:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8c46509e0 con 0x55e8c4561ed0 2024-09-11T11:01:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff8c960a640 1 -- 172.21.15.145:0/1662254448 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d400f9a0 con 0x55e8c4561ed0 2024-09-11T11:01:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff8c960a640 1 -- 172.21.15.145:0/1662254448 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d402c060 con 0x55e8c4561ed0 2024-09-11T11:01:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c46536c0 con 0x55e8c4561ed0 2024-09-11T11:01:49.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff8c960a640 1 -- 172.21.15.145:0/1662254448 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9d4017070 con 0x55e8c4561ed0 2024-09-11T11:01:49.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff8c960a640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8c4034650 0x7ff8c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff8c960a640 1 -- 172.21.15.145:0/1662254448 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7ff9d4015020 con 0x55e8c4561ed0 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9dc440640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8c4034650 0x7ff8c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9df131980 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c4655190 0x55e8c4657580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4657ba0 con 0x55e8c4655190 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9dd442640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c4655190 0x55e8c4657580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9dc440640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8c4034650 0x7ff8c4036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40ae000 tx=0x7ff9c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9dd442640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c4655190 0x55e8c4657580 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9dd442640 1 -- 172.21.15.145:0/1662254448 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c4655190 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9df131980 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4658970 0x55e8c465ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c465b390 con 0x55e8c4658970 2024-09-11T11:01:49.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4658970 0x55e8c465ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.180+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4658970 0x55e8c465ad60 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9dcc41640 1 -- 172.21.15.145:0/1662254448 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9d402e070 con 0x55e8c4658970 2024-09-11T11:01:49.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c465cc40 con 0x55e8c4658970 2024-09-11T11:01:49.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9dcc41640 1 -- 172.21.15.145:0/1662254448 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff9d402e070 con 0x55e8c4658970 2024-09-11T11:01:49.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c465bdb0 con 0x55e8c4658970 2024-09-11T11:01:49.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9dcc41640 1 -- 172.21.15.145:0/1662254448 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9d402e070 con 0x55e8c4658970 2024-09-11T11:01:49.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9df131980 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c465c820 0x55e8c4660060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46607f0 con 0x55e8c465c820 2024-09-11T11:01:49.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9dc440640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c465c820 0x55e8c4660060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9dc440640 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c465c820 0x55e8c4660060 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9dc440640 1 -- 172.21.15.145:0/1662254448 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c465c820 2024-09-11T11:01:49.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9df131980 1 Processor -- start 2024-09-11T11:01:49.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9df131980 1 -- start start 2024-09-11T11:01:49.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9df131980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c466e2c0 0x55e8c466e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.184+0000 7ff9df131980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e8c4462800 con 0x55e8c466e2c0 2024-09-11T11:01:49.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c466e2c0 0x55e8c466e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c466e2c0 0x55e8c466e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32810/0 (socket says 172.21.15.145:32810) 2024-09-11T11:01:49.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9dcc41640 1 -- 172.21.15.145:0/419003880 learned_addr learned my addr 172.21.15.145:0/419003880 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9dcc41640 1 -- 172.21.15.145:0/419003880 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c466ec20 con 0x55e8c466e2c0 2024-09-11T11:01:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/419003880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c466e2c0 0x55e8c466e6e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4048d80 tx=0x7ff9d401be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff8c27fc640 1 -- 172.21.15.145:0/419003880 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d40460c0 con 0x55e8c466e2c0 2024-09-11T11:01:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff8c27fc640 1 -- 172.21.15.145:0/419003880 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d4046260 con 0x55e8c466e2c0 2024-09-11T11:01:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff8c27fc640 1 -- 172.21.15.145:0/419003880 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d404abd0 con 0x55e8c466e2c0 2024-09-11T11:01:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9df131980 1 -- 172.21.15.145:0/419003880 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8c466ee50 con 0x55e8c466e2c0 2024-09-11T11:01:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9df131980 1 -- 172.21.15.145:0/419003880 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c466ee50 con 0x55e8c466e2c0 2024-09-11T11:01:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff8c27fc640 1 -- 172.21.15.145:0/419003880 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9d40278b0 con 0x55e8c466e2c0 2024-09-11T11:01:49.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff8c27fc640 1 --2- 172.21.15.145:0/419003880 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8b4034650 0x7ff8b4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff8c27fc640 1 -- 172.21.15.145:0/419003880 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7ff9d4054bc0 con 0x55e8c466e2c0 2024-09-11T11:01:49.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9dc440640 1 --2- 172.21.15.145:0/419003880 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8b4034650 0x7ff8b4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9df131980 1 Processor -- start 2024-09-11T11:01:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9df131980 1 -- start start 2024-09-11T11:01:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9dc440640 1 --2- 172.21.15.145:0/419003880 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8b4034650 0x7ff8b4036b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55e8c4654800 tx=0x7ff9c4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9df131980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c467ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.188+0000 7ff9df131980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e8c46495c0 con 0x55e8c467a810 2024-09-11T11:01:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c467ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c467ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32814/0 (socket says 172.21.15.145:32814) 2024-09-11T11:01:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 -- 172.21.15.145:0/2608628077 learned_addr learned my addr 172.21.15.145:0/2608628077 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 -- 172.21.15.145:0/2608628077 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c467b1e0 con 0x55e8c467a810 2024-09-11T11:01:49.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/2608628077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c467ac10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff9d401cfd0 tx=0x7ff9d403e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb4d600a9cc36c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff8b3fff640 1 -- 172.21.15.145:0/2608628077 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d40428d0 con 0x55e8c467a810 2024-09-11T11:01:49.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff8b3fff640 1 -- 172.21.15.145:0/2608628077 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d4064070 con 0x55e8c467a810 2024-09-11T11:01:49.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff8b3fff640 1 -- 172.21.15.145:0/2608628077 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d4054e10 con 0x55e8c467a810 2024-09-11T11:01:49.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 -- 172.21.15.145:0/2608628077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 msgr2=0x55e8c467ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 --2- 172.21.15.145:0/2608628077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c467ac10 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff9d401cfd0 tx=0x7ff9d403e7f0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 -- 172.21.15.145:0/2608628077 shutdown_connections 2024-09-11T11:01:49.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 --2- 172.21.15.145:0/2608628077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c467ac10 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 -- 172.21.15.145:0/2608628077 >> 172.21.15.145:0/2608628077 conn(0x55e8c4676c40 msgr2=0x55e8c4674d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 -- 172.21.15.145:0/2608628077 shutdown_connections 2024-09-11T11:01:49.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 -- 172.21.15.145:0/2608628077 wait complete. 2024-09-11T11:01:49.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 Processor -- start 2024-09-11T11:01:49.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 -- start start 2024-09-11T11:01:49.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c4681ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9df131980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55e8c467b6b0 con 0x55e8c467a810 2024-09-11T11:01:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c4681ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c4681ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32820/0 (socket says 172.21.15.145:32820) 2024-09-11T11:01:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 learned_addr learned my addr 172.21.15.145:0/685815434 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c4681ff0 con 0x55e8c467a810 2024-09-11T11:01:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.192+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c4681ab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff9d401cfd0 tx=0x7ff9d405e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff8b27fc640 1 -- 172.21.15.145:0/685815434 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d40428d0 con 0x55e8c467a810 2024-09-11T11:01:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e8c4681ff0 con 0x55e8c467a810 2024-09-11T11:01:49.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff8b27fc640 1 -- 172.21.15.145:0/685815434 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9d4028000 con 0x55e8c467a810 2024-09-11T11:01:49.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff8b27fc640 1 -- 172.21.15.145:0/685815434 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9d4046660 con 0x55e8c467a810 2024-09-11T11:01:49.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c4681ff0 con 0x55e8c467a810 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff8b27fc640 1 -- 172.21.15.145:0/685815434 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff9d4046800 con 0x55e8c467a810 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff8b27fc640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 0x7ff8a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff8b27fc640 1 -- 172.21.15.145:0/685815434 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7ff9d4075c10 con 0x55e8c467a810 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9dc440640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 0x7ff8a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c468cb70 0x55e8c468f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c468f780 con 0x55e8c468cb70 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9dd442640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c468cb70 0x55e8c468f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9dc440640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 0x7ff8a8036b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40aafd0 tx=0x7ff9c40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9dd442640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c468cb70 0x55e8c468f030 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 20 realm 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c468bfa0 con 0x55e8c468cb70 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4690210 con 0x55e8c468cb70 2024-09-11T11:01:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4690ff0 0x55e8c46933e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4693a70 con 0x55e8c4690ff0 2024-09-11T11:01:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.196+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4690ff0 0x55e8c46933e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4690ff0 0x55e8c46933e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9df131980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46942c0 con 0x55e8c4690ff0 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9df131980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9df131980 20 searching for the correct realm 2024-09-11T11:01:49.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e8c4696030 0x55e8c4698420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4696030 2024-09-11T11:01:49.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dc440640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e8c4696030 0x55e8c4698420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dc440640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e8c4696030 0x55e8c4698420 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dcc41640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c44d02a0 0x7ff9d4089800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.200+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c44d02a0 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c44d02a0 0x7ff9d4089800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c44d02a0 0x7ff9d4089800 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4696030 2024-09-11T11:01:49.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c44d02a0 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.204+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c44d02a0 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4696030 2024-09-11T11:01:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4696030 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4696030 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.208+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c44d02a0 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c468cb70 2024-09-11T11:01:49.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c44d02a0 2024-09-11T11:01:49.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4696030 2024-09-11T11:01:49.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c44d02a0 2024-09-11T11:01:49.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4696030 2024-09-11T11:01:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.212+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4698aa0 con 0x55e8c4690ff0 2024-09-11T11:01:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4694c40 con 0x55e8c468cb70 2024-09-11T11:01:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46954e0 con 0x55e8c4690ff0 2024-09-11T11:01:49.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c4694880 con 0x55e8c44d02a0 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 zone default found 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 4 Realm: () 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 zonegroup default 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46993d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469b150 con 0x55e8c4696030 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469b540 con 0x55e8c4696030 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 started sync module instance, tier type = 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:49.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.216+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469a5f0 con 0x55e8c4690ff0 2024-09-11T11:01:49.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.220+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.220+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94458216033008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469a5f0 con 0x55e8c4690ff0 2024-09-11T11:01:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.220+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469c000 con 0x55e8c468cb70 2024-09-11T11:01:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.220+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.220+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94458216037136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469bf30 con 0x55e8c468cb70 2024-09-11T11:01:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.220+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469cf00 con 0x55e8c4690ff0 2024-09-11T11:01:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.220+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94458216033008] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.224+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94458216037136] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.224+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.224+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94458216039408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469ca10 con 0x55e8c4690ff0 2024-09-11T11:01:49.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.224+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469d7a0 con 0x55e8c44d02a0 2024-09-11T11:01:49.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.224+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.224+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94458216043248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469ca10 con 0x55e8c44d02a0 2024-09-11T11:01:49.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.224+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469e220 con 0x55e8c4690ff0 2024-09-11T11:01:49.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.224+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94458216039408] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.228+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94458216043248] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.228+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.228+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94458216044304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469dd30 con 0x55e8c4690ff0 2024-09-11T11:01:49.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.228+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469eaf0 con 0x55e8c4696030 2024-09-11T11:01:49.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.228+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.228+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94458216048192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469dd30 con 0x55e8c4696030 2024-09-11T11:01:49.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.228+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469f960 con 0x55e8c4696030 2024-09-11T11:01:49.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.228+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94458216044304] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94458216048192] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94458216051888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469fd00 con 0x55e8c4696030 2024-09-11T11:01:49.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46a0550 con 0x55e8c44d02a0 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94458216054496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46a09c0 con 0x55e8c44d02a0 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 20 add_watcher() i=0 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 20 add_watcher() i=1 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 20 add_watcher() i=2 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 20 add_watcher() i=3 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 20 add_watcher() i=4 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 20 add_watcher() i=5 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94458216051888] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 20 add_watcher() i=6 2024-09-11T11:01:49.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94458216054496] v34'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 20 add_watcher() i=7 2024-09-11T11:01:49.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:49.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469a140 con 0x55e8c468cb70 2024-09-11T11:01:49.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.232+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94458216030528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46a0f00 con 0x55e8c468cb70 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94458216030528] v34'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff892fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 5 note: GC not initialized 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff891fe3640 20 reqs_thread_entry: start 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 20 Filter name: none 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff8037fe640 20 reqs_thread_entry: start 2024-09-11T11:01:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46c7020 con 0x55e8c468cb70 2024-09-11T11:01:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv16 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 20 rados_obj.operate() r=0 bl.length=403 2024-09-11T11:01:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:49.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:49.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46cd230 con 0x55e8c468cb70 2024-09-11T11:01:49.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.236+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v34'17 uv17 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9df131980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9df131980 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9df131980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94458216238240 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46cbd80 con 0x55e8c4690ff0 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94458216044304 notify 146028888103 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7ff9d4037040 con 0x55e8c4690ff0 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff8b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888103 cookie 94458216044304 notifier 4668 bl.length()=567 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff8b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff8b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94458216238240 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff8b3fff640 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff8a0003eb0 con 0x55e8c4690ff0 2024-09-11T11:01:49.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94458216238240 notify 146028888103 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e8c46536c0 con 0x55e8c4690ff0 2024-09-11T11:01:49.243 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-11T11:01:22.637348Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:01:22.637325Z","tags":[],"group_ids":[]} 2024-09-11T11:01:49.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff892fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:49.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.240+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94458216030528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46c4e50 con 0x55e8c468cb70 2024-09-11T11:01:49.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.244+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94458216030528] v34'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.244+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94458216033008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46c4e50 con 0x55e8c4690ff0 2024-09-11T11:01:49.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.244+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94458216033008] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.244+0000 7ff9df131980 20 remove_watcher() i=0 2024-09-11T11:01:49.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.244+0000 7ff9df131980 2 removed watcher, disabling cache 2024-09-11T11:01:49.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.244+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94458216037136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46c4e50 con 0x55e8c468cb70 2024-09-11T11:01:49.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94458216037136] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c468cb70 2024-09-11T11:01:49.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9df131980 20 remove_watcher() i=1 2024-09-11T11:01:49.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94458216039408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469bb10 con 0x55e8c4690ff0 2024-09-11T11:01:49.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94458216039408] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9df131980 20 remove_watcher() i=2 2024-09-11T11:01:49.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94458216043248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46c4e50 con 0x55e8c44d02a0 2024-09-11T11:01:49.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94458216043248] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9df131980 20 remove_watcher() i=3 2024-09-11T11:01:49.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.248+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94458216044304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46c4e50 con 0x55e8c4690ff0 2024-09-11T11:01:49.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.252+0000 7ff9dcc41640 1 -- 172.21.15.145:0/685815434 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94458216044304] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9d405c040 con 0x55e8c4690ff0 2024-09-11T11:01:49.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.252+0000 7ff9df131980 20 remove_watcher() i=4 2024-09-11T11:01:49.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.252+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94458216048192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46c4e50 con 0x55e8c4696030 2024-09-11T11:01:49.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.252+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94458216048192] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.252+0000 7ff9df131980 20 remove_watcher() i=5 2024-09-11T11:01:49.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.252+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94458216051888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c46c4e50 con 0x55e8c4696030 2024-09-11T11:01:49.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9dc440640 1 -- 172.21.15.145:0/685815434 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94458216051888] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9c40aaa80 con 0x55e8c4696030 2024-09-11T11:01:49.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 20 remove_watcher() i=6 2024-09-11T11:01:49.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94458216054496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55e8c469f4b0 con 0x55e8c44d02a0 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94458216054496] v34'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff9cc00a4d0 con 0x55e8c44d02a0 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 20 remove_watcher() i=7 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4690ff0 msgr2=0x55e8c46933e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4690ff0 0x55e8c46933e0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c468cb70 msgr2=0x55e8c468f030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c468cb70 0x55e8c468f030 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c44d02a0 msgr2=0x7ff9d4089800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c44d02a0 0x7ff9d4089800 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e8c4696030 msgr2=0x55e8c4698420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55e8c4696030 0x55e8c4698420 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 msgr2=0x7ff8a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8a8034650 0x7ff8a8036b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40aafd0 tx=0x7ff9c40c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 msgr2=0x55e8c4681ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c4681ab0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff9d401cfd0 tx=0x7ff9d405e000 comp rx=0 tx=0).stop 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9dd442640 1 -- 172.21.15.145:0/685815434 reap_dead start 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 shutdown_connections 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/685815434 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c467a810 0x55e8c4681ab0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 >> 172.21.15.145:0/685815434 conn(0x55e8c4676c40 msgr2=0x55e8c4674d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 shutdown_connections 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/685815434 wait complete. 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/419003880 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8b4034650 msgr2=0x7ff8b4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/419003880 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8b4034650 0x7ff8b4036b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x55e8c4654800 tx=0x7ff9c4005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/419003880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c466e2c0 msgr2=0x55e8c466e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/419003880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c466e2c0 0x55e8c466e6e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4048d80 tx=0x7ff9d401be10 comp rx=0 tx=0).stop 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/419003880 shutdown_connections 2024-09-11T11:01:49.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/419003880 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8b4034650 0x7ff8b4036b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/419003880 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c466e2c0 0x55e8c466e6e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/419003880 >> 172.21.15.145:0/419003880 conn(0x55e8c4663410 msgr2=0x55e8c4665e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/419003880 shutdown_connections 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/419003880 wait complete. 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4658970 msgr2=0x55e8c465ad60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55e8c4658970 0x55e8c465ad60 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c4655190 msgr2=0x55e8c4657580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55e8c4655190 0x55e8c4657580 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c465c820 msgr2=0x55e8c4660060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55e8c465c820 0x55e8c4660060 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8c4034650 msgr2=0x7ff8c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff8c4034650 0x7ff8c4036b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40ae000 tx=0x7ff9c40a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:49.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 msgr2=0x55e8c4650210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 --2- 172.21.15.145:0/1662254448 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55e8c4561ed0 0x55e8c4650210 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4004000 tx=0x7ff9d4000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9dd442640 1 -- 172.21.15.145:0/1662254448 reap_dead start 2024-09-11T11:01:49.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 shutdown_connections 2024-09-11T11:01:49.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 >> 172.21.15.145:0/1662254448 conn(0x55e8c45560a0 msgr2=0x55e8c4643420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 shutdown_connections 2024-09-11T11:01:49.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.256+0000 7ff9df131980 1 -- 172.21.15.145:0/1662254448 wait complete. 2024-09-11T11:01:49.271 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-11T11:01:22.637348Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:01:22.637325Z', 'tags': [], 'group_ids': []} 2024-09-11T11:01:49.284 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:49.284 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-11T11:01:49.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-11T11:01:49.284 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-11T11:01:49.342 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:01:49.343 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:01:49.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c8b51980 1 Processor -- start 2024-09-11T11:01:49.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c8b51980 1 -- start start 2024-09-11T11:01:49.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c8b51980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564e06a0a5c0 0x564e06a11fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c8b51980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e06891ae0 con 0x564e06a07ac0 2024-09-11T11:01:49.344 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c8b51980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x564e068b5e30 con 0x564e06a0a5c0 2024-09-11T11:01:49.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c5e60640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564e06a0a5c0 0x564e06a11fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c5e60640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x564e06a0a5c0 0x564e06a11fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32832/0 (socket says 172.21.15.145:32832) 2024-09-11T11:01:49.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c6661640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x564e06a07ac0 0x564e06a09eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:60984/0 (socket says 172.21.15.145:60984) 2024-09-11T11:01:49.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.340+0000 7f64c5e60640 1 -- 172.21.15.145:0/4293915892 learned_addr learned my addr 172.21.15.145:0/4293915892 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c5e60640 1 -- 172.21.15.145:0/4293915892 >> v1:172.21.15.102:6789/0 conn(0x564e06a07ac0 legacy=0x564e06a09eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c5e60640 1 -- 172.21.15.145:0/4293915892 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e06a134f0 con 0x564e06a0a5c0 2024-09-11T11:01:49.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c5e60640 1 --2- 172.21.15.145:0/4293915892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a0a5c0 0x564e06a11fa0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00a5c0 tx=0x7f64bc01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9432549e97dbf4df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c565f640 1 -- 172.21.15.145:0/4293915892 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64bc0a6070 con 0x564e06a0a5c0 2024-09-11T11:01:49.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c565f640 1 -- 172.21.15.145:0/4293915892 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64bc0af070 con 0x564e06a0a5c0 2024-09-11T11:01:49.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c565f640 1 -- 172.21.15.145:0/4293915892 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64bc0aa5c0 con 0x564e06a0a5c0 2024-09-11T11:01:49.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c8b51980 1 -- 172.21.15.145:0/4293915892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a0a5c0 msgr2=0x564e06a11fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4293915892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a0a5c0 0x564e06a11fa0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f64bc00a5c0 tx=0x7f64bc01b340 comp rx=0 tx=0).stop 2024-09-11T11:01:49.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c8b51980 1 -- 172.21.15.145:0/4293915892 shutdown_connections 2024-09-11T11:01:49.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4293915892 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a0a5c0 0x564e06a11fa0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c8b51980 1 -- 172.21.15.145:0/4293915892 >> 172.21.15.145:0/4293915892 conn(0x564e06a037a0 msgr2=0x564e06a05bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c8b51980 1 -- 172.21.15.145:0/4293915892 shutdown_connections 2024-09-11T11:01:49.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.344+0000 7f64c8b51980 1 -- 172.21.15.145:0/4293915892 wait complete. 2024-09-11T11:01:49.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.360+0000 7f64c8b51980 1 Processor -- start 2024-09-11T11:01:49.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.360+0000 7f64c8b51980 1 -- start start 2024-09-11T11:01:49.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.360+0000 7f64c8b51980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06af6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.360+0000 7f64c8b51980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e068b7200 con 0x564e06a07ac0 2024-09-11T11:01:49.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.360+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06af6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.360+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06af6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32844/0 (socket says 172.21.15.145:32844) 2024-09-11T11:01:49.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.360+0000 7f64c6661640 1 -- 172.21.15.145:0/1640239947 learned_addr learned my addr 172.21.15.145:0/1640239947 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.360+0000 7f64c6661640 1 -- 172.21.15.145:0/1640239947 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e06af7210 con 0x564e06a07ac0 2024-09-11T11:01:49.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c6661640 1 --2- 172.21.15.145:0/1640239947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06af6c40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f64b8001e50 tx=0x7f64b8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8084e061a53d100e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f63b4608640 1 -- 172.21.15.145:0/1640239947 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b800e5d0 con 0x564e06a07ac0 2024-09-11T11:01:49.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f63b4608640 1 -- 172.21.15.145:0/1640239947 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b800e770 con 0x564e06a07ac0 2024-09-11T11:01:49.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f63b4608640 1 -- 172.21.15.145:0/1640239947 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b800eab0 con 0x564e06a07ac0 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- 172.21.15.145:0/1640239947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 msgr2=0x564e06af6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 --2- 172.21.15.145:0/1640239947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06af6c40 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f64b8001e50 tx=0x7f64b8001e80 comp rx=0 tx=0).stop 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- 172.21.15.145:0/1640239947 shutdown_connections 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 --2- 172.21.15.145:0/1640239947 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06af6c40 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- 172.21.15.145:0/1640239947 >> 172.21.15.145:0/1640239947 conn(0x564e06a037a0 msgr2=0x564e06af2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- 172.21.15.145:0/1640239947 shutdown_connections 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- 172.21.15.145:0/1640239947 wait complete. 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 Processor -- start 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- start start 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06afdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e06a12ff0 con 0x564e06a07ac0 2024-09-11T11:01:49.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06afdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06afdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32846/0 (socket says 172.21.15.145:32846) 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c6661640 1 -- 172.21.15.145:0/731995517 learned_addr learned my addr 172.21.15.145:0/731995517 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c6661640 1 -- 172.21.15.145:0/731995517 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e06afe510 con 0x564e06a07ac0 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c6661640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06afdfd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x564e06af7e20 tx=0x7f64b8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f63b2e05640 1 -- 172.21.15.145:0/731995517 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b800f9f0 con 0x564e06a07ac0 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f63b2e05640 1 -- 172.21.15.145:0/731995517 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b800fbb0 con 0x564e06a07ac0 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e06afe7a0 con 0x564e06a07ac0 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f63b2e05640 1 -- 172.21.15.145:0/731995517 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b801a480 con 0x564e06a07ac0 2024-09-11T11:01:49.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.364+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e06b01480 con 0x564e06a07ac0 2024-09-11T11:01:49.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f63b2e05640 1 -- 172.21.15.145:0/731995517 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f64b8017070 con 0x564e06a07ac0 2024-09-11T11:01:49.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f63b2e05640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63ac034650 0x7f63ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f63b2e05640 1 -- 172.21.15.145:0/731995517 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f64b8015020 con 0x564e06a07ac0 2024-09-11T11:01:49.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c5e60640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63ac034650 0x7f63ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c8b51980 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06a0a5c0 0x564e06b04fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b05610 con 0x564e06a0a5c0 2024-09-11T11:01:49.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c6e62640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06a0a5c0 0x564e06b04fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c5e60640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63ac034650 0x7f63ac036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0ae000 tx=0x7f64bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c6e62640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06a0a5c0 0x564e06b04fa0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c6e62640 1 -- 172.21.15.145:0/731995517 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06a0a5c0 2024-09-11T11:01:49.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c8b51980 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b06400 0x564e06b087f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b08e30 con 0x564e06b06400 2024-09-11T11:01:49.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c6661640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b06400 0x564e06b087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c6661640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b06400 0x564e06b087f0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c6661640 1 -- 172.21.15.145:0/731995517 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64b802e070 con 0x564e06b06400 2024-09-11T11:01:49.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.368+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b0a6e0 con 0x564e06b06400 2024-09-11T11:01:49.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c6661640 1 -- 172.21.15.145:0/731995517 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f64b802e070 con 0x564e06b06400 2024-09-11T11:01:49.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b09910 con 0x564e06b06400 2024-09-11T11:01:49.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c6661640 1 -- 172.21.15.145:0/731995517 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64b802e070 con 0x564e06b06400 2024-09-11T11:01:49.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c8b51980 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564e06b0ba90 0x564e06b0de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b0e3c0 con 0x564e06b0ba90 2024-09-11T11:01:49.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c5e60640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564e06b0ba90 0x564e06b0de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c5e60640 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564e06b0ba90 0x564e06b0de80 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c5e60640 1 -- 172.21.15.145:0/731995517 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b0ba90 2024-09-11T11:01:49.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c8b51980 1 Processor -- start 2024-09-11T11:01:49.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c8b51980 1 -- start start 2024-09-11T11:01:49.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c8b51980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b1be50 0x564e06b1c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c8b51980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e06910800 con 0x564e06b1be50 2024-09-11T11:01:49.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b1be50 0x564e06b1c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b1be50 0x564e06b1c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32862/0 (socket says 172.21.15.145:32862) 2024-09-11T11:01:49.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.372+0000 7f64c6661640 1 -- 172.21.15.145:0/3533116849 learned_addr learned my addr 172.21.15.145:0/3533116849 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c6661640 1 -- 172.21.15.145:0/3533116849 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e06b1c7b0 con 0x564e06b1be50 2024-09-11T11:01:49.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c6661640 1 --2- 172.21.15.145:0/3533116849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b1be50 0x564e06b1c270 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f64b8048ef0 tx=0x7f64b8019e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f63abfff640 1 -- 172.21.15.145:0/3533116849 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b804f070 con 0x564e06b1be50 2024-09-11T11:01:49.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c8b51980 1 -- 172.21.15.145:0/3533116849 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e06b1c9e0 con 0x564e06b1be50 2024-09-11T11:01:49.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f63abfff640 1 -- 172.21.15.145:0/3533116849 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b801c580 con 0x564e06b1be50 2024-09-11T11:01:49.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f63abfff640 1 -- 172.21.15.145:0/3533116849 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b80441e0 con 0x564e06b1be50 2024-09-11T11:01:49.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c8b51980 1 -- 172.21.15.145:0/3533116849 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e06b1f600 con 0x564e06b1be50 2024-09-11T11:01:49.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f63abfff640 1 -- 172.21.15.145:0/3533116849 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f64b8042120 con 0x564e06b1be50 2024-09-11T11:01:49.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f63abfff640 1 --2- 172.21.15.145:0/3533116849 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63a0034600 0x7f63a0036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f63abfff640 1 -- 172.21.15.145:0/3533116849 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f64b8054bc0 con 0x564e06b1be50 2024-09-11T11:01:49.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c5e60640 1 --2- 172.21.15.145:0/3533116849 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63a0034600 0x7f63a0036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c8b51980 1 Processor -- start 2024-09-11T11:01:49.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c8b51980 1 -- start start 2024-09-11T11:01:49.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c5e60640 1 --2- 172.21.15.145:0/3533116849 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63a0034600 0x7f63a0036ac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f64bc018f70 tx=0x7f64bc005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c8b51980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c8b51980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e06af7590 con 0x564e06b283e0 2024-09-11T11:01:49.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b287c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32874/0 (socket says 172.21.15.145:32874) 2024-09-11T11:01:49.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.376+0000 7f64c6661640 1 -- 172.21.15.145:0/4191158809 learned_addr learned my addr 172.21.15.145:0/4191158809 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c6661640 1 -- 172.21.15.145:0/4191158809 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e06b28d90 con 0x564e06b283e0 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c6661640 1 --2- 172.21.15.145:0/4191158809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b287c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f64b8042430 tx=0x7f64b80425c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e636e8a0a4ee24d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f63a9ffb640 1 -- 172.21.15.145:0/4191158809 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b805e040 con 0x564e06b283e0 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f63a9ffb640 1 -- 172.21.15.145:0/4191158809 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b8044970 con 0x564e06b283e0 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f63a9ffb640 1 -- 172.21.15.145:0/4191158809 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b8047a90 con 0x564e06b283e0 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- 172.21.15.145:0/4191158809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 msgr2=0x564e06b287c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4191158809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b287c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f64b8042430 tx=0x7f64b80425c0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- 172.21.15.145:0/4191158809 shutdown_connections 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4191158809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b287c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- 172.21.15.145:0/4191158809 >> 172.21.15.145:0/4191158809 conn(0x564e06b247c0 msgr2=0x564e06b228c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- 172.21.15.145:0/4191158809 shutdown_connections 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- 172.21.15.145:0/4191158809 wait complete. 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 Processor -- start 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- start start 2024-09-11T11:01:49.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b2f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564e06b29230 con 0x564e06b283e0 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b2f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c6661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b2f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:32888/0 (socket says 172.21.15.145:32888) 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 learned_addr learned my addr 172.21.15.145:0/4199961488 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e06b2fb80 con 0x564e06b283e0 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c6661640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b2f640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f64b8032be0 tx=0x7f64b8006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f6397fff640 1 -- 172.21.15.145:0/4199961488 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b8072070 con 0x564e06b283e0 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e06b2fb80 con 0x564e06b283e0 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f6397fff640 1 -- 172.21.15.145:0/4199961488 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64b8049dd0 con 0x564e06b283e0 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f6397fff640 1 -- 172.21.15.145:0/4199961488 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64b804ac70 con 0x564e06b283e0 2024-09-11T11:01:49.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.380+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e06b2fb80 con 0x564e06b283e0 2024-09-11T11:01:49.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f6397fff640 1 -- 172.21.15.145:0/4199961488 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f64b8075070 con 0x564e06b283e0 2024-09-11T11:01:49.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f6397fff640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6390034650 0x7f6390036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f6397fff640 1 -- 172.21.15.145:0/4199961488 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f64b8078c20 con 0x564e06b283e0 2024-09-11T11:01:49.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c5e60640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6390034650 0x7f6390036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06b3a640 0x564e06b3cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b3d250 con 0x564e06b3a640 2024-09-11T11:01:49.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c6e62640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06b3a640 0x564e06b3cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c5e60640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6390034650 0x7f6390036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64bc01b380 tx=0x7f64bc0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c6e62640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06b3a640 0x564e06b3cb00 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 20 realm 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b39a70 con 0x564e06b3a640 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b3dd10 con 0x564e06b3a640 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b3eaf0 0x564e06b40ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b41570 con 0x564e06b3eaf0 2024-09-11T11:01:49.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.384+0000 7f64c6661640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b3eaf0 0x564e06b40ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6661640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b3eaf0 0x564e06b40ee0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f64b807e070 con 0x564e06b3eaf0 2024-09-11T11:01:49.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c8b51980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:49.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b41dc0 con 0x564e06b3eaf0 2024-09-11T11:01:49.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f64b807e070 con 0x564e06b3eaf0 2024-09-11T11:01:49.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c8b51980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:01:49.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c8b51980 20 searching for the correct realm 2024-09-11T11:01:49.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564e06b43b30 0x564e06b45f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b43b30 2024-09-11T11:01:49.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c5e60640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564e06b43b30 0x564e06b45f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c5e60640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564e06b43b30 0x564e06b45f20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f64b807e070 con 0x564e06b3eaf0 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6661640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f64b8077070 0x7f64b8054270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x7f64b8077070 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6e62640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f64b8077070 0x7f64b8054270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6e62640 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f64b8077070 0x7f64b8054270 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.388+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b43b30 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b807e070 con 0x564e06b3eaf0 2024-09-11T11:01:49.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b807e070 con 0x564e06b3eaf0 2024-09-11T11:01:49.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x7f64b8077070 2024-09-11T11:01:49.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x7f64b8077070 2024-09-11T11:01:49.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.392+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b43b30 2024-09-11T11:01:49.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b43b30 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b43b30 2024-09-11T11:01:49.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x7f64b8077070 2024-09-11T11:01:49.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3a640 2024-09-11T11:01:49.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.396+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x7f64b8077070 2024-09-11T11:01:49.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b43b30 2024-09-11T11:01:49.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x7f64b8077070 2024-09-11T11:01:49.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b43b30 2024-09-11T11:01:49.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x564e06b465a0 con 0x564e06b3eaf0 2024-09-11T11:01:49.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:01:49.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:01:49.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:01:49.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:01:49.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:01:49.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:01:49.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b42710 con 0x564e06b3a640 2024-09-11T11:01:49.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.400+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b42fb0 con 0x564e06b3eaf0 2024-09-11T11:01:49.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b42350 con 0x7f64b8077070 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 zone default found 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 4 Realm: () 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 zonegroup default 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b46eb0 con 0x7f64b8077070 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b49130 con 0x564e06b43b30 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b494d0 con 0x564e06b43b30 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 started sync module instance, tier type = 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:01:49.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.404+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b485c0 con 0x564e06b3eaf0 2024-09-11T11:01:49.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.408+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.408+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94893119933200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b485c0 con 0x564e06b3eaf0 2024-09-11T11:01:49.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.408+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b49ed0 con 0x564e06b3a640 2024-09-11T11:01:49.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.408+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.408+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94893119936992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b49e00 con 0x564e06b3a640 2024-09-11T11:01:49.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.408+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4add0 con 0x564e06b3eaf0 2024-09-11T11:01:49.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.408+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94893119933200] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.408+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94893119936992] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94893119939264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4a8e0 con 0x564e06b3eaf0 2024-09-11T11:01:49.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4b670 con 0x7f64b8077070 2024-09-11T11:01:49.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94893119943104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4a8e0 con 0x7f64b8077070 2024-09-11T11:01:49.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4c0f0 con 0x564e06b3eaf0 2024-09-11T11:01:49.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94893119939264] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94893119943104] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94893119944160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4bc00 con 0x564e06b3eaf0 2024-09-11T11:01:49.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.412+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4c990 con 0x564e06b43b30 2024-09-11T11:01:49.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94893119948000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4bc00 con 0x564e06b43b30 2024-09-11T11:01:49.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4d800 con 0x564e06b43b30 2024-09-11T11:01:49.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94893119944160] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94893119948000] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94893119951696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4ce40 con 0x564e06b43b30 2024-09-11T11:01:49.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4e290 con 0x7f64b8077070 2024-09-11T11:01:49.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94893119951696] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94893119954272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4e250 con 0x7f64b8077070 2024-09-11T11:01:49.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 20 add_watcher() i=0 2024-09-11T11:01:49.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 20 add_watcher() i=1 2024-09-11T11:01:49.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 20 add_watcher() i=2 2024-09-11T11:01:49.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 20 add_watcher() i=3 2024-09-11T11:01:49.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 20 add_watcher() i=4 2024-09-11T11:01:49.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 20 add_watcher() i=5 2024-09-11T11:01:49.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.416+0000 7f64c8b51980 20 add_watcher() i=6 2024-09-11T11:01:49.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94893119954272] v34'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c8b51980 20 add_watcher() i=7 2024-09-11T11:01:49.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c8b51980 2 all 8 watchers are set, enabling cache 2024-09-11T11:01:49.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b48200 con 0x564e06b3a640 2024-09-11T11:01:49.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94893119956528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b48200 con 0x564e06b3a640 2024-09-11T11:01:49.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94893119956528] v34'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f637cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:49.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c8b51980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:01:49.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c8b51980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:01:49.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.420+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5a080 con 0x564e06b3eaf0 2024-09-11T11:01:49.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.424+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.424+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5a750 con 0x7f64b8077070 2024-09-11T11:01:49.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.424+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.424+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5ac00 con 0x564e06b43b30 2024-09-11T11:01:49.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.428+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.428+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b57ec0 con 0x564e06b3a640 2024-09-11T11:01:49.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.428+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.428+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b57ec0 con 0x564e06b3eaf0 2024-09-11T11:01:49.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.432+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.432+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b57ec0 con 0x564e06b43b30 2024-09-11T11:01:49.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.432+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.432+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5b930 con 0x564e06b3eaf0 2024-09-11T11:01:49.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.436+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.436+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5b930 con 0x564e06b3a640 2024-09-11T11:01:49.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.436+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'43 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.436+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5bea0 con 0x564e06b3eaf0 2024-09-11T11:01:49.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.440+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.440+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5bea0 con 0x564e06b3eaf0 2024-09-11T11:01:49.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.444+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.444+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5bea0 con 0x564e06b3eaf0 2024-09-11T11:01:49.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.444+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.444+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5bea0 con 0x564e06b43b30 2024-09-11T11:01:49.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.448+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.448+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c410 con 0x564e06b3eaf0 2024-09-11T11:01:49.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.448+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.448+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c410 con 0x564e06b3a640 2024-09-11T11:01:49.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.448+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.448+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c7f0 con 0x564e06b3a640 2024-09-11T11:01:49.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.452+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.452+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c770 con 0x564e06b3eaf0 2024-09-11T11:01:49.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.456+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'59 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.456+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c770 con 0x564e06b3eaf0 2024-09-11T11:01:49.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.456+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.456+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c770 con 0x564e06b43b30 2024-09-11T11:01:49.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.460+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.460+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c770 con 0x564e06b3eaf0 2024-09-11T11:01:49.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.460+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.460+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c770 con 0x564e06b3a640 2024-09-11T11:01:49.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.464+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.464+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c770 con 0x564e06b3eaf0 2024-09-11T11:01:49.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.468+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'60 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.468+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c770 con 0x564e06b3eaf0 2024-09-11T11:01:49.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.468+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.468+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c770 con 0x564e06b43b30 2024-09-11T11:01:49.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.468+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.468+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c800 con 0x564e06b3eaf0 2024-09-11T11:01:49.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.472+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.472+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c800 con 0x564e06b43b30 2024-09-11T11:01:49.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.476+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.476+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5c800 con 0x564e06b43b30 2024-09-11T11:01:49.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.476+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.476+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5cd20 con 0x564e06b43b30 2024-09-11T11:01:49.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.476+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.476+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5cd20 con 0x564e06b3eaf0 2024-09-11T11:01:49.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.480+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.480+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5cd20 con 0x564e06b3a640 2024-09-11T11:01:49.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.484+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.484+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5cd20 con 0x564e06b3eaf0 2024-09-11T11:01:49.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.484+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'61 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.484+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5cd20 con 0x564e06b3a640 2024-09-11T11:01:49.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.489 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b5cd20 con 0x7f64b8077070 2024-09-11T11:01:49.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f62f77fe640 20 reqs_thread_entry: start 2024-09-11T11:01:49.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 20 init_complete bucket index max shards: 11 2024-09-11T11:01:49.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 20 Filter name: none 2024-09-11T11:01:49.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f62f57fa640 20 reqs_thread_entry: start 2024-09-11T11:01:49.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:01:49.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 20 rados->read ofs=0 len=0 2024-09-11T11:01:49.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b77d50 con 0x564e06b3a640 2024-09-11T11:01:49.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:01:49.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:01:49.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:01:49.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:01:49.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.488+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x564e06b7a610 con 0x7f64b8077070 2024-09-11T11:01:49.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.492+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.493 INFO:teuthology.orchestra.run.smithi145.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-11T11:01:49.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.492+0000 7f637cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:01:49.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.492+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94893119956528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b53cb0 con 0x564e06b3a640 2024-09-11T11:01:49.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.492+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94893119956528] v34'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.492+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94893119933200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b53800 con 0x564e06b3eaf0 2024-09-11T11:01:49.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.496+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94893119933200] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.496+0000 7f64c8b51980 20 remove_watcher() i=0 2024-09-11T11:01:49.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.496+0000 7f64c8b51980 2 removed watcher, disabling cache 2024-09-11T11:01:49.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.496+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94893119936992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b48b10 con 0x564e06b3a640 2024-09-11T11:01:49.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.496+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94893119936992] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x564e06b3a640 2024-09-11T11:01:49.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.496+0000 7f64c8b51980 20 remove_watcher() i=1 2024-09-11T11:01:49.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.496+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94893119939264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b48b10 con 0x564e06b3eaf0 2024-09-11T11:01:49.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.500+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94893119939264] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.500+0000 7f64c8b51980 20 remove_watcher() i=2 2024-09-11T11:01:49.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.500+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94893119943104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b48b10 con 0x7f64b8077070 2024-09-11T11:01:49.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.500+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94893119943104] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.500+0000 7f64c8b51980 20 remove_watcher() i=3 2024-09-11T11:01:49.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.500+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94893119944160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4b1c0 con 0x564e06b3eaf0 2024-09-11T11:01:49.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c6661640 1 -- 172.21.15.145:0/4199961488 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94893119944160] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64b8091040 con 0x564e06b3eaf0 2024-09-11T11:01:49.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c8b51980 20 remove_watcher() i=4 2024-09-11T11:01:49.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94893119948000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b48b10 con 0x564e06b43b30 2024-09-11T11:01:49.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94893119948000] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c8b51980 20 remove_watcher() i=5 2024-09-11T11:01:49.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94893119951696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b4c4e0 con 0x564e06b43b30 2024-09-11T11:01:49.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c5e60640 1 -- 172.21.15.145:0/4199961488 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94893119951696] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64bc0aab60 con 0x564e06b43b30 2024-09-11T11:01:49.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c8b51980 20 remove_watcher() i=6 2024-09-11T11:01:49.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.504+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94893119954272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x564e06b48b10 con 0x7f64b8077070 2024-09-11T11:01:49.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94893119954272] v34'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f64c000a4d0 con 0x7f64b8077070 2024-09-11T11:01:49.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 20 remove_watcher() i=7 2024-09-11T11:01:49.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b3eaf0 msgr2=0x564e06b40ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b3eaf0 0x564e06b40ee0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06b3a640 msgr2=0x564e06b3cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06b3a640 0x564e06b3cb00 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f64b8077070 msgr2=0x7f64b8054270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f64b8077070 0x7f64b8054270 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564e06b43b30 msgr2=0x564e06b45f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564e06b43b30 0x564e06b45f20 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6390034650 msgr2=0x7f6390036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6390034650 0x7f6390036b10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64bc01b380 tx=0x7f64bc0c1040 comp rx=0 tx=0).stop 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 msgr2=0x564e06b2f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b2f640 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f64b8032be0 tx=0x7f64b8006f50 comp rx=0 tx=0).stop 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c6e62640 1 -- 172.21.15.145:0/4199961488 reap_dead start 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 shutdown_connections 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/4199961488 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b283e0 0x564e06b2f640 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 >> 172.21.15.145:0/4199961488 conn(0x564e06b247c0 msgr2=0x564e06b22890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 shutdown_connections 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/4199961488 wait complete. 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/3533116849 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63a0034600 msgr2=0x7f63a0036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/3533116849 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63a0034600 0x7f63a0036ac0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f64bc018f70 tx=0x7f64bc005ad0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/3533116849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b1be50 msgr2=0x564e06b1c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/3533116849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b1be50 0x564e06b1c270 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f64b8048ef0 tx=0x7f64b8019e90 comp rx=0 tx=0).stop 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/3533116849 shutdown_connections 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/3533116849 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63a0034600 0x7f63a0036ac0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/3533116849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06b1be50 0x564e06b1c270 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/3533116849 >> 172.21.15.145:0/3533116849 conn(0x564e06b10fa0 msgr2=0x564e06b13a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/3533116849 shutdown_connections 2024-09-11T11:01:49.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/3533116849 wait complete. 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b06400 msgr2=0x564e06b087f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564e06b06400 0x564e06b087f0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06a0a5c0 msgr2=0x564e06b04fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564e06a0a5c0 0x564e06b04fa0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564e06b0ba90 msgr2=0x564e06b0de80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564e06b0ba90 0x564e06b0de80 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63ac034650 msgr2=0x7f63ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f63ac034650 0x7f63ac036b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0ae000 tx=0x7f64bc0a6000 comp rx=0 tx=0).stop 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 msgr2=0x564e06afdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 --2- 172.21.15.145:0/731995517 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564e06a07ac0 0x564e06afdfd0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x564e06af7e20 tx=0x7f64b8000bd0 comp rx=0 tx=0).stop 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c6e62640 1 -- 172.21.15.145:0/731995517 reap_dead start 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 shutdown_connections 2024-09-11T11:01:49.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 >> 172.21.15.145:0/731995517 conn(0x564e06a037a0 msgr2=0x564e06af13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:01:49.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 shutdown_connections 2024-09-11T11:01:49.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:01:49.508+0000 7f64c8b51980 1 -- 172.21.15.145:0/731995517 wait complete. 2024-09-11T11:01:49.522 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-11T11:01:49.548 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:01:49.556 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-11T11:02:24.557 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-11T11:02:24.557 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-11T11:02:24.557 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-11T11:02:24.596 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:24.596 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:24.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d77984980 1 Processor -- start 2024-09-11T11:02:24.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d77984980 1 -- start start 2024-09-11T11:02:24.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d77984980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558b700ef3b0 0x558b700edb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d77984980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b70000ae0 con 0x558b700ef7c0 2024-09-11T11:02:24.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d77984980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x558b70024e30 con 0x558b700ef3b0 2024-09-11T11:02:24.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d75494640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558b700ef3b0 0x558b700edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d75494640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558b700ef3b0 0x558b700edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53112/0 (socket says 172.21.15.145:53112) 2024-09-11T11:02:24.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d75494640 1 -- 172.21.15.145:0/3078933609 learned_addr learned my addr 172.21.15.145:0/3078933609 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.594+0000 7f0d74c93640 1 --1- 172.21.15.145:0/3078933609 >> v1:172.21.15.102:6789/0 conn(0x558b700ef7c0 0x558b700ee0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:33180/0 (socket says 172.21.15.145:33180) 2024-09-11T11:02:24.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d75494640 1 -- 172.21.15.145:0/3078933609 >> v1:172.21.15.102:6789/0 conn(0x558b700ef7c0 legacy=0x558b700ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d75494640 1 -- 172.21.15.145:0/3078933609 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b700ee8e0 con 0x558b700ef3b0 2024-09-11T11:02:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d75494640 1 --2- 172.21.15.145:0/3078933609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b700edb70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800a4e0 tx=0x7f0d6801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9aafdf9ab6723e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d67fff640 1 -- 172.21.15.145:0/3078933609 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680aa540 con 0x558b700ef3b0 2024-09-11T11:02:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d67fff640 1 -- 172.21.15.145:0/3078933609 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d680aa6e0 con 0x558b700ef3b0 2024-09-11T11:02:24.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d67fff640 1 -- 172.21.15.145:0/3078933609 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680aaa40 con 0x558b700ef3b0 2024-09-11T11:02:24.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d77984980 1 -- 172.21.15.145:0/3078933609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 msgr2=0x558b700edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d77984980 1 --2- 172.21.15.145:0/3078933609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b700edb70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800a4e0 tx=0x7f0d6801b090 comp rx=0 tx=0).stop 2024-09-11T11:02:24.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d77984980 1 -- 172.21.15.145:0/3078933609 shutdown_connections 2024-09-11T11:02:24.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d77984980 1 --2- 172.21.15.145:0/3078933609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b700edb70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d77984980 1 -- 172.21.15.145:0/3078933609 >> 172.21.15.145:0/3078933609 conn(0x558b701741b0 msgr2=0x558b701765d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d77984980 1 -- 172.21.15.145:0/3078933609 shutdown_connections 2024-09-11T11:02:24.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.598+0000 7f0d77984980 1 -- 172.21.15.145:0/3078933609 wait complete. 2024-09-11T11:02:24.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 Processor -- start 2024-09-11T11:02:24.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- start start 2024-09-11T11:02:24.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b70265c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b70026200 con 0x558b700ef3b0 2024-09-11T11:02:24.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b70265c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b70265c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53116/0 (socket says 172.21.15.145:53116) 2024-09-11T11:02:24.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d75494640 1 -- 172.21.15.145:0/288516184 learned_addr learned my addr 172.21.15.145:0/288516184 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d75494640 1 -- 172.21.15.145:0/288516184 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b70266240 con 0x558b700ef3b0 2024-09-11T11:02:24.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d75494640 1 --2- 172.21.15.145:0/288516184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b70265c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0d68017ca0 tx=0x7f0d680033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa93ed49016ba2d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0c63606640 1 -- 172.21.15.145:0/288516184 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680b9070 con 0x558b700ef3b0 2024-09-11T11:02:24.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0c63606640 1 -- 172.21.15.145:0/288516184 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d680aab50 con 0x558b700ef3b0 2024-09-11T11:02:24.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0c63606640 1 -- 172.21.15.145:0/288516184 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680aae50 con 0x558b700ef3b0 2024-09-11T11:02:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- 172.21.15.145:0/288516184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 msgr2=0x558b70265c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 --2- 172.21.15.145:0/288516184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b70265c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f0d68017ca0 tx=0x7f0d680033b0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- 172.21.15.145:0/288516184 shutdown_connections 2024-09-11T11:02:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 --2- 172.21.15.145:0/288516184 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b70265c70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- 172.21.15.145:0/288516184 >> 172.21.15.145:0/288516184 conn(0x558b701741b0 msgr2=0x558b702618a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- 172.21.15.145:0/288516184 shutdown_connections 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- 172.21.15.145:0/288516184 wait complete. 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 Processor -- start 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- start start 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b7026ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.618+0000 7f0d77984980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b70184200 con 0x558b700ef3b0 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b7026ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b7026ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53130/0 (socket says 172.21.15.145:53130) 2024-09-11T11:02:24.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d75494640 1 -- 172.21.15.145:0/745031451 learned_addr learned my addr 172.21.15.145:0/745031451 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d75494640 1 -- 172.21.15.145:0/745031451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b7026d3c0 con 0x558b700ef3b0 2024-09-11T11:02:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d75494640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b7026ce80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0d68017ca0 tx=0x7f0d68017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0c61e03640 1 -- 172.21.15.145:0/745031451 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680b9070 con 0x558b700ef3b0 2024-09-11T11:02:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0c61e03640 1 -- 172.21.15.145:0/745031451 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d680c7410 con 0x558b700ef3b0 2024-09-11T11:02:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b7026d650 con 0x558b700ef3b0 2024-09-11T11:02:24.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0c61e03640 1 -- 172.21.15.145:0/745031451 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680c7710 con 0x558b700ef3b0 2024-09-11T11:02:24.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b70270330 con 0x558b700ef3b0 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0c61e03640 1 -- 172.21.15.145:0/745031451 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d680b3040 con 0x558b700ef3b0 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0c61e03640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c5c034650 0x7f0c5c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0c61e03640 1 -- 172.21.15.145:0/745031451 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f0d680c4070 con 0x558b700ef3b0 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d77984980 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b700ef7c0 0x558b70273e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d74c93640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c5c034650 0x7f0c5c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702744b0 con 0x558b700ef7c0 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d75c95640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b700ef7c0 0x558b70273e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.622+0000 7f0d74c93640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c5c034650 0x7f0c5c036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c000f70 tx=0x7f0d6c001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d75c95640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b700ef7c0 0x558b70273e70 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d75c95640 1 -- 172.21.15.145:0/745031451 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b700ef7c0 2024-09-11T11:02:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d77984980 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702752a0 0x558b70277690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b70277cc0 con 0x558b702752a0 2024-09-11T11:02:24.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d75494640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702752a0 0x558b70277690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d75494640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702752a0 0x558b70277690 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d75494640 1 -- 172.21.15.145:0/745031451 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d680ce340 con 0x558b702752a0 2024-09-11T11:02:24.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b70279570 con 0x558b702752a0 2024-09-11T11:02:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d75494640 1 -- 172.21.15.145:0/745031451 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d680ce340 con 0x558b702752a0 2024-09-11T11:02:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702787a0 con 0x558b702752a0 2024-09-11T11:02:24.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d75494640 1 -- 172.21.15.145:0/745031451 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d680ce340 con 0x558b702752a0 2024-09-11T11:02:24.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d77984980 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558b7027a920 0x558b7027cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b7027d250 con 0x558b7027a920 2024-09-11T11:02:24.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.626+0000 7f0d74c93640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558b7027a920 0x558b7027cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d74c93640 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558b7027a920 0x558b7027cd10 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d74c93640 1 -- 172.21.15.145:0/745031451 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0d6c00f6a0 con 0x558b7027a920 2024-09-11T11:02:24.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d77984980 1 Processor -- start 2024-09-11T11:02:24.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d77984980 1 -- start start 2024-09-11T11:02:24.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d77984980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b7028ad20 0x558b7028b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d77984980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b7007f800 con 0x558b7028ad20 2024-09-11T11:02:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b7028ad20 0x558b7028b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b7028ad20 0x558b7028b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53138/0 (socket says 172.21.15.145:53138) 2024-09-11T11:02:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d75494640 1 -- 172.21.15.145:0/2243382060 learned_addr learned my addr 172.21.15.145:0/2243382060 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d75494640 1 -- 172.21.15.145:0/2243382060 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b7028b680 con 0x558b7028ad20 2024-09-11T11:02:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d75494640 1 --2- 172.21.15.145:0/2243382060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b7028ad20 0x558b7028b140 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0d680e3150 tx=0x7f0d680b3c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0c5affd640 1 -- 172.21.15.145:0/2243382060 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680b3d90 con 0x558b7028ad20 2024-09-11T11:02:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d77984980 1 -- 172.21.15.145:0/2243382060 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b7028b910 con 0x558b7028ad20 2024-09-11T11:02:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0c5affd640 1 -- 172.21.15.145:0/2243382060 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d680c78b0 con 0x558b7028ad20 2024-09-11T11:02:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0c5affd640 1 -- 172.21.15.145:0/2243382060 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680c7c10 con 0x558b7028ad20 2024-09-11T11:02:24.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0d77984980 1 -- 172.21.15.145:0/2243382060 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b7028b910 con 0x558b7028ad20 2024-09-11T11:02:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.630+0000 7f0c5affd640 1 -- 172.21.15.145:0/2243382060 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d680a93c0 con 0x558b7028ad20 2024-09-11T11:02:24.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0c5affd640 1 --2- 172.21.15.145:0/2243382060 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c4c0346a0 0x7f0c4c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0c5affd640 1 -- 172.21.15.145:0/2243382060 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f0d680e4e00 con 0x558b7028ad20 2024-09-11T11:02:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d74c93640 1 --2- 172.21.15.145:0/2243382060 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c4c0346a0 0x7f0c4c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 Processor -- start 2024-09-11T11:02:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- start start 2024-09-11T11:02:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d74c93640 1 --2- 172.21.15.145:0/2243382060 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c4c0346a0 0x7f0c4c036b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d680e31b0 tx=0x7f0d6c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b702978c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b70266500 con 0x558b702974c0 2024-09-11T11:02:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b702978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b702978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53146/0 (socket says 172.21.15.145:53146) 2024-09-11T11:02:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d75494640 1 -- 172.21.15.145:0/1919913602 learned_addr learned my addr 172.21.15.145:0/1919913602 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d75494640 1 -- 172.21.15.145:0/1919913602 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b70297e90 con 0x558b702974c0 2024-09-11T11:02:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d75494640 1 --2- 172.21.15.145:0/1919913602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b702978c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0d680b5c20 tx=0x7f0d68002fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d071cba27e5d27 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0c58ff9640 1 -- 172.21.15.145:0/1919913602 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680bece0 con 0x558b702974c0 2024-09-11T11:02:24.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0c58ff9640 1 -- 172.21.15.145:0/1919913602 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d680cf560 con 0x558b702974c0 2024-09-11T11:02:24.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0c58ff9640 1 -- 172.21.15.145:0/1919913602 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680a96b0 con 0x558b702974c0 2024-09-11T11:02:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- 172.21.15.145:0/1919913602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 msgr2=0x558b702978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 --2- 172.21.15.145:0/1919913602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b702978c0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f0d680b5c20 tx=0x7f0d68002fa0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- 172.21.15.145:0/1919913602 shutdown_connections 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 --2- 172.21.15.145:0/1919913602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b702978c0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- 172.21.15.145:0/1919913602 >> 172.21.15.145:0/1919913602 conn(0x558b70293840 msgr2=0x558b70291940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- 172.21.15.145:0/1919913602 shutdown_connections 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- 172.21.15.145:0/1919913602 wait complete. 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 Processor -- start 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- start start 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b7029e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d77984980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558b70298250 con 0x558b702974c0 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b7029e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d75494640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b7029e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53158/0 (socket says 172.21.15.145:53158) 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.634+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 learned_addr learned my addr 172.21.15.145:0/3347971726 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b7029eb80 con 0x558b702974c0 2024-09-11T11:02:24.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d75494640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b7029e640 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0d680dbfd0 tx=0x7f0d680d6f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0c4affd640 1 -- 172.21.15.145:0/3347971726 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d68107070 con 0x558b702974c0 2024-09-11T11:02:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b7029eb80 con 0x558b702974c0 2024-09-11T11:02:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0c4affd640 1 -- 172.21.15.145:0/3347971726 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d680c9e40 con 0x558b702974c0 2024-09-11T11:02:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0c4affd640 1 -- 172.21.15.145:0/3347971726 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d680e3c20 con 0x558b702974c0 2024-09-11T11:02:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b7029f050 con 0x558b702974c0 2024-09-11T11:02:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0c4affd640 1 -- 172.21.15.145:0/3347971726 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0d6810a070 con 0x558b702974c0 2024-09-11T11:02:24.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0c4affd640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c40034650 0x7f0c40036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0c4affd640 1 -- 172.21.15.145:0/3347971726 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f0d680f5070 con 0x558b702974c0 2024-09-11T11:02:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d74c93640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c40034650 0x7f0c40036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b702a9740 0x558b702abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702ac330 con 0x558b702a9740 2024-09-11T11:02:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d75c95640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b702a9740 0x558b702abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d74c93640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c40034650 0x7f0c40036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c010 tx=0x7f0d6c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d75c95640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b702a9740 0x558b702abbe0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 20 realm 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702a8c80 con 0x558b702a9740 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:24.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.638+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702ace40 con 0x558b702a9740 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702adc20 0x558b702b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0670 con 0x558b702adc20 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d75494640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702adc20 0x558b702b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d75494640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702adc20 0x558b702b0010 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 20 searching for the correct realm 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558b702b2c80 0x558b702b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b5680 con 0x558b702b2c80 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d74c93640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558b702b2c80 0x558b702b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d74c93640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558b702b2c80 0x558b702b5070 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.642+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b5680 con 0x558b702adc20 2024-09-11T11:02:24.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75494640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0d6810c070 0x7f0d68103600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x7f0d6810c070 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0d6810c070 0x7f0d68103600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0d6810c070 0x7f0d68103600 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702b2c80 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.646+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x7f0d6810c070 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x7f0d6810c070 2024-09-11T11:02:24.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702b2c80 2024-09-11T11:02:24.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702b2c80 2024-09-11T11:02:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.650+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702b2c80 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x7f0d6810c070 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702a9740 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x7f0d6810c070 2024-09-11T11:02:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702b2c80 2024-09-11T11:02:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x7f0d6810c070 2024-09-11T11:02:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702b2c80 2024-09-11T11:02:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.654+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558b702b0f10 con 0x558b702adc20 2024-09-11T11:02:24.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702b1760 con 0x558b702a9740 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702b1b50 con 0x558b702adc20 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702b1b50 con 0x7f0d6810c070 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 zone default found 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 4 Realm: () 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:24.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 zonegroup default 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702b5ae0 con 0x7f0d6810c070 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702b7860 con 0x558b702b2c80 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702b7c00 con 0x558b702b2c80 2024-09-11T11:02:24.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 started sync module instance, tier type = 2024-09-11T11:02:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:24.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.658+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b6d00 con 0x558b702adc20 2024-09-11T11:02:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.662+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.662+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94057370710576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b6d00 con 0x558b702adc20 2024-09-11T11:02:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.662+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b85c0 con 0x558b702a9740 2024-09-11T11:02:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.662+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.662+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94057370714384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b8530 con 0x558b702a9740 2024-09-11T11:02:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.662+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b94b0 con 0x558b702adc20 2024-09-11T11:02:24.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.662+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94057370710576] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.666+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94057370714384] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.666+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.666+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94057370716640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b9000 con 0x558b702adc20 2024-09-11T11:02:24.667 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.666+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b9d50 con 0x7f0d6810c070 2024-09-11T11:02:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.666+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.666+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94057370720416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b9000 con 0x7f0d6810c070 2024-09-11T11:02:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.666+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702ba7f0 con 0x558b702adc20 2024-09-11T11:02:24.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.666+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94057370716640] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94057370720416] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94057370721472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702ba7b0 con 0x558b702adc20 2024-09-11T11:02:24.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702babe0 con 0x558b702b2c80 2024-09-11T11:02:24.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94057370708048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702bb480 con 0x558b702b2c80 2024-09-11T11:02:24.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702bbe80 con 0x558b702b2c80 2024-09-11T11:02:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94057370721472] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94057370708048] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94057370723040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702bc270 con 0x558b702b2c80 2024-09-11T11:02:24.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.670+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702bcac0 con 0x7f0d6810c070 2024-09-11T11:02:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94057370723040] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94057370731120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702bcb40 con 0x7f0d6810c070 2024-09-11T11:02:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 20 add_watcher() i=0 2024-09-11T11:02:24.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 20 add_watcher() i=1 2024-09-11T11:02:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 20 add_watcher() i=2 2024-09-11T11:02:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 20 add_watcher() i=3 2024-09-11T11:02:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 20 add_watcher() i=4 2024-09-11T11:02:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 20 add_watcher() i=5 2024-09-11T11:02:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 20 add_watcher() i=6 2024-09-11T11:02:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94057370731120] v34'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 20 add_watcher() i=7 2024-09-11T11:02:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702bfe90 con 0x558b702a9740 2024-09-11T11:02:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.674+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94057370744992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702bccb0 con 0x558b702a9740 2024-09-11T11:02:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94057370744992] v34'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0c2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d77984980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d77984980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d77984980 5 note: GC not initialized 2024-09-11T11:02:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0c2afe5640 20 reqs_thread_entry: start 2024-09-11T11:02:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d77984980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:24.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d77984980 20 Filter name: none 2024-09-11T11:02:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0c28fe1640 20 reqs_thread_entry: start 2024-09-11T11:02:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b50 con 0x558b702adc20 2024-09-11T11:02:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b50 con 0x558b702adc20 2024-09-11T11:02:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.678+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702adc20 2024-09-11T11:02:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702b2c80 2024-09-11T11:02:24.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702adc20 2024-09-11T11:02:24.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702b2c80 2024-09-11T11:02:24.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702a9740 2024-09-11T11:02:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702a9740 2024-09-11T11:02:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702b2c80 2024-09-11T11:02:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702b2c80 2024-09-11T11:02:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e3b10 con 0x558b702b2c80 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702a9740 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x7f0d6810c070 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.682+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702b2c80 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x7f0d6810c070 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702a9740 2024-09-11T11:02:24.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702b2c80 2024-09-11T11:02:24.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702a9740 2024-09-11T11:02:24.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702adc20 2024-09-11T11:02:24.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702adc20 2024-09-11T11:02:24.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702b2c80 2024-09-11T11:02:24.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702adc20 2024-09-11T11:02:24.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702b2c80 2024-09-11T11:02:24.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.686+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702a9740 2024-09-11T11:02:24.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702adc20 2024-09-11T11:02:24.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702adc20 2024-09-11T11:02:24.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702adc20 2024-09-11T11:02:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702a9740 2024-09-11T11:02:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702b2c80 2024-09-11T11:02:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702b2c80 2024-09-11T11:02:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702adc20 2024-09-11T11:02:24.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558b702e5740 con 0x558b702a9740 2024-09-11T11:02:24.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.690+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.694+0000 7f0c2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:24.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.694+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94057370744992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702e1760 con 0x558b702a9740 2024-09-11T11:02:24.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.694+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94057370744992] v34'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.697 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.694+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94057370710576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702e0f80 con 0x558b702adc20 2024-09-11T11:02:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.698+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94057370710576] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.698+0000 7f0d77984980 20 remove_watcher() i=0 2024-09-11T11:02:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.698+0000 7f0d77984980 2 removed watcher, disabling cache 2024-09-11T11:02:24.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.698+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94057370714384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702e0f80 con 0x558b702a9740 2024-09-11T11:02:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.698+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94057370714384] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x558b702a9740 2024-09-11T11:02:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.698+0000 7f0d77984980 20 remove_watcher() i=1 2024-09-11T11:02:24.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.698+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94057370716640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b8110 con 0x558b702adc20 2024-09-11T11:02:24.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94057370716640] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d77984980 20 remove_watcher() i=2 2024-09-11T11:02:24.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94057370720416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702e0f80 con 0x7f0d6810c070 2024-09-11T11:02:24.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94057370720416] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d77984980 20 remove_watcher() i=3 2024-09-11T11:02:24.704 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94057370721472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702b8110 con 0x558b702adc20 2024-09-11T11:02:24.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d75494640 1 -- 172.21.15.145:0/3347971726 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94057370721472] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d68109030 con 0x558b702adc20 2024-09-11T11:02:24.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d77984980 20 remove_watcher() i=4 2024-09-11T11:02:24.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.702+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94057370708048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702e0f80 con 0x558b702b2c80 2024-09-11T11:02:24.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94057370708048] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 20 remove_watcher() i=5 2024-09-11T11:02:24.707 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94057370723040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702e0f80 con 0x558b702b2c80 2024-09-11T11:02:24.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d74c93640 1 -- 172.21.15.145:0/3347971726 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94057370723040] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d6c037040 con 0x558b702b2c80 2024-09-11T11:02:24.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 20 remove_watcher() i=6 2024-09-11T11:02:24.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94057370731120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558b702e0f80 con 0x7f0d6810c070 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94057370731120] v34'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d700083f0 con 0x7f0d6810c070 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 20 remove_watcher() i=7 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702adc20 msgr2=0x558b702b0010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702adc20 0x558b702b0010 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b702a9740 msgr2=0x558b702abbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b702a9740 0x558b702abbe0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0d6810c070 msgr2=0x7f0d68103600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f0d6810c070 0x7f0d68103600 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558b702b2c80 msgr2=0x558b702b5070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.706+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558b702b2c80 0x558b702b5070 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c40034650 msgr2=0x7f0c40036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c40034650 0x7f0c40036b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00c010 tx=0x7f0d6c010000 comp rx=0 tx=0).stop 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 msgr2=0x558b7029e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d75c95640 1 -- 172.21.15.145:0/3347971726 reap_dead start 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b7029e640 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0d680dbfd0 tx=0x7f0d680d6f70 comp rx=0 tx=0).stop 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 shutdown_connections 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/3347971726 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b702974c0 0x558b7029e640 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 >> 172.21.15.145:0/3347971726 conn(0x558b70293840 msgr2=0x558b70291910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 shutdown_connections 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/3347971726 wait complete. 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/2243382060 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c4c0346a0 msgr2=0x7f0c4c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/2243382060 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c4c0346a0 0x7f0c4c036b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d680e31b0 tx=0x7f0d6c00f000 comp rx=0 tx=0).stop 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/2243382060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b7028ad20 msgr2=0x558b7028b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/2243382060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b7028ad20 0x558b7028b140 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0d680e3150 tx=0x7f0d680b3c60 comp rx=0 tx=0).stop 2024-09-11T11:02:24.713 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/2243382060 shutdown_connections 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/2243382060 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c4c0346a0 0x7f0c4c036b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/2243382060 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b7028ad20 0x558b7028b140 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/2243382060 >> 172.21.15.145:0/2243382060 conn(0x558b7027fe70 msgr2=0x558b702828f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/2243382060 shutdown_connections 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/2243382060 wait complete. 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702752a0 msgr2=0x558b70277690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558b702752a0 0x558b70277690 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b700ef7c0 msgr2=0x558b70273e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558b700ef7c0 0x558b70273e70 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558b7027a920 msgr2=0x558b7027cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558b7027a920 0x558b7027cd10 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c5c034650 msgr2=0x7f0c5c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0c5c034650 0x7f0c5c036b10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c000f70 tx=0x7f0d6c001380 comp rx=0 tx=0).stop 2024-09-11T11:02:24.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 msgr2=0x558b7026ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 --2- 172.21.15.145:0/745031451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558b700ef3b0 0x558b7026ce80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0d68017ca0 tx=0x7f0d68017e30 comp rx=0 tx=0).stop 2024-09-11T11:02:24.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d75c95640 1 -- 172.21.15.145:0/745031451 reap_dead start 2024-09-11T11:02:24.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 shutdown_connections 2024-09-11T11:02:24.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 >> 172.21.15.145:0/745031451 conn(0x558b701741b0 msgr2=0x558b70260420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 shutdown_connections 2024-09-11T11:02:24.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.710+0000 7f0d77984980 1 -- 172.21.15.145:0/745031451 wait complete. 2024-09-11T11:02:24.724 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-11T11:02:24.724 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-11T11:02:24.724 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-11T11:02:24.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-11T11:02:24.725 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-11T11:02:24.800 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:24.800 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:24.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.798+0000 7f8ebc75f980 1 Processor -- start 2024-09-11T11:02:24.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.798+0000 7f8ebc75f980 1 -- start start 2024-09-11T11:02:24.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.798+0000 7f8ebc75f980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55bb91af9b80 0x55bb91afbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.798+0000 7f8ebc75f980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bb9197dae0 con 0x55bb91af3ab0 2024-09-11T11:02:24.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.798+0000 7f8ebc75f980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55bb919a1e30 con 0x55bb91af9b80 2024-09-11T11:02:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.798+0000 7f8eb9a6e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55bb91af9b80 0x55bb91afbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.798+0000 7f8eba26f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55bb91af3ab0 0x55bb91af3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:33196/0 (socket says 172.21.15.145:33196) 2024-09-11T11:02:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.798+0000 7f8eba26f640 1 -- 172.21.15.145:0/3971944545 learned_addr learned my addr 172.21.15.145:0/3971944545 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:02:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8eb926d640 1 -- 172.21.15.145:0/3971944545 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347910696 0 0) 0x55bb9197dae0 con 0x55bb91af3ab0 2024-09-11T11:02:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8eb926d640 1 -- 172.21.15.145:0/3971944545 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ea8001e20 con 0x55bb91af3ab0 2024-09-11T11:02:24.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3971944545 >> v1:172.21.15.102:6789/0 conn(0x55bb91af3ab0 legacy=0x55bb91af3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3971944545 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb91af45a0 con 0x55bb91af9b80 2024-09-11T11:02:24.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/3971944545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af9b80 0x55bb91afbf70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400a480 tx=0x7f8ea401b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25479d866c5005eb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8eb926d640 1 -- 172.21.15.145:0/3971944545 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea40b0070 con 0x55bb91af9b80 2024-09-11T11:02:24.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8eb926d640 1 -- 172.21.15.145:0/3971944545 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea40ab540 con 0x55bb91af9b80 2024-09-11T11:02:24.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8eb926d640 1 -- 172.21.15.145:0/3971944545 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea40ab840 con 0x55bb91af9b80 2024-09-11T11:02:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3971944545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af9b80 msgr2=0x55bb91afbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3971944545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af9b80 0x55bb91afbf70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400a480 tx=0x7f8ea401b280 comp rx=0 tx=0).stop 2024-09-11T11:02:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3971944545 shutdown_connections 2024-09-11T11:02:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3971944545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af9b80 0x55bb91afbf70 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3971944545 >> 172.21.15.145:0/3971944545 conn(0x55bb91aef790 msgr2=0x55bb91af1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3971944545 shutdown_connections 2024-09-11T11:02:24.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.802+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3971944545 wait complete. 2024-09-11T11:02:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.818+0000 7f8ebc75f980 1 Processor -- start 2024-09-11T11:02:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.818+0000 7f8ebc75f980 1 -- start start 2024-09-11T11:02:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.818+0000 7f8ebc75f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91be0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.818+0000 7f8ebc75f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bb919a3200 con 0x55bb91af3ab0 2024-09-11T11:02:24.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91be0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91be0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53174/0 (socket says 172.21.15.145:53174) 2024-09-11T11:02:24.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8eba26f640 1 -- 172.21.15.145:0/3574733052 learned_addr learned my addr 172.21.15.145:0/3574733052 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8eba26f640 1 -- 172.21.15.145:0/3574733052 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb91be0dd0 con 0x55bb91af3ab0 2024-09-11T11:02:24.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8eba26f640 1 --2- 172.21.15.145:0/3574733052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91be0800 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8eac006fc0 tx=0x7f8eac001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff69da40ff4c31ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8da8608640 1 -- 172.21.15.145:0/3574733052 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac004530 con 0x55bb91af3ab0 2024-09-11T11:02:24.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8da8608640 1 -- 172.21.15.145:0/3574733052 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac0046d0 con 0x55bb91af3ab0 2024-09-11T11:02:24.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8da8608640 1 -- 172.21.15.145:0/3574733052 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac004a70 con 0x55bb91af3ab0 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3574733052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 msgr2=0x55bb91be0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3574733052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91be0800 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8eac006fc0 tx=0x7f8eac001af0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3574733052 shutdown_connections 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3574733052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91be0800 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3574733052 >> 172.21.15.145:0/3574733052 conn(0x55bb91aef790 msgr2=0x55bb91bdc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3574733052 shutdown_connections 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3574733052 wait complete. 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 Processor -- start 2024-09-11T11:02:24.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 -- start start 2024-09-11T11:02:24.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91af6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8ebc75f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bb91afefd0 con 0x55bb91af3ab0 2024-09-11T11:02:24.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91af6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91af6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53186/0 (socket says 172.21.15.145:53186) 2024-09-11T11:02:24.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.822+0000 7f8eba26f640 1 -- 172.21.15.145:0/1588220182 learned_addr learned my addr 172.21.15.145:0/1588220182 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8eba26f640 1 -- 172.21.15.145:0/1588220182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb91af4b90 con 0x55bb91af3ab0 2024-09-11T11:02:24.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8eba26f640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91af6470 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8eac002260 tx=0x7f8eac000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8da6e05640 1 -- 172.21.15.145:0/1588220182 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac013760 con 0x55bb91af3ab0 2024-09-11T11:02:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8da6e05640 1 -- 172.21.15.145:0/1588220182 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac013900 con 0x55bb91af3ab0 2024-09-11T11:02:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb91af4e20 con 0x55bb91af3ab0 2024-09-11T11:02:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8da6e05640 1 -- 172.21.15.145:0/1588220182 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac013c20 con 0x55bb91af3ab0 2024-09-11T11:02:24.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb91af5310 con 0x55bb91af3ab0 2024-09-11T11:02:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8da6e05640 1 -- 172.21.15.145:0/1588220182 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8eac010070 con 0x55bb91af3ab0 2024-09-11T11:02:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8da6e05640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8da0034650 0x7f8da0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8da6e05640 1 -- 172.21.15.145:0/1588220182 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f8eac018070 con 0x55bb91af3ab0 2024-09-11T11:02:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8da0034650 0x7f8da0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91af9b80 0x55bb91bf0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91bf14d0 con 0x55bb91af9b80 2024-09-11T11:02:24.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8ebaa70640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91af9b80 0x55bb91bf0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8da0034650 0x7f8da0036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400a480 tx=0x7f8ea40a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8ebaa70640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91af9b80 0x55bb91bf0f90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.826+0000 7f8ebaa70640 1 -- 172.21.15.145:0/1588220182 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91af9b80 2024-09-11T11:02:24.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91bf1f80 0x55bb91bf4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91bf4bb0 con 0x55bb91bf1f80 2024-09-11T11:02:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8eba26f640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91bf1f80 0x55bb91bf4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8eba26f640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91bf1f80 0x55bb91bf4440 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8eba26f640 1 -- 172.21.15.145:0/1588220182 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8eac01b030 con 0x55bb91bf1f80 2024-09-11T11:02:24.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91bf6460 con 0x55bb91bf1f80 2024-09-11T11:02:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8eba26f640 1 -- 172.21.15.145:0/1588220182 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8eac01b030 con 0x55bb91bf1f80 2024-09-11T11:02:24.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91bf5690 con 0x55bb91bf1f80 2024-09-11T11:02:24.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8eba26f640 1 -- 172.21.15.145:0/1588220182 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8eac01b030 con 0x55bb91bf1f80 2024-09-11T11:02:24.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bb91bf7810 0x55bb91bf9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91bfa140 con 0x55bb91bf7810 2024-09-11T11:02:24.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bb91bf7810 0x55bb91bf9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.830+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bb91bf7810 0x55bb91bf9c00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/1588220182 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ea40b3040 con 0x55bb91bf7810 2024-09-11T11:02:24.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8ebc75f980 1 Processor -- start 2024-09-11T11:02:24.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8ebc75f980 1 -- start start 2024-09-11T11:02:24.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8ebc75f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c07b00 0x55bb91c07f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8ebc75f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bb919fc800 con 0x55bb91c07b00 2024-09-11T11:02:24.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c07b00 0x55bb91c07f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c07b00 0x55bb91c07f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53198/0 (socket says 172.21.15.145:53198) 2024-09-11T11:02:24.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8eba26f640 1 -- 172.21.15.145:0/1628414953 learned_addr learned my addr 172.21.15.145:0/1628414953 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8eba26f640 1 -- 172.21.15.145:0/1628414953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb91c08460 con 0x55bb91c07b00 2024-09-11T11:02:24.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8eba26f640 1 --2- 172.21.15.145:0/1628414953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c07b00 0x55bb91c07f20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0483f0 tx=0x7f8eac010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8d9ffff640 1 -- 172.21.15.145:0/1628414953 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac0123c0 con 0x55bb91c07b00 2024-09-11T11:02:24.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8d9ffff640 1 -- 172.21.15.145:0/1628414953 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac012560 con 0x55bb91c07b00 2024-09-11T11:02:24.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8d9ffff640 1 -- 172.21.15.145:0/1628414953 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac012730 con 0x55bb91c07b00 2024-09-11T11:02:24.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1628414953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb91c086f0 con 0x55bb91c07b00 2024-09-11T11:02:24.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1628414953 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb91c086f0 con 0x55bb91c07b00 2024-09-11T11:02:24.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8d9ffff640 1 -- 172.21.15.145:0/1628414953 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8eac041a20 con 0x55bb91c07b00 2024-09-11T11:02:24.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8d9ffff640 1 --2- 172.21.15.145:0/1628414953 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d94034650 0x7f8d94036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.834+0000 7f8d9ffff640 1 -- 172.21.15.145:0/1628414953 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f8eac0530b0 con 0x55bb91c07b00 2024-09-11T11:02:24.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/1628414953 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d94034650 0x7f8d94036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 Processor -- start 2024-09-11T11:02:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- start start 2024-09-11T11:02:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/1628414953 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d94034650 0x7f8d94036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55bb91af5b80 tx=0x7f8ea4005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c146b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bb91be1150 con 0x55bb91c142d0 2024-09-11T11:02:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c146b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c146b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53202/0 (socket says 172.21.15.145:53202) 2024-09-11T11:02:24.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8eba26f640 1 -- 172.21.15.145:0/1492808145 learned_addr learned my addr 172.21.15.145:0/1492808145 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8eba26f640 1 -- 172.21.15.145:0/1492808145 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb91c14c80 con 0x55bb91c142d0 2024-09-11T11:02:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8eba26f640 1 --2- 172.21.15.145:0/1492808145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c146b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8eac010fd0 tx=0x7f8eac041220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891e7ae03bb27cf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8d9dffb640 1 -- 172.21.15.145:0/1492808145 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac029940 con 0x55bb91c142d0 2024-09-11T11:02:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8d9dffb640 1 -- 172.21.15.145:0/1492808145 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac061070 con 0x55bb91c142d0 2024-09-11T11:02:24.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8d9dffb640 1 -- 172.21.15.145:0/1492808145 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac028d50 con 0x55bb91c142d0 2024-09-11T11:02:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1492808145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 msgr2=0x55bb91c146b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1492808145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c146b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f8eac010fd0 tx=0x7f8eac041220 comp rx=0 tx=0).stop 2024-09-11T11:02:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1492808145 shutdown_connections 2024-09-11T11:02:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1492808145 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c146b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1492808145 >> 172.21.15.145:0/1492808145 conn(0x55bb91c106b0 msgr2=0x55bb91c0e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1492808145 shutdown_connections 2024-09-11T11:02:24.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1492808145 wait complete. 2024-09-11T11:02:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 Processor -- start 2024-09-11T11:02:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- start start 2024-09-11T11:02:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c1b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.838+0000 7f8ebc75f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55bb91c15120 con 0x55bb91c142d0 2024-09-11T11:02:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c1b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8eba26f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c1b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53216/0 (socket says 172.21.15.145:53216) 2024-09-11T11:02:24.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 learned_addr learned my addr 172.21.15.145:0/3864655318 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb91c1ba30 con 0x55bb91c142d0 2024-09-11T11:02:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8eba26f640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c1b4f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8eac047210 tx=0x7f8eac008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8d8bfff640 1 -- 172.21.15.145:0/3864655318 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac074070 con 0x55bb91c142d0 2024-09-11T11:02:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8d8bfff640 1 -- 172.21.15.145:0/3864655318 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eac029940 con 0x55bb91c142d0 2024-09-11T11:02:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bb91c1ba30 con 0x55bb91c142d0 2024-09-11T11:02:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8d8bfff640 1 -- 172.21.15.145:0/3864655318 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8eac028960 con 0x55bb91c142d0 2024-09-11T11:02:24.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb91c1ba30 con 0x55bb91c142d0 2024-09-11T11:02:24.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8d8bfff640 1 -- 172.21.15.145:0/3864655318 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f8eac077070 con 0x55bb91c142d0 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8d8bfff640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d84034650 0x7f8d84036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8d8bfff640 1 -- 172.21.15.145:0/3864655318 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f8eac06d070 con 0x55bb91c142d0 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d84034650 0x7f8d84036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91c26570 0x55bb91c28a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c29160 con 0x55bb91c26570 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebaa70640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91c26570 0x55bb91c28a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d84034650 0x7f8d84036b10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55bb91bf63b0 tx=0x7f8ea40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebaa70640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91c26570 0x55bb91c28a10 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 20 realm 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.842+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c25a60 con 0x55bb91c26570 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c29bf0 con 0x55bb91c26570 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91c2a9d0 0x55bb91c2cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c2d3f0 con 0x55bb91c2a9d0 2024-09-11T11:02:24.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8eba26f640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91c2a9d0 0x55bb91c2cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8eba26f640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91c2a9d0 0x55bb91c2cdc0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c2d7e0 con 0x55bb91c2a9d0 2024-09-11T11:02:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 20 searching for the correct realm 2024-09-11T11:02:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bb91c2f180 0x55bb91c315f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c31cc0 con 0x55bb91c2f180 2024-09-11T11:02:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bb91c2f180 0x55bb91c315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.846+0000 7f8eb9a6e640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bb91c2f180 0x55bb91c315f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c31cc0 con 0x55bb91c2a9d0 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eba26f640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8eac079060 0x7f8eac066470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x7f8eac079060 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8eac079060 0x7f8eac066470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8eac079060 0x7f8eac066470 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2f180 2024-09-11T11:02:24.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.850+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x7f8eac079060 2024-09-11T11:02:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x7f8eac079060 2024-09-11T11:02:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2f180 2024-09-11T11:02:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2f180 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.854+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2f180 2024-09-11T11:02:24.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x7f8eac079060 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c26570 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x7f8eac079060 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2f180 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x7f8eac079060 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2f180 2024-09-11T11:02:24.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.858+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7f8eac065030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c2daf0 con 0x55bb91c26570 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c2dee0 con 0x55bb91c2a9d0 2024-09-11T11:02:24.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c2dee0 con 0x7f8eac079060 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 zone default found 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 4 Realm: () 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 zonegroup default 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c32140 con 0x7f8eac079060 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c33ec0 con 0x55bb91c2f180 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c34260 con 0x55bb91c2f180 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 started sync module instance, tier type = 2024-09-11T11:02:24.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:24.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.862+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c33360 con 0x55bb91c2a9d0 2024-09-11T11:02:24.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.866+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.866+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94264092735616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c33360 con 0x55bb91c2a9d0 2024-09-11T11:02:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.866+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c34c20 con 0x55bb91c26570 2024-09-11T11:02:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.866+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.866+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94264092739440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c35040 con 0x55bb91c26570 2024-09-11T11:02:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.866+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c35a90 con 0x55bb91c2a9d0 2024-09-11T11:02:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.866+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94264092735616] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94264092739440] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94264092743040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c34b90 con 0x55bb91c2a9d0 2024-09-11T11:02:24.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c36360 con 0x7f8eac079060 2024-09-11T11:02:24.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94264092745392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c34b90 con 0x7f8eac079060 2024-09-11T11:02:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c36e00 con 0x55bb91c2a9d0 2024-09-11T11:02:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94264092743040] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.870+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94264092745392] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94264092746448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c36dc0 con 0x55bb91c2a9d0 2024-09-11T11:02:24.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c371f0 con 0x55bb91c2f180 2024-09-11T11:02:24.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94264092733104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c37a90 con 0x55bb91c2f180 2024-09-11T11:02:24.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c38490 con 0x55bb91c2f180 2024-09-11T11:02:24.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94264092746448] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94264092748016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c38d30 con 0x55bb91c2f180 2024-09-11T11:02:24.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c396f0 con 0x7f8eac079060 2024-09-11T11:02:24.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.874+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94264092733104] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94264092758592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c39b10 con 0x7f8eac079060 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 20 add_watcher() i=0 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 20 add_watcher() i=1 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 20 add_watcher() i=2 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 20 add_watcher() i=3 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 20 add_watcher() i=4 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 20 add_watcher() i=5 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94264092748016] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 20 add_watcher() i=6 2024-09-11T11:02:24.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94264092758592] v34'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 20 add_watcher() i=7 2024-09-11T11:02:24.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:24.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c3cb40 con 0x55bb91c26570 2024-09-11T11:02:24.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.878+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94264092759648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c39f30 con 0x55bb91c26570 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94264092759648] v34'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8d70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 5 note: GC not initialized 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ceb7fe640 20 reqs_thread_entry: start 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 20 Filter name: none 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ce97fa640 20 reqs_thread_entry: start 2024-09-11T11:02:24.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c605c0 con 0x55bb91c2a9d0 2024-09-11T11:02:24.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c605c0 con 0x55bb91c2a9d0 2024-09-11T11:02:24.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c2a9d0 2024-09-11T11:02:24.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.882+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c2f180 2024-09-11T11:02:24.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c2a9d0 2024-09-11T11:02:24.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c2f180 2024-09-11T11:02:24.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c26570 2024-09-11T11:02:24.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c26570 2024-09-11T11:02:24.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c2f180 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c2f180 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c60580 con 0x55bb91c2f180 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c26570 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x7f8eac079060 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2f180 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x7f8eac079060 2024-09-11T11:02:24.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.886+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c26570 2024-09-11T11:02:24.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2f180 2024-09-11T11:02:24.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c26570 2024-09-11T11:02:24.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2a9d0 2024-09-11T11:02:24.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2a9d0 2024-09-11T11:02:24.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2f180 2024-09-11T11:02:24.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2a9d0 2024-09-11T11:02:24.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2f180 2024-09-11T11:02:24.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c26570 2024-09-11T11:02:24.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.890+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2a9d0 2024-09-11T11:02:24.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2a9d0 2024-09-11T11:02:24.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2a9d0 2024-09-11T11:02:24.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.895 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c26570 2024-09-11T11:02:24.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2f180 2024-09-11T11:02:24.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2f180 2024-09-11T11:02:24.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c2a9d0 2024-09-11T11:02:24.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c62260 con 0x55bb91c26570 2024-09-11T11:02:24.897 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.894+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.898+0000 7f8d70fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:24.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.898+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94264092759648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c5e3b0 con 0x55bb91c26570 2024-09-11T11:02:24.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.898+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94264092759648] v34'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.898+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94264092735616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c5e860 con 0x55bb91c2a9d0 2024-09-11T11:02:24.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94264092735616] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8ebc75f980 20 remove_watcher() i=0 2024-09-11T11:02:24.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8ebc75f980 2 removed watcher, disabling cache 2024-09-11T11:02:24.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94264092739440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c33880 con 0x55bb91c26570 2024-09-11T11:02:24.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94264092739440] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x55bb91c26570 2024-09-11T11:02:24.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8ebc75f980 20 remove_watcher() i=1 2024-09-11T11:02:24.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94264092743040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c33880 con 0x55bb91c2a9d0 2024-09-11T11:02:24.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94264092743040] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8ebc75f980 20 remove_watcher() i=2 2024-09-11T11:02:24.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.902+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94264092745392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c35580 con 0x7f8eac079060 2024-09-11T11:02:24.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.906+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94264092745392] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.906+0000 7f8ebc75f980 20 remove_watcher() i=3 2024-09-11T11:02:24.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.906+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94264092746448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c35eb0 con 0x55bb91c2a9d0 2024-09-11T11:02:24.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.906+0000 7f8eba26f640 1 -- 172.21.15.145:0/3864655318 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94264092746448] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eac076030 con 0x55bb91c2a9d0 2024-09-11T11:02:24.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.906+0000 7f8ebc75f980 20 remove_watcher() i=4 2024-09-11T11:02:24.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.906+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94264092733104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c35580 con 0x55bb91c2f180 2024-09-11T11:02:24.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.906+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94264092733104] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 20 remove_watcher() i=5 2024-09-11T11:02:24.910 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94264092748016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c32eb0 con 0x55bb91c2f180 2024-09-11T11:02:24.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8eb9a6e640 1 -- 172.21.15.145:0/3864655318 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94264092748016] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ea40c9030 con 0x55bb91c2f180 2024-09-11T11:02:24.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 20 remove_watcher() i=6 2024-09-11T11:02:24.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94264092758592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55bb91c35580 con 0x7f8eac079060 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94264092758592] v34'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb40083f0 con 0x7f8eac079060 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 20 remove_watcher() i=7 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91c2a9d0 msgr2=0x55bb91c2cdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91c2a9d0 0x55bb91c2cdc0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91c26570 msgr2=0x55bb91c28a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91c26570 0x55bb91c28a10 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8eac079060 msgr2=0x7f8eac066470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f8eac079060 0x7f8eac066470 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bb91c2f180 msgr2=0x55bb91c315f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55bb91c2f180 0x55bb91c315f0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d84034650 msgr2=0x7f8d84036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d84034650 0x7f8d84036b10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55bb91bf63b0 tx=0x7f8ea40a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 msgr2=0x55bb91c1b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/3864655318 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c142d0 0x55bb91c1b4f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8eac047210 tx=0x7f8eac008eb0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 reap_dead start 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebaa70640 1 -- 172.21.15.145:0/3864655318 reap_dead start 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 shutdown_connections 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 >> 172.21.15.145:0/3864655318 conn(0x55bb91c106b0 msgr2=0x55bb91c0e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 shutdown_connections 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/3864655318 wait complete. 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1628414953 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d94034650 msgr2=0x7f8d94036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1628414953 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d94034650 0x7f8d94036b10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x55bb91af5b80 tx=0x7f8ea4005a10 comp rx=0 tx=0).stop 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1628414953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c07b00 msgr2=0x55bb91c07f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1628414953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c07b00 0x55bb91c07f20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0483f0 tx=0x7f8eac010d70 comp rx=0 tx=0).stop 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1628414953 shutdown_connections 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1628414953 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8d94034650 0x7f8d94036b10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1628414953 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91c07b00 0x55bb91c07f20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.910+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1628414953 >> 172.21.15.145:0/1628414953 conn(0x55bb91bfcc50 msgr2=0x55bb91bff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1628414953 shutdown_connections 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1628414953 wait complete. 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91bf1f80 msgr2=0x55bb91bf4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55bb91bf1f80 0x55bb91bf4440 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91af9b80 msgr2=0x55bb91bf0f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55bb91af9b80 0x55bb91bf0f90 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bb91bf7810 msgr2=0x55bb91bf9c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55bb91bf7810 0x55bb91bf9c00 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8da0034650 msgr2=0x7f8da0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f8da0034650 0x7f8da0036b10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400a480 tx=0x7f8ea40a5040 comp rx=0 tx=0).stop 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 msgr2=0x55bb91af6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 --2- 172.21.15.145:0/1588220182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55bb91af3ab0 0x55bb91af6470 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8eac002260 tx=0x7f8eac000f50 comp rx=0 tx=0).stop 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebaa70640 1 -- 172.21.15.145:0/1588220182 reap_dead start 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 shutdown_connections 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 >> 172.21.15.145:0/1588220182 conn(0x55bb91aef790 msgr2=0x55bb91bdafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 shutdown_connections 2024-09-11T11:02:24.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:24.914+0000 7f8ebc75f980 1 -- 172.21.15.145:0/1588220182 wait complete. 2024-09-11T11:02:24.926 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-11T11:02:24.926 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-11T11:02:24.926 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-11T11:02:24.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-11T11:02:24.926 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-11T11:02:25.003 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:25.004 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:25.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97e5c4980 1 Processor -- start 2024-09-11T11:02:25.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97e5c4980 1 -- start start 2024-09-11T11:02:25.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97e5c4980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55910d808c60 0x55910d80b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97e5c4980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55910d68aae0 con 0x55910d8048e0 2024-09-11T11:02:25.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97e5c4980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55910d6aee30 con 0x55910d808c60 2024-09-11T11:02:25.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97c0d4640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55910d8048e0 0x55910d804cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:33204/0 (socket says 172.21.15.145:33204) 2024-09-11T11:02:25.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97c0d4640 1 -- 172.21.15.145:0/4293769155 learned_addr learned my addr 172.21.15.145:0/4293769155 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:02:25.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/4293769155 >> v2:172.21.15.102:3300/0 conn(0x55910d808c60 0x55910d80b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97b0d2640 1 -- 172.21.15.145:0/4293769155 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493949513 0 0) 0x55910d68aae0 con 0x55910d8048e0 2024-09-11T11:02:25.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.002+0000 7fa97b0d2640 1 -- 172.21.15.145:0/4293769155 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa964001e20 con 0x55910d8048e0 2024-09-11T11:02:25.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97b8d3640 1 -- 172.21.15.145:0/4293769155 >> v1:172.21.15.102:6789/0 conn(0x55910d8048e0 legacy=0x55910d804cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97b8d3640 1 -- 172.21.15.145:0/4293769155 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910d80c5a0 con 0x55910d808c60 2024-09-11T11:02:25.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/4293769155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d808c60 0x55910d80b050 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa97000a480 tx=0x7fa97001b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3619e008e1201865 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97b0d2640 1 -- 172.21.15.145:0/4293769155 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9700b0070 con 0x55910d808c60 2024-09-11T11:02:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97b0d2640 1 -- 172.21.15.145:0/4293769155 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9700ab540 con 0x55910d808c60 2024-09-11T11:02:25.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97b0d2640 1 -- 172.21.15.145:0/4293769155 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9700ab840 con 0x55910d808c60 2024-09-11T11:02:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97e5c4980 1 -- 172.21.15.145:0/4293769155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d808c60 msgr2=0x55910d80b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/4293769155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d808c60 0x55910d80b050 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa97000a480 tx=0x7fa97001b280 comp rx=0 tx=0).stop 2024-09-11T11:02:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97e5c4980 1 -- 172.21.15.145:0/4293769155 shutdown_connections 2024-09-11T11:02:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/4293769155 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d808c60 0x55910d80b050 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97e5c4980 1 -- 172.21.15.145:0/4293769155 >> 172.21.15.145:0/4293769155 conn(0x55910d778230 msgr2=0x55910d778640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97e5c4980 1 -- 172.21.15.145:0/4293769155 shutdown_connections 2024-09-11T11:02:25.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.006+0000 7fa97e5c4980 1 -- 172.21.15.145:0/4293769155 wait complete. 2024-09-11T11:02:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.022+0000 7fa97e5c4980 1 Processor -- start 2024-09-11T11:02:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.022+0000 7fa97e5c4980 1 -- start start 2024-09-11T11:02:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.022+0000 7fa97e5c4980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8efa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55910d6b0200 con 0x55910d8048e0 2024-09-11T11:02:25.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8efa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53236/0 (socket says 172.21.15.145:53236) 2024-09-11T11:02:25.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97c0d4640 1 -- 172.21.15.145:0/3281472272 learned_addr learned my addr 172.21.15.145:0/3281472272 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97c0d4640 1 -- 172.21.15.145:0/3281472272 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910d8f0010 con 0x55910d8048e0 2024-09-11T11:02:25.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/3281472272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8efa40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa96c001dc0 tx=0x7fa96c00b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea01f77326352269 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa86a60c640 1 -- 172.21.15.145:0/3281472272 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c012020 con 0x55910d8048e0 2024-09-11T11:02:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa86a60c640 1 -- 172.21.15.145:0/3281472272 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c00e7c0 con 0x55910d8048e0 2024-09-11T11:02:25.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa86a60c640 1 -- 172.21.15.145:0/3281472272 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c00eb40 con 0x55910d8048e0 2024-09-11T11:02:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3281472272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 msgr2=0x55910d8efa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/3281472272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8efa40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa96c001dc0 tx=0x7fa96c00b6d0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3281472272 shutdown_connections 2024-09-11T11:02:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/3281472272 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8efa40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3281472272 >> 172.21.15.145:0/3281472272 conn(0x55910d778230 msgr2=0x55910d8eb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3281472272 shutdown_connections 2024-09-11T11:02:25.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3281472272 wait complete. 2024-09-11T11:02:25.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 Processor -- start 2024-09-11T11:02:25.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 -- start start 2024-09-11T11:02:25.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8f6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97e5c4980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55910d80c0a0 con 0x55910d8048e0 2024-09-11T11:02:25.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8f6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8f6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53238/0 (socket says 172.21.15.145:53238) 2024-09-11T11:02:25.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.026+0000 7fa97c0d4640 1 -- 172.21.15.145:0/1723515598 learned_addr learned my addr 172.21.15.145:0/1723515598 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97c0d4640 1 -- 172.21.15.145:0/1723515598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910d8f7350 con 0x55910d8048e0 2024-09-11T11:02:25.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8f6e10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x55910d8f0c20 tx=0x7fa96c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa868e09640 1 -- 172.21.15.145:0/1723515598 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c012030 con 0x55910d8048e0 2024-09-11T11:02:25.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55910d8f75e0 con 0x55910d8048e0 2024-09-11T11:02:25.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa868e09640 1 -- 172.21.15.145:0/1723515598 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c001440 con 0x55910d8048e0 2024-09-11T11:02:25.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa868e09640 1 -- 172.21.15.145:0/1723515598 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c01aaf0 con 0x55910d8048e0 2024-09-11T11:02:25.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910d8fa2c0 con 0x55910d8048e0 2024-09-11T11:02:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa868e09640 1 -- 172.21.15.145:0/1723515598 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa96c015020 con 0x55910d8048e0 2024-09-11T11:02:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa868e09640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa864034650 0x7fa864036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa868e09640 1 -- 172.21.15.145:0/1723515598 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fa96c020030 con 0x55910d8048e0 2024-09-11T11:02:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa864034650 0x7fa864036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d808c60 0x55910d8fdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d8fe450 con 0x55910d808c60 2024-09-11T11:02:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97c8d5640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d808c60 0x55910d8fdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa864034650 0x7fa864036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa9700ad000 tx=0x7fa9700a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97c8d5640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d808c60 0x55910d8fdde0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97c8d5640 1 -- 172.21.15.145:0/1723515598 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d808c60 2024-09-11T11:02:25.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d8ff220 0x55910d901610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.030+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d901c50 con 0x55910d8ff220 2024-09-11T11:02:25.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d8ff220 0x55910d901610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d8ff220 0x55910d901610 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97c0d4640 1 -- 172.21.15.145:0/1723515598 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa96c008030 con 0x55910d8ff220 2024-09-11T11:02:25.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d903500 con 0x55910d8ff220 2024-09-11T11:02:25.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97c0d4640 1 -- 172.21.15.145:0/1723515598 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa96c008030 con 0x55910d8ff220 2024-09-11T11:02:25.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d902730 con 0x55910d8ff220 2024-09-11T11:02:25.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97c0d4640 1 -- 172.21.15.145:0/1723515598 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa96c008030 con 0x55910d8ff220 2024-09-11T11:02:25.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55910d9048b0 0x55910d906ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d9071e0 con 0x55910d9048b0 2024-09-11T11:02:25.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55910d9048b0 0x55910d906ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55910d9048b0 0x55910d906ca0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.034+0000 7fa97b8d3640 1 -- 172.21.15.145:0/1723515598 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9700abd10 con 0x55910d9048b0 2024-09-11T11:02:25.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97e5c4980 1 Processor -- start 2024-09-11T11:02:25.038 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97e5c4980 1 -- start start 2024-09-11T11:02:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97e5c4980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d914c70 0x55910d915090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97e5c4980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55910d709800 con 0x55910d914c70 2024-09-11T11:02:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d914c70 0x55910d915090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d914c70 0x55910d915090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53242/0 (socket says 172.21.15.145:53242) 2024-09-11T11:02:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97c0d4640 1 -- 172.21.15.145:0/3104656005 learned_addr learned my addr 172.21.15.145:0/3104656005 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97c0d4640 1 -- 172.21.15.145:0/3104656005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910d9155d0 con 0x55910d914c70 2024-09-11T11:02:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/3104656005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d914c70 0x55910d915090 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa96c048590 tx=0x7fa96c018d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa861ffb640 1 -- 172.21.15.145:0/3104656005 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c0168b0 con 0x55910d914c70 2024-09-11T11:02:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa861ffb640 1 -- 172.21.15.145:0/3104656005 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c018430 con 0x55910d914c70 2024-09-11T11:02:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3104656005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55910d915860 con 0x55910d914c70 2024-09-11T11:02:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa861ffb640 1 -- 172.21.15.145:0/3104656005 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c018730 con 0x55910d914c70 2024-09-11T11:02:25.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3104656005 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910d9184e0 con 0x55910d914c70 2024-09-11T11:02:25.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa861ffb640 1 -- 172.21.15.145:0/3104656005 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa96c009070 con 0x55910d914c70 2024-09-11T11:02:25.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa861ffb640 1 --2- 172.21.15.145:0/3104656005 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa8540346a0 0x7fa854036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa861ffb640 1 -- 172.21.15.145:0/3104656005 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fa96c02de00 con 0x55910d914c70 2024-09-11T11:02:25.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/3104656005 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa8540346a0 0x7fa854036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97e5c4980 1 Processor -- start 2024-09-11T11:02:25.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.038+0000 7fa97e5c4980 1 -- start start 2024-09-11T11:02:25.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/3104656005 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa8540346a0 0x7fa854036b60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa970017e90 tx=0x7fa970005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d921a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55910d8f0390 con 0x55910d921670 2024-09-11T11:02:25.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d921a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d921a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53244/0 (socket says 172.21.15.145:53244) 2024-09-11T11:02:25.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97c0d4640 1 -- 172.21.15.145:0/921566324 learned_addr learned my addr 172.21.15.145:0/921566324 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97c0d4640 1 -- 172.21.15.145:0/921566324 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910d922020 con 0x55910d921670 2024-09-11T11:02:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/921566324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d921a50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa96c053000 tx=0x7fa96c00ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55da13b9695790c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa85b7fe640 1 -- 172.21.15.145:0/921566324 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c05f070 con 0x55910d921670 2024-09-11T11:02:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa85b7fe640 1 -- 172.21.15.145:0/921566324 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c04f480 con 0x55910d921670 2024-09-11T11:02:25.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa85b7fe640 1 -- 172.21.15.145:0/921566324 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c048940 con 0x55910d921670 2024-09-11T11:02:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 -- 172.21.15.145:0/921566324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 msgr2=0x55910d921a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/921566324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d921a50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa96c053000 tx=0x7fa96c00ddd0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 -- 172.21.15.145:0/921566324 shutdown_connections 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/921566324 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d921a50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 -- 172.21.15.145:0/921566324 >> 172.21.15.145:0/921566324 conn(0x55910d91d9a0 msgr2=0x55910d91baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 -- 172.21.15.145:0/921566324 shutdown_connections 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 -- 172.21.15.145:0/921566324 wait complete. 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 Processor -- start 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 -- start start 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d9287e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97e5c4980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55910d9223b0 con 0x55910d921670 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d9287e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97c0d4640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d9287e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53256/0 (socket says 172.21.15.145:53256) 2024-09-11T11:02:25.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.042+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 learned_addr learned my addr 172.21.15.145:0/2941332084 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55910d928d20 con 0x55910d921670 2024-09-11T11:02:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d9287e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa96c01ad40 tx=0x7fa96c038ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa859ffb640 1 -- 172.21.15.145:0/2941332084 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c072070 con 0x55910d921670 2024-09-11T11:02:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa859ffb640 1 -- 172.21.15.145:0/2941332084 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c0327f0 con 0x55910d921670 2024-09-11T11:02:25.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55910d928d20 con 0x55910d921670 2024-09-11T11:02:25.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa859ffb640 1 -- 172.21.15.145:0/2941332084 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa96c032ad0 con 0x55910d921670 2024-09-11T11:02:25.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55910d928d20 con 0x55910d921670 2024-09-11T11:02:25.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa859ffb640 1 -- 172.21.15.145:0/2941332084 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa96c075070 con 0x55910d921670 2024-09-11T11:02:25.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa859ffb640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa84c034650 0x7fa84c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa859ffb640 1 -- 172.21.15.145:0/2941332084 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fa96c005050 con 0x55910d921670 2024-09-11T11:02:25.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa84c034650 0x7fa84c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d933930 0x55910d935df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d936540 con 0x55910d933930 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97c8d5640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d933930 0x55910d935df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa84c034650 0x7fa84c036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9700b7fd0 tx=0x7fa9700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97c8d5640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d933930 0x55910d935df0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 20 realm 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d932de0 con 0x55910d933930 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d937010 con 0x55910d933930 2024-09-11T11:02:25.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d937bc0 0x55910d93a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.046+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d937bc0 0x55910d93a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d937bc0 0x55910d93a080 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97e5c4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d93b090 con 0x55910d937bc0 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97e5c4980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97e5c4980 20 searching for the correct realm 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55910d93c900 0x55910d93edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93f490 con 0x55910d93c900 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55910d93c900 0x55910d93edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97b8d3640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55910d93c900 0x55910d93edc0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93f490 con 0x55910d937bc0 2024-09-11T11:02:25.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97c0d4640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa96c077060 0x7fa96c0411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x7fa96c077060 2024-09-11T11:02:25.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.050+0000 7fa97c8d5640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa96c077060 0x7fa96c0411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa96c077060 0x7fa96c0411c0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d93c900 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x7fa96c077060 2024-09-11T11:02:25.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.054+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x7fa96c077060 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d93c900 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d93c900 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d93c900 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x7fa96c077060 2024-09-11T11:02:25.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d933930 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x7fa96c077060 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.058+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d93c900 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x7fa96c077060 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d93c900 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55910d93a7f0 con 0x55910d937bc0 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:25.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d93b1c0 con 0x55910d933930 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.062+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d93b5b0 con 0x55910d937bc0 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d93b5b0 con 0x7fa96c077060 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 zone default found 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 4 Realm: () 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 zonegroup default 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d93f910 con 0x7fa96c077060 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d941690 con 0x55910d93c900 2024-09-11T11:02:25.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d941a30 con 0x55910d93c900 2024-09-11T11:02:25.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 started sync module instance, tier type = 2024-09-11T11:02:25.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:25.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d940b30 con 0x55910d937bc0 2024-09-11T11:02:25.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94081486425936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d940b30 con 0x55910d937bc0 2024-09-11T11:02:25.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.066+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d9423f0 con 0x55910d933930 2024-09-11T11:02:25.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.070+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.070+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94081486430016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d942810 con 0x55910d933930 2024-09-11T11:02:25.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.070+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d943270 con 0x55910d937bc0 2024-09-11T11:02:25.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.070+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94081486425936] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.070+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94081486430016] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.070+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.070+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94081486423680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d942360 con 0x55910d937bc0 2024-09-11T11:02:25.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.070+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d943b10 con 0x7fa96c077060 2024-09-11T11:02:25.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.074+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.074+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94081486435936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d942360 con 0x7fa96c077060 2024-09-11T11:02:25.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.074+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d9445b0 con 0x55910d937bc0 2024-09-11T11:02:25.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.074+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94081486435936] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.074+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94081486423680] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.074+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.074+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94081486438560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d944570 con 0x55910d937bc0 2024-09-11T11:02:25.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.074+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d9449d0 con 0x55910d93c900 2024-09-11T11:02:25.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94081486433616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d945220 con 0x55910d93c900 2024-09-11T11:02:25.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d945be0 con 0x55910d93c900 2024-09-11T11:02:25.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94081486438560] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94081486436992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d946480 con 0x55910d93c900 2024-09-11T11:02:25.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d946d10 con 0x7fa96c077060 2024-09-11T11:02:25.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94081486433616] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94081486441840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d947100 con 0x7fa96c077060 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 20 add_watcher() i=0 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 20 add_watcher() i=1 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 20 add_watcher() i=2 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 20 add_watcher() i=3 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 20 add_watcher() i=4 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 20 add_watcher() i=5 2024-09-11T11:02:25.082 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94081486436992] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.078+0000 7fa97e5c4980 20 add_watcher() i=6 2024-09-11T11:02:25.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.082+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94081486441840] v34'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.082+0000 7fa97e5c4980 20 add_watcher() i=7 2024-09-11T11:02:25.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.082+0000 7fa97e5c4980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:25.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.082+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d946000 con 0x55910d933930 2024-09-11T11:02:25.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.082+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.082+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94081486446544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d946960 con 0x55910d933930 2024-09-11T11:02:25.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.082+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94081486446544] v34'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa8327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:25.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:25.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 5 note: GC not initialized 2024-09-11T11:02:25.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa8317e2640 20 reqs_thread_entry: start 2024-09-11T11:02:25.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:25.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 20 Filter name: none 2024-09-11T11:02:25.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa7a2ffd640 20 reqs_thread_entry: start 2024-09-11T11:02:25.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d96d560 con 0x55910d933930 2024-09-11T11:02:25.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:02:25.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55910d96eab0 con 0x55910d93c900 2024-09-11T11:02:25.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa8327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.086+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94081486446544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d96c910 con 0x55910d933930 2024-09-11T11:02:25.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.090+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94081486446544] v34'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.090+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94081486425936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d96c910 con 0x55910d937bc0 2024-09-11T11:02:25.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.090+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94081486425936] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.090+0000 7fa97e5c4980 20 remove_watcher() i=0 2024-09-11T11:02:25.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.090+0000 7fa97e5c4980 2 removed watcher, disabling cache 2024-09-11T11:02:25.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.090+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94081486430016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d940f50 con 0x55910d933930 2024-09-11T11:02:25.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.094+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94081486430016] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x55910d933930 2024-09-11T11:02:25.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.094+0000 7fa97e5c4980 20 remove_watcher() i=1 2024-09-11T11:02:25.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.094+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94081486423680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d96c910 con 0x55910d937bc0 2024-09-11T11:02:25.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.094+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94081486423680] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.094+0000 7fa97e5c4980 20 remove_watcher() i=2 2024-09-11T11:02:25.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.094+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94081486435936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d941f40 con 0x7fa96c077060 2024-09-11T11:02:25.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.094+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94081486435936] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.098+0000 7fa97e5c4980 20 remove_watcher() i=3 2024-09-11T11:02:25.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.098+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94081486438560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d940680 con 0x55910d937bc0 2024-09-11T11:02:25.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.098+0000 7fa97c0d4640 1 -- 172.21.15.145:0/2941332084 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94081486438560] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa96c074030 con 0x55910d937bc0 2024-09-11T11:02:25.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.098+0000 7fa97e5c4980 20 remove_watcher() i=4 2024-09-11T11:02:25.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.098+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94081486433616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d96c910 con 0x55910d93c900 2024-09-11T11:02:25.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.098+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94081486433616] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.098+0000 7fa97e5c4980 20 remove_watcher() i=5 2024-09-11T11:02:25.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.098+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94081486436992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d941f40 con 0x55910d93c900 2024-09-11T11:02:25.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97b8d3640 1 -- 172.21.15.145:0/2941332084 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94081486436992] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9700d9070 con 0x55910d93c900 2024-09-11T11:02:25.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 20 remove_watcher() i=6 2024-09-11T11:02:25.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94081486441840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55910d941f40 con 0x7fa96c077060 2024-09-11T11:02:25.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94081486441840] v34'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa97400a4d0 con 0x7fa96c077060 2024-09-11T11:02:25.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 20 remove_watcher() i=7 2024-09-11T11:02:25.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d937bc0 msgr2=0x55910d93a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d937bc0 0x55910d93a080 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d933930 msgr2=0x55910d935df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d933930 0x55910d935df0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa96c077060 msgr2=0x7fa96c0411c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa96c077060 0x7fa96c0411c0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55910d93c900 msgr2=0x55910d93edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55910d93c900 0x55910d93edc0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa84c034650 msgr2=0x7fa84c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa84c034650 0x7fa84c036b10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa9700b7fd0 tx=0x7fa9700a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 msgr2=0x55910d9287e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/2941332084 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d921670 0x55910d9287e0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa96c01ad40 tx=0x7fa96c038ee0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97c8d5640 1 -- 172.21.15.145:0/2941332084 reap_dead start 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 shutdown_connections 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 >> 172.21.15.145:0/2941332084 conn(0x55910d91d9a0 msgr2=0x55910d91ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 shutdown_connections 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/2941332084 wait complete. 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3104656005 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa8540346a0 msgr2=0x7fa854036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/3104656005 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa8540346a0 0x7fa854036b60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa970017e90 tx=0x7fa970005a10 comp rx=0 tx=0).stop 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3104656005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d914c70 msgr2=0x55910d915090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/3104656005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d914c70 0x55910d915090 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa96c048590 tx=0x7fa96c018d40 comp rx=0 tx=0).stop 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3104656005 shutdown_connections 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/3104656005 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa8540346a0 0x7fa854036b60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/3104656005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d914c70 0x55910d915090 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3104656005 >> 172.21.15.145:0/3104656005 conn(0x55910d909dc0 msgr2=0x55910d90c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3104656005 shutdown_connections 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/3104656005 wait complete. 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d8ff220 msgr2=0x55910d901610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55910d8ff220 0x55910d901610 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d808c60 msgr2=0x55910d8fdde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55910d808c60 0x55910d8fdde0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55910d9048b0 msgr2=0x55910d906ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55910d9048b0 0x55910d906ca0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa864034650 msgr2=0x7fa864036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa864034650 0x7fa864036b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa9700ad000 tx=0x7fa9700a5040 comp rx=0 tx=0).stop 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 msgr2=0x55910d8f6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 --2- 172.21.15.145:0/1723515598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55910d8048e0 0x55910d8f6e10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x55910d8f0c20 tx=0x7fa96c000bd0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97c8d5640 1 -- 172.21.15.145:0/1723515598 reap_dead start 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 shutdown_connections 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 >> 172.21.15.145:0/1723515598 conn(0x55910d778230 msgr2=0x55910d8ea1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 shutdown_connections 2024-09-11T11:02:25.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.102+0000 7fa97e5c4980 1 -- 172.21.15.145:0/1723515598 wait complete. 2024-09-11T11:02:25.116 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-09-11T11:02:25.116 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-09-11T11:02:25.116 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-11T11:02:25.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-11T11:02:25.117 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-11T11:02:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:25.195 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:25.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdda054980 1 Processor -- start 2024-09-11T11:02:25.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdda054980 1 -- start start 2024-09-11T11:02:25.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdda054980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5562d7a947d0 0x5562d7a93290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdda054980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562d79a5ae0 con 0x5562d7a943c0 2024-09-11T11:02:25.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdda054980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5562d79c9e30 con 0x5562d7a947d0 2024-09-11T11:02:25.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdd7363640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5562d7a947d0 0x5562d7a93290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdd7b64640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x5562d7a943c0 0x5562d7a92b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:33208/0 (socket says 172.21.15.145:33208) 2024-09-11T11:02:25.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdd7b64640 1 -- 172.21.15.145:0/2223038549 learned_addr learned my addr 172.21.15.145:0/2223038549 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:02:25.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdd7363640 1 -- 172.21.15.145:0/2223038549 >> v1:172.21.15.102:6789/0 conn(0x5562d7a943c0 legacy=0x5562d7a92b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.194+0000 7fbdd7363640 1 -- 172.21.15.145:0/2223038549 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d7a938f0 con 0x5562d7a947d0 2024-09-11T11:02:25.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdd7363640 1 --2- 172.21.15.145:0/2223038549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a947d0 0x5562d7a93290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00a480 tx=0x7fbdcc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19b47f08cb64483 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdd6b62640 1 -- 172.21.15.145:0/2223038549 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0b0070 con 0x5562d7a947d0 2024-09-11T11:02:25.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdd6b62640 1 -- 172.21.15.145:0/2223038549 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0ab540 con 0x5562d7a947d0 2024-09-11T11:02:25.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdd6b62640 1 -- 172.21.15.145:0/2223038549 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdcc0ab840 con 0x5562d7a947d0 2024-09-11T11:02:25.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdda054980 1 -- 172.21.15.145:0/2223038549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a947d0 msgr2=0x5562d7a93290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdda054980 1 --2- 172.21.15.145:0/2223038549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a947d0 0x5562d7a93290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00a480 tx=0x7fbdcc01b280 comp rx=0 tx=0).stop 2024-09-11T11:02:25.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdda054980 1 -- 172.21.15.145:0/2223038549 shutdown_connections 2024-09-11T11:02:25.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdda054980 1 --2- 172.21.15.145:0/2223038549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a947d0 0x5562d7a93290 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdda054980 1 -- 172.21.15.145:0/2223038549 >> 172.21.15.145:0/2223038549 conn(0x5562d7b191c0 msgr2=0x5562d7b1b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdda054980 1 -- 172.21.15.145:0/2223038549 shutdown_connections 2024-09-11T11:02:25.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.198+0000 7fbdda054980 1 -- 172.21.15.145:0/2223038549 wait complete. 2024-09-11T11:02:25.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.214+0000 7fbdda054980 1 Processor -- start 2024-09-11T11:02:25.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.214+0000 7fbdda054980 1 -- start start 2024-09-11T11:02:25.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.214+0000 7fbdda054980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c0ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.214+0000 7fbdda054980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562d79cb200 con 0x5562d7a943c0 2024-09-11T11:02:25.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.214+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c0ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.214+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c0ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53280/0 (socket says 172.21.15.145:53280) 2024-09-11T11:02:25.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.214+0000 7fbdd7b64640 1 -- 172.21.15.145:0/1053662113 learned_addr learned my addr 172.21.15.145:0/1053662113 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.214+0000 7fbdd7b64640 1 -- 172.21.15.145:0/1053662113 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d7c0b240 con 0x5562d7a943c0 2024-09-11T11:02:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/1053662113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c0ac70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8001e20 tx=0x7fbdc800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0f58e72aee9a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbcc5e0b640 1 -- 172.21.15.145:0/1053662113 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc8012020 con 0x5562d7a943c0 2024-09-11T11:02:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbcc5e0b640 1 -- 172.21.15.145:0/1053662113 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc800e7c0 con 0x5562d7a943c0 2024-09-11T11:02:25.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbcc5e0b640 1 -- 172.21.15.145:0/1053662113 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc800eb00 con 0x5562d7a943c0 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- 172.21.15.145:0/1053662113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 msgr2=0x5562d7c0ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 --2- 172.21.15.145:0/1053662113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c0ac70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8001e20 tx=0x7fbdc800b790 comp rx=0 tx=0).stop 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- 172.21.15.145:0/1053662113 shutdown_connections 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 --2- 172.21.15.145:0/1053662113 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c0ac70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- 172.21.15.145:0/1053662113 >> 172.21.15.145:0/1053662113 conn(0x5562d7b191c0 msgr2=0x5562d7c068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- 172.21.15.145:0/1053662113 shutdown_connections 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- 172.21.15.145:0/1053662113 wait complete. 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 Processor -- start 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- start start 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c11fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562d7b29210 con 0x5562d7a943c0 2024-09-11T11:02:25.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c11fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c11fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53282/0 (socket says 172.21.15.145:53282) 2024-09-11T11:02:25.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3864590094 learned_addr learned my addr 172.21.15.145:0/3864590094 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3864590094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d7c12500 con 0x5562d7a943c0 2024-09-11T11:02:25.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c11fc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8001e20 tx=0x7fbdc8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbcbffff640 1 -- 172.21.15.145:0/3864590094 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc8012030 con 0x5562d7a943c0 2024-09-11T11:02:25.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562d7c12790 con 0x5562d7a943c0 2024-09-11T11:02:25.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbcbffff640 1 -- 172.21.15.145:0/3864590094 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc8001480 con 0x5562d7a943c0 2024-09-11T11:02:25.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbcbffff640 1 -- 172.21.15.145:0/3864590094 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc801a940 con 0x5562d7a943c0 2024-09-11T11:02:25.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.218+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d7c15470 con 0x5562d7a943c0 2024-09-11T11:02:25.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbcbffff640 1 -- 172.21.15.145:0/3864590094 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbdc8015020 con 0x5562d7a943c0 2024-09-11T11:02:25.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbcbffff640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcc0034650 0x7fbcc0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbcbffff640 1 -- 172.21.15.145:0/3864590094 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fbdc8020030 con 0x5562d7a943c0 2024-09-11T11:02:25.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdd7363640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcc0034650 0x7fbcc0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdda054980 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7a947d0 0x5562d7c18f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c195c0 con 0x5562d7a947d0 2024-09-11T11:02:25.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdd8365640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7a947d0 0x5562d7c18f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdd7363640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcc0034650 0x7fbcc0036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0ad000 tx=0x7fbdcc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdd8365640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7a947d0 0x5562d7c18f50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdd8365640 1 -- 172.21.15.145:0/3864590094 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7a947d0 2024-09-11T11:02:25.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdda054980 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c1a3b0 0x5562d7c1c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c1cde0 con 0x5562d7c1a3b0 2024-09-11T11:02:25.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c1a3b0 0x5562d7c1c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c1a3b0 0x5562d7c1c7a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3864590094 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c1a3b0 2024-09-11T11:02:25.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.222+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c1e690 con 0x5562d7c1a3b0 2024-09-11T11:02:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3864590094 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c1a3b0 2024-09-11T11:02:25.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c1d8c0 con 0x5562d7c1a3b0 2024-09-11T11:02:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3864590094 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c1a3b0 2024-09-11T11:02:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdda054980 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5562d7c1fa40 0x5562d7c21e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c22370 con 0x5562d7c1fa40 2024-09-11T11:02:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdd7363640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5562d7c1fa40 0x5562d7c21e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdd7363640 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5562d7c1fa40 0x5562d7c21e30 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdd7363640 1 -- 172.21.15.145:0/3864590094 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbdcc0b3040 con 0x5562d7c1fa40 2024-09-11T11:02:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdda054980 1 Processor -- start 2024-09-11T11:02:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdda054980 1 -- start start 2024-09-11T11:02:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdda054980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c2fd70 0x5562d7c30190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdda054980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562d7a24800 con 0x5562d7c2fd70 2024-09-11T11:02:25.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c2fd70 0x5562d7c30190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c2fd70 0x5562d7c30190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53284/0 (socket says 172.21.15.145:53284) 2024-09-11T11:02:25.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.226+0000 7fbdd7b64640 1 -- 172.21.15.145:0/1850675166 learned_addr learned my addr 172.21.15.145:0/1850675166 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdd7b64640 1 -- 172.21.15.145:0/1850675166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d7c306d0 con 0x5562d7c2fd70 2024-09-11T11:02:25.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/1850675166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c2fd70 0x5562d7c30190 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800d010 tx=0x7fbdc8016b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbcbd7fa640 1 -- 172.21.15.145:0/1850675166 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc8017d80 con 0x5562d7c2fd70 2024-09-11T11:02:25.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbcbd7fa640 1 -- 172.21.15.145:0/1850675166 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc8041c00 con 0x5562d7c2fd70 2024-09-11T11:02:25.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdda054980 1 -- 172.21.15.145:0/1850675166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562d7c30960 con 0x5562d7c2fd70 2024-09-11T11:02:25.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbcbd7fa640 1 -- 172.21.15.145:0/1850675166 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc8041f00 con 0x5562d7c2fd70 2024-09-11T11:02:25.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdda054980 1 -- 172.21.15.145:0/1850675166 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d7c335e0 con 0x5562d7c2fd70 2024-09-11T11:02:25.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbcbd7fa640 1 -- 172.21.15.145:0/1850675166 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbdc8009070 con 0x5562d7c2fd70 2024-09-11T11:02:25.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbcbd7fa640 1 --2- 172.21.15.145:0/1850675166 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcb00346a0 0x7fbcb0036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbcbd7fa640 1 -- 172.21.15.145:0/1850675166 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fbdc8005050 con 0x5562d7c2fd70 2024-09-11T11:02:25.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdd7363640 1 --2- 172.21.15.145:0/1850675166 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcb00346a0 0x7fbcb0036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdda054980 1 Processor -- start 2024-09-11T11:02:25.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdda054980 1 -- start start 2024-09-11T11:02:25.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdd7363640 1 --2- 172.21.15.145:0/1850675166 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcb00346a0 0x7fbcb0036b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5562d7c165b0 tx=0x7fbdcc005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdda054980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c3cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.230+0000 7fbdda054980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562d7c0b5c0 con 0x5562d7c3c760 2024-09-11T11:02:25.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c3cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c3cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53294/0 (socket says 172.21.15.145:53294) 2024-09-11T11:02:25.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3901893263 learned_addr learned my addr 172.21.15.145:0/3901893263 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3901893263 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d7c3d130 con 0x5562d7c3c760 2024-09-11T11:02:25.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/3901893263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c3cb60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbdc801a740 tx=0x7fbdc8024b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc3b83041d7837c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbcb6ffd640 1 -- 172.21.15.145:0/3901893263 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc801b040 con 0x5562d7c3c760 2024-09-11T11:02:25.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbcb6ffd640 1 -- 172.21.15.145:0/3901893263 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc802d3f0 con 0x5562d7c3c760 2024-09-11T11:02:25.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbcb6ffd640 1 -- 172.21.15.145:0/3901893263 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc800d510 con 0x5562d7c3c760 2024-09-11T11:02:25.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- 172.21.15.145:0/3901893263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 msgr2=0x5562d7c3cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 --2- 172.21.15.145:0/3901893263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c3cb60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fbdc801a740 tx=0x7fbdc8024b30 comp rx=0 tx=0).stop 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- 172.21.15.145:0/3901893263 shutdown_connections 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 --2- 172.21.15.145:0/3901893263 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c3cb60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- 172.21.15.145:0/3901893263 >> 172.21.15.145:0/3901893263 conn(0x5562d7c38a90 msgr2=0x5562d7c36b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- 172.21.15.145:0/3901893263 shutdown_connections 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- 172.21.15.145:0/3901893263 wait complete. 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 Processor -- start 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- start start 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c43860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5562d7c3d620 con 0x5562d7c3c760 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c43860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c43860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53310/0 (socket says 172.21.15.145:53310) 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 learned_addr learned my addr 172.21.15.145:0/3968734425 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562d7c43da0 con 0x5562d7c3c760 2024-09-11T11:02:25.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c43860 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbdc801a6f0 tx=0x7fbdc8015f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbcb57fa640 1 -- 172.21.15.145:0/3968734425 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc806a070 con 0x5562d7c3c760 2024-09-11T11:02:25.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562d7c43da0 con 0x5562d7c3c760 2024-09-11T11:02:25.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbcb57fa640 1 -- 172.21.15.145:0/3968734425 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc8024e50 con 0x5562d7c3c760 2024-09-11T11:02:25.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbcb57fa640 1 -- 172.21.15.145:0/3968734425 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbdc804e5a0 con 0x5562d7c3c760 2024-09-11T11:02:25.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.234+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562d7c44210 con 0x5562d7c3c760 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbcb57fa640 1 -- 172.21.15.145:0/3968734425 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fbdc8075060 con 0x5562d7c3c760 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbcb57fa640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbca0034650 0x7fbca0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbcb57fa640 1 -- 172.21.15.145:0/3968734425 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fbdc806fbd0 con 0x5562d7c3c760 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd7363640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbca0034650 0x7fbca0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7c4e9d0 0x5562d7c50e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c515e0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd8365640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7c4e9d0 0x5562d7c50e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd7363640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbca0034650 0x7fbca0036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc000c10 tx=0x7fbdcc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd8365640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7c4e9d0 0x5562d7c50e90 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 20 realm 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c4de80 con 0x5562d7c4e9d0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c520b0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c52c90 0x5562d7c55150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c558c0 con 0x5562d7c52c90 2024-09-11T11:02:25.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c52c90 0x5562d7c55150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.238+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c52c90 0x5562d7c55150 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdda054980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c51ca0 con 0x5562d7c52c90 2024-09-11T11:02:25.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdda054980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:25.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdda054980 20 searching for the correct realm 2024-09-11T11:02:25.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5562d7c57630 0x5562d7c59af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5a1c0 con 0x5562d7c57630 2024-09-11T11:02:25.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7363640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5562d7c57630 0x5562d7c59af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7363640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5562d7c57630 0x5562d7c59af0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5a1c0 con 0x5562d7c52c90 2024-09-11T11:02:25.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7b64640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbdc8077070 0x7fbdc80647c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x7fbdc8077070 2024-09-11T11:02:25.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd8365640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbdc8077070 0x7fbdc80647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd8365640 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbdc8077070 0x7fbdc80647c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.242+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c57630 2024-09-11T11:02:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c52c90 2024-09-11T11:02:25.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c52c90 2024-09-11T11:02:25.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x7fbdc8077070 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x7fbdc8077070 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.246+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c52c90 2024-09-11T11:02:25.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c57630 2024-09-11T11:02:25.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c52c90 2024-09-11T11:02:25.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c57630 2024-09-11T11:02:25.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c57630 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x7fbdc8077070 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c4e9d0 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x7fbdc8077070 2024-09-11T11:02:25.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.250+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c57630 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x7fbdc8077070 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c52c90 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c52c90 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c57630 2024-09-11T11:02:25.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c52c90 2024-09-11T11:02:25.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fbdc804d030 con 0x5562d7c52c90 2024-09-11T11:02:25.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:25.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:25.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:25.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:25.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:25.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:25.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c55f50 con 0x5562d7c4e9d0 2024-09-11T11:02:25.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.254+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c56340 con 0x5562d7c52c90 2024-09-11T11:02:25.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c56340 con 0x7fbdc8077070 2024-09-11T11:02:25.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:25.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 zone default found 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 4 Realm: () 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 zonegroup default 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5a640 con 0x7fbdc8077070 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5c3c0 con 0x5562d7c57630 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5c760 con 0x5562d7c57630 2024-09-11T11:02:25.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 started sync module instance, tier type = 2024-09-11T11:02:25.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:25.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.258+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5b860 con 0x5562d7c52c90 2024-09-11T11:02:25.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.262+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.262+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93883015216528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5b860 con 0x5562d7c52c90 2024-09-11T11:02:25.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.262+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5d120 con 0x5562d7c4e9d0 2024-09-11T11:02:25.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.262+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.262+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93883015220336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5d540 con 0x5562d7c4e9d0 2024-09-11T11:02:25.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.262+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5dfc0 con 0x5562d7c52c90 2024-09-11T11:02:25.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.262+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93883015220336] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.262+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93883015216528] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93883015224016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5d090 con 0x5562d7c52c90 2024-09-11T11:02:25.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5e890 con 0x7fbdc8077070 2024-09-11T11:02:25.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93883015226336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5d090 con 0x7fbdc8077070 2024-09-11T11:02:25.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5f310 con 0x5562d7c52c90 2024-09-11T11:02:25.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93883015226336] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93883015224016] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93883015214000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5ee20 con 0x5562d7c52c90 2024-09-11T11:02:25.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.266+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5fbb0 con 0x5562d7c57630 2024-09-11T11:02:25.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93883015231232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5ee20 con 0x5562d7c57630 2024-09-11T11:02:25.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c60a20 con 0x5562d7c57630 2024-09-11T11:02:25.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93883015214000] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93883015231232] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93883015234928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c60dc0 con 0x5562d7c57630 2024-09-11T11:02:25.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c61610 con 0x7fbdc8077070 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93883015238464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c61db0 con 0x7fbdc8077070 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 20 add_watcher() i=0 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 20 add_watcher() i=1 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 20 add_watcher() i=2 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 20 add_watcher() i=3 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 20 add_watcher() i=4 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 20 add_watcher() i=5 2024-09-11T11:02:25.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93883015234928] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.270+0000 7fbdda054980 20 add_watcher() i=6 2024-09-11T11:02:25.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.274+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93883015238464] v34'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.274+0000 7fbdda054980 20 add_watcher() i=7 2024-09-11T11:02:25.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.274+0000 7fbdda054980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:25.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.274+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5e800 con 0x5562d7c4e9d0 2024-09-11T11:02:25.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.274+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.274+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93883015227392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c622f0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.274+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93883015227392] v34'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.274+0000 7fbc8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:25.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:25.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 5 note: GC not initialized 2024-09-11T11:02:25.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbc8cfe1640 20 reqs_thread_entry: start 2024-09-11T11:02:25.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:25.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 20 Filter name: none 2024-09-11T11:02:25.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbc067fc640 20 reqs_thread_entry: start 2024-09-11T11:02:25.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c87fb0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:02:25.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c89500 con 0x5562d7c57630 2024-09-11T11:02:25.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbc8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.278+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93883015227392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c86760 con 0x5562d7c4e9d0 2024-09-11T11:02:25.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.282+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93883015227392] v34'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.282+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93883015216528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5e800 con 0x5562d7c52c90 2024-09-11T11:02:25.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.282+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93883015216528] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.282+0000 7fbdda054980 20 remove_watcher() i=0 2024-09-11T11:02:25.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.282+0000 7fbdda054980 2 removed watcher, disabling cache 2024-09-11T11:02:25.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.282+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93883015220336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5bd90 con 0x5562d7c4e9d0 2024-09-11T11:02:25.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93883015220336] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x5562d7c4e9d0 2024-09-11T11:02:25.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdda054980 20 remove_watcher() i=1 2024-09-11T11:02:25.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93883015224016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5bd90 con 0x5562d7c52c90 2024-09-11T11:02:25.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93883015224016] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdda054980 20 remove_watcher() i=2 2024-09-11T11:02:25.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93883015226336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5dad0 con 0x7fbdc8077070 2024-09-11T11:02:25.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93883015226336] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdda054980 20 remove_watcher() i=3 2024-09-11T11:02:25.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.286+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93883015214000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5dad0 con 0x5562d7c52c90 2024-09-11T11:02:25.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.290+0000 7fbdd7b64640 1 -- 172.21.15.145:0/3968734425 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93883015214000] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdc8008030 con 0x5562d7c52c90 2024-09-11T11:02:25.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.290+0000 7fbdda054980 20 remove_watcher() i=4 2024-09-11T11:02:25.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.290+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93883015231232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5b3b0 con 0x5562d7c57630 2024-09-11T11:02:25.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.290+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93883015231232] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.290+0000 7fbdda054980 20 remove_watcher() i=5 2024-09-11T11:02:25.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.290+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93883015234928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5dad0 con 0x5562d7c57630 2024-09-11T11:02:25.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdd7363640 1 -- 172.21.15.145:0/3968734425 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93883015234928] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdcc0c9030 con 0x5562d7c57630 2024-09-11T11:02:25.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 20 remove_watcher() i=6 2024-09-11T11:02:25.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93883015238464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5562d7c5b3b0 con 0x7fbdc8077070 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93883015238464] v34'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbdd000a4d0 con 0x7fbdc8077070 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 20 remove_watcher() i=7 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c52c90 msgr2=0x5562d7c55150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c52c90 0x5562d7c55150 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7c4e9d0 msgr2=0x5562d7c50e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7c4e9d0 0x5562d7c50e90 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbdc8077070 msgr2=0x7fbdc80647c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fbdc8077070 0x7fbdc80647c0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5562d7c57630 msgr2=0x5562d7c59af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5562d7c57630 0x5562d7c59af0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbca0034650 msgr2=0x7fbca0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbca0034650 0x7fbca0036b10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc000c10 tx=0x7fbdcc0a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 msgr2=0x5562d7c43860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c43860 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fbdc801a6f0 tx=0x7fbdc8015f90 comp rx=0 tx=0).stop 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdd8365640 1 -- 172.21.15.145:0/3968734425 reap_dead start 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 shutdown_connections 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3968734425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c3c760 0x5562d7c43860 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 >> 172.21.15.145:0/3968734425 conn(0x5562d7c38a90 msgr2=0x5562d7c36b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 shutdown_connections 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3968734425 wait complete. 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/1850675166 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcb00346a0 msgr2=0x7fbcb0036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/1850675166 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcb00346a0 0x7fbcb0036b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5562d7c165b0 tx=0x7fbdcc005a10 comp rx=0 tx=0).stop 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/1850675166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c2fd70 msgr2=0x5562d7c30190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/1850675166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c2fd70 0x5562d7c30190 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800d010 tx=0x7fbdc8016b00 comp rx=0 tx=0).stop 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/1850675166 shutdown_connections 2024-09-11T11:02:25.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/1850675166 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcb00346a0 0x7fbcb0036b60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/1850675166 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7c2fd70 0x5562d7c30190 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/1850675166 >> 172.21.15.145:0/1850675166 conn(0x5562d7c24ec0 msgr2=0x5562d7c27940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/1850675166 shutdown_connections 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/1850675166 wait complete. 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c1a3b0 msgr2=0x5562d7c1c7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5562d7c1a3b0 0x5562d7c1c7a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7a947d0 msgr2=0x5562d7c18f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5562d7a947d0 0x5562d7c18f50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5562d7c1fa40 msgr2=0x5562d7c21e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5562d7c1fa40 0x5562d7c21e30 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcc0034650 msgr2=0x7fbcc0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fbcc0034650 0x7fbcc0036b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0ad000 tx=0x7fbdcc0a5040 comp rx=0 tx=0).stop 2024-09-11T11:02:25.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 msgr2=0x5562d7c11fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 --2- 172.21.15.145:0/3864590094 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5562d7a943c0 0x5562d7c11fc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8001e20 tx=0x7fbdc8000ee0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdd8365640 1 -- 172.21.15.145:0/3864590094 reap_dead start 2024-09-11T11:02:25.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 shutdown_connections 2024-09-11T11:02:25.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 >> 172.21.15.145:0/3864590094 conn(0x5562d7b191c0 msgr2=0x5562d7c05420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 shutdown_connections 2024-09-11T11:02:25.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.294+0000 7fbdda054980 1 -- 172.21.15.145:0/3864590094 wait complete. 2024-09-11T11:02:25.308 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-09-11T11:02:25.308 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-09-11T11:02:25.308 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-11T11:02:25.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-11T11:02:25.308 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-11T11:02:25.384 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:25.385 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.382+0000 7fd5f4e00980 1 Processor -- start 2024-09-11T11:02:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.382+0000 7fd5f4e00980 1 -- start start 2024-09-11T11:02:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.382+0000 7fd5f4e00980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ac924678f0 0x55ac92467cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f4e00980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac922edae0 con 0x55ac92468240 2024-09-11T11:02:25.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f4e00980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55ac92311e30 con 0x55ac924678f0 2024-09-11T11:02:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f2910640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ac924678f0 0x55ac92467cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f2910640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ac924678f0 0x55ac92467cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53320/0 (socket says 172.21.15.145:53320) 2024-09-11T11:02:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f210f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55ac92468240 0x55ac9246cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:33224/0 (socket says 172.21.15.145:33224) 2024-09-11T11:02:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f2910640 1 -- 172.21.15.145:0/4018976021 learned_addr learned my addr 172.21.15.145:0/4018976021 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f2910640 1 -- 172.21.15.145:0/4018976021 >> v1:172.21.15.102:6789/0 conn(0x55ac92468240 legacy=0x55ac9246cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f2910640 1 -- 172.21.15.145:0/4018976021 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9246f4c0 con 0x55ac924678f0 2024-09-11T11:02:25.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f2910640 1 --2- 172.21.15.145:0/4018976021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92467cd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400a5c0 tx=0x7fd5e401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9923f46aaa79d08f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f190e640 1 -- 172.21.15.145:0/4018976021 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40a6070 con 0x55ac924678f0 2024-09-11T11:02:25.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f190e640 1 -- 172.21.15.145:0/4018976021 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e40af070 con 0x55ac924678f0 2024-09-11T11:02:25.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.386+0000 7fd5f190e640 1 -- 172.21.15.145:0/4018976021 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40aa5c0 con 0x55ac924678f0 2024-09-11T11:02:25.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.390+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4018976021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 msgr2=0x55ac92467cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.390+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/4018976021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92467cd0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd5e400a5c0 tx=0x7fd5e401b340 comp rx=0 tx=0).stop 2024-09-11T11:02:25.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.390+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4018976021 shutdown_connections 2024-09-11T11:02:25.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.390+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/4018976021 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92467cd0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.390+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4018976021 >> 172.21.15.145:0/4018976021 conn(0x55ac923db240 msgr2=0x55ac923db650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.390+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4018976021 shutdown_connections 2024-09-11T11:02:25.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.390+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4018976021 wait complete. 2024-09-11T11:02:25.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.402+0000 7fd5f4e00980 1 Processor -- start 2024-09-11T11:02:25.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.402+0000 7fd5f4e00980 1 -- start start 2024-09-11T11:02:25.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92552c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac92313200 con 0x55ac924678f0 2024-09-11T11:02:25.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92552c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92552c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53324/0 (socket says 172.21.15.145:53324) 2024-09-11T11:02:25.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f2910640 1 -- 172.21.15.145:0/4096835723 learned_addr learned my addr 172.21.15.145:0/4096835723 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f2910640 1 -- 172.21.15.145:0/4096835723 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac92553200 con 0x55ac924678f0 2024-09-11T11:02:25.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f2910640 1 --2- 172.21.15.145:0/4096835723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92552c30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40199f0 tx=0x7fd5e4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45c2034c7203b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd4e0e09640 1 -- 172.21.15.145:0/4096835723 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40aaa00 con 0x55ac924678f0 2024-09-11T11:02:25.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd4e0e09640 1 -- 172.21.15.145:0/4096835723 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e40aaba0 con 0x55ac924678f0 2024-09-11T11:02:25.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd4e0e09640 1 -- 172.21.15.145:0/4096835723 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40bd3f0 con 0x55ac924678f0 2024-09-11T11:02:25.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4096835723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 msgr2=0x55ac92552c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/4096835723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92552c30 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40199f0 tx=0x7fd5e4003030 comp rx=0 tx=0).stop 2024-09-11T11:02:25.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4096835723 shutdown_connections 2024-09-11T11:02:25.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/4096835723 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92552c30 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4096835723 >> 172.21.15.145:0/4096835723 conn(0x55ac923db240 msgr2=0x55ac9254e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4096835723 shutdown_connections 2024-09-11T11:02:25.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 -- 172.21.15.145:0/4096835723 wait complete. 2024-09-11T11:02:25.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 Processor -- start 2024-09-11T11:02:25.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 -- start start 2024-09-11T11:02:25.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92559ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f4e00980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac9246ef00 con 0x55ac924678f0 2024-09-11T11:02:25.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92559ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92559ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53330/0 (socket says 172.21.15.145:53330) 2024-09-11T11:02:25.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.406+0000 7fd5f2910640 1 -- 172.21.15.145:0/2460755029 learned_addr learned my addr 172.21.15.145:0/2460755029 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f2910640 1 -- 172.21.15.145:0/2460755029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9255a3e0 con 0x55ac924678f0 2024-09-11T11:02:25.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f2910640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92559ea0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40199f0 tx=0x7fd5e40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd4df606640 1 -- 172.21.15.145:0/2460755029 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40bd7c0 con 0x55ac924678f0 2024-09-11T11:02:25.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd4df606640 1 -- 172.21.15.145:0/2460755029 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e40bd960 con 0x55ac924678f0 2024-09-11T11:02:25.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd4df606640 1 -- 172.21.15.145:0/2460755029 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40bdc40 con 0x55ac924678f0 2024-09-11T11:02:25.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac9255a670 con 0x55ac924678f0 2024-09-11T11:02:25.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9255d350 con 0x55ac924678f0 2024-09-11T11:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd4df606640 1 -- 172.21.15.145:0/2460755029 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5e40ce020 con 0x55ac924678f0 2024-09-11T11:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd4df606640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4d8034650 0x7fd4d8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd4df606640 1 -- 172.21.15.145:0/2460755029 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fd5e40cc020 con 0x55ac924678f0 2024-09-11T11:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f210f640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4d8034650 0x7fd4d8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92468240 0x55ac92560e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac925614e0 con 0x55ac92468240 2024-09-11T11:02:25.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f3111640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92468240 0x55ac92560e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f3111640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92468240 0x55ac92560e70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f210f640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4d8034650 0x7fd4d8036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8000f70 tx=0x7fd5e8001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f3111640 1 -- 172.21.15.145:0/2460755029 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92468240 2024-09-11T11:02:25.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac925622b0 0x55ac925646a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.410+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac92564ce0 con 0x55ac925622b0 2024-09-11T11:02:25.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f2910640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac925622b0 0x55ac925646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f2910640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac925622b0 0x55ac925646a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f2910640 1 -- 172.21.15.145:0/2460755029 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5e40cf370 con 0x55ac925622b0 2024-09-11T11:02:25.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac92566590 con 0x55ac925622b0 2024-09-11T11:02:25.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f2910640 1 -- 172.21.15.145:0/2460755029 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd5e40cf370 con 0x55ac925622b0 2024-09-11T11:02:25.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac925657c0 con 0x55ac925622b0 2024-09-11T11:02:25.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f2910640 1 -- 172.21.15.145:0/2460755029 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5e40cf370 con 0x55ac925622b0 2024-09-11T11:02:25.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac92567940 0x55ac92569d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac9256a270 con 0x55ac92567940 2024-09-11T11:02:25.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f210f640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac92567940 0x55ac92569d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f210f640 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac92567940 0x55ac92569d30 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f210f640 1 -- 172.21.15.145:0/2460755029 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd5e800f6a0 con 0x55ac92567940 2024-09-11T11:02:25.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f4e00980 1 Processor -- start 2024-09-11T11:02:25.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.414+0000 7fd5f4e00980 1 -- start start 2024-09-11T11:02:25.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f4e00980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92577d00 0x55ac92578120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f4e00980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac9236c800 con 0x55ac92577d00 2024-09-11T11:02:25.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92577d00 0x55ac92578120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92577d00 0x55ac92578120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53332/0 (socket says 172.21.15.145:53332) 2024-09-11T11:02:25.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f2910640 1 -- 172.21.15.145:0/41624012 learned_addr learned my addr 172.21.15.145:0/41624012 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f2910640 1 -- 172.21.15.145:0/41624012 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac92578660 con 0x55ac92577d00 2024-09-11T11:02:25.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f2910640 1 --2- 172.21.15.145:0/41624012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92577d00 0x55ac92578120 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40e5500 tx=0x7fd5e40de2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd4dce01640 1 -- 172.21.15.145:0/41624012 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40cfa30 con 0x55ac92577d00 2024-09-11T11:02:25.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd4dce01640 1 -- 172.21.15.145:0/41624012 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e40cfbd0 con 0x55ac92577d00 2024-09-11T11:02:25.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f4e00980 1 -- 172.21.15.145:0/41624012 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac925788f0 con 0x55ac92577d00 2024-09-11T11:02:25.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd4dce01640 1 -- 172.21.15.145:0/41624012 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40c6480 con 0x55ac92577d00 2024-09-11T11:02:25.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f4e00980 1 -- 172.21.15.145:0/41624012 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9257b570 con 0x55ac92577d00 2024-09-11T11:02:25.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd4dce01640 1 -- 172.21.15.145:0/41624012 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5e40c6620 con 0x55ac92577d00 2024-09-11T11:02:25.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd4dce01640 1 --2- 172.21.15.145:0/41624012 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4cc034650 0x7fd4cc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd4dce01640 1 -- 172.21.15.145:0/41624012 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fd5e40bf0d0 con 0x55ac92577d00 2024-09-11T11:02:25.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f210f640 1 --2- 172.21.15.145:0/41624012 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4cc034650 0x7fd4cc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f4e00980 1 Processor -- start 2024-09-11T11:02:25.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f4e00980 1 -- start start 2024-09-11T11:02:25.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f4e00980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac92584a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f4e00980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac925534c0 con 0x55ac92584650 2024-09-11T11:02:25.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.418+0000 7fd5f210f640 1 --2- 172.21.15.145:0/41624012 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4cc034650 0x7fd4cc036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55ac9256a670 tx=0x7fd5e800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac92584a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac92584a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53334/0 (socket says 172.21.15.145:53334) 2024-09-11T11:02:25.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 -- 172.21.15.145:0/3145372051 learned_addr learned my addr 172.21.15.145:0/3145372051 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 -- 172.21.15.145:0/3145372051 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac92585000 con 0x55ac92584650 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 --2- 172.21.15.145:0/3145372051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac92584a30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40aab70 tx=0x7fd5e40c69d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa671673024c1239 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd4d67fc640 1 -- 172.21.15.145:0/3145372051 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e4105070 con 0x55ac92584650 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd4d67fc640 1 -- 172.21.15.145:0/3145372051 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e40db440 con 0x55ac92584650 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd4d67fc640 1 -- 172.21.15.145:0/3145372051 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40e7e10 con 0x55ac92584650 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 -- 172.21.15.145:0/3145372051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 msgr2=0x55ac92584a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/3145372051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac92584a30 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40aab70 tx=0x7fd5e40c69d0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 -- 172.21.15.145:0/3145372051 shutdown_connections 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/3145372051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac92584a30 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 -- 172.21.15.145:0/3145372051 >> 172.21.15.145:0/3145372051 conn(0x55ac92580a30 msgr2=0x55ac9257eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 -- 172.21.15.145:0/3145372051 shutdown_connections 2024-09-11T11:02:25.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 -- 172.21.15.145:0/3145372051 wait complete. 2024-09-11T11:02:25.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 Processor -- start 2024-09-11T11:02:25.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 -- start start 2024-09-11T11:02:25.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac9258b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac925854a0 con 0x55ac92584650 2024-09-11T11:02:25.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac9258b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac9258b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53338/0 (socket says 172.21.15.145:53338) 2024-09-11T11:02:25.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 learned_addr learned my addr 172.21.15.145:0/1042550811 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac9258bdb0 con 0x55ac92584650 2024-09-11T11:02:25.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f2910640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac9258b870 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40db5f0 tx=0x7fd5e40aded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd4d4ff9640 1 -- 172.21.15.145:0/1042550811 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e4105040 con 0x55ac92584650 2024-09-11T11:02:25.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd4d4ff9640 1 -- 172.21.15.145:0/1042550811 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5e40c5810 con 0x55ac92584650 2024-09-11T11:02:25.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd4d4ff9640 1 -- 172.21.15.145:0/1042550811 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5e40bc5e0 con 0x55ac92584650 2024-09-11T11:02:25.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.422+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac9258bdb0 con 0x55ac92584650 2024-09-11T11:02:25.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac9258bdb0 con 0x55ac92584650 2024-09-11T11:02:25.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd4d4ff9640 1 -- 172.21.15.145:0/1042550811 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5e40de500 con 0x55ac92584650 2024-09-11T11:02:25.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd4d4ff9640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4bc034650 0x7fd4bc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd4d4ff9640 1 -- 172.21.15.145:0/1042550811 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fd5e4114c20 con 0x55ac92584650 2024-09-11T11:02:25.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f210f640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4bc034650 0x7fd4bc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92596910 0x55ac92598db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac92599500 con 0x55ac92596910 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f3111640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92596910 0x55ac92598db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f210f640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4bc034650 0x7fd4bc036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800c010 tx=0x7fd5e8010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f3111640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92596910 0x55ac92598db0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 20 realm 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac92595e00 con 0x55ac92596910 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:25.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac92599fd0 con 0x55ac92596910 2024-09-11T11:02:25.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac9259ab80 0x55ac9259d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac9259d7b0 con 0x55ac9259ab80 2024-09-11T11:02:25.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.426+0000 7fd5f2910640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac9259ab80 0x55ac9259d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f2910640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac9259ab80 0x55ac9259d040 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f4e00980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac9259e050 con 0x55ac9259ab80 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f4e00980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f4e00980 20 searching for the correct realm 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac9259f8c0 0x55ac925a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a2450 con 0x55ac9259f8c0 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f210f640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac9259f8c0 0x55ac925a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f210f640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac9259f8c0 0x55ac925a1d80 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a2450 con 0x55ac9259ab80 2024-09-11T11:02:25.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f2910640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd5e40c95b0 0x7fd5e4128800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x7fd5e40c95b0 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f3111640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd5e40c95b0 0x7fd5e4128800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f3111640 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd5e40c95b0 0x7fd5e4128800 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.430+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259f8c0 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259ab80 2024-09-11T11:02:25.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259ab80 2024-09-11T11:02:25.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x7fd5e40c95b0 2024-09-11T11:02:25.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x7fd5e40c95b0 2024-09-11T11:02:25.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259ab80 2024-09-11T11:02:25.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.434+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259f8c0 2024-09-11T11:02:25.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259ab80 2024-09-11T11:02:25.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259f8c0 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259f8c0 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x7fd5e40c95b0 2024-09-11T11:02:25.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac92596910 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x7fd5e40c95b0 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259f8c0 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x7fd5e40c95b0 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.438+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259ab80 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259ab80 2024-09-11T11:02:25.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259f8c0 2024-09-11T11:02:25.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259ab80 2024-09-11T11:02:25.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x7fd5e4127040 con 0x55ac9259ab80 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac9259e180 con 0x55ac92596910 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac9259e570 con 0x55ac9259ab80 2024-09-11T11:02:25.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.442+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac9259e570 con 0x7fd5e40c95b0 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 zone default found 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 4 Realm: () 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 zonegroup default 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a28d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a4650 con 0x55ac9259f8c0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a49f0 con 0x55ac9259f8c0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 started sync module instance, tier type = 2024-09-11T11:02:25.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:25.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a3af0 con 0x55ac9259ab80 2024-09-11T11:02:25.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94199678124064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a3af0 con 0x55ac9259ab80 2024-09-11T11:02:25.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.446+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a53f0 con 0x55ac92596910 2024-09-11T11:02:25.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.450+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.450+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94199678127872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a5320 con 0x55ac92596910 2024-09-11T11:02:25.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.450+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a6320 con 0x55ac9259ab80 2024-09-11T11:02:25.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.450+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94199678124064] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.450+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94199678127872] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.450+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.450+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94199678130192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a5e30 con 0x55ac9259ab80 2024-09-11T11:02:25.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.450+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a6bc0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.454+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.454+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94199678134032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a5e30 con 0x7fd5e40c95b0 2024-09-11T11:02:25.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.454+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a7660 con 0x55ac9259ab80 2024-09-11T11:02:25.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.454+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94199678130192] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94199678134032] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94199678135088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a7620 con 0x55ac9259ab80 2024-09-11T11:02:25.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a7a80 con 0x55ac9259f8c0 2024-09-11T11:02:25.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94199678121536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a82d0 con 0x55ac9259f8c0 2024-09-11T11:02:25.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a8c90 con 0x55ac9259f8c0 2024-09-11T11:02:25.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94199678121536] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94199678135088] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94199678142432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a9080 con 0x55ac9259f8c0 2024-09-11T11:02:25.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.458+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a98d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94199678142432] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94199678144640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a9950 con 0x7fd5e40c95b0 2024-09-11T11:02:25.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 20 add_watcher() i=0 2024-09-11T11:02:25.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 20 add_watcher() i=1 2024-09-11T11:02:25.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 20 add_watcher() i=2 2024-09-11T11:02:25.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 20 add_watcher() i=3 2024-09-11T11:02:25.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 20 add_watcher() i=4 2024-09-11T11:02:25.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 20 add_watcher() i=5 2024-09-11T11:02:25.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 20 add_watcher() i=6 2024-09-11T11:02:25.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94199678144640] v34'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 20 add_watcher() i=7 2024-09-11T11:02:25.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:25.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac925acc50 con 0x55ac92596910 2024-09-11T11:02:25.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94199678146064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a9ee0 con 0x55ac92596910 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94199678146064] v34'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.462+0000 7fd4a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 5 note: GC not initialized 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd423fff640 20 reqs_thread_entry: start 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 20 Filter name: none 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd421ffb640 20 reqs_thread_entry: start 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac925cfe90 con 0x55ac92596910 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:02:25.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55ac925d13e0 con 0x55ac9259f8c0 2024-09-11T11:02:25.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd4a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.466+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94199678146064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925ce640 con 0x55ac92596910 2024-09-11T11:02:25.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94199678146064] v34'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94199678124064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a9610 con 0x55ac9259ab80 2024-09-11T11:02:25.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94199678124064] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f4e00980 20 remove_watcher() i=0 2024-09-11T11:02:25.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f4e00980 2 removed watcher, disabling cache 2024-09-11T11:02:25.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94199678127872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a9610 con 0x55ac92596910 2024-09-11T11:02:25.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94199678127872] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x55ac92596910 2024-09-11T11:02:25.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f4e00980 20 remove_watcher() i=1 2024-09-11T11:02:25.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.470+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94199678130192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a4f00 con 0x55ac9259ab80 2024-09-11T11:02:25.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.474+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94199678130192] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.474+0000 7fd5f4e00980 20 remove_watcher() i=2 2024-09-11T11:02:25.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.474+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94199678134032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a9610 con 0x7fd5e40c95b0 2024-09-11T11:02:25.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.474+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94199678134032] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.474+0000 7fd5f4e00980 20 remove_watcher() i=3 2024-09-11T11:02:25.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.474+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94199678135088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a4f00 con 0x55ac9259ab80 2024-09-11T11:02:25.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f2910640 1 -- 172.21.15.145:0/1042550811 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94199678135088] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e4119020 con 0x55ac9259ab80 2024-09-11T11:02:25.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f4e00980 20 remove_watcher() i=4 2024-09-11T11:02:25.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94199678121536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a9610 con 0x55ac9259f8c0 2024-09-11T11:02:25.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94199678121536] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f4e00980 20 remove_watcher() i=5 2024-09-11T11:02:25.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94199678142432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a4f00 con 0x55ac9259f8c0 2024-09-11T11:02:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f210f640 1 -- 172.21.15.145:0/1042550811 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94199678142432] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5e8037040 con 0x55ac9259f8c0 2024-09-11T11:02:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f4e00980 20 remove_watcher() i=6 2024-09-11T11:02:25.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.478+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94199678144640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55ac925a3640 con 0x7fd5e40c95b0 2024-09-11T11:02:25.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94199678144640] v34'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5ec00a4d0 con 0x7fd5e40c95b0 2024-09-11T11:02:25.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 20 remove_watcher() i=7 2024-09-11T11:02:25.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac9259ab80 msgr2=0x55ac9259d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac9259ab80 0x55ac9259d040 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92596910 msgr2=0x55ac92598db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92596910 0x55ac92598db0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd5e40c95b0 msgr2=0x7fd5e4128800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd5e40c95b0 0x7fd5e4128800 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac9259f8c0 msgr2=0x55ac925a1d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac9259f8c0 0x55ac925a1d80 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4bc034650 msgr2=0x7fd4bc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4bc034650 0x7fd4bc036b10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800c010 tx=0x7fd5e8010000 comp rx=0 tx=0).stop 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 msgr2=0x55ac9258b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/1042550811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92584650 0x55ac9258b870 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40db5f0 tx=0x7fd5e40aded0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 reap_dead start 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f3111640 1 -- 172.21.15.145:0/1042550811 reap_dead start 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 shutdown_connections 2024-09-11T11:02:25.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 >> 172.21.15.145:0/1042550811 conn(0x55ac92580a30 msgr2=0x55ac9257eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 shutdown_connections 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/1042550811 wait complete. 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/41624012 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4cc034650 msgr2=0x7fd4cc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/41624012 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4cc034650 0x7fd4cc036b10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55ac9256a670 tx=0x7fd5e800f000 comp rx=0 tx=0).stop 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/41624012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92577d00 msgr2=0x55ac92578120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/41624012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92577d00 0x55ac92578120 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40e5500 tx=0x7fd5e40de2f0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/41624012 shutdown_connections 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/41624012 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4cc034650 0x7fd4cc036b10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/41624012 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac92577d00 0x55ac92578120 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/41624012 >> 172.21.15.145:0/41624012 conn(0x55ac9256ce50 msgr2=0x55ac9256f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/41624012 shutdown_connections 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/41624012 wait complete. 2024-09-11T11:02:25.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac925622b0 msgr2=0x55ac925646a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac925622b0 0x55ac925646a0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92468240 msgr2=0x55ac92560e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac92468240 0x55ac92560e70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac92567940 msgr2=0x55ac92569d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac92567940 0x55ac92569d30 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4d8034650 msgr2=0x7fd4d8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd4d8034650 0x7fd4d8036b10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8000f70 tx=0x7fd5e8001380 comp rx=0 tx=0).stop 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 msgr2=0x55ac92559ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 --2- 172.21.15.145:0/2460755029 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac924678f0 0x55ac92559ea0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40199f0 tx=0x7fd5e40180e0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f3111640 1 -- 172.21.15.145:0/2460755029 reap_dead start 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 shutdown_connections 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 >> 172.21.15.145:0/2460755029 conn(0x55ac923db240 msgr2=0x55ac9254d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 shutdown_connections 2024-09-11T11:02:25.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.482+0000 7fd5f4e00980 1 -- 172.21.15.145:0/2460755029 wait complete. 2024-09-11T11:02:25.493 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-09-11T11:02:25.493 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-09-11T11:02:25.493 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-11T11:02:25.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-11T11:02:25.494 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-11T11:02:25.569 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:25.570 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:25.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51e06ef980 1 Processor -- start 2024-09-11T11:02:25.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51e06ef980 1 -- start start 2024-09-11T11:02:25.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51e06ef980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559f551bb9e0 0x559f551bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51e06ef980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559f5503fae0 con 0x559f551b7660 2024-09-11T11:02:25.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51e06ef980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x559f55063e30 con 0x559f551bb9e0 2024-09-11T11:02:25.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51dd9fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559f551bb9e0 0x559f551bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51dd9fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559f551bb9e0 0x559f551bddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53342/0 (socket says 172.21.15.145:53342) 2024-09-11T11:02:25.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51dd9fe640 1 -- 172.21.15.145:0/589832337 learned_addr learned my addr 172.21.15.145:0/589832337 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51dd9fe640 1 -- 172.21.15.145:0/589832337 >> v1:172.21.15.102:6789/0 conn(0x559f551b7660 legacy=0x559f551b7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.570+0000 7f51dd9fe640 1 -- 172.21.15.145:0/589832337 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f551bf320 con 0x559f551bb9e0 2024-09-11T11:02:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/589832337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 0x559f551bddd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f51d400a5c0 tx=0x7f51d401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138f7923127642d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51dd1fd640 1 -- 172.21.15.145:0/589832337 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d40a6070 con 0x559f551bb9e0 2024-09-11T11:02:25.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51dd1fd640 1 -- 172.21.15.145:0/589832337 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d40af070 con 0x559f551bb9e0 2024-09-11T11:02:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51dd1fd640 1 -- 172.21.15.145:0/589832337 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d40aa5c0 con 0x559f551bb9e0 2024-09-11T11:02:25.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51e06ef980 1 -- 172.21.15.145:0/589832337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 msgr2=0x559f551bddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51e06ef980 1 --2- 172.21.15.145:0/589832337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 0x559f551bddd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f51d400a5c0 tx=0x7f51d401b340 comp rx=0 tx=0).stop 2024-09-11T11:02:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51e06ef980 1 -- 172.21.15.145:0/589832337 shutdown_connections 2024-09-11T11:02:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51e06ef980 1 --2- 172.21.15.145:0/589832337 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 0x559f551bddd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51e06ef980 1 -- 172.21.15.145:0/589832337 >> 172.21.15.145:0/589832337 conn(0x559f551b3180 msgr2=0x559f551b55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51e06ef980 1 -- 172.21.15.145:0/589832337 shutdown_connections 2024-09-11T11:02:25.576 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.574+0000 7f51e06ef980 1 -- 172.21.15.145:0/589832337 wait complete. 2024-09-11T11:02:25.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51e06ef980 1 Processor -- start 2024-09-11T11:02:25.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51e06ef980 1 -- start start 2024-09-11T11:02:25.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51e06ef980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551b7660 0x559f552a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51e06ef980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f55065200 con 0x559f551b7660 2024-09-11T11:02:25.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551b7660 0x559f552a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551b7660 0x559f552a2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53352/0 (socket says 172.21.15.145:53352) 2024-09-11T11:02:25.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51de1ff640 1 -- 172.21.15.145:0/2708218009 learned_addr learned my addr 172.21.15.145:0/2708218009 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51de1ff640 1 -- 172.21.15.145:0/2708218009 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f552a30b0 con 0x559f551b7660 2024-09-11T11:02:25.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.586+0000 7f51de1ff640 1 --2- 172.21.15.145:0/2708218009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551b7660 0x559f552a2ae0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f51d0001ea0 tx=0x7f51d000b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7181c805b8e05ec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f50cc608640 1 -- 172.21.15.145:0/2708218009 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d000a040 con 0x559f551b7660 2024-09-11T11:02:25.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f50cc608640 1 -- 172.21.15.145:0/2708218009 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d000f620 con 0x559f551b7660 2024-09-11T11:02:25.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f50cc608640 1 -- 172.21.15.145:0/2708218009 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d000f890 con 0x559f551b7660 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- 172.21.15.145:0/2708218009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551b7660 msgr2=0x559f552a2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2708218009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551b7660 0x559f552a2ae0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f51d0001ea0 tx=0x7f51d000b680 comp rx=0 tx=0).stop 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- 172.21.15.145:0/2708218009 shutdown_connections 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2708218009 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551b7660 0x559f552a2ae0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- 172.21.15.145:0/2708218009 >> 172.21.15.145:0/2708218009 conn(0x559f551b3180 msgr2=0x559f5529e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- 172.21.15.145:0/2708218009 shutdown_connections 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- 172.21.15.145:0/2708218009 wait complete. 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 Processor -- start 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- start start 2024-09-11T11:02:25.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 0x559f552aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f551bee20 con 0x559f551bb9e0 2024-09-11T11:02:25.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 0x559f552aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 0x559f552aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53358/0 (socket says 172.21.15.145:53358) 2024-09-11T11:02:25.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51de1ff640 1 -- 172.21.15.145:0/2046933857 learned_addr learned my addr 172.21.15.145:0/2046933857 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51de1ff640 1 -- 172.21.15.145:0/2046933857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f552aa640 con 0x559f551bb9e0 2024-09-11T11:02:25.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51de1ff640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 0x559f552aa100 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f51d0001fd0 tx=0x7f51d0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f50cae05640 1 -- 172.21.15.145:0/2046933857 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d0001520 con 0x559f551bb9e0 2024-09-11T11:02:25.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f50cae05640 1 -- 172.21.15.145:0/2046933857 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d001c970 con 0x559f551bb9e0 2024-09-11T11:02:25.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f552aa8d0 con 0x559f551bb9e0 2024-09-11T11:02:25.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f50cae05640 1 -- 172.21.15.145:0/2046933857 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d001ccb0 con 0x559f551bb9e0 2024-09-11T11:02:25.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.590+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f552ad5b0 con 0x559f551bb9e0 2024-09-11T11:02:25.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f50cae05640 1 -- 172.21.15.145:0/2046933857 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51d0017050 con 0x559f551bb9e0 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f50cae05640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50c4034650 0x7f50c4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f50cae05640 1 -- 172.21.15.145:0/2046933857 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f51d0015020 con 0x559f551bb9e0 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50c4034650 0x7f50c4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552af1f0 0x559f552b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552b1b20 con 0x559f552af1f0 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51dea00640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552af1f0 0x559f552b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50c4034650 0x7f50c4036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51d40ae000 tx=0x7f51d40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51dea00640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552af1f0 0x559f552b15e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51dea00640 1 -- 172.21.15.145:0/2046933857 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552af1f0 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552b2900 0x559f552b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552b5320 con 0x559f552b2900 2024-09-11T11:02:25.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51de1ff640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552b2900 0x559f552b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51de1ff640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552b2900 0x559f552b4cf0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51de1ff640 1 -- 172.21.15.145:0/2046933857 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51d002e070 con 0x559f552b2900 2024-09-11T11:02:25.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.594+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552b6bd0 con 0x559f552b2900 2024-09-11T11:02:25.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51de1ff640 1 -- 172.21.15.145:0/2046933857 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f51d002e070 con 0x559f552b2900 2024-09-11T11:02:25.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552b5e00 con 0x559f552b2900 2024-09-11T11:02:25.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51de1ff640 1 -- 172.21.15.145:0/2046933857 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51d002e070 con 0x559f552b2900 2024-09-11T11:02:25.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559f552b7f80 0x559f552ba370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552ba8b0 con 0x559f552b7f80 2024-09-11T11:02:25.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559f552b7f80 0x559f552ba370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559f552b7f80 0x559f552ba370 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51dd9fe640 1 -- 172.21.15.145:0/2046933857 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552b7f80 2024-09-11T11:02:25.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 Processor -- start 2024-09-11T11:02:25.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 -- start start 2024-09-11T11:02:25.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f552c8230 0x559f552c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f550be800 con 0x559f552c8230 2024-09-11T11:02:25.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f552c8230 0x559f552c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f552c8230 0x559f552c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53368/0 (socket says 172.21.15.145:53368) 2024-09-11T11:02:25.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51de1ff640 1 -- 172.21.15.145:0/2665391883 learned_addr learned my addr 172.21.15.145:0/2665391883 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51de1ff640 1 -- 172.21.15.145:0/2665391883 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f552c8b90 con 0x559f552c8230 2024-09-11T11:02:25.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51de1ff640 1 --2- 172.21.15.145:0/2665391883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f552c8230 0x559f552c8650 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f51d00484f0 tx=0x7f51d002f8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f50c3fff640 1 -- 172.21.15.145:0/2665391883 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d001a690 con 0x559f552c8230 2024-09-11T11:02:25.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 -- 172.21.15.145:0/2665391883 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f552c8e20 con 0x559f552c8230 2024-09-11T11:02:25.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f50c3fff640 1 -- 172.21.15.145:0/2665391883 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d001a830 con 0x559f552c8230 2024-09-11T11:02:25.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f50c3fff640 1 -- 172.21.15.145:0/2665391883 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d0013130 con 0x559f552c8230 2024-09-11T11:02:25.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.598+0000 7f51e06ef980 1 -- 172.21.15.145:0/2665391883 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f552c8e20 con 0x559f552c8230 2024-09-11T11:02:25.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f50c3fff640 1 -- 172.21.15.145:0/2665391883 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51d00132d0 con 0x559f552c8230 2024-09-11T11:02:25.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f50c3fff640 1 --2- 172.21.15.145:0/2665391883 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50b8034600 0x7f50b8036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f50c3fff640 1 -- 172.21.15.145:0/2665391883 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f51d003fbf0 con 0x559f552c8230 2024-09-11T11:02:25.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/2665391883 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50b8034600 0x7f50b8036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 Processor -- start 2024-09-11T11:02:25.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- start start 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/2665391883 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50b8034600 0x7f50b8036ac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x559f552ae6f0 tx=0x7f51d4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f5512da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f552a3430 con 0x559f5512d650 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f5512da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f5512da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53376/0 (socket says 172.21.15.145:53376) 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51de1ff640 1 -- 172.21.15.145:0/565701619 learned_addr learned my addr 172.21.15.145:0/565701619 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51de1ff640 1 -- 172.21.15.145:0/565701619 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f5512e000 con 0x559f5512d650 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51de1ff640 1 --2- 172.21.15.145:0/565701619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f5512da30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f51d00188c0 tx=0x7f51d0027570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ce6103f14e6976 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f50c1ffb640 1 -- 172.21.15.145:0/565701619 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d001edc0 con 0x559f5512d650 2024-09-11T11:02:25.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f50c1ffb640 1 -- 172.21.15.145:0/565701619 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d0019be0 con 0x559f5512d650 2024-09-11T11:02:25.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f50c1ffb640 1 -- 172.21.15.145:0/565701619 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d00488a0 con 0x559f5512d650 2024-09-11T11:02:25.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- 172.21.15.145:0/565701619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 msgr2=0x559f5512da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 --2- 172.21.15.145:0/565701619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f5512da30 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f51d00188c0 tx=0x7f51d0027570 comp rx=0 tx=0).stop 2024-09-11T11:02:25.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- 172.21.15.145:0/565701619 shutdown_connections 2024-09-11T11:02:25.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 --2- 172.21.15.145:0/565701619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f5512da30 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- 172.21.15.145:0/565701619 >> 172.21.15.145:0/565701619 conn(0x559f552d0db0 msgr2=0x559f552ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- 172.21.15.145:0/565701619 shutdown_connections 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- 172.21.15.145:0/565701619 wait complete. 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 Processor -- start 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- start start 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f552ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.602+0000 7f51e06ef980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559f5512e000 con 0x559f5512d650 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f552ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51de1ff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f552ddc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53390/0 (socket says 172.21.15.145:53390) 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 learned_addr learned my addr 172.21.15.145:0/623412423 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f552de1c0 con 0x559f5512d650 2024-09-11T11:02:25.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51de1ff640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f552ddc80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f51d002fa30 tx=0x7f51d000b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f50affff640 1 -- 172.21.15.145:0/623412423 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d006c020 con 0x559f5512d650 2024-09-11T11:02:25.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f50affff640 1 -- 172.21.15.145:0/623412423 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d000ee20 con 0x559f5512d650 2024-09-11T11:02:25.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559f552de1c0 con 0x559f5512d650 2024-09-11T11:02:25.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f50affff640 1 -- 172.21.15.145:0/623412423 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51d00489d0 con 0x559f5512d650 2024-09-11T11:02:25.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f552de1c0 con 0x559f5512d650 2024-09-11T11:02:25.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f50affff640 1 -- 172.21.15.145:0/623412423 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f51d006f020 con 0x559f5512d650 2024-09-11T11:02:25.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f50affff640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50a8034650 0x7f50a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f50affff640 1 -- 172.21.15.145:0/623412423 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f51d0072bd0 con 0x559f5512d650 2024-09-11T11:02:25.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50a8034650 0x7f50a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552e8ae0 0x559f552eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552eb6f0 con 0x559f552e8ae0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51dea00640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552e8ae0 0x559f552eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50a8034650 0x7f50a8036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f51d4000c10 tx=0x7f51d40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51dea00640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552e8ae0 0x559f552eafa0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 20 realm 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552e7f90 con 0x559f552e8ae0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552ec1b0 con 0x559f552e8ae0 2024-09-11T11:02:25.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.606+0000 7f51e06ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552ecf90 0x559f552ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552ef9e0 con 0x559f552ecf90 2024-09-11T11:02:25.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51de1ff640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552ecf90 0x559f552ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51de1ff640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552ecf90 0x559f552ef380 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:25.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 20 searching for the correct realm 2024-09-11T11:02:25.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559f552f1ff0 0x559f552f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f4a60 con 0x559f552f1ff0 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559f552f1ff0 0x559f552f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51dd9fe640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559f552f1ff0 0x559f552f43e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f4a60 con 0x559f552ecf90 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51de1ff640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f51d0071020 0x7f51d006d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x7f51d0071020 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.610+0000 7f51dea00640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f51d0071020 0x7f51d006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f51d0071020 0x7f51d006d980 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552f1ff0 2024-09-11T11:02:25.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x7f51d0071020 2024-09-11T11:02:25.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.614+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x7f51d0071020 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552f1ff0 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552f1ff0 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552f1ff0 2024-09-11T11:02:25.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x7f51d0071020 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552e8ae0 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.618+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x7f51d0071020 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552f1ff0 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x7f51d0071020 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552f1ff0 2024-09-11T11:02:25.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0280 con 0x559f552ecf90 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0ad0 con 0x559f552e8ae0 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.622+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0ec0 con 0x559f552ecf90 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552f0ec0 con 0x7f51d0071020 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 zone default found 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 4 Realm: () 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:25.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 zonegroup default 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552f4f10 con 0x7f51d0071020 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552f6c90 con 0x559f552f1ff0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552f7030 con 0x559f552f1ff0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 started sync module instance, tier type = 2024-09-11T11:02:25.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:25.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f6130 con 0x559f552ecf90 2024-09-11T11:02:25.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94142817330784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f6130 con 0x559f552ecf90 2024-09-11T11:02:25.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.626+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f79f0 con 0x559f552e8ae0 2024-09-11T11:02:25.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94142817334592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f7e10 con 0x559f552e8ae0 2024-09-11T11:02:25.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f8830 con 0x559f552ecf90 2024-09-11T11:02:25.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94142817330784] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94142817334592] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94142817338144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f7960 con 0x559f552ecf90 2024-09-11T11:02:25.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f90d0 con 0x7f51d0071020 2024-09-11T11:02:25.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94142817340448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f7960 con 0x7f51d0071020 2024-09-11T11:02:25.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.630+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f9b50 con 0x559f552ecf90 2024-09-11T11:02:25.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94142817340448] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94142817338144] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94142817328256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f9660 con 0x559f552ecf90 2024-09-11T11:02:25.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552fa3f0 con 0x559f552f1ff0 2024-09-11T11:02:25.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94142817345344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f9660 con 0x559f552f1ff0 2024-09-11T11:02:25.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552fb260 con 0x559f552f1ff0 2024-09-11T11:02:25.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94142817328256] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94142817341504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552fbab0 con 0x559f552f1ff0 2024-09-11T11:02:25.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.634+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552fc360 con 0x7f51d0071020 2024-09-11T11:02:25.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94142817345344] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94142817341504] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94142817347472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552fbab0 con 0x7f51d0071020 2024-09-11T11:02:25.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 20 add_watcher() i=0 2024-09-11T11:02:25.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 20 add_watcher() i=1 2024-09-11T11:02:25.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 20 add_watcher() i=2 2024-09-11T11:02:25.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 20 add_watcher() i=3 2024-09-11T11:02:25.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 20 add_watcher() i=4 2024-09-11T11:02:25.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 20 add_watcher() i=5 2024-09-11T11:02:25.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 20 add_watcher() i=6 2024-09-11T11:02:25.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94142817347472] v34'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 20 add_watcher() i=7 2024-09-11T11:02:25.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:25.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f552fbab0 con 0x559f552e8ae0 2024-09-11T11:02:25.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.638+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94142817351168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552fba50 con 0x559f552e8ae0 2024-09-11T11:02:25.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94142817351168] v34'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f5094fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:25.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:25.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 5 note: GC not initialized 2024-09-11T11:02:25.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f500f7fe640 20 reqs_thread_entry: start 2024-09-11T11:02:25.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:25.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 20 Filter name: none 2024-09-11T11:02:25.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f500d7fa640 20 reqs_thread_entry: start 2024-09-11T11:02:25.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f55322420 con 0x559f552e8ae0 2024-09-11T11:02:25.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:02:25.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x559f55323970 con 0x559f552f1ff0 2024-09-11T11:02:25.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f5094fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.642+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94142817351168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f55321080 con 0x559f552e8ae0 2024-09-11T11:02:25.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.646+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94142817351168] v34'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.646+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94142817330784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552fb600 con 0x559f552ecf90 2024-09-11T11:02:25.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.646+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94142817330784] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.646+0000 7f51e06ef980 20 remove_watcher() i=0 2024-09-11T11:02:25.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.646+0000 7f51e06ef980 2 removed watcher, disabling cache 2024-09-11T11:02:25.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.646+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94142817334592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f6660 con 0x559f552e8ae0 2024-09-11T11:02:25.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94142817334592] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x559f552e8ae0 2024-09-11T11:02:25.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51e06ef980 20 remove_watcher() i=1 2024-09-11T11:02:25.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94142817338144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f6660 con 0x559f552ecf90 2024-09-11T11:02:25.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94142817338144] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51e06ef980 20 remove_watcher() i=2 2024-09-11T11:02:25.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94142817340448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f8320 con 0x7f51d0071020 2024-09-11T11:02:25.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94142817340448] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51e06ef980 20 remove_watcher() i=3 2024-09-11T11:02:25.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.650+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94142817328256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f6660 con 0x559f552ecf90 2024-09-11T11:02:25.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51de1ff640 1 -- 172.21.15.145:0/623412423 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94142817328256] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d002e070 con 0x559f552ecf90 2024-09-11T11:02:25.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51e06ef980 20 remove_watcher() i=4 2024-09-11T11:02:25.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94142817345344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f8c20 con 0x559f552f1ff0 2024-09-11T11:02:25.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94142817345344] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51e06ef980 20 remove_watcher() i=5 2024-09-11T11:02:25.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94142817341504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f5c80 con 0x559f552f1ff0 2024-09-11T11:02:25.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51dd9fe640 1 -- 172.21.15.145:0/623412423 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94142817341504] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d40aaa80 con 0x559f552f1ff0 2024-09-11T11:02:25.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51e06ef980 20 remove_watcher() i=6 2024-09-11T11:02:25.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.654+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94142817347472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x559f552f6660 con 0x7f51d0071020 2024-09-11T11:02:25.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94142817347472] v34'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f51d800a4d0 con 0x7f51d0071020 2024-09-11T11:02:25.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 20 remove_watcher() i=7 2024-09-11T11:02:25.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552ecf90 msgr2=0x559f552ef380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552ecf90 0x559f552ef380 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552e8ae0 msgr2=0x559f552eafa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552e8ae0 0x559f552eafa0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f51d0071020 msgr2=0x7f51d006d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f51d0071020 0x7f51d006d980 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559f552f1ff0 msgr2=0x559f552f43e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x559f552f1ff0 0x559f552f43e0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50a8034650 msgr2=0x7f50a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50a8034650 0x7f50a8036b10 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f51d4000c10 tx=0x7f51d40c1040 comp rx=0 tx=0).stop 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 msgr2=0x559f552ddc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f552ddc80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f51d002fa30 tx=0x7f51d000b0f0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51dea00640 1 -- 172.21.15.145:0/623412423 reap_dead start 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 shutdown_connections 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/623412423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f5512d650 0x559f552ddc80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 >> 172.21.15.145:0/623412423 conn(0x559f552d0db0 msgr2=0x559f552cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 shutdown_connections 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/623412423 wait complete. 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2665391883 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50b8034600 msgr2=0x7f50b8036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2665391883 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50b8034600 0x7f50b8036ac0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x559f552ae6f0 tx=0x7f51d4005ad0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2665391883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f552c8230 msgr2=0x559f552c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2665391883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f552c8230 0x559f552c8650 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f51d00484f0 tx=0x7f51d002f8e0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2665391883 shutdown_connections 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2665391883 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50b8034600 0x7f50b8036ac0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2665391883 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f552c8230 0x559f552c8650 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2665391883 >> 172.21.15.145:0/2665391883 conn(0x559f552bd380 msgr2=0x559f552bfe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2665391883 shutdown_connections 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2665391883 wait complete. 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552b2900 msgr2=0x559f552b4cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559f552b2900 0x559f552b4cf0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552af1f0 msgr2=0x559f552b15e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559f552af1f0 0x559f552b15e0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559f552b7f80 msgr2=0x559f552ba370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x559f552b7f80 0x559f552ba370 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50c4034650 msgr2=0x7f50c4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f50c4034650 0x7f50c4036b10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f51d40ae000 tx=0x7f51d40a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 msgr2=0x559f552aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 --2- 172.21.15.145:0/2046933857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559f551bb9e0 0x559f552aa100 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f51d0001fd0 tx=0x7f51d0000bd0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51dea00640 1 -- 172.21.15.145:0/2046933857 reap_dead start 2024-09-11T11:02:25.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 shutdown_connections 2024-09-11T11:02:25.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 >> 172.21.15.145:0/2046933857 conn(0x559f551b3180 msgr2=0x559f5529d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 shutdown_connections 2024-09-11T11:02:25.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.658+0000 7f51e06ef980 1 -- 172.21.15.145:0/2046933857 wait complete. 2024-09-11T11:02:25.668 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-09-11T11:02:25.669 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-09-11T11:02:25.669 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-11T11:02:25.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-11T11:02:25.669 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-11T11:02:25.744 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:25.744 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:25.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6744673980 1 Processor -- start 2024-09-11T11:02:25.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6744673980 1 -- start start 2024-09-11T11:02:25.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6744673980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55af36587ad0 0x55af36589ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6744673980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55af3640bae0 con 0x55af364f82a0 2024-09-11T11:02:25.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6744673980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55af3642fe30 con 0x55af36587ad0 2024-09-11T11:02:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6741982640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55af36587ad0 0x55af36589ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6741982640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55af36587ad0 0x55af36589ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53402/0 (socket says 172.21.15.145:53402) 2024-09-11T11:02:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6741982640 1 -- 172.21.15.145:0/3191397608 learned_addr learned my addr 172.21.15.145:0/3191397608 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.742+0000 7f6742183640 1 --1- 172.21.15.145:0/3191397608 >> v1:172.21.15.102:6789/0 conn(0x55af364f82a0 0x55af365863b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:33246/0 (socket says 172.21.15.145:33246) 2024-09-11T11:02:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6741982640 1 -- 172.21.15.145:0/3191397608 >> v1:172.21.15.102:6789/0 conn(0x55af364f82a0 legacy=0x55af365863b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6741982640 1 -- 172.21.15.145:0/3191397608 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af364f8830 con 0x55af36587ad0 2024-09-11T11:02:25.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6741982640 1 --2- 172.21.15.145:0/3191397608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36587ad0 0x55af36589ec0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f673800a5c0 tx=0x7f673801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2831d3a89db714bc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6741181640 1 -- 172.21.15.145:0/3191397608 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67380a6070 con 0x55af36587ad0 2024-09-11T11:02:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6741181640 1 -- 172.21.15.145:0/3191397608 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67380af070 con 0x55af36587ad0 2024-09-11T11:02:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6741181640 1 -- 172.21.15.145:0/3191397608 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67380aa5c0 con 0x55af36587ad0 2024-09-11T11:02:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6744673980 1 -- 172.21.15.145:0/3191397608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36587ad0 msgr2=0x55af36589ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6744673980 1 --2- 172.21.15.145:0/3191397608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36587ad0 0x55af36589ec0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f673800a5c0 tx=0x7f673801b340 comp rx=0 tx=0).stop 2024-09-11T11:02:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6744673980 1 -- 172.21.15.145:0/3191397608 shutdown_connections 2024-09-11T11:02:25.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6744673980 1 --2- 172.21.15.145:0/3191397608 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36587ad0 0x55af36589ec0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6744673980 1 -- 172.21.15.145:0/3191397608 >> 172.21.15.145:0/3191397608 conn(0x55af3657e0a0 msgr2=0x55af365804c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6744673980 1 -- 172.21.15.145:0/3191397608 shutdown_connections 2024-09-11T11:02:25.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.746+0000 7f6744673980 1 -- 172.21.15.145:0/3191397608 wait complete. 2024-09-11T11:02:25.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 Processor -- start 2024-09-11T11:02:25.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 -- start start 2024-09-11T11:02:25.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af3666ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55af36431200 con 0x55af364f82a0 2024-09-11T11:02:25.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af3666ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af3666ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53418/0 (socket says 172.21.15.145:53418) 2024-09-11T11:02:25.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6742183640 1 -- 172.21.15.145:0/2720483491 learned_addr learned my addr 172.21.15.145:0/2720483491 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6742183640 1 -- 172.21.15.145:0/2720483491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af3666f030 con 0x55af364f82a0 2024-09-11T11:02:25.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6742183640 1 --2- 172.21.15.145:0/2720483491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af3666ea60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6734001e50 tx=0x7f6734001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722e41c22d070571 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6630608640 1 -- 172.21.15.145:0/2720483491 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f673400e5d0 con 0x55af364f82a0 2024-09-11T11:02:25.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6630608640 1 -- 172.21.15.145:0/2720483491 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673400e770 con 0x55af364f82a0 2024-09-11T11:02:25.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6630608640 1 -- 172.21.15.145:0/2720483491 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f673400eab0 con 0x55af364f82a0 2024-09-11T11:02:25.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 -- 172.21.15.145:0/2720483491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 msgr2=0x55af3666ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 --2- 172.21.15.145:0/2720483491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af3666ea60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6734001e50 tx=0x7f6734001e80 comp rx=0 tx=0).stop 2024-09-11T11:02:25.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 -- 172.21.15.145:0/2720483491 shutdown_connections 2024-09-11T11:02:25.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 --2- 172.21.15.145:0/2720483491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af3666ea60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 -- 172.21.15.145:0/2720483491 >> 172.21.15.145:0/2720483491 conn(0x55af3657e0a0 msgr2=0x55af3666a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 -- 172.21.15.145:0/2720483491 shutdown_connections 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 -- 172.21.15.145:0/2720483491 wait complete. 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 Processor -- start 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.762+0000 7f6744673980 1 -- start start 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6744673980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af36675db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6744673980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55af3658af10 con 0x55af364f82a0 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af36675db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af36675db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53428/0 (socket says 172.21.15.145:53428) 2024-09-11T11:02:25.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6742183640 1 -- 172.21.15.145:0/3074477687 learned_addr learned my addr 172.21.15.145:0/3074477687 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6742183640 1 -- 172.21.15.145:0/3074477687 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af366762f0 con 0x55af364f82a0 2024-09-11T11:02:25.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6742183640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af36675db0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55af3666fc40 tx=0x7f6734000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f662ee05640 1 -- 172.21.15.145:0/3074477687 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6734001260 con 0x55af364f82a0 2024-09-11T11:02:25.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f662ee05640 1 -- 172.21.15.145:0/3074477687 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f673400fa40 con 0x55af364f82a0 2024-09-11T11:02:25.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af36676580 con 0x55af364f82a0 2024-09-11T11:02:25.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f662ee05640 1 -- 172.21.15.145:0/3074477687 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f673400fd80 con 0x55af364f82a0 2024-09-11T11:02:25.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af36679260 con 0x55af364f82a0 2024-09-11T11:02:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f662ee05640 1 -- 172.21.15.145:0/3074477687 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6734017070 con 0x55af364f82a0 2024-09-11T11:02:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f662ee05640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f66280346a0 0x7f6628036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f662ee05640 1 -- 172.21.15.145:0/3074477687 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f6734015020 con 0x55af364f82a0 2024-09-11T11:02:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6741982640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f66280346a0 0x7f6628036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6744673980 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af36587ad0 0x55af3667cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af3667d3f0 con 0x55af36587ad0 2024-09-11T11:02:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.766+0000 7f6742984640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af36587ad0 0x55af3667cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6741982640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f66280346a0 0x7f6628036b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f67380ae000 tx=0x7f67380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6742984640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af36587ad0 0x55af3667cd80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6742984640 1 -- 172.21.15.145:0/3074477687 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af36587ad0 2024-09-11T11:02:25.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6744673980 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af3667e1e0 0x55af366805d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af36680c10 con 0x55af3667e1e0 2024-09-11T11:02:25.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6742183640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af3667e1e0 0x55af366805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6742183640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af3667e1e0 0x55af366805d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6742183640 1 -- 172.21.15.145:0/3074477687 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f673402e070 con 0x55af3667e1e0 2024-09-11T11:02:25.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366824c0 con 0x55af3667e1e0 2024-09-11T11:02:25.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6742183640 1 -- 172.21.15.145:0/3074477687 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f673402e070 con 0x55af3667e1e0 2024-09-11T11:02:25.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366816f0 con 0x55af3667e1e0 2024-09-11T11:02:25.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6742183640 1 -- 172.21.15.145:0/3074477687 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f673402e070 con 0x55af3667e1e0 2024-09-11T11:02:25.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6744673980 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55af36683870 0x55af36685c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366861a0 con 0x55af36683870 2024-09-11T11:02:25.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.770+0000 7f6741982640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55af36683870 0x55af36685c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6741982640 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55af36683870 0x55af36685c60 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6741982640 1 -- 172.21.15.145:0/3074477687 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f67380aaae0 con 0x55af36683870 2024-09-11T11:02:25.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6744673980 1 Processor -- start 2024-09-11T11:02:25.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6744673980 1 -- start start 2024-09-11T11:02:25.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6744673980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36693bc0 0x55af36693fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6744673980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55af3648a800 con 0x55af36693bc0 2024-09-11T11:02:25.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36693bc0 0x55af36693fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36693bc0 0x55af36693fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53436/0 (socket says 172.21.15.145:53436) 2024-09-11T11:02:25.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6742183640 1 -- 172.21.15.145:0/2576575906 learned_addr learned my addr 172.21.15.145:0/2576575906 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6742183640 1 -- 172.21.15.145:0/2576575906 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af36694520 con 0x55af36693bc0 2024-09-11T11:02:25.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6742183640 1 --2- 172.21.15.145:0/2576575906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36693bc0 0x55af36693fe0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f673401cfd0 tx=0x7f6734017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6627fff640 1 -- 172.21.15.145:0/2576575906 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6734042120 con 0x55af36693bc0 2024-09-11T11:02:25.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6627fff640 1 -- 172.21.15.145:0/2576575906 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67340440b0 con 0x55af36693bc0 2024-09-11T11:02:25.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6744673980 1 -- 172.21.15.145:0/2576575906 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af36694750 con 0x55af36693bc0 2024-09-11T11:02:25.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6627fff640 1 -- 172.21.15.145:0/2576575906 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f673404aae0 con 0x55af36693bc0 2024-09-11T11:02:25.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6744673980 1 -- 172.21.15.145:0/2576575906 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af36694750 con 0x55af36693bc0 2024-09-11T11:02:25.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6627fff640 1 -- 172.21.15.145:0/2576575906 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6734051060 con 0x55af36693bc0 2024-09-11T11:02:25.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6627fff640 1 --2- 172.21.15.145:0/2576575906 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f661c034600 0x7f661c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6627fff640 1 -- 172.21.15.145:0/2576575906 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f673404a040 con 0x55af36693bc0 2024-09-11T11:02:25.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.774+0000 7f6741982640 1 --2- 172.21.15.145:0/2576575906 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f661c034600 0x7f661c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 Processor -- start 2024-09-11T11:02:25.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- start start 2024-09-11T11:02:25.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55af3666f3b0 con 0x55af366a0160 2024-09-11T11:02:25.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6741982640 1 --2- 172.21.15.145:0/2576575906 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f661c034600 0x7f661c036ac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55af3667a3a0 tx=0x7f6738005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53444/0 (socket says 172.21.15.145:53444) 2024-09-11T11:02:25.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 -- 172.21.15.145:0/218783491 learned_addr learned my addr 172.21.15.145:0/218783491 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 -- 172.21.15.145:0/218783491 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af366a0b30 con 0x55af366a0160 2024-09-11T11:02:25.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 --2- 172.21.15.145:0/218783491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a0560 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f67340197f0 tx=0x7f673401bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04290c32354f711 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6625ffb640 1 -- 172.21.15.145:0/218783491 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6734063070 con 0x55af366a0160 2024-09-11T11:02:25.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6625ffb640 1 -- 172.21.15.145:0/218783491 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6734032d80 con 0x55af366a0160 2024-09-11T11:02:25.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6625ffb640 1 -- 172.21.15.145:0/218783491 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6734047280 con 0x55af366a0160 2024-09-11T11:02:25.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- 172.21.15.145:0/218783491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 msgr2=0x55af366a0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 --2- 172.21.15.145:0/218783491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a0560 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f67340197f0 tx=0x7f673401bde0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- 172.21.15.145:0/218783491 shutdown_connections 2024-09-11T11:02:25.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 --2- 172.21.15.145:0/218783491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a0560 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- 172.21.15.145:0/218783491 >> 172.21.15.145:0/218783491 conn(0x55af3669c540 msgr2=0x55af3669a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- 172.21.15.145:0/218783491 shutdown_connections 2024-09-11T11:02:25.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- 172.21.15.145:0/218783491 wait complete. 2024-09-11T11:02:25.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 Processor -- start 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- start start 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6744673980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55af366a0fb0 con 0x55af366a0160 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53458/0 (socket says 172.21.15.145:53458) 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 learned_addr learned my addr 172.21.15.145:0/971529829 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af366a78c0 con 0x55af366a0160 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.778+0000 7f6742183640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a7380 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6734049fe0 tx=0x7f67340423c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6613fff640 1 -- 172.21.15.145:0/971529829 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f673406e020 con 0x55af366a0160 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55af366a78c0 con 0x55af366a0160 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6613fff640 1 -- 172.21.15.145:0/971529829 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6734019d10 con 0x55af366a0160 2024-09-11T11:02:25.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6613fff640 1 -- 172.21.15.145:0/971529829 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6734063040 con 0x55af366a0160 2024-09-11T11:02:25.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af366a7d30 con 0x55af366a0160 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6613fff640 1 -- 172.21.15.145:0/971529829 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6734071020 con 0x55af366a0160 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6613fff640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f660c034650 0x7f660c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6613fff640 1 -- 172.21.15.145:0/971529829 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f6734059070 con 0x55af366a0160 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6741982640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f660c034650 0x7f660c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af366b23e0 0x55af366b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366b4fd0 con 0x55af366b23e0 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6742984640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af366b23e0 0x55af366b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6741982640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f660c034650 0x7f660c036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6738000c10 tx=0x7f67380c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6742984640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af366b23e0 0x55af366b4880 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 20 realm 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366b18d0 con 0x55af366b23e0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366b5aa0 con 0x55af366b23e0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af366b6680 0x55af366b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366b92b0 con 0x55af366b6680 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6742183640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af366b6680 0x55af366b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.782+0000 7f6742183640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af366b6680 0x55af366b8b40 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f673402e070 con 0x55af366b6680 2024-09-11T11:02:25.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6744673980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366b9b50 con 0x55af366b6680 2024-09-11T11:02:25.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f673402e070 con 0x55af366b6680 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6744673980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6744673980 20 searching for the correct realm 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55af366bb8c0 0x55af366bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366bb8c0 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6741982640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55af366bb8c0 0x55af366bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6741982640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55af366bb8c0 0x55af366bdcb0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f673402e070 con 0x55af366b6680 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742183640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6734073020 0x7f6734064a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x7f6734073020 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6734073020 0x7f6734064a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6734073020 0x7f6734064a10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366bb8c0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.786+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673402e070 con 0x55af366b6680 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673402e070 con 0x55af366b6680 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x7f6734073020 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x7f6734073020 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366bb8c0 2024-09-11T11:02:25.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.790+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366bb8c0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366bb8c0 2024-09-11T11:02:25.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x7f6734073020 2024-09-11T11:02:25.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b23e0 2024-09-11T11:02:25.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x7f6734073020 2024-09-11T11:02:25.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.798 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366bb8c0 2024-09-11T11:02:25.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x7f6734073020 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366bb8c0 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.794+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55af366be330 con 0x55af366b6680 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366ba4a0 con 0x55af366b23e0 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366ba8f0 con 0x55af366b6680 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366bad10 con 0x7f6734073020 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 zone default found 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 4 Realm: () 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 zonegroup default 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366ba0d0 con 0x7f6734073020 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366c0ba0 con 0x55af366bb8c0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366c0f40 con 0x55af366bb8c0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 started sync module instance, tier type = 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:25.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.798+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c0030 con 0x55af366b6680 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94211020686688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c0030 con 0x55af366b6680 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c1960 con 0x55af366b23e0 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94211020690512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c1920 con 0x55af366b23e0 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c2860 con 0x55af366b6680 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94211020686688] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94211020690512] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.802+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94211020692816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c2860 con 0x55af366b6680 2024-09-11T11:02:25.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c2cb0 con 0x7f6734073020 2024-09-11T11:02:25.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94211020684160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c2c70 con 0x7f6734073020 2024-09-11T11:02:25.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c3b90 con 0x55af366b6680 2024-09-11T11:02:25.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94211020692816] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94211020684160] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94211020697760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c3b90 con 0x55af366b6680 2024-09-11T11:02:25.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.806+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c3f80 con 0x55af366bb8c0 2024-09-11T11:02:25.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94211020694384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c47d0 con 0x55af366bb8c0 2024-09-11T11:02:25.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c51d0 con 0x55af366bb8c0 2024-09-11T11:02:25.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94211020697760] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94211020694384] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94211020699328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c55c0 con 0x55af366bb8c0 2024-09-11T11:02:25.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c5e10 con 0x7f6734073020 2024-09-11T11:02:25.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94211020699328] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94211020707264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c6200 con 0x7f6734073020 2024-09-11T11:02:25.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 20 add_watcher() i=0 2024-09-11T11:02:25.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 20 add_watcher() i=1 2024-09-11T11:02:25.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 20 add_watcher() i=2 2024-09-11T11:02:25.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 20 add_watcher() i=3 2024-09-11T11:02:25.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 20 add_watcher() i=4 2024-09-11T11:02:25.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 20 add_watcher() i=5 2024-09-11T11:02:25.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 20 add_watcher() i=6 2024-09-11T11:02:25.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94211020707264] v34'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 20 add_watcher() i=7 2024-09-11T11:02:25.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.810+0000 7f6744673980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:25.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366c92a0 con 0x55af366b23e0 2024-09-11T11:02:25.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94211020708320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c6640 con 0x55af366b23e0 2024-09-11T11:02:25.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94211020708320] v34'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f65f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:25.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:25.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 5 note: GC not initialized 2024-09-11T11:02:25.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f65737fe640 20 reqs_thread_entry: start 2024-09-11T11:02:25.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:25.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 20 Filter name: none 2024-09-11T11:02:25.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f65717fa640 20 reqs_thread_entry: start 2024-09-11T11:02:25.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366ee6e0 con 0x55af366b23e0 2024-09-11T11:02:25.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:02:25.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55af366efc30 con 0x55af366bb8c0 2024-09-11T11:02:25.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.814+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.818+0000 7f65f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:25.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.818+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94211020708320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366ece90 con 0x55af366b23e0 2024-09-11T11:02:25.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.818+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94211020708320] v34'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.818+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94211020686688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c59e0 con 0x55af366b6680 2024-09-11T11:02:25.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94211020686688] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6744673980 20 remove_watcher() i=0 2024-09-11T11:02:25.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6744673980 2 removed watcher, disabling cache 2024-09-11T11:02:25.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94211020690512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c59e0 con 0x55af366b23e0 2024-09-11T11:02:25.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94211020690512] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x55af366b23e0 2024-09-11T11:02:25.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6744673980 20 remove_watcher() i=1 2024-09-11T11:02:25.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94211020692816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c59e0 con 0x55af366b6680 2024-09-11T11:02:25.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94211020692816] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6744673980 20 remove_watcher() i=2 2024-09-11T11:02:25.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.822+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94211020684160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c59e0 con 0x7f6734073020 2024-09-11T11:02:25.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94211020684160] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6744673980 20 remove_watcher() i=3 2024-09-11T11:02:25.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94211020697760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c59e0 con 0x55af366b6680 2024-09-11T11:02:25.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6742183640 1 -- 172.21.15.145:0/971529829 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94211020697760] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673408d040 con 0x55af366b6680 2024-09-11T11:02:25.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6744673980 20 remove_watcher() i=4 2024-09-11T11:02:25.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94211020694384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c30a0 con 0x55af366bb8c0 2024-09-11T11:02:25.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94211020694384] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6744673980 20 remove_watcher() i=5 2024-09-11T11:02:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.826+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94211020699328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c59e0 con 0x55af366bb8c0 2024-09-11T11:02:25.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6741982640 1 -- 172.21.15.145:0/971529829 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94211020699328] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f67380aaae0 con 0x55af366bb8c0 2024-09-11T11:02:25.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 20 remove_watcher() i=6 2024-09-11T11:02:25.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94211020707264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55af366c2370 con 0x7f6734073020 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94211020707264] v34'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f673c00a4d0 con 0x7f6734073020 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 20 remove_watcher() i=7 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af366b6680 msgr2=0x55af366b8b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af366b6680 0x55af366b8b40 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af366b23e0 msgr2=0x55af366b4880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af366b23e0 0x55af366b4880 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6734073020 msgr2=0x7f6734064a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6734073020 0x7f6734064a10 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55af366bb8c0 msgr2=0x55af366bdcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55af366bb8c0 0x55af366bdcb0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f660c034650 msgr2=0x7f660c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f660c034650 0x7f660c036b10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6738000c10 tx=0x7f67380c1040 comp rx=0 tx=0).stop 2024-09-11T11:02:25.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 msgr2=0x55af366a7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/971529829 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af366a0160 0x55af366a7380 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f6734049fe0 tx=0x7f67340423c0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6742984640 1 -- 172.21.15.145:0/971529829 reap_dead start 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 shutdown_connections 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 >> 172.21.15.145:0/971529829 conn(0x55af3669c540 msgr2=0x55af3669a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 shutdown_connections 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/971529829 wait complete. 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/2576575906 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f661c034600 msgr2=0x7f661c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/2576575906 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f661c034600 0x7f661c036ac0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x55af3667a3a0 tx=0x7f6738005ad0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/2576575906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36693bc0 msgr2=0x55af36693fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/2576575906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36693bc0 0x55af36693fe0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f673401cfd0 tx=0x7f6734017d50 comp rx=0 tx=0).stop 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/2576575906 shutdown_connections 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/2576575906 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f661c034600 0x7f661c036ac0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/2576575906 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af36693bc0 0x55af36693fe0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/2576575906 >> 172.21.15.145:0/2576575906 conn(0x55af36688d10 msgr2=0x55af3668b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/2576575906 shutdown_connections 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/2576575906 wait complete. 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af3667e1e0 msgr2=0x55af366805d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55af3667e1e0 0x55af366805d0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af36587ad0 msgr2=0x55af3667cd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55af36587ad0 0x55af3667cd80 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55af36683870 msgr2=0x55af36685c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55af36683870 0x55af36685c60 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f66280346a0 msgr2=0x7f6628036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f66280346a0 0x7f6628036b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f67380ae000 tx=0x7f67380a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:25.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 msgr2=0x55af36675db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 --2- 172.21.15.145:0/3074477687 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55af364f82a0 0x55af36675db0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x55af3666fc40 tx=0x7f6734000bd0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6742984640 1 -- 172.21.15.145:0/3074477687 reap_dead start 2024-09-11T11:02:25.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 shutdown_connections 2024-09-11T11:02:25.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 >> 172.21.15.145:0/3074477687 conn(0x55af3657e0a0 msgr2=0x55af36669210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 shutdown_connections 2024-09-11T11:02:25.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.830+0000 7f6744673980 1 -- 172.21.15.145:0/3074477687 wait complete. 2024-09-11T11:02:25.842 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-09-11T11:00:00.000000Z","epoch":1726052400,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-09-11T11:02:25.842 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-09-11T11:02:25.842 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-11T11:02:25.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-11T11:02:25.842 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-11T11:02:25.929 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:25.930 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:25.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fed0d980 1 Processor -- start 2024-09-11T11:02:25.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fed0d980 1 -- start start 2024-09-11T11:02:25.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fed0d980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x563aace8e310 0x563aacf1c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fed0d980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563aacda1ae0 con 0x563aacf1c8e0 2024-09-11T11:02:25.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fed0d980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x563aacdc5e30 con 0x563aace8e310 2024-09-11T11:02:25.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fc81d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x563aace8e310 0x563aacf1c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fc01c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x563aacf1c8e0 0x563aacf1ecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:33256/0 (socket says 172.21.15.145:33256) 2024-09-11T11:02:25.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fc01c640 1 -- 172.21.15.145:0/4183238266 learned_addr learned my addr 172.21.15.145:0/4183238266 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:02:25.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fc81d640 1 -- 172.21.15.145:0/4183238266 >> v1:172.21.15.102:6789/0 conn(0x563aacf1c8e0 legacy=0x563aacf1ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fc81d640 1 -- 172.21.15.145:0/4183238266 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aacf21400 con 0x563aace8e310 2024-09-11T11:02:25.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.930+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/4183238266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aacf1c3a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00a420 tx=0x7fe6ec01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99fb9634c098f3d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fb81b640 1 -- 172.21.15.145:0/4183238266 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0af070 con 0x563aace8e310 2024-09-11T11:02:25.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fb81b640 1 -- 172.21.15.145:0/4183238266 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0aa530 con 0x563aace8e310 2024-09-11T11:02:25.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fb81b640 1 -- 172.21.15.145:0/4183238266 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0aa850 con 0x563aace8e310 2024-09-11T11:02:25.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fed0d980 1 -- 172.21.15.145:0/4183238266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 msgr2=0x563aacf1c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/4183238266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aacf1c3a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec00a420 tx=0x7fe6ec01afd0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fed0d980 1 -- 172.21.15.145:0/4183238266 shutdown_connections 2024-09-11T11:02:25.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/4183238266 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aacf1c3a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fed0d980 1 -- 172.21.15.145:0/4183238266 >> 172.21.15.145:0/4183238266 conn(0x563aacf140d0 msgr2=0x563aacf164f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fed0d980 1 -- 172.21.15.145:0/4183238266 shutdown_connections 2024-09-11T11:02:25.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.934+0000 7fe6fed0d980 1 -- 172.21.15.145:0/4183238266 wait complete. 2024-09-11T11:02:25.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.946+0000 7fe6fed0d980 1 Processor -- start 2024-09-11T11:02:25.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.946+0000 7fe6fed0d980 1 -- start start 2024-09-11T11:02:25.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.946+0000 7fe6fed0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad004b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.946+0000 7fe6fed0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563aacdc7200 con 0x563aace8e310 2024-09-11T11:02:25.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.946+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad004b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.946+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad004b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53490/0 (socket says 172.21.15.145:53490) 2024-09-11T11:02:25.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.946+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3147013340 learned_addr learned my addr 172.21.15.145:0/3147013340 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.946+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3147013340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aad005120 con 0x563aace8e310 2024-09-11T11:02:25.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/3147013340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad004b50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0aa500 tx=0x7fe6ec0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f83c0f787d71edb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe5eae0d640 1 -- 172.21.15.145:0/3147013340 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0af040 con 0x563aace8e310 2024-09-11T11:02:25.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe5eae0d640 1 -- 172.21.15.145:0/3147013340 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0abb80 con 0x563aace8e310 2024-09-11T11:02:25.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe5eae0d640 1 -- 172.21.15.145:0/3147013340 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0b5470 con 0x563aace8e310 2024-09-11T11:02:25.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3147013340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 msgr2=0x563aad004b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3147013340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad004b50 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0aa500 tx=0x7fe6ec0033b0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3147013340 shutdown_connections 2024-09-11T11:02:25.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3147013340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad004b50 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3147013340 >> 172.21.15.145:0/3147013340 conn(0x563aacf140d0 msgr2=0x563aad000780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3147013340 shutdown_connections 2024-09-11T11:02:25.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3147013340 wait complete. 2024-09-11T11:02:25.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 Processor -- start 2024-09-11T11:02:25.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- start start 2024-09-11T11:02:25.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad00be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563aacf20e70 con 0x563aace8e310 2024-09-11T11:02:25.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad00be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad00be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53494/0 (socket says 172.21.15.145:53494) 2024-09-11T11:02:25.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fc81d640 1 -- 172.21.15.145:0/1407683666 learned_addr learned my addr 172.21.15.145:0/1407683666 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fc81d640 1 -- 172.21.15.145:0/1407683666 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aad00c360 con 0x563aace8e310 2024-09-11T11:02:25.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad00be20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0aa500 tx=0x7fe6ec017d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe5e960a640 1 -- 172.21.15.145:0/1407683666 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0b58f0 con 0x563aace8e310 2024-09-11T11:02:25.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563aad00c5f0 con 0x563aace8e310 2024-09-11T11:02:25.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe5e960a640 1 -- 172.21.15.145:0/1407683666 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0c6070 con 0x563aace8e310 2024-09-11T11:02:25.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe5e960a640 1 -- 172.21.15.145:0/1407683666 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0b5be0 con 0x563aace8e310 2024-09-11T11:02:25.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.950+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aad00f2d0 con 0x563aace8e310 2024-09-11T11:02:25.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe5e960a640 1 -- 172.21.15.145:0/1407683666 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe6ec0cb460 con 0x563aace8e310 2024-09-11T11:02:25.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe5e960a640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5e4034650 0x7fe5e4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe5e960a640 1 -- 172.21.15.145:0/1407683666 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fe6ec0bb070 con 0x563aace8e310 2024-09-11T11:02:25.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5e4034650 0x7fe5e4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aacf1c8e0 0x563aad012f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad013460 con 0x563aacf1c8e0 2024-09-11T11:02:25.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fd01e640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aacf1c8e0 0x563aad012f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5e4034650 0x7fe5e4036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000f70 tx=0x7fe6f00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fd01e640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aacf1c8e0 0x563aad012f20 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fd01e640 1 -- 172.21.15.145:0/1407683666 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aacf1c8e0 2024-09-11T11:02:25.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad014210 0x563aad016600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad016c40 con 0x563aad014210 2024-09-11T11:02:25.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad014210 0x563aad016600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad014210 0x563aad016600 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fc81d640 1 -- 172.21.15.145:0/1407683666 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad014210 2024-09-11T11:02:25.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.954+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad0184f0 con 0x563aad014210 2024-09-11T11:02:25.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc81d640 1 -- 172.21.15.145:0/1407683666 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad014210 2024-09-11T11:02:25.958 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad017720 con 0x563aad014210 2024-09-11T11:02:25.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc81d640 1 -- 172.21.15.145:0/1407683666 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad014210 2024-09-11T11:02:25.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563aad0198a0 0x563aad01bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad01c1d0 con 0x563aad0198a0 2024-09-11T11:02:25.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563aad0198a0 0x563aad01bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563aad0198a0 0x563aad01bc90 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc01c640 1 -- 172.21.15.145:0/1407683666 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad0198a0 2024-09-11T11:02:25.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 Processor -- start 2024-09-11T11:02:25.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 -- start start 2024-09-11T11:02:25.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad029b80 0x563aad029fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563aace20800 con 0x563aad029b80 2024-09-11T11:02:25.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad029b80 0x563aad029fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad029b80 0x563aad029fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53500/0 (socket says 172.21.15.145:53500) 2024-09-11T11:02:25.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3570268248 learned_addr learned my addr 172.21.15.145:0/3570268248 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3570268248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aad02a4e0 con 0x563aad029b80 2024-09-11T11:02:25.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/3570268248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad029b80 0x563aad029fa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0d4da0 tx=0x7fe6ec0cde00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe5e27fc640 1 -- 172.21.15.145:0/3570268248 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0d0040 con 0x563aad029b80 2024-09-11T11:02:25.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3570268248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563aad02a710 con 0x563aad029b80 2024-09-11T11:02:25.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe5e27fc640 1 -- 172.21.15.145:0/3570268248 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0e9070 con 0x563aad029b80 2024-09-11T11:02:25.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe5e27fc640 1 -- 172.21.15.145:0/3570268248 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0052b0 con 0x563aad029b80 2024-09-11T11:02:25.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.958+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3570268248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aad02d330 con 0x563aad029b80 2024-09-11T11:02:25.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe5e27fc640 1 -- 172.21.15.145:0/3570268248 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe6ec0eb020 con 0x563aad029b80 2024-09-11T11:02:25.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe5e27fc640 1 --2- 172.21.15.145:0/3570268248 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5d4034650 0x7fe5d4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe5e27fc640 1 -- 172.21.15.145:0/3570268248 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fe6ec0e70e0 con 0x563aad029b80 2024-09-11T11:02:25.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/3570268248 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5d4034650 0x7fe5d4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 Processor -- start 2024-09-11T11:02:25.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- start start 2024-09-11T11:02:25.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/3570268248 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5d4034650 0x7fe5d4036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000bf60 tx=0x7fe6f000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad036560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563aad0053e0 con 0x563aad036180 2024-09-11T11:02:25.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad036560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad036560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53504/0 (socket says 172.21.15.145:53504) 2024-09-11T11:02:25.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3930572629 learned_addr learned my addr 172.21.15.145:0/3930572629 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3930572629 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aad036b30 con 0x563aad036180 2024-09-11T11:02:25.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/3930572629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad036560 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0e26d0 tx=0x7fe6ec0b6420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba6c7ce9678831b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe5d3fff640 1 -- 172.21.15.145:0/3930572629 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0bf5b0 con 0x563aad036180 2024-09-11T11:02:25.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe5d3fff640 1 -- 172.21.15.145:0/3930572629 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0fb070 con 0x563aad036180 2024-09-11T11:02:25.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe5d3fff640 1 -- 172.21.15.145:0/3930572629 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0e55f0 con 0x563aad036180 2024-09-11T11:02:25.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3930572629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 msgr2=0x563aad036560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:25.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3930572629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad036560 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0e26d0 tx=0x7fe6ec0b6420 comp rx=0 tx=0).stop 2024-09-11T11:02:25.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3930572629 shutdown_connections 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3930572629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad036560 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3930572629 >> 172.21.15.145:0/3930572629 conn(0x563aad032560 msgr2=0x563aad030660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3930572629 shutdown_connections 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3930572629 wait complete. 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 Processor -- start 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- start start 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad03d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.962+0000 7fe6fed0d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x563aad036fd0 con 0x563aad036180 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad03d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fc81d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad03d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53518/0 (socket says 172.21.15.145:53518) 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 learned_addr learned my addr 172.21.15.145:0/3606183255 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:25.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563aad03d8a0 con 0x563aad036180 2024-09-11T11:02:25.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad03d360 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0b6460 tx=0x7fe6ec0c7f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe5d27fc640 1 -- 172.21.15.145:0/3606183255 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec110020 con 0x563aad036180 2024-09-11T11:02:25.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe5d27fc640 1 -- 172.21.15.145:0/3606183255 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec0e5c90 con 0x563aad036180 2024-09-11T11:02:25.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563aad03d8a0 con 0x563aad036180 2024-09-11T11:02:25.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe5d27fc640 1 -- 172.21.15.145:0/3606183255 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe6ec0e8be0 con 0x563aad036180 2024-09-11T11:02:25.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563aad03d8a0 con 0x563aad036180 2024-09-11T11:02:25.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe5d27fc640 1 -- 172.21.15.145:0/3606183255 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe6ec113020 con 0x563aad036180 2024-09-11T11:02:25.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe5d27fc640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5c8034650 0x7fe5c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe5d27fc640 1 -- 172.21.15.145:0/3606183255 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fe6ec108040 con 0x563aad036180 2024-09-11T11:02:25.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aad048410 0x563aad04a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad04b020 con 0x563aad048410 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fd01e640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aad048410 0x563aad04a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fd01e640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aad048410 0x563aad04a8d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 20 realm 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad047840 con 0x563aad048410 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad04bae0 con 0x563aad048410 2024-09-11T11:02:25.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad04c8c0 0x563aad04ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.966+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad04c8c0 0x563aad04ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad04c8c0 0x563aad04ecb0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fed0d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad04fb90 con 0x563aad04c8c0 2024-09-11T11:02:25.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fed0d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fed0d980 20 searching for the correct realm 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563aad051410 0x563aad0538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad053fa0 con 0x563aad051410 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563aad051410 0x563aad0538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563aad051410 0x563aad0538d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad053fa0 con 0x563aad04c8c0 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc81d640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe6ec115020 0x7fe6ec0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x7fe6ec115020 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.970+0000 7fe6fd01e640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe6ec115020 0x7fe6ec0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe6ec115020 0x7fe6ec0a5a40 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:25.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad051410 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x7fe6ec115020 2024-09-11T11:02:25.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x7fe6ec115020 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.974+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad051410 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad051410 2024-09-11T11:02:25.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad051410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x7fe6ec115020 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad048410 2024-09-11T11:02:25.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x7fe6ec115020 2024-09-11T11:02:25.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad051410 2024-09-11T11:02:25.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.978+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x7fe6ec115020 2024-09-11T11:02:25.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad051410 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f340 con 0x563aad04c8c0 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:25.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad04f860 con 0x563aad048410 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad04fc50 con 0x563aad04c8c0 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.982+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad04fc50 con 0x7fe6ec115020 2024-09-11T11:02:25.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 zone default found 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 4 Realm: () 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 zonegroup default 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad054420 con 0x7fe6ec115020 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad050190 con 0x563aad051410 2024-09-11T11:02:25.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:25.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad056770 con 0x563aad051410 2024-09-11T11:02:25.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:25.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 started sync module instance, tier type = 2024-09-11T11:02:25.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:25.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad055ae0 con 0x563aad04c8c0 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94810010902528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad055ae0 con 0x563aad04c8c0 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.986+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad0571f0 con 0x563aad048410 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94810010905920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad057160 con 0x563aad048410 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad058130 con 0x563aad04c8c0 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94810010902528] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94810010905920] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:25.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94810010908128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad0580f0 con 0x563aad04c8c0 2024-09-11T11:02:25.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad0589d0 con 0x7fe6ec115020 2024-09-11T11:02:25.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94810010912032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad0580f0 con 0x7fe6ec115020 2024-09-11T11:02:25.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.990+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad059440 con 0x563aad04c8c0 2024-09-11T11:02:25.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94810010912032] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94810010908128] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94810010909696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad058f90 con 0x563aad04c8c0 2024-09-11T11:02:25.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad059820 con 0x563aad051410 2024-09-11T11:02:25.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94810010914976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad05a0c0 con 0x563aad051410 2024-09-11T11:02:25.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad05aa80 con 0x563aad051410 2024-09-11T11:02:25.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94810010909696] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:25.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94810010914976] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94810010920400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad05ae70 con 0x563aad051410 2024-09-11T11:02:25.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.994+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad05b6c0 con 0x7fe6ec115020 2024-09-11T11:02:25.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94810010920400] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:25.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:25.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94810010922608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad05bab0 con 0x7fe6ec115020 2024-09-11T11:02:25.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 20 add_watcher() i=0 2024-09-11T11:02:25.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 20 add_watcher() i=1 2024-09-11T11:02:26.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 20 add_watcher() i=2 2024-09-11T11:02:26.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 20 add_watcher() i=3 2024-09-11T11:02:26.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 20 add_watcher() i=4 2024-09-11T11:02:26.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 20 add_watcher() i=5 2024-09-11T11:02:26.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 20 add_watcher() i=6 2024-09-11T11:02:26.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94810010922608] v34'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:26.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 20 add_watcher() i=7 2024-09-11T11:02:26.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:26.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad05eb50 con 0x563aad048410 2024-09-11T11:02:26.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:26.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:25.998+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94810010923664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad05bef0 con 0x563aad048410 2024-09-11T11:02:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94810010923664] v34'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe5b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 5 note: GC not initialized 2024-09-11T11:02:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe5b27e4640 20 reqs_thread_entry: start 2024-09-11T11:02:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:26.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 20 Filter name: none 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe5ab7fe640 20 reqs_thread_entry: start 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad0822d0 con 0x7fe6ec115020 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad080a70 con 0x563aad048410 2024-09-11T11:02:26.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:26.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-11T11:02:26.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-11T11:02:26.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-11T11:02:26.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-11T11:02:26.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.002+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad081340 con 0x7fe6ec115020 2024-09-11T11:02:26.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v34'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:26.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-11T11:02:26.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-11T11:02:26.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94810011078288 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad085d70 con 0x7fe6ec115020 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== watch-notify(notify (1) cookie 94810010922608 notify 146028888082 ret 0) ==== 598+0+0 (crc 0 0 0) 0x563aad0816e0 con 0x7fe6ec115020 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94810010922608 notifier 4731 bl.length()=556 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(65 notify.7 [notify cookie 94810011078288 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5d3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5d3fff640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5c0003eb0 con 0x7fe6ec115020 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== watch-notify(notify_complete (2) cookie 94810011078288 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563aad081d20 con 0x7fe6ec115020 2024-09-11T11:02:26.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad080e40 con 0x563aad048410 2024-09-11T11:02:26.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94810011093168 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x563aad080e40 con 0x563aad051410 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== watch-notify(notify (1) cookie 94810010914976 notify 146028888078 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fe6f0032040 con 0x563aad051410 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888078 cookie 94810010914976 notifier 4731 bl.length()=177 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5d3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(68 notify.5 [notify cookie 94810011093168 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5d3fff640 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fe5c0003eb0 con 0x563aad051410 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:26.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== watch-notify(notify_complete (2) cookie 94810011093168 notify 146028888078 ret 0) ==== 42+0+48 (crc 0 0 0) 0x563aacda1ae0 con 0x563aad051410 2024-09-11T11:02:26.011 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-11T11:02:26.005574Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:02:26.005563Z","tags":[],"group_ids":[]} 2024-09-11T11:02:26.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe5b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:26.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.006+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94810010923664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad080070 con 0x563aad048410 2024-09-11T11:02:26.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.010+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94810010923664] v34'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:26.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.010+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94810010902528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad080070 con 0x563aad04c8c0 2024-09-11T11:02:26.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.010+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94810010902528] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:26.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.010+0000 7fe6fed0d980 20 remove_watcher() i=0 2024-09-11T11:02:26.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.010+0000 7fe6fed0d980 2 removed watcher, disabling cache 2024-09-11T11:02:26.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.010+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94810010905920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad056000 con 0x563aad048410 2024-09-11T11:02:26.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.014+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94810010905920] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x563aad048410 2024-09-11T11:02:26.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.014+0000 7fe6fed0d980 20 remove_watcher() i=1 2024-09-11T11:02:26.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.014+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94810010908128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad080070 con 0x563aad04c8c0 2024-09-11T11:02:26.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.014+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94810010908128] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:26.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.014+0000 7fe6fed0d980 20 remove_watcher() i=2 2024-09-11T11:02:26.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.014+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94810010912032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad056d40 con 0x7fe6ec115020 2024-09-11T11:02:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.014+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94810010912032] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fed0d980 20 remove_watcher() i=3 2024-09-11T11:02:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94810010909696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad056000 con 0x563aad04c8c0 2024-09-11T11:02:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5c8034650 0x7fe5c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fc01c640 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5c8034650 0x7fe5c8036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x563aad0566d0 tx=0x7fe6f003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.020 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fc81d640 1 -- 172.21.15.145:0/3606183255 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94810010909696] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6ec0b2040 con 0x563aad04c8c0 2024-09-11T11:02:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fed0d980 20 remove_watcher() i=4 2024-09-11T11:02:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94810010914976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad080070 con 0x563aad051410 2024-09-11T11:02:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94810010914976] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:26.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fed0d980 20 remove_watcher() i=5 2024-09-11T11:02:26.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.018+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94810010920400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad058520 con 0x563aad051410 2024-09-11T11:02:26.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fc01c640 1 -- 172.21.15.145:0/3606183255 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94810010920400] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f000e620 con 0x563aad051410 2024-09-11T11:02:26.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 20 remove_watcher() i=6 2024-09-11T11:02:26.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94810010922608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x563aad056d40 con 0x7fe6ec115020 2024-09-11T11:02:26.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94810010922608] v34'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe6f40083f0 con 0x7fe6ec115020 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 20 remove_watcher() i=7 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad04c8c0 msgr2=0x563aad04ecb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad04c8c0 0x563aad04ecb0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aad048410 msgr2=0x563aad04a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aad048410 0x563aad04a8d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe6ec115020 msgr2=0x7fe6ec0a5a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe6ec115020 0x7fe6ec0a5a40 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563aad051410 msgr2=0x563aad0538d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x563aad051410 0x563aad0538d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5c8034650 msgr2=0x7fe5c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5c8034650 0x7fe5c8036b10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x563aad0566d0 tx=0x7fe6f003b040 comp rx=0 tx=0).stop 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 msgr2=0x563aad03d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fd01e640 1 -- 172.21.15.145:0/3606183255 reap_dead start 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad03d360 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0b6460 tx=0x7fe6ec0c7f10 comp rx=0 tx=0).stop 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 shutdown_connections 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3606183255 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad036180 0x563aad03d360 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 >> 172.21.15.145:0/3606183255 conn(0x563aad032560 msgr2=0x563aad030630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 shutdown_connections 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3606183255 wait complete. 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3570268248 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5d4034650 msgr2=0x7fe5d4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3570268248 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5d4034650 0x7fe5d4036b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000bf60 tx=0x7fe6f000f000 comp rx=0 tx=0).stop 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3570268248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad029b80 msgr2=0x563aad029fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3570268248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad029b80 0x563aad029fa0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0d4da0 tx=0x7fe6ec0cde00 comp rx=0 tx=0).stop 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3570268248 shutdown_connections 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3570268248 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5d4034650 0x7fe5d4036b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/3570268248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aad029b80 0x563aad029fa0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3570268248 >> 172.21.15.145:0/3570268248 conn(0x563aad01ec80 msgr2=0x563aad021750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3570268248 shutdown_connections 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/3570268248 wait complete. 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad014210 msgr2=0x563aad016600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x563aad014210 0x563aad016600 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aacf1c8e0 msgr2=0x563aad012f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x563aacf1c8e0 0x563aad012f20 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563aad0198a0 msgr2=0x563aad01bc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x563aad0198a0 0x563aad01bc90 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5e4034650 msgr2=0x7fe5e4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe5e4034650 0x7fe5e4036b10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0000f70 tx=0x7fe6f00012c0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 msgr2=0x563aad00be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 --2- 172.21.15.145:0/1407683666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x563aace8e310 0x563aad00be20 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec0aa500 tx=0x7fe6ec017d70 comp rx=0 tx=0).stop 2024-09-11T11:02:26.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fd01e640 1 -- 172.21.15.145:0/1407683666 reap_dead start 2024-09-11T11:02:26.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 shutdown_connections 2024-09-11T11:02:26.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 >> 172.21.15.145:0/1407683666 conn(0x563aacf140d0 msgr2=0x563aacfff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 shutdown_connections 2024-09-11T11:02:26.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.022+0000 7fe6fed0d980 1 -- 172.21.15.145:0/1407683666 wait complete. 2024-09-11T11:02:26.034 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-11T11:02:26.005574Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:02:26.005563Z', 'tags': [], 'group_ids': []} 2024-09-11T11:02:26.050 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:02:26.055 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-11T11:02:26.055 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-11T11:02:26.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-11T11:02:26.056 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-11T11:02:26.109 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:26.109 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:26.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.106+0000 7fca9aa97980 1 Processor -- start 2024-09-11T11:02:26.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca9aa97980 1 -- start start 2024-09-11T11:02:26.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca9aa97980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55c6b79c4920 0x55c6b79c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca9aa97980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c6b7849ae0 con 0x55c6b79c0550 2024-09-11T11:02:26.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca9aa97980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55c6b786de30 con 0x55c6b79c4920 2024-09-11T11:02:26.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca97da6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55c6b79c4920 0x55c6b79c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca97da6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55c6b79c4920 0x55c6b79c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53528/0 (socket says 172.21.15.145:53528) 2024-09-11T11:02:26.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca97da6640 1 -- 172.21.15.145:0/1943355588 learned_addr learned my addr 172.21.15.145:0/1943355588 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:26.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca985a7640 1 --1- 172.21.15.145:0/1943355588 >> v1:172.21.15.102:6789/0 conn(0x55c6b79c0550 0x55c6b79c0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:33262/0 (socket says 172.21.15.145:33262) 2024-09-11T11:02:26.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca97da6640 1 -- 172.21.15.145:0/1943355588 >> v1:172.21.15.102:6789/0 conn(0x55c6b79c0550 legacy=0x55c6b79c0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca97da6640 1 -- 172.21.15.145:0/1943355588 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b79c8260 con 0x55c6b79c4920 2024-09-11T11:02:26.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca97da6640 1 --2- 172.21.15.145:0/1943355588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c4920 0x55c6b79c6d10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fca8800a4e0 tx=0x7fca8801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e29abae4ae6af01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca975a5640 1 -- 172.21.15.145:0/1943355588 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca880aa540 con 0x55c6b79c4920 2024-09-11T11:02:26.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca975a5640 1 -- 172.21.15.145:0/1943355588 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca880aa6e0 con 0x55c6b79c4920 2024-09-11T11:02:26.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.110+0000 7fca975a5640 1 -- 172.21.15.145:0/1943355588 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca880aaa40 con 0x55c6b79c4920 2024-09-11T11:02:26.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.114+0000 7fca9aa97980 1 -- 172.21.15.145:0/1943355588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c4920 msgr2=0x55c6b79c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.114+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1943355588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c4920 0x55c6b79c6d10 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fca8800a4e0 tx=0x7fca8801b090 comp rx=0 tx=0).stop 2024-09-11T11:02:26.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.114+0000 7fca9aa97980 1 -- 172.21.15.145:0/1943355588 shutdown_connections 2024-09-11T11:02:26.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.114+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1943355588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c4920 0x55c6b79c6d10 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.114+0000 7fca9aa97980 1 -- 172.21.15.145:0/1943355588 >> 172.21.15.145:0/1943355588 conn(0x55c6b79bc070 msgr2=0x55c6b79be490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.114+0000 7fca9aa97980 1 -- 172.21.15.145:0/1943355588 shutdown_connections 2024-09-11T11:02:26.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.114+0000 7fca9aa97980 1 -- 172.21.15.145:0/1943355588 wait complete. 2024-09-11T11:02:26.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 Processor -- start 2024-09-11T11:02:26.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- start start 2024-09-11T11:02:26.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b79353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c6b786f200 con 0x55c6b79c0550 2024-09-11T11:02:26.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b79353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b79353f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53544/0 (socket says 172.21.15.145:53544) 2024-09-11T11:02:26.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca985a7640 1 -- 172.21.15.145:0/1929728179 learned_addr learned my addr 172.21.15.145:0/1929728179 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:26.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca985a7640 1 -- 172.21.15.145:0/1929728179 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b79359c0 con 0x55c6b79c0550 2024-09-11T11:02:26.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca985a7640 1 --2- 172.21.15.145:0/1929728179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b79353f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fca90001e50 tx=0x7fca90001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b1263df3c81a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fc98660c640 1 -- 172.21.15.145:0/1929728179 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9000e5d0 con 0x55c6b79c0550 2024-09-11T11:02:26.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fc98660c640 1 -- 172.21.15.145:0/1929728179 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9000e770 con 0x55c6b79c0550 2024-09-11T11:02:26.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fc98660c640 1 -- 172.21.15.145:0/1929728179 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9000eab0 con 0x55c6b79c0550 2024-09-11T11:02:26.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- 172.21.15.145:0/1929728179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 msgr2=0x55c6b79353f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1929728179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b79353f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fca90001e50 tx=0x7fca90001e80 comp rx=0 tx=0).stop 2024-09-11T11:02:26.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- 172.21.15.145:0/1929728179 shutdown_connections 2024-09-11T11:02:26.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1929728179 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b79353f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- 172.21.15.145:0/1929728179 >> 172.21.15.145:0/1929728179 conn(0x55c6b79bc070 msgr2=0x55c6b7aa75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- 172.21.15.145:0/1929728179 shutdown_connections 2024-09-11T11:02:26.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- 172.21.15.145:0/1929728179 wait complete. 2024-09-11T11:02:26.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 Processor -- start 2024-09-11T11:02:26.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- start start 2024-09-11T11:02:26.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b7ab3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.126+0000 7fca9aa97980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c6b79c7d60 con 0x55c6b79c0550 2024-09-11T11:02:26.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b7ab3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b7ab3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53552/0 (socket says 172.21.15.145:53552) 2024-09-11T11:02:26.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca985a7640 1 -- 172.21.15.145:0/1902834874 learned_addr learned my addr 172.21.15.145:0/1902834874 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:26.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca985a7640 1 -- 172.21.15.145:0/1902834874 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b7ab4340 con 0x55c6b79c0550 2024-09-11T11:02:26.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca985a7640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b7ab3e00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x55c6b7aadc70 tx=0x7fca90000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fc984e09640 1 -- 172.21.15.145:0/1902834874 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca90001260 con 0x55c6b79c0550 2024-09-11T11:02:26.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fc984e09640 1 -- 172.21.15.145:0/1902834874 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9000fa40 con 0x55c6b79c0550 2024-09-11T11:02:26.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fc984e09640 1 -- 172.21.15.145:0/1902834874 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9000fd80 con 0x55c6b79c0550 2024-09-11T11:02:26.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6b7ab45d0 con 0x55c6b79c0550 2024-09-11T11:02:26.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6b7ab72b0 con 0x55c6b79c0550 2024-09-11T11:02:26.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fc984e09640 1 -- 172.21.15.145:0/1902834874 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fca90017070 con 0x55c6b79c0550 2024-09-11T11:02:26.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fc984e09640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc980034650 0x7fc980036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fc984e09640 1 -- 172.21.15.145:0/1902834874 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fca90015020 con 0x55c6b79c0550 2024-09-11T11:02:26.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca97da6640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc980034650 0x7fc980036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b79c4920 0x55c6b7abadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7abb460 con 0x55c6b79c4920 2024-09-11T11:02:26.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca98da8640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b79c4920 0x55c6b7abadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca97da6640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc980034650 0x7fc980036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fca880ab000 tx=0x7fca880a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca98da8640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b79c4920 0x55c6b7abadf0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca98da8640 1 -- 172.21.15.145:0/1902834874 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b79c4920 2024-09-11T11:02:26.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7abc230 0x55c6b7abe620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.130+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7abec60 con 0x55c6b7abc230 2024-09-11T11:02:26.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca985a7640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7abc230 0x55c6b7abe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca985a7640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7abc230 0x55c6b7abe620 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca985a7640 1 -- 172.21.15.145:0/1902834874 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca9002e070 con 0x55c6b7abc230 2024-09-11T11:02:26.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7ac0510 con 0x55c6b7abc230 2024-09-11T11:02:26.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca985a7640 1 -- 172.21.15.145:0/1902834874 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca9002e070 con 0x55c6b7abc230 2024-09-11T11:02:26.136 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7abf680 con 0x55c6b7abc230 2024-09-11T11:02:26.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca985a7640 1 -- 172.21.15.145:0/1902834874 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca9002e070 con 0x55c6b7abc230 2024-09-11T11:02:26.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c6b7ac18c0 0x55c6b7ac3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7ac41f0 con 0x55c6b7ac18c0 2024-09-11T11:02:26.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca97da6640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c6b7ac18c0 0x55c6b7ac3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.134+0000 7fca97da6640 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c6b7ac18c0 0x55c6b7ac3cb0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca97da6640 1 -- 172.21.15.145:0/1902834874 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca880bc040 con 0x55c6b7ac18c0 2024-09-11T11:02:26.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca9aa97980 1 Processor -- start 2024-09-11T11:02:26.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca9aa97980 1 -- start start 2024-09-11T11:02:26.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca9aa97980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ad1be0 0x55c6b7ad2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca9aa97980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c6b78c8800 con 0x55c6b7ad1be0 2024-09-11T11:02:26.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ad1be0 0x55c6b7ad2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ad1be0 0x55c6b7ad2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53560/0 (socket says 172.21.15.145:53560) 2024-09-11T11:02:26.139 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca985a7640 1 -- 172.21.15.145:0/1543258251 learned_addr learned my addr 172.21.15.145:0/1543258251 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:26.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca985a7640 1 -- 172.21.15.145:0/1543258251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b7ad2560 con 0x55c6b7ad1be0 2024-09-11T11:02:26.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca985a7640 1 --2- 172.21.15.145:0/1543258251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ad1be0 0x55c6b7ad2020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fca9004ab70 tx=0x7fca90017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fc97dffb640 1 -- 172.21.15.145:0/1543258251 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca90042160 con 0x55c6b7ad1be0 2024-09-11T11:02:26.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca9aa97980 1 -- 172.21.15.145:0/1543258251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6b7ad5190 con 0x55c6b7ad1be0 2024-09-11T11:02:26.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fc97dffb640 1 -- 172.21.15.145:0/1543258251 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca90042300 con 0x55c6b7ad1be0 2024-09-11T11:02:26.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fc97dffb640 1 -- 172.21.15.145:0/1543258251 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9004ad10 con 0x55c6b7ad1be0 2024-09-11T11:02:26.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca9aa97980 1 -- 172.21.15.145:0/1543258251 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6b7ad5540 con 0x55c6b7ad1be0 2024-09-11T11:02:26.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fc97dffb640 1 -- 172.21.15.145:0/1543258251 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fca90042510 con 0x55c6b7ad1be0 2024-09-11T11:02:26.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fc97dffb640 1 --2- 172.21.15.145:0/1543258251 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc970034650 0x7fc970036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fc97dffb640 1 -- 172.21.15.145:0/1543258251 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fca90032bc0 con 0x55c6b7ad1be0 2024-09-11T11:02:26.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca97da6640 1 --2- 172.21.15.145:0/1543258251 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc970034650 0x7fc970036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca9aa97980 1 Processor -- start 2024-09-11T11:02:26.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.138+0000 7fca9aa97980 1 -- start start 2024-09-11T11:02:26.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca97da6640 1 --2- 172.21.15.145:0/1543258251 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc970034650 0x7fc970036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55c6b7ab83f0 tx=0x7fca88005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ade6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c6b7935d40 con 0x55c6b7ade300 2024-09-11T11:02:26.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ade6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ade6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53562/0 (socket says 172.21.15.145:53562) 2024-09-11T11:02:26.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 -- 172.21.15.145:0/952122378 learned_addr learned my addr 172.21.15.145:0/952122378 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:26.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 -- 172.21.15.145:0/952122378 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b7adecb0 con 0x55c6b7ade300 2024-09-11T11:02:26.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 --2- 172.21.15.145:0/952122378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ade6e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fca90047c60 tx=0x7fca90019e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0f914f1fdd22df server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fc9777fe640 1 -- 172.21.15.145:0/952122378 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca90047200 con 0x55c6b7ade300 2024-09-11T11:02:26.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fc9777fe640 1 -- 172.21.15.145:0/952122378 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca900460c0 con 0x55c6b7ade300 2024-09-11T11:02:26.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fc9777fe640 1 -- 172.21.15.145:0/952122378 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9001db00 con 0x55c6b7ade300 2024-09-11T11:02:26.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 -- 172.21.15.145:0/952122378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 msgr2=0x55c6b7ade6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 --2- 172.21.15.145:0/952122378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ade6e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fca90047c60 tx=0x7fca90019e90 comp rx=0 tx=0).stop 2024-09-11T11:02:26.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 -- 172.21.15.145:0/952122378 shutdown_connections 2024-09-11T11:02:26.145 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 --2- 172.21.15.145:0/952122378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ade6e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 -- 172.21.15.145:0/952122378 >> 172.21.15.145:0/952122378 conn(0x55c6b7ada6e0 msgr2=0x55c6b7ad87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 -- 172.21.15.145:0/952122378 shutdown_connections 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 -- 172.21.15.145:0/952122378 wait complete. 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 Processor -- start 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 -- start start 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ae54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca9aa97980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c6b7adf150 con 0x55c6b7ade300 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ae54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ae54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:53564/0 (socket says 172.21.15.145:53564) 2024-09-11T11:02:26.146 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 learned_addr learned my addr 172.21.15.145:0/1329972503 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:26.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.142+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6b7ae5a00 con 0x55c6b7ade300 2024-09-11T11:02:26.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca985a7640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ae54c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fca90047010 tx=0x7fca90035510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fc975ffb640 1 -- 172.21.15.145:0/1329972503 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9006d070 con 0x55c6b7ade300 2024-09-11T11:02:26.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fc975ffb640 1 -- 172.21.15.145:0/1329972503 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca90047580 con 0x55c6b7ade300 2024-09-11T11:02:26.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c6b7ae5a00 con 0x55c6b7ade300 2024-09-11T11:02:26.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fc975ffb640 1 -- 172.21.15.145:0/1329972503 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca9003f810 con 0x55c6b7ade300 2024-09-11T11:02:26.148 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6b7ae5e70 con 0x55c6b7ade300 2024-09-11T11:02:26.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fc975ffb640 1 -- 172.21.15.145:0/1329972503 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fca90070070 con 0x55c6b7ade300 2024-09-11T11:02:26.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fc975ffb640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc9680346a0 0x7fc968036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fc975ffb640 1 -- 172.21.15.145:0/1329972503 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fca90065070 con 0x55c6b7ade300 2024-09-11T11:02:26.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca97da6640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc9680346a0 0x7fc968036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b7af0600 0x55c6b7af2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af3210 con 0x55c6b7af0600 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca98da8640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b7af0600 0x55c6b7af2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca97da6640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc9680346a0 0x7fc968036b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fca8801b0d0 tx=0x7fca880a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca98da8640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b7af0600 0x55c6b7af2ac0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 20 realm 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7aefab0 con 0x55c6b7af0600 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:26.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af3ce0 con 0x55c6b7af0600 2024-09-11T11:02:26.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7af4ac0 0x55c6b7af6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.146+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7530 con 0x55c6b7af4ac0 2024-09-11T11:02:26.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca985a7640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7af4ac0 0x55c6b7af6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca985a7640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7af4ac0 0x55c6b7af6eb0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca9aa97980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca9aa97980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca9aa97980 20 searching for the correct realm 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c6b7af9b40 0x55c6b7afbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7afc5b0 con 0x55c6b7af9b40 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca97da6640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c6b7af9b40 0x55c6b7afbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca97da6640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c6b7af9b40 0x55c6b7afbf30 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7afc5b0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca985a7640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fca90072060 0x7fca90034930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x7fca90072060 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca98da8640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fca90072060 0x7fca90034930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.150+0000 7fca98da8640 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fca90072060 0x7fca90034930 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af9b40 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.157 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.158 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x7fca90072060 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x7fca90072060 2024-09-11T11:02:26.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.154+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af9b40 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af9b40 2024-09-11T11:02:26.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af9b40 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x7fca90072060 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af0600 2024-09-11T11:02:26.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x7fca90072060 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af9b40 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x7fca90072060 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.158+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af9b40 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af7dd0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af8620 con 0x55c6b7af0600 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af8a10 con 0x55c6b7af4ac0 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7af8a10 con 0x7fca90072060 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 zone default found 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 4 Realm: () 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 zonegroup default 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7afca30 con 0x7fca90072060 2024-09-11T11:02:26.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.162+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7afe840 con 0x55c6b7af9b40 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7afed10 con 0x55c6b7af9b40 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 20 started sync module instance, tier type = 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:26.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7afdc50 con 0x55c6b7af4ac0 2024-09-11T11:02:26.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94311973642576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7afdc50 con 0x55c6b7af4ac0 2024-09-11T11:02:26.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7aff790 con 0x55c6b7af0600 2024-09-11T11:02:26.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94311973647072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7aff700 con 0x55c6b7af0600 2024-09-11T11:02:26.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.166+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b006f0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94311973642576] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94311973647072] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94311973649280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b006f0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b00f90 con 0x7fca90072060 2024-09-11T11:02:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94311973653216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b006f0 con 0x7fca90072060 2024-09-11T11:02:26.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b01a50 con 0x55c6b7af4ac0 2024-09-11T11:02:26.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94311973649280] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.170+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94311973653216] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94311973654272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b01a10 con 0x55c6b7af4ac0 2024-09-11T11:02:26.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b01e40 con 0x55c6b7af9b40 2024-09-11T11:02:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94311973640096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b026e0 con 0x55c6b7af9b40 2024-09-11T11:02:26.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b030a0 con 0x55c6b7af9b40 2024-09-11T11:02:26.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94311973654272] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94311973640096] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94311973661680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b03490 con 0x55c6b7af9b40 2024-09-11T11:02:26.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.174+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b03d60 con 0x7fca90072060 2024-09-11T11:02:26.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94311973664816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b04600 con 0x7fca90072060 2024-09-11T11:02:26.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 add_watcher() i=0 2024-09-11T11:02:26.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 add_watcher() i=1 2024-09-11T11:02:26.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 add_watcher() i=2 2024-09-11T11:02:26.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 add_watcher() i=3 2024-09-11T11:02:26.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 add_watcher() i=4 2024-09-11T11:02:26.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 add_watcher() i=5 2024-09-11T11:02:26.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94311973661680] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 add_watcher() i=6 2024-09-11T11:02:26.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94311973664816] v34'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 add_watcher() i=7 2024-09-11T11:02:26.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:26.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b04600 con 0x55c6b7af0600 2024-09-11T11:02:26.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94311973667072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b04520 con 0x55c6b7af0600 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94311973667072] v34'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fc94e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.178+0000 7fca9aa97980 5 note: GC not initialized 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fc94d7e2640 20 reqs_thread_entry: start 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 20 Filter name: none 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fc8beffd640 20 reqs_thread_entry: start 2024-09-11T11:02:26.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-11T11:02:26.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2abd0 con 0x7fca90072060 2024-09-11T11:02:26.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:02:26.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-11T11:02:26.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-11T11:02:26.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:02:26.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2ed90 con 0x7fca90072060 2024-09-11T11:02:26.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v34'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-11T11:02:26.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-11T11:02:26.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-11T11:02:26.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94311973837664 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f9c0 con 0x55c6b7af9b40 2024-09-11T11:02:26.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== watch-notify(notify (1) cookie 94311973640096 notify 146028888079 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55c6b79c8260 con 0x55c6b7af9b40 2024-09-11T11:02:26.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fc9777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888079 cookie 94311973640096 notifier 4738 bl.length()=382 2024-09-11T11:02:26.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fc9777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fc9777fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(64 notify.5 [notify cookie 94311973837664 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fc9777fe640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc95c003eb0 con 0x55c6b7af9b40 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== watch-notify(notify_complete (2) cookie 94311973837664 notify 146028888079 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca880b57f0 con 0x55c6b7af9b40 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f8c0 con 0x55c6b7af0600 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 : miss 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 20 rados->read ofs=0 len=0 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 8.1a 8:5a37c305:root::.bucket.meta.myfoo6%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2d290 con 0x55c6b7af9b40 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(67 .bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:02:26.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 info.flags=0x17 2024-09-11T11:02:26.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 to cache LRU end 2024-09-11T11:02:26.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:02:26.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:02:26.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 2024-09-11T11:02:26.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.182+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 8.1a 8:5a37c305:root::.bucket.meta.myfoo6%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b36b50 con 0x55c6b7af9b40 2024-09-11T11:02:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(68 .bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 info.flags=0x17 2024-09-11T11:02:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 to cache LRU end 2024-09-11T11:02:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-11T11:02:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9, ofs0, ns] 2024-09-11T11:02:26.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.9 7:93e5b521:::notify.7:head [notify cookie 94311973837024 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b35840 con 0x7fca90072060 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== watch-notify(notify (1) cookie 94311973664816 notify 146028888085 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fca80029480 con 0x7fca90072060 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fc976ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 94311973664816 notifier 4738 bl.length()=748 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fc976ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 info.flags=0x17 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fc976ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 to cache LRU end 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fc976ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(69 notify.7 [notify cookie 94311973837024 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fc976ffd640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8cc003540 con 0x7fca90072060 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(70 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== watch-notify(notify_complete (2) cookie 94311973837024 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca80029650 con 0x7fca90072060 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 20 handle_bi_update(): bucket=:myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]): orig_sources= new_sources= 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 20 handle_bi_update(): bucket=:myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]): potential sources added=[] removed=[] 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 20 handle_bi_update(): bucket=:myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]): orig_dests= new_dests= 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 20 handle_bi_update(): bucket=:myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]): potential dests added=[] removed=[] 2024-09-11T11:02:26.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2d8e0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(71 bud.buckets [call] v34'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.186+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2d8e0 con 0x55c6b7af4ac0 2024-09-11T11:02:26.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(72 bud.buckets [call] v34'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2d8e0 con 0x55c6b7af0600 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v34'19 uv19 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca9aa97980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca9aa97980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca9aa97980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94311973837024 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2ffe0 con 0x7fca90072060 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== watch-notify(notify (1) cookie 94311973653216 notify 146028888086 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55c6b7b33e30 con 0x7fca90072060 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fc976ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 94311973653216 notifier 4738 bl.length()=316 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fc976ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-11T11:02:26.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fc976ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-11T11:02:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(74 notify.3 [notify cookie 94311973837024 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fc976ffd640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8cc003570 con 0x7fca90072060 2024-09-11T11:02:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== watch-notify(notify_complete (2) cookie 94311973837024 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca80029650 con 0x7fca90072060 2024-09-11T11:02:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca9aa97980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 : hit (requested=0x17, cached=0x17) 2024-09-11T11:02:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca9aa97980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 2024-09-11T11:02:26.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.190+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 8.1a 8:5a37c305:root::.bucket.meta.myfoo6%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2e780 con 0x55c6b7af9b40 2024-09-11T11:02:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(76 .bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v34'5 uv5 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 info.flags=0x17 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 to cache LRU end 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9, ofs0, ns] 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [notify cookie 94311973838240 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2e670 con 0x7fca90072060 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 23 ==== watch-notify(notify (1) cookie 94311973664816 notify 146028888087 ret 0) ==== 790+0+0 (crc 0 0 0) 0x7fca80029650 con 0x7fca90072060 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fc9777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 94311973664816 notifier 4738 bl.length()=748 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fc9777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 info.flags=0x17 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fc9777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 to cache LRU end 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fc9777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 24 ==== osd_op_reply(77 notify.7 [notify cookie 94311973838240 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fc9777fe640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc95c003eb0 con 0x7fca90072060 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 25 ==== osd_op_reply(78 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 26 ==== watch-notify(notify_complete (2) cookie 94311973838240 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca80029dc0 con 0x7fca90072060 2024-09-11T11:02:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 20 handle_bi_update(): bucket=:myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]): orig_sources= new_sources= 2024-09-11T11:02:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 20 handle_bi_update(): bucket=:myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]): potential sources added=[] removed=[] 2024-09-11T11:02:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 20 handle_bi_update(): bucket=:myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]): orig_dests= new_dests= 2024-09-11T11:02:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 20 handle_bi_update(): bucket=:myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]): potential dests added=[] removed=[] 2024-09-11T11:02:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:79 4.5 4:a056f2df:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2e230 con 0x55c6b7af4ac0 2024-09-11T11:02:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(79 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0 [call out=85b] v0'0 uv14 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:80 4.3a 4:5d04c75d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x55c6b7af9b40 2024-09-11T11:02:26.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(80 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 4.35 4:ae22deb2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x55c6b7af0600 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(81 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:82 4.19 4:990a4740:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x55c6b7af9b40 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(82 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:83 4.3a 4:5eb79869:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x55c6b7af9b40 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(83 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca880ca070 con 0x55c6b7af9b40 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.194+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:84 4.3d 4:be1067ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x55c6b7af4ac0 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(84 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:85 4.11 4:89f6661e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x7fca90072060 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 27 ==== osd_op_reply(85 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:86 4.1e 4:79aca478:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x55c6b7af0600 2024-09-11T11:02:26.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(86 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:87 4.3e 4:7d8e0d30:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x55c6b7af4ac0 2024-09-11T11:02:26.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(87 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:88 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x7fca90072060 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 28 ==== osd_op_reply(88 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [call out=377b] v0'0 uv3 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 10 cls_bucket_list_unordered: got thirteen 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:89 4.8 4:117b87dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dd80 con 0x55c6b7af9b40 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(89 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 get_obj_state: octx=0x7fca9005f4e0 obj=myfoo6:thirteen state=0x55c6b7b341e8 s->prefetch_data=0 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:90 3.22 3:46aa9246:::27698d38-fc40-410e-96d8-191ffc71147c.4235.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2e1d0 con 0x55c6b7af9b40 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(90 27698d38-fc40-410e-96d8-191ffc71147c.4235.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 10 manifest: total_size = 8 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 get_obj_state: setting s->obj_tag to 27698d38-fc40-410e-96d8-191ffc71147c.4235.2592143896608149236 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 Read xattr rgw_rados: user.rgw.acl 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 Read xattr rgw_rados: user.rgw.etag 2024-09-11T11:02:26.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 get_obj_state: octx=0x7fca9005f4e0 obj=myfoo6:thirteen state=0x55c6b7b341e8 s->prefetch_data=0 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 : hit (requested=0x17, cached=0x17) 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 2024-09-11T11:02:26.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.198+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:91 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b33750 con 0x7fca90072060 2024-09-11T11:02:26.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.202+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 29 ==== osd_op_reply(91 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [stat,call,call] v34'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.202+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:92 3.22 3:46aa9246:::27698d38-fc40-410e-96d8-191ffc71147c.4235.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b33750 con 0x55c6b7af9b40 2024-09-11T11:02:26.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.202+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(92 27698d38-fc40-410e-96d8-191ffc71147c.4235.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v34'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.202+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b397a0 con 0x7fca90072060 2024-09-11T11:02:26.205 INFO:teuthology.orchestra.run.smithi145.stderr:1 objects processed in :myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9]). Next marker thirteen 2024-09-11T11:02:26.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.202+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2dc10 con 0x7fca90072060 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 30 ==== osd_op_reply(93 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [stat,call,call] v34'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc976ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 31 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v34'4 uv4 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94311973843984 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f830 con 0x55c6b7af9b40 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== watch-notify(notify (1) cookie 94311973640096 notify 146028888080 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55c6b7b2d680 con 0x55c6b7af9b40 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc9777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888080 cookie 94311973640096 notifier 4738 bl.length()=556 2024-09-11T11:02:26.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc9777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-11T11:02:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc9777fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-11T11:02:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(95 notify.5 [notify cookie 94311973843984 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc9777fe640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc95c003eb0 con 0x55c6b7af9b40 2024-09-11T11:02:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== watch-notify(notify_complete (2) cookie 94311973843984 notify 146028888080 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c6b7b2cb20 con 0x55c6b7af9b40 2024-09-11T11:02:26.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b341d0 con 0x55c6b7af0600 2024-09-11T11:02:26.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v34'10 uv10 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-11T11:02:26.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-11T11:02:26.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-11T11:02:26.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94311973843984 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b33750 con 0x55c6b7af9b40 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== watch-notify(notify (1) cookie 94311973640096 notify 146028888081 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55c6b7b2cb20 con 0x55c6b7af9b40 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc976ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888081 cookie 94311973640096 notifier 4738 bl.length()=177 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc976ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc976ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fc976ffd640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc8cc003570 con 0x55c6b7af9b40 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(98 notify.5 [notify cookie 94311973843984 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== watch-notify(notify_complete (2) cookie 94311973843984 notify 146028888081 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca880b57f0 con 0x55c6b7af9b40 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 10 removing user index: bar 2024-09-11T11:02:26.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.206+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f830 con 0x7fca90072060 2024-09-11T11:02:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 32 ==== osd_op_reply(100 bar [delete] v34'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca9aa97980 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-11T11:02:26.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca9aa97980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-11T11:02:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94311973843984 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b33750 con 0x7fca90072060 2024-09-11T11:02:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 33 ==== watch-notify(notify (1) cookie 94311973664816 notify 146028888088 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55c6b7b34000 con 0x7fca90072060 2024-09-11T11:02:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fc9777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 94311973664816 notifier 4738 bl.length()=152 2024-09-11T11:02:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 34 ==== osd_op_reply(101 notify.7 [notify cookie 94311973843984 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fc9777fe640 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fc95c003eb0 con 0x7fca90072060 2024-09-11T11:02:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 35 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 36 ==== watch-notify(notify_complete (2) cookie 94311973843984 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c6b7b2d8e0 con 0x7fca90072060 2024-09-11T11:02:26.212 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-11T11:02:26.005574Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:02:26.005563Z","tags":[],"group_ids":[]} 2024-09-11T11:02:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fc94e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:26.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.210+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94311973667072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f830 con 0x55c6b7af0600 2024-09-11T11:02:26.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94311973667072] v34'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94311973642576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b33750 con 0x55c6b7af4ac0 2024-09-11T11:02:26.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94311973642576] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca9aa97980 20 remove_watcher() i=0 2024-09-11T11:02:26.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca9aa97980 2 removed watcher, disabling cache 2024-09-11T11:02:26.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94311973647072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f830 con 0x55c6b7af0600 2024-09-11T11:02:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94311973647072] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x55c6b7af0600 2024-09-11T11:02:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca9aa97980 20 remove_watcher() i=1 2024-09-11T11:02:26.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.214+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94311973649280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b33750 con 0x55c6b7af4ac0 2024-09-11T11:02:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.218+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94311973649280] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.218+0000 7fca9aa97980 20 remove_watcher() i=2 2024-09-11T11:02:26.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.218+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94311973653216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f830 con 0x7fca90072060 2024-09-11T11:02:26.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.218+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 37 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94311973653216] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.218+0000 7fca9aa97980 20 remove_watcher() i=3 2024-09-11T11:02:26.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.218+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94311973654272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b33750 con 0x55c6b7af4ac0 2024-09-11T11:02:26.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca985a7640 1 -- 172.21.15.145:0/1329972503 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94311973654272] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca9006f030 con 0x55c6b7af4ac0 2024-09-11T11:02:26.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca9aa97980 20 remove_watcher() i=4 2024-09-11T11:02:26.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94311973640096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f830 con 0x55c6b7af9b40 2024-09-11T11:02:26.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94311973640096] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca9aa97980 20 remove_watcher() i=5 2024-09-11T11:02:26.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94311973661680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b33750 con 0x55c6b7af9b40 2024-09-11T11:02:26.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca97da6640 1 -- 172.21.15.145:0/1329972503 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94311973661680] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca880e9060 con 0x55c6b7af9b40 2024-09-11T11:02:26.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca9aa97980 20 remove_watcher() i=6 2024-09-11T11:02:26.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.222+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94311973664816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55c6b7b2f830 con 0x7fca90072060 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 <== osd.2 v2:172.21.15.145:6816/446921044 38 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94311973664816] v34'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca800083f0 con 0x7fca90072060 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 20 remove_watcher() i=7 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7af4ac0 msgr2=0x55c6b7af6eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7af4ac0 0x55c6b7af6eb0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b7af0600 msgr2=0x55c6b7af2ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b7af0600 0x55c6b7af2ac0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fca90072060 msgr2=0x7fca90034930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fca90072060 0x7fca90034930 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c6b7af9b40 msgr2=0x55c6b7afbf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c6b7af9b40 0x55c6b7afbf30 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc9680346a0 msgr2=0x7fc968036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc9680346a0 0x7fc968036b60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fca8801b0d0 tx=0x7fca880a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca98da8640 1 -- 172.21.15.145:0/1329972503 reap_dead start 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 msgr2=0x55c6b7ae54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ae54c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fca90047010 tx=0x7fca90035510 comp rx=0 tx=0).stop 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 shutdown_connections 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1329972503 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ade300 0x55c6b7ae54c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 >> 172.21.15.145:0/1329972503 conn(0x55c6b7ada6e0 msgr2=0x55c6b7ad87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 shutdown_connections 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1329972503 wait complete. 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1543258251 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc970034650 msgr2=0x7fc970036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1543258251 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc970034650 0x7fc970036b10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55c6b7ab83f0 tx=0x7fca88005e50 comp rx=0 tx=0).stop 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1543258251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ad1be0 msgr2=0x55c6b7ad2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1543258251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ad1be0 0x55c6b7ad2020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fca9004ab70 tx=0x7fca90017d50 comp rx=0 tx=0).stop 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1543258251 shutdown_connections 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1543258251 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc970034650 0x7fc970036b10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1543258251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b7ad1be0 0x55c6b7ad2020 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1543258251 >> 172.21.15.145:0/1543258251 conn(0x55c6b7ac6d30 msgr2=0x55c6b7ac97b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1543258251 shutdown_connections 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1543258251 wait complete. 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7abc230 msgr2=0x55c6b7abe620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c6b7abc230 0x55c6b7abe620 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b79c4920 msgr2=0x55c6b7abadf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c6b79c4920 0x55c6b7abadf0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c6b7ac18c0 msgr2=0x55c6b7ac3cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c6b7ac18c0 0x55c6b7ac3cb0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc980034650 msgr2=0x7fc980036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fc980034650 0x7fc980036b10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fca880ab000 tx=0x7fca880a5000 comp rx=0 tx=0).stop 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 msgr2=0x55c6b7ab3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 --2- 172.21.15.145:0/1902834874 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c6b79c0550 0x55c6b7ab3e00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x55c6b7aadc70 tx=0x7fca90000bd0 comp rx=0 tx=0).stop 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca98da8640 1 -- 172.21.15.145:0/1902834874 reap_dead start 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 shutdown_connections 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 >> 172.21.15.145:0/1902834874 conn(0x55c6b79bc070 msgr2=0x55c6b7aa6120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 shutdown_connections 2024-09-11T11:02:26.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:26.226+0000 7fca9aa97980 1 -- 172.21.15.145:0/1902834874 wait complete. 2024-09-11T11:02:26.238 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-11T11:02:26.005574Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:02:26.005563Z', 'tags': [], 'group_ids': []} 2024-09-11T11:02:31.249 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:02:31.249 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-11T11:02:31.249 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-11T11:02:31.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-11T11:02:31.250 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-11T11:02:31.297 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:31.297 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:31.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff378a89980 1 Processor -- start 2024-09-11T11:02:31.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff378a89980 1 -- start start 2024-09-11T11:02:31.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff378a89980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5580c72dcca0 0x5580c72df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff378a89980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5580c715eae0 con 0x5580c72d8920 2024-09-11T11:02:31.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff378a89980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5580c7182e30 con 0x5580c72dcca0 2024-09-11T11:02:31.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff375d98640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5580c72dcca0 0x5580c72df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff375d98640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5580c72dcca0 0x5580c72df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56458/0 (socket says 172.21.15.145:56458) 2024-09-11T11:02:31.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff375d98640 1 -- 172.21.15.145:0/4278107576 learned_addr learned my addr 172.21.15.145:0/4278107576 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff375d98640 1 -- 172.21.15.145:0/4278107576 >> v1:172.21.15.102:6789/0 conn(0x5580c72d8920 legacy=0x5580c72d8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff375d98640 1 -- 172.21.15.145:0/4278107576 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c72e05e0 con 0x5580c72dcca0 2024-09-11T11:02:31.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff375597640 1 -- 172.21.15.145:0/4278107576 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036101253 0 0) 0x5580c715eae0 con 0x5580c72d8920 2024-09-11T11:02:31.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.298+0000 7ff375d98640 1 --2- 172.21.15.145:0/4278107576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72dcca0 0x5580c72df090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00a5c0 tx=0x7ff36c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e013d0c8e9a0fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff375597640 1 -- 172.21.15.145:0/4278107576 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff36c0a6070 con 0x5580c72dcca0 2024-09-11T11:02:31.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff375597640 1 -- 172.21.15.145:0/4278107576 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff36c0af070 con 0x5580c72dcca0 2024-09-11T11:02:31.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff375597640 1 -- 172.21.15.145:0/4278107576 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff36c0aa5c0 con 0x5580c72dcca0 2024-09-11T11:02:31.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff378a89980 1 -- 172.21.15.145:0/4278107576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72dcca0 msgr2=0x5580c72df090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff378a89980 1 --2- 172.21.15.145:0/4278107576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72dcca0 0x5580c72df090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00a5c0 tx=0x7ff36c01b340 comp rx=0 tx=0).stop 2024-09-11T11:02:31.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff378a89980 1 -- 172.21.15.145:0/4278107576 shutdown_connections 2024-09-11T11:02:31.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff378a89980 1 --2- 172.21.15.145:0/4278107576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72dcca0 0x5580c72df090 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff378a89980 1 -- 172.21.15.145:0/4278107576 >> 172.21.15.145:0/4278107576 conn(0x5580c724c270 msgr2=0x5580c724c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff378a89980 1 -- 172.21.15.145:0/4278107576 shutdown_connections 2024-09-11T11:02:31.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.302+0000 7ff378a89980 1 -- 172.21.15.145:0/4278107576 wait complete. 2024-09-11T11:02:31.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 Processor -- start 2024-09-11T11:02:31.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 -- start start 2024-09-11T11:02:31.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72d8920 0x5580c73c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5580c7184200 con 0x5580c72d8920 2024-09-11T11:02:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72d8920 0x5580c73c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72d8920 0x5580c73c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56462/0 (socket says 172.21.15.145:56462) 2024-09-11T11:02:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff376599640 1 -- 172.21.15.145:0/652083469 learned_addr learned my addr 172.21.15.145:0/652083469 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff376599640 1 -- 172.21.15.145:0/652083469 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c73c4270 con 0x5580c72d8920 2024-09-11T11:02:31.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff376599640 1 --2- 172.21.15.145:0/652083469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72d8920 0x5580c73c3ca0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff370001670 tx=0x7ff370001b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb5c7c34fc89108 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff264608640 1 -- 172.21.15.145:0/652083469 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff370017070 con 0x5580c72d8920 2024-09-11T11:02:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff264608640 1 -- 172.21.15.145:0/652083469 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3700025d0 con 0x5580c72d8920 2024-09-11T11:02:31.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff264608640 1 -- 172.21.15.145:0/652083469 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff370002910 con 0x5580c72d8920 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 -- 172.21.15.145:0/652083469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72d8920 msgr2=0x5580c73c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 --2- 172.21.15.145:0/652083469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72d8920 0x5580c73c3ca0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff370001670 tx=0x7ff370001b30 comp rx=0 tx=0).stop 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 -- 172.21.15.145:0/652083469 shutdown_connections 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 --2- 172.21.15.145:0/652083469 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c72d8920 0x5580c73c3ca0 secure :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff370001670 tx=0x7ff370001b30 comp rx=0 tx=0).stop 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 -- 172.21.15.145:0/652083469 >> 172.21.15.145:0/652083469 conn(0x5580c724c270 msgr2=0x5580c73bf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 -- 172.21.15.145:0/652083469 shutdown_connections 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 -- 172.21.15.145:0/652083469 wait complete. 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.318+0000 7ff378a89980 1 Processor -- start 2024-09-11T11:02:31.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff378a89980 1 -- start start 2024-09-11T11:02:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff378a89980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73cb270 0x5580c73cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff378a89980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5580c72e00e0 con 0x5580c73cb270 2024-09-11T11:02:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73cb270 0x5580c73cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.323 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73cb270 0x5580c73cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56478/0 (socket says 172.21.15.145:56478) 2024-09-11T11:02:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff376599640 1 -- 172.21.15.145:0/1895224265 learned_addr learned my addr 172.21.15.145:0/1895224265 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff376599640 1 -- 172.21.15.145:0/1895224265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c73cbbd0 con 0x5580c73cb270 2024-09-11T11:02:31.324 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff376599640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73cb270 0x5580c73cb690 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff370006fb0 tx=0x7ff370001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff262e05640 1 -- 172.21.15.145:0/1895224265 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff370017040 con 0x5580c73cb270 2024-09-11T11:02:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c73cbe60 con 0x5580c73cb270 2024-09-11T11:02:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff262e05640 1 -- 172.21.15.145:0/1895224265 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37001e530 con 0x5580c73cb270 2024-09-11T11:02:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff262e05640 1 -- 172.21.15.145:0/1895224265 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37001e810 con 0x5580c73cb270 2024-09-11T11:02:31.325 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c73ce9c0 con 0x5580c73cb270 2024-09-11T11:02:31.326 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff262e05640 1 -- 172.21.15.145:0/1895224265 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff37001e9b0 con 0x5580c73cb270 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff262e05640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff25c034650 0x7ff25c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff262e05640 1 -- 172.21.15.145:0/1895224265 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7ff370049520 con 0x5580c73cb270 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff375d98640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff25c034650 0x7ff25c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff378a89980 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c73d0710 0x5580c73d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c73d3040 con 0x5580c73d0710 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.322+0000 7ff376d9a640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c73d0710 0x5580c73d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff375d98640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff25c034650 0x7ff25c036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0ae000 tx=0x7ff36c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff376d9a640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c73d0710 0x5580c73d2b00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff376d9a640 1 -- 172.21.15.145:0/1895224265 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c73d0710 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff378a89980 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c73d3dc0 0x5580c73d61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.327 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c73d67f0 con 0x5580c73d3dc0 2024-09-11T11:02:31.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff376599640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c73d3dc0 0x5580c73d61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff376599640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c73d3dc0 0x5580c73d61b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff376599640 1 -- 172.21.15.145:0/1895224265 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff37000f070 con 0x5580c73d3dc0 2024-09-11T11:02:31.328 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c73d80a0 con 0x5580c73d3dc0 2024-09-11T11:02:31.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff376599640 1 -- 172.21.15.145:0/1895224265 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff37000f070 con 0x5580c73d3dc0 2024-09-11T11:02:31.329 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c73d72d0 con 0x5580c73d3dc0 2024-09-11T11:02:31.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff376599640 1 -- 172.21.15.145:0/1895224265 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff37000f070 con 0x5580c73d3dc0 2024-09-11T11:02:31.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff378a89980 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5580c73d9450 0x5580c73db840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c73dbdc0 con 0x5580c73d9450 2024-09-11T11:02:31.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff375d98640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5580c73d9450 0x5580c73db840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.330 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.326+0000 7ff375d98640 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5580c73d9450 0x5580c73db840 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff375d98640 1 -- 172.21.15.145:0/1895224265 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c73d9450 2024-09-11T11:02:31.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff378a89980 1 Processor -- start 2024-09-11T11:02:31.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff378a89980 1 -- start start 2024-09-11T11:02:31.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff378a89980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73e9820 0x5580c73e9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff378a89980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5580c71dd800 con 0x5580c73e9820 2024-09-11T11:02:31.331 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73e9820 0x5580c73e9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73e9820 0x5580c73e9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56480/0 (socket says 172.21.15.145:56480) 2024-09-11T11:02:31.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff376599640 1 -- 172.21.15.145:0/2261493989 learned_addr learned my addr 172.21.15.145:0/2261493989 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff376599640 1 -- 172.21.15.145:0/2261493989 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c73ea180 con 0x5580c73e9820 2024-09-11T11:02:31.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff376599640 1 --2- 172.21.15.145:0/2261493989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73e9820 0x5580c73e9c40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff370019fd0 tx=0x7ff370019a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff25bfff640 1 -- 172.21.15.145:0/2261493989 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff370027400 con 0x5580c73e9820 2024-09-11T11:02:31.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff25bfff640 1 -- 172.21.15.145:0/2261493989 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3700275a0 con 0x5580c73e9820 2024-09-11T11:02:31.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff378a89980 1 -- 172.21.15.145:0/2261493989 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c73ea410 con 0x5580c73e9820 2024-09-11T11:02:31.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff25bfff640 1 -- 172.21.15.145:0/2261493989 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff370027880 con 0x5580c73e9820 2024-09-11T11:02:31.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff378a89980 1 -- 172.21.15.145:0/2261493989 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c73ed090 con 0x5580c73e9820 2024-09-11T11:02:31.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff25bfff640 1 -- 172.21.15.145:0/2261493989 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff370040f70 con 0x5580c73e9820 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff25bfff640 1 --2- 172.21.15.145:0/2261493989 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff250034650 0x7ff250036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff25bfff640 1 -- 172.21.15.145:0/2261493989 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7ff37003dbe0 con 0x5580c73e9820 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.330+0000 7ff375d98640 1 --2- 172.21.15.145:0/2261493989 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff250034650 0x7ff250036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 Processor -- start 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- start start 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5580c73c45f0 con 0x5580c73f6300 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff375d98640 1 --2- 172.21.15.145:0/2261493989 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff250034650 0x7ff250036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff36c01b380 tx=0x7ff36c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73f66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56486/0 (socket says 172.21.15.145:56486) 2024-09-11T11:02:31.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff376599640 1 -- 172.21.15.145:0/1480185933 learned_addr learned my addr 172.21.15.145:0/1480185933 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff376599640 1 -- 172.21.15.145:0/1480185933 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c73f6cb0 con 0x5580c73f6300 2024-09-11T11:02:31.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff376599640 1 --2- 172.21.15.145:0/1480185933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73f66e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff37001d490 tx=0x7ff3700526e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cd5d751231d01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff259ffb640 1 -- 172.21.15.145:0/1480185933 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff370062070 con 0x5580c73f6300 2024-09-11T11:02:31.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff259ffb640 1 -- 172.21.15.145:0/1480185933 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37001bb40 con 0x5580c73f6300 2024-09-11T11:02:31.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff259ffb640 1 -- 172.21.15.145:0/1480185933 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37001b670 con 0x5580c73f6300 2024-09-11T11:02:31.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- 172.21.15.145:0/1480185933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 msgr2=0x5580c73f66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 --2- 172.21.15.145:0/1480185933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73f66e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff37001d490 tx=0x7ff3700526e0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- 172.21.15.145:0/1480185933 shutdown_connections 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 --2- 172.21.15.145:0/1480185933 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73f66e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- 172.21.15.145:0/1480185933 >> 172.21.15.145:0/1480185933 conn(0x5580c73f26e0 msgr2=0x5580c73f07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- 172.21.15.145:0/1480185933 shutdown_connections 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- 172.21.15.145:0/1480185933 wait complete. 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 Processor -- start 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- start start 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff378a89980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5580c73f7150 con 0x5580c73f6300 2024-09-11T11:02:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff376599640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73fd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56496/0 (socket says 172.21.15.145:56496) 2024-09-11T11:02:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.334+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 learned_addr learned my addr 172.21.15.145:0/2747466816 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580c73fda20 con 0x5580c73f6300 2024-09-11T11:02:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff376599640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73fd4e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff370049f90 tx=0x7ff370027a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff247fff640 1 -- 172.21.15.145:0/2747466816 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff37006c070 con 0x5580c73f6300 2024-09-11T11:02:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff247fff640 1 -- 172.21.15.145:0/2747466816 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff370041aa0 con 0x5580c73f6300 2024-09-11T11:02:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580c73fda20 con 0x5580c73f6300 2024-09-11T11:02:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff247fff640 1 -- 172.21.15.145:0/2747466816 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff370062040 con 0x5580c73f6300 2024-09-11T11:02:31.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580c73fda20 con 0x5580c73f6300 2024-09-11T11:02:31.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff247fff640 1 -- 172.21.15.145:0/2747466816 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff370003330 con 0x5580c73f6300 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff247fff640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff2400345b0 0x7ff240036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff247fff640 1 -- 172.21.15.145:0/2747466816 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7ff370071bd0 con 0x5580c73f6300 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff375d98640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff2400345b0 0x7ff240036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c74084c0 0x5580c740a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c740b0d0 con 0x5580c74084c0 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff376d9a640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c74084c0 0x5580c740a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff375d98640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff2400345b0 0x7ff240036a70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5580c73dc1a0 tx=0x7ff36c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.338+0000 7ff376d9a640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c74084c0 0x5580c740a980 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 realm 2024-09-11T11:02:31.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c74078f0 con 0x5580c74084c0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c740bb90 con 0x5580c74084c0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c740c970 0x5580c740ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c740f410 con 0x5580c740c970 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff376599640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c740c970 0x5580c740ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff376599640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c740c970 0x5580c740ed60 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 20 searching for the correct realm 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5580c74119d0 0x5580c7413dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c7414440 con 0x5580c74119d0 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff375d98640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5580c74119d0 0x5580c7413dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff375d98640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5580c74119d0 0x5580c7413dc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.342+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c7414440 con 0x5580c740c970 2024-09-11T11:02:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376599640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff370041260 0x7ff370023970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x7ff370041260 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff370041260 0x7ff370023970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff370041260 0x7ff370023970 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74119d0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.346+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x7ff370041260 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.352 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x7ff370041260 2024-09-11T11:02:31.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74119d0 2024-09-11T11:02:31.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74119d0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.350+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74119d0 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x7ff370041260 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74084c0 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x7ff370041260 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74119d0 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x7ff370041260 2024-09-11T11:02:31.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c74119d0 2024-09-11T11:02:31.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.354+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x5580c740fc60 con 0x5580c740c970 2024-09-11T11:02:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c74104b0 con 0x5580c74084c0 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c74108a0 con 0x5580c740c970 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c74108a0 con 0x7ff370041260 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 zone default found 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 4 Realm: () 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 zonegroup default 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c74148c0 con 0x7ff370041260 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c7410de0 con 0x5580c74119d0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c7416bc0 con 0x5580c74119d0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 started sync module instance, tier type = 2024-09-11T11:02:31.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:31.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.358+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7415f80 con 0x5580c740c970 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.362+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.362+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94011587126400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7415f80 con 0x5580c740c970 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.362+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7417640 con 0x5580c74084c0 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.362+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.362+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94011587129744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c74175b0 con 0x5580c74084c0 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.362+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7418570 con 0x5580c740c970 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.362+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94011587126400] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94011587129744] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94011587131952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7418570 con 0x5580c740c970 2024-09-11T11:02:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c74189d0 con 0x7ff370041260 2024-09-11T11:02:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94011587123920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7418990 con 0x7ff370041260 2024-09-11T11:02:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7419890 con 0x5580c740c970 2024-09-11T11:02:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94011587123920] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.369 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.366+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94011587131952] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94011587133568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c74193e0 con 0x5580c740c970 2024-09-11T11:02:31.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c741a130 con 0x5580c74119d0 2024-09-11T11:02:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94011587140736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c74193e0 con 0x5580c74119d0 2024-09-11T11:02:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c741aeb0 con 0x5580c74119d0 2024-09-11T11:02:31.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94011587133568] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94011587140736] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94011587142864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c741b2a0 con 0x5580c74119d0 2024-09-11T11:02:31.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.370+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c741baf0 con 0x7ff370041260 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94011587146880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c741be90 con 0x7ff370041260 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 20 add_watcher() i=0 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 20 add_watcher() i=1 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 20 add_watcher() i=2 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 20 add_watcher() i=3 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 20 add_watcher() i=4 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 20 add_watcher() i=5 2024-09-11T11:02:31.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94011587142864] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 20 add_watcher() i=6 2024-09-11T11:02:31.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94011587146880] v34'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 20 add_watcher() i=7 2024-09-11T11:02:31.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:31.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c741a8f0 con 0x5580c74084c0 2024-09-11T11:02:31.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.374+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94011587148064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c741a8f0 con 0x5580c74084c0 2024-09-11T11:02:31.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94011587148064] v34'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff22cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 5 note: GC not initialized 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff1a77fe640 20 reqs_thread_entry: start 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 20 Filter name: none 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff1a57fa640 20 reqs_thread_entry: start 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c74426e0 con 0x7ff370041260 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c7440e80 con 0x5580c74119d0 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-11T11:02:31.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.378+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7441750 con 0x7ff370041260 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v34'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94011587302048 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c7446180 con 0x5580c74119d0 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== watch-notify(notify (1) cookie 94011587140736 notify 146028888082 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5580c72e05e0 con 0x5580c74119d0 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff259ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888082 cookie 94011587140736 notifier 4745 bl.length()=556 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff259ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff259ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff259ffb640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff23c003eb0 con 0x5580c74119d0 2024-09-11T11:02:31.384 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(65 notify.5 [notify cookie 94011587302048 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== watch-notify(notify_complete (2) cookie 94011587302048 notify 146028888082 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff36c0bf640 con 0x5580c74119d0 2024-09-11T11:02:31.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c74412a0 con 0x5580c74119d0 2024-09-11T11:02:31.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v34'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-11T11:02:31.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:02:31.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-11T11:02:31.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.382+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94011587302048 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5580c7446180 con 0x5580c740c970 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94011587131952 notify 146028888107 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5580c73ed090 con 0x5580c740c970 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff2597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888107 cookie 94011587131952 notifier 4745 bl.length()=177 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff2597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff2597fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff2597fa640 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7ff1ac003410 con 0x5580c740c970 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [notify cookie 94011587302048 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94011587302048 notify 146028888107 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5580c73ea410 con 0x5580c740c970 2024-09-11T11:02:31.387 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-11T11:02:31.382069Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:02:31.382047Z","tags":[],"group_ids":[]} 2024-09-11T11:02:31.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff22cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:31.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.386+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94011587148064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7440480 con 0x5580c74084c0 2024-09-11T11:02:31.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94011587148064] v34'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94011587126400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7440480 con 0x5580c740c970 2024-09-11T11:02:31.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94011587126400] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff378a89980 20 remove_watcher() i=0 2024-09-11T11:02:31.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff378a89980 2 removed watcher, disabling cache 2024-09-11T11:02:31.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94011587129744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7440480 con 0x5580c74084c0 2024-09-11T11:02:31.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94011587129744] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x5580c74084c0 2024-09-11T11:02:31.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff378a89980 20 remove_watcher() i=1 2024-09-11T11:02:31.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.390+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94011587131952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7417190 con 0x5580c740c970 2024-09-11T11:02:31.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.394+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94011587131952] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.394+0000 7ff378a89980 20 remove_watcher() i=2 2024-09-11T11:02:31.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.394+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94011587123920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7440480 con 0x7ff370041260 2024-09-11T11:02:31.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.394+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94011587123920] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.394+0000 7ff378a89980 20 remove_watcher() i=3 2024-09-11T11:02:31.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.394+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94011587133568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7417a30 con 0x5580c740c970 2024-09-11T11:02:31.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff376599640 1 -- 172.21.15.145:0/2747466816 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94011587133568] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff370077070 con 0x5580c740c970 2024-09-11T11:02:31.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff378a89980 20 remove_watcher() i=4 2024-09-11T11:02:31.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94011587140736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7417190 con 0x5580c74119d0 2024-09-11T11:02:31.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94011587140736] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff378a89980 20 remove_watcher() i=5 2024-09-11T11:02:31.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94011587142864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7440480 con 0x5580c74119d0 2024-09-11T11:02:31.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff375d98640 1 -- 172.21.15.145:0/2747466816 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94011587142864] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff36c0aaa00 con 0x5580c74119d0 2024-09-11T11:02:31.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff378a89980 20 remove_watcher() i=6 2024-09-11T11:02:31.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.398+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94011587146880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5580c7417190 con 0x7ff370041260 2024-09-11T11:02:31.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94011587146880] v34'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff3680083f0 con 0x7ff370041260 2024-09-11T11:02:31.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 20 remove_watcher() i=7 2024-09-11T11:02:31.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c740c970 msgr2=0x5580c740ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c740c970 0x5580c740ed60 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c74084c0 msgr2=0x5580c740a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c74084c0 0x5580c740a980 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff370041260 msgr2=0x7ff370023970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7ff370041260 0x7ff370023970 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5580c74119d0 msgr2=0x5580c7413dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5580c74119d0 0x5580c7413dc0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff2400345b0 msgr2=0x7ff240036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff2400345b0 0x7ff240036a70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5580c73dc1a0 tx=0x7ff36c0c1040 comp rx=0 tx=0).stop 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 msgr2=0x5580c73fd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff376d9a640 1 -- 172.21.15.145:0/2747466816 reap_dead start 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73fd4e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff370049f90 tx=0x7ff370027a20 comp rx=0 tx=0).stop 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 shutdown_connections 2024-09-11T11:02:31.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2747466816 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73f6300 0x5580c73fd4e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 >> 172.21.15.145:0/2747466816 conn(0x5580c73f26e0 msgr2=0x5580c73f07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 shutdown_connections 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2747466816 wait complete. 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2261493989 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff250034650 msgr2=0x7ff250036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2261493989 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff250034650 0x7ff250036b10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff36c01b380 tx=0x7ff36c005ad0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2261493989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73e9820 msgr2=0x5580c73e9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2261493989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73e9820 0x5580c73e9c40 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff370019fd0 tx=0x7ff370019a70 comp rx=0 tx=0).stop 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2261493989 shutdown_connections 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2261493989 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff250034650 0x7ff250036b10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/2261493989 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73e9820 0x5580c73e9c40 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2261493989 >> 172.21.15.145:0/2261493989 conn(0x5580c73de970 msgr2=0x5580c73e13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2261493989 shutdown_connections 2024-09-11T11:02:31.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/2261493989 wait complete. 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c73d3dc0 msgr2=0x5580c73d61b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5580c73d3dc0 0x5580c73d61b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c73d0710 msgr2=0x5580c73d2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5580c73d0710 0x5580c73d2b00 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5580c73d9450 msgr2=0x5580c73db840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5580c73d9450 0x5580c73db840 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff25c034650 msgr2=0x7ff25c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff25c034650 0x7ff25c036b10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff36c0ae000 tx=0x7ff36c0a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73cb270 msgr2=0x5580c73cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 --2- 172.21.15.145:0/1895224265 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5580c73cb270 0x5580c73cb690 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff370006fb0 tx=0x7ff370001260 comp rx=0 tx=0).stop 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff376d9a640 1 -- 172.21.15.145:0/1895224265 reap_dead start 2024-09-11T11:02:31.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 shutdown_connections 2024-09-11T11:02:31.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 >> 172.21.15.145:0/1895224265 conn(0x5580c724c270 msgr2=0x5580c73be3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 shutdown_connections 2024-09-11T11:02:31.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.402+0000 7ff378a89980 1 -- 172.21.15.145:0/1895224265 wait complete. 2024-09-11T11:02:31.415 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-11T11:02:31.382069Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:02:31.382047Z', 'tags': [], 'group_ids': []} 2024-09-11T11:02:31.431 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:02:31.436 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-11T11:02:31.436 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-11T11:02:31.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-11T11:02:31.437 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-11T11:02:31.469 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:31.469 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:31.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.466+0000 7f319b2e2980 1 Processor -- start 2024-09-11T11:02:31.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f319b2e2980 1 -- start start 2024-09-11T11:02:31.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f319b2e2980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558ee8ebca20 0x558ee8ebee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f319b2e2980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558ee8d40ae0 con 0x558ee8eb86a0 2024-09-11T11:02:31.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f319b2e2980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x558ee8d64e30 con 0x558ee8ebca20 2024-09-11T11:02:31.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f31985f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558ee8ebca20 0x558ee8ebee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f31985f1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558ee8ebca20 0x558ee8ebee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56508/0 (socket says 172.21.15.145:56508) 2024-09-11T11:02:31.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f31985f1640 1 -- 172.21.15.145:0/3486999450 learned_addr learned my addr 172.21.15.145:0/3486999450 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f31985f1640 1 -- 172.21.15.145:0/3486999450 >> v1:172.21.15.102:6789/0 conn(0x558ee8eb86a0 legacy=0x558ee8eb8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f31985f1640 1 -- 172.21.15.145:0/3486999450 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee8ec0360 con 0x558ee8ebca20 2024-09-11T11:02:31.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f31985f1640 1 --2- 172.21.15.145:0/3486999450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8ebca20 0x558ee8ebee10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f318000a5c0 tx=0x7f318001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156fe94ff6bdb8c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f3197df0640 1 -- 172.21.15.145:0/3486999450 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31800a6070 con 0x558ee8ebca20 2024-09-11T11:02:31.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f3197df0640 1 -- 172.21.15.145:0/3486999450 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31800af070 con 0x558ee8ebca20 2024-09-11T11:02:31.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.470+0000 7f3197df0640 1 -- 172.21.15.145:0/3486999450 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31800aa5c0 con 0x558ee8ebca20 2024-09-11T11:02:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.474+0000 7f319b2e2980 1 -- 172.21.15.145:0/3486999450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8ebca20 msgr2=0x558ee8ebee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.474+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3486999450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8ebca20 0x558ee8ebee10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f318000a5c0 tx=0x7f318001b340 comp rx=0 tx=0).stop 2024-09-11T11:02:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.474+0000 7f319b2e2980 1 -- 172.21.15.145:0/3486999450 shutdown_connections 2024-09-11T11:02:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.474+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3486999450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8ebca20 0x558ee8ebee10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.474+0000 7f319b2e2980 1 -- 172.21.15.145:0/3486999450 >> 172.21.15.145:0/3486999450 conn(0x558ee8eb41c0 msgr2=0x558ee8eb65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.474+0000 7f319b2e2980 1 -- 172.21.15.145:0/3486999450 shutdown_connections 2024-09-11T11:02:31.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.474+0000 7f319b2e2980 1 -- 172.21.15.145:0/3486999450 wait complete. 2024-09-11T11:02:31.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.486+0000 7f319b2e2980 1 Processor -- start 2024-09-11T11:02:31.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.486+0000 7f319b2e2980 1 -- start start 2024-09-11T11:02:31.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.486+0000 7f319b2e2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8fa3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.486+0000 7f319b2e2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ee8d66200 con 0x558ee8eb86a0 2024-09-11T11:02:31.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.486+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8fa3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.486+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8fa3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56520/0 (socket says 172.21.15.145:56520) 2024-09-11T11:02:31.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.486+0000 7f3198df2640 1 -- 172.21.15.145:0/1860388876 learned_addr learned my addr 172.21.15.145:0/1860388876 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3198df2640 1 -- 172.21.15.145:0/1860388876 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee8fa4170 con 0x558ee8eb86a0 2024-09-11T11:02:31.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3198df2640 1 --2- 172.21.15.145:0/1860388876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8fa3ba0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3188001ea0 tx=0x7f318800b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cc2c448fac8779 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3086e0d640 1 -- 172.21.15.145:0/1860388876 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318800a040 con 0x558ee8eb86a0 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3086e0d640 1 -- 172.21.15.145:0/1860388876 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318800f620 con 0x558ee8eb86a0 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3086e0d640 1 -- 172.21.15.145:0/1860388876 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318800f890 con 0x558ee8eb86a0 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- 172.21.15.145:0/1860388876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 msgr2=0x558ee8fa3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1860388876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8fa3ba0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f3188001ea0 tx=0x7f318800b680 comp rx=0 tx=0).stop 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- 172.21.15.145:0/1860388876 shutdown_connections 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1860388876 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8fa3ba0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- 172.21.15.145:0/1860388876 >> 172.21.15.145:0/1860388876 conn(0x558ee8eb41c0 msgr2=0x558ee8f9f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- 172.21.15.145:0/1860388876 shutdown_connections 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- 172.21.15.145:0/1860388876 wait complete. 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 Processor -- start 2024-09-11T11:02:31.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- start start 2024-09-11T11:02:31.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8e2f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ee8ebfe60 con 0x558ee8eb86a0 2024-09-11T11:02:31.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8e2f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8e2f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56524/0 (socket says 172.21.15.145:56524) 2024-09-11T11:02:31.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3198df2640 1 -- 172.21.15.145:0/3321781557 learned_addr learned my addr 172.21.15.145:0/3321781557 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3198df2640 1 -- 172.21.15.145:0/3321781557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee8e2dc40 con 0x558ee8eb86a0 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f3198df2640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8e2f520 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3188001fd0 tx=0x7f3188000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f308560a640 1 -- 172.21.15.145:0/3321781557 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188001520 con 0x558ee8eb86a0 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ee8e2ded0 con 0x558ee8eb86a0 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f308560a640 1 -- 172.21.15.145:0/3321781557 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318801c9c0 con 0x558ee8eb86a0 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f308560a640 1 -- 172.21.15.145:0/3321781557 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f318801cd00 con 0x558ee8eb86a0 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.490+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee8e2e420 con 0x558ee8eb86a0 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f308560a640 1 -- 172.21.15.145:0/3321781557 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3188017050 con 0x558ee8eb86a0 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f308560a640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3080034650 0x7f3080036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f308560a640 1 -- 172.21.15.145:0/3321781557 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f3188015020 con 0x558ee8eb86a0 2024-09-11T11:02:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f31985f1640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3080034650 0x7f3080036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fb2320 0x558ee8fb4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8fb4c50 con 0x558ee8fb2320 2024-09-11T11:02:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f31995f3640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fb2320 0x558ee8fb4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f31985f1640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3080034650 0x7f3080036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31800ae000 tx=0x7f31800a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f31995f3640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fb2320 0x558ee8fb4710 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f31995f3640 1 -- 172.21.15.145:0/3321781557 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fb2320 2024-09-11T11:02:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fb5700 0x558ee8fb7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8fb8330 con 0x558ee8fb5700 2024-09-11T11:02:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f3198df2640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fb5700 0x558ee8fb7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f3198df2640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fb5700 0x558ee8fb7bc0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.494+0000 7f3198df2640 1 -- 172.21.15.145:0/3321781557 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fb5700 2024-09-11T11:02:31.498 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8fb9be0 con 0x558ee8fb5700 2024-09-11T11:02:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f3198df2640 1 -- 172.21.15.145:0/3321781557 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fb5700 2024-09-11T11:02:31.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8fb8e10 con 0x558ee8fb5700 2024-09-11T11:02:31.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f3198df2640 1 -- 172.21.15.145:0/3321781557 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fb5700 2024-09-11T11:02:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ee8fbaf90 0x558ee8fbd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8fbd8c0 con 0x558ee8fbaf90 2024-09-11T11:02:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f31985f1640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ee8fbaf90 0x558ee8fbd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f31985f1640 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ee8fbaf90 0x558ee8fbd380 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f31985f1640 1 -- 172.21.15.145:0/3321781557 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8fbaf90 2024-09-11T11:02:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f319b2e2980 1 Processor -- start 2024-09-11T11:02:31.501 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f319b2e2980 1 -- start start 2024-09-11T11:02:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f319b2e2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fcb2c0 0x558ee8fcb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f319b2e2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ee8dbf800 con 0x558ee8fcb2c0 2024-09-11T11:02:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fcb2c0 0x558ee8fcb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fcb2c0 0x558ee8fcb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56528/0 (socket says 172.21.15.145:56528) 2024-09-11T11:02:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f3198df2640 1 -- 172.21.15.145:0/2372694991 learned_addr learned my addr 172.21.15.145:0/2372694991 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.498+0000 7f3198df2640 1 -- 172.21.15.145:0/2372694991 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee8fcbc20 con 0x558ee8fcb2c0 2024-09-11T11:02:31.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f3198df2640 1 --2- 172.21.15.145:0/2372694991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fcb2c0 0x558ee8fcb6e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f318804a1c0 tx=0x7f318801a850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f307e7fc640 1 -- 172.21.15.145:0/2372694991 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188013130 con 0x558ee8fcb2c0 2024-09-11T11:02:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f307e7fc640 1 -- 172.21.15.145:0/2372694991 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31880132d0 con 0x558ee8fcb2c0 2024-09-11T11:02:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f319b2e2980 1 -- 172.21.15.145:0/2372694991 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ee8fcbeb0 con 0x558ee8fcb2c0 2024-09-11T11:02:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f307e7fc640 1 -- 172.21.15.145:0/2372694991 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f31880135d0 con 0x558ee8fcb2c0 2024-09-11T11:02:31.503 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f319b2e2980 1 -- 172.21.15.145:0/2372694991 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee8fcbeb0 con 0x558ee8fcb2c0 2024-09-11T11:02:31.504 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f307e7fc640 1 -- 172.21.15.145:0/2372694991 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3188043040 con 0x558ee8fcb2c0 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f307e7fc640 1 --2- 172.21.15.145:0/2372694991 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3070034650 0x7f3070036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f307e7fc640 1 -- 172.21.15.145:0/2372694991 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f3188020140 con 0x558ee8fcb2c0 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f31985f1640 1 --2- 172.21.15.145:0/2372694991 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3070034650 0x7f3070036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f319b2e2980 1 Processor -- start 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f319b2e2980 1 -- start start 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f319b2e2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fd7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f31985f1640 1 --2- 172.21.15.145:0/2372694991 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3070034650 0x7f3070036b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x558ee8e2ec30 tx=0x7f3180005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f319b2e2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ee8fa44f0 con 0x558ee8fd7a30 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fd7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fd7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56532/0 (socket says 172.21.15.145:56532) 2024-09-11T11:02:31.505 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f3198df2640 1 -- 172.21.15.145:0/253446860 learned_addr learned my addr 172.21.15.145:0/253446860 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f3198df2640 1 -- 172.21.15.145:0/253446860 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee8fd83e0 con 0x558ee8fd7a30 2024-09-11T11:02:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f3198df2640 1 --2- 172.21.15.145:0/253446860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fd7e10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3188013820 tx=0x7f31880138b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6e97f94dbf5bc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f306ffff640 1 -- 172.21.15.145:0/253446860 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188069070 con 0x558ee8fd7a30 2024-09-11T11:02:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f306ffff640 1 -- 172.21.15.145:0/253446860 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f318805d070 con 0x558ee8fd7a30 2024-09-11T11:02:31.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.502+0000 7f306ffff640 1 -- 172.21.15.145:0/253446860 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188041110 con 0x558ee8fd7a30 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- 172.21.15.145:0/253446860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 msgr2=0x558ee8fd7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 --2- 172.21.15.145:0/253446860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fd7e10 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3188013820 tx=0x7f31880138b0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- 172.21.15.145:0/253446860 shutdown_connections 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 --2- 172.21.15.145:0/253446860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fd7e10 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- 172.21.15.145:0/253446860 >> 172.21.15.145:0/253446860 conn(0x558ee8fd3e10 msgr2=0x558ee8fd1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- 172.21.15.145:0/253446860 shutdown_connections 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- 172.21.15.145:0/253446860 wait complete. 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 Processor -- start 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- start start 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fdec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558ee8fd8880 con 0x558ee8fd7a30 2024-09-11T11:02:31.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fdec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f3198df2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fdec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56538/0 (socket says 172.21.15.145:56538) 2024-09-11T11:02:31.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 learned_addr learned my addr 172.21.15.145:0/1666420580 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ee8fdf1b0 con 0x558ee8fd7a30 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f3198df2640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fdec70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3188019de0 tx=0x7f3188044f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f306e7fc640 1 -- 172.21.15.145:0/1666420580 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188069030 con 0x558ee8fd7a30 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f306e7fc640 1 -- 172.21.15.145:0/1666420580 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3188075070 con 0x558ee8fd7a30 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558ee8fdf1b0 con 0x558ee8fd7a30 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f306e7fc640 1 -- 172.21.15.145:0/1666420580 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3188048610 con 0x558ee8fd7a30 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ee8fdf1b0 con 0x558ee8fd7a30 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f306e7fc640 1 -- 172.21.15.145:0/1666420580 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f31880414e0 con 0x558ee8fd7a30 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.506+0000 7f306e7fc640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3064034650 0x7f3064036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f306e7fc640 1 -- 172.21.15.145:0/1666420580 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f318806a070 con 0x558ee8fd7a30 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f31985f1640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3064034650 0x7f3064036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fe9cb0 0x558ee8fec170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8fec8c0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f31995f3640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fe9cb0 0x558ee8fec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f31985f1640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3064034650 0x7f3064036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x558ee8fb9b70 tx=0x7f31800c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.512 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f31995f3640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fe9cb0 0x558ee8fec170 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 realm 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8fe90e0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8fed390 con 0x558ee8fe9cb0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.515 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fee170 0x558ee8ff0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff0be0 con 0x558ee8fee170 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f3198df2640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fee170 0x558ee8ff0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f3198df2640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fee170 0x558ee8ff0560 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.510+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f319b2e2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f319b2e2980 20 searching for the correct realm 2024-09-11T11:02:31.516 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ee8ff31a0 0x558ee8ff5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff5c10 con 0x558ee8ff31a0 2024-09-11T11:02:31.517 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31985f1640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ee8ff31a0 0x558ee8ff5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31985f1640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ee8ff31a0 0x558ee8ff5590 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff5c10 con 0x558ee8fee170 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f3198df2640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f318804fc20 0x7f31880145a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x7f318804fc20 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f318804fc20 0x7f31880145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f318804fc20 0x7f31880145a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8ff31a0 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.514+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x7f318804fc20 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.524 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x7f318804fc20 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8ff31a0 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.518+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8ff31a0 2024-09-11T11:02:31.525 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8ff31a0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x7f318804fc20 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fe9cb0 2024-09-11T11:02:31.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x7f318804fc20 2024-09-11T11:02:31.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8ff31a0 2024-09-11T11:02:31.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x7f318804fc20 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.522+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8ff31a0 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1430 con 0x558ee8fee170 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff1c80 con 0x558ee8fe9cb0 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.530 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff2070 con 0x558ee8fee170 2024-09-11T11:02:31.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:31.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff2070 con 0x7f318804fc20 2024-09-11T11:02:31.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:31.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 zone default found 2024-09-11T11:02:31.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 4 Realm: () 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 zonegroup default 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.526+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff6070 con 0x7f318804fc20 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff82a0 con 0x558ee8ff31a0 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff8640 con 0x558ee8ff31a0 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 20 started sync module instance, tier type = 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff76e0 con 0x558ee8fee170 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94072282774272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff76e0 con 0x558ee8fee170 2024-09-11T11:02:31.535 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.530+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff8e90 con 0x558ee8fe9cb0 2024-09-11T11:02:31.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.534+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.534+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94072282778080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff92b0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.536 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.534+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff9cf0 con 0x558ee8fee170 2024-09-11T11:02:31.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.534+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94072282774272] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.534+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94072282778080] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.534+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.534+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94072282781632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff8e00 con 0x558ee8fee170 2024-09-11T11:02:31.537 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.534+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffa590 con 0x7f318804fc20 2024-09-11T11:02:31.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.538+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.538+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94072282783968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff8e00 con 0x7f318804fc20 2024-09-11T11:02:31.538 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.538+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffb050 con 0x558ee8fee170 2024-09-11T11:02:31.539 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.538+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94072282781632] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.538+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94072282783968] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.541 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.538+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.538+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94072282785024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffb010 con 0x558ee8fee170 2024-09-11T11:02:31.542 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.538+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffb440 con 0x558ee8ff31a0 2024-09-11T11:02:31.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94072282772016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffbce0 con 0x558ee8ff31a0 2024-09-11T11:02:31.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffc6a0 con 0x558ee8ff31a0 2024-09-11T11:02:31.543 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94072282785024] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94072282772016] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94072282792432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffca90 con 0x558ee8ff31a0 2024-09-11T11:02:31.544 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffd2e0 con 0x7f318804fc20 2024-09-11T11:02:31.545 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94072282792432] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94072282794640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffd6d0 con 0x7f318804fc20 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 20 add_watcher() i=0 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 20 add_watcher() i=1 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 20 add_watcher() i=2 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 20 add_watcher() i=3 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 20 add_watcher() i=4 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 20 add_watcher() i=5 2024-09-11T11:02:31.546 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.542+0000 7f319b2e2980 20 add_watcher() i=6 2024-09-11T11:02:31.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94072282794640] v34'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 20 add_watcher() i=7 2024-09-11T11:02:31.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:31.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee9000700 con 0x558ee8fe9cb0 2024-09-11T11:02:31.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.547 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94072282796160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffdc00 con 0x558ee8fe9cb0 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94072282796160] v34'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f304f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 5 note: GC not initialized 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f304e7e4640 20 reqs_thread_entry: start 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f319b2e2980 20 Filter name: none 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.546+0000 7f3047fff640 20 reqs_thread_entry: start 2024-09-11T11:02:31.550 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-11T11:02:31.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x558ee9023de0 con 0x7f318804fc20 2024-09-11T11:02:31.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:02:31.551 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-11T11:02:31.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-11T11:02:31.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:02:31.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee9027f90 con 0x7f318804fc20 2024-09-11T11:02:31.552 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v34'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.553 INFO:teuthology.orchestra.run.smithi145.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-11T11:02:31.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f304f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:31.553 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.550+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94072282796160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee9021c10 con 0x558ee8fe9cb0 2024-09-11T11:02:31.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.554+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94072282796160] v34'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.555 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.554+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94072282774272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee9021c10 con 0x558ee8fee170 2024-09-11T11:02:31.557 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.554+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94072282774272] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.554+0000 7f319b2e2980 20 remove_watcher() i=0 2024-09-11T11:02:31.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.554+0000 7f319b2e2980 2 removed watcher, disabling cache 2024-09-11T11:02:31.558 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.554+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94072282778080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee9021c10 con 0x558ee8fe9cb0 2024-09-11T11:02:31.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94072282778080] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x558ee8fe9cb0 2024-09-11T11:02:31.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f319b2e2980 20 remove_watcher() i=1 2024-09-11T11:02:31.559 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94072282781632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff89e0 con 0x558ee8fee170 2024-09-11T11:02:31.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94072282781632] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f319b2e2980 20 remove_watcher() i=2 2024-09-11T11:02:31.561 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94072282783968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee9021c10 con 0x7f318804fc20 2024-09-11T11:02:31.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94072282783968] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f319b2e2980 20 remove_watcher() i=3 2024-09-11T11:02:31.562 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.558+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94072282785024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ff97c0 con 0x558ee8fee170 2024-09-11T11:02:31.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.562+0000 7f3198df2640 1 -- 172.21.15.145:0/1666420580 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94072282785024] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f318802e070 con 0x558ee8fee170 2024-09-11T11:02:31.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.562+0000 7f319b2e2980 20 remove_watcher() i=4 2024-09-11T11:02:31.564 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.562+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94072282772016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee9021c10 con 0x558ee8ff31a0 2024-09-11T11:02:31.565 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.562+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94072282772016] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.562+0000 7f319b2e2980 20 remove_watcher() i=5 2024-09-11T11:02:31.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.562+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94072282792432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee9021c10 con 0x558ee8ff31a0 2024-09-11T11:02:31.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f31985f1640 1 -- 172.21.15.145:0/1666420580 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94072282792432] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f31800aaa90 con 0x558ee8ff31a0 2024-09-11T11:02:31.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 20 remove_watcher() i=6 2024-09-11T11:02:31.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94072282794640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x558ee8ffc1f0 con 0x7f318804fc20 2024-09-11T11:02:31.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94072282794640] v34'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f319000a4d0 con 0x7f318804fc20 2024-09-11T11:02:31.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 20 remove_watcher() i=7 2024-09-11T11:02:31.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fee170 msgr2=0x558ee8ff0560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fee170 0x558ee8ff0560 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fe9cb0 msgr2=0x558ee8fec170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fe9cb0 0x558ee8fec170 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f318804fc20 msgr2=0x7f31880145a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f318804fc20 0x7f31880145a0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ee8ff31a0 msgr2=0x558ee8ff5590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558ee8ff31a0 0x558ee8ff5590 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3064034650 msgr2=0x7f3064036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3064034650 0x7f3064036b10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x558ee8fb9b70 tx=0x7f31800c1040 comp rx=0 tx=0).stop 2024-09-11T11:02:31.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 msgr2=0x558ee8fdec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f31995f3640 1 -- 172.21.15.145:0/1666420580 reap_dead start 2024-09-11T11:02:31.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fdec70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3188019de0 tx=0x7f3188044f10 comp rx=0 tx=0).stop 2024-09-11T11:02:31.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 shutdown_connections 2024-09-11T11:02:31.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/1666420580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fd7a30 0x558ee8fdec70 secure :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3188019de0 tx=0x7f3188044f10 comp rx=0 tx=0).stop 2024-09-11T11:02:31.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 >> 172.21.15.145:0/1666420580 conn(0x558ee8fd3e10 msgr2=0x558ee8fd1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 shutdown_connections 2024-09-11T11:02:31.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/1666420580 wait complete. 2024-09-11T11:02:31.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/2372694991 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3070034650 msgr2=0x7f3070036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/2372694991 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3070034650 0x7f3070036b10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x558ee8e2ec30 tx=0x7f3180005ad0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/2372694991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fcb2c0 msgr2=0x558ee8fcb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/2372694991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fcb2c0 0x558ee8fcb6e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f318804a1c0 tx=0x7f318801a850 comp rx=0 tx=0).stop 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/2372694991 shutdown_connections 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/2372694991 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3070034650 0x7f3070036b10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/2372694991 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8fcb2c0 0x558ee8fcb6e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/2372694991 >> 172.21.15.145:0/2372694991 conn(0x558ee8fc0410 msgr2=0x558ee8fc2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/2372694991 shutdown_connections 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/2372694991 wait complete. 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fb5700 msgr2=0x558ee8fb7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.573 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558ee8fb5700 0x558ee8fb7bc0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fb2320 msgr2=0x558ee8fb4710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558ee8fb2320 0x558ee8fb4710 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ee8fbaf90 msgr2=0x558ee8fbd380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558ee8fbaf90 0x558ee8fbd380 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3080034650 msgr2=0x7f3080036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3080034650 0x7f3080036b10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f31800ae000 tx=0x7f31800a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 msgr2=0x558ee8e2f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 --2- 172.21.15.145:0/3321781557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558ee8eb86a0 0x558ee8e2f520 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f3188001fd0 tx=0x7f3188000bd0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f31995f3640 1 -- 172.21.15.145:0/3321781557 reap_dead start 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 shutdown_connections 2024-09-11T11:02:31.574 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 >> 172.21.15.145:0/3321781557 conn(0x558ee8eb41c0 msgr2=0x558ee8f9e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 shutdown_connections 2024-09-11T11:02:31.575 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.566+0000 7f319b2e2980 1 -- 172.21.15.145:0/3321781557 wait complete. 2024-09-11T11:02:31.580 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-11T11:02:31.585 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:02:31.585 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-11T11:02:31.590 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-11T11:02:31.590 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-11T11:02:31.590 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-11T11:02:31.591 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-11T11:02:31.591 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-11T11:02:31.657 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:31.657 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:31.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde36a4f980 1 Processor -- start 2024-09-11T11:02:31.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde36a4f980 1 -- start start 2024-09-11T11:02:31.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde36a4f980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557b8c6cf900 0x557b8c6d1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde36a4f980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557b8c554ae0 con 0x557b8c6cb580 2024-09-11T11:02:31.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde36a4f980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x557b8c578e30 con 0x557b8c6cf900 2024-09-11T11:02:31.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde33d5e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557b8c6cf900 0x557b8c6d1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde33d5e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x557b8c6cf900 0x557b8c6d1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56544/0 (socket says 172.21.15.145:56544) 2024-09-11T11:02:31.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde3455f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x557b8c6cb580 0x557b8c6cb960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:59262/0 (socket says 172.21.15.145:59262) 2024-09-11T11:02:31.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde33d5e640 1 -- 172.21.15.145:0/1106532005 learned_addr learned my addr 172.21.15.145:0/1106532005 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde33d5e640 1 -- 172.21.15.145:0/1106532005 >> v1:172.21.15.102:6789/0 conn(0x557b8c6cb580 legacy=0x557b8c6cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde33d5e640 1 -- 172.21.15.145:0/1106532005 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8c6d3240 con 0x557b8c6cf900 2024-09-11T11:02:31.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.658+0000 7fde33d5e640 1 --2- 172.21.15.145:0/1106532005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cf900 0x557b8c6d1cf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fde2400a4e0 tx=0x7fde2401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4926c86a7dc5bfeb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde3355d640 1 -- 172.21.15.145:0/1106532005 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde240aa540 con 0x557b8c6cf900 2024-09-11T11:02:31.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde3355d640 1 -- 172.21.15.145:0/1106532005 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde240aa6e0 con 0x557b8c6cf900 2024-09-11T11:02:31.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde3355d640 1 -- 172.21.15.145:0/1106532005 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde240aaa40 con 0x557b8c6cf900 2024-09-11T11:02:31.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde36a4f980 1 -- 172.21.15.145:0/1106532005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cf900 msgr2=0x557b8c6d1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde36a4f980 1 --2- 172.21.15.145:0/1106532005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cf900 0x557b8c6d1cf0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fde2400a4e0 tx=0x7fde2401b090 comp rx=0 tx=0).stop 2024-09-11T11:02:31.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde36a4f980 1 -- 172.21.15.145:0/1106532005 shutdown_connections 2024-09-11T11:02:31.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde36a4f980 1 --2- 172.21.15.145:0/1106532005 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cf900 0x557b8c6d1cf0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde36a4f980 1 -- 172.21.15.145:0/1106532005 >> 172.21.15.145:0/1106532005 conn(0x557b8c6c70a0 msgr2=0x557b8c6c94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde36a4f980 1 -- 172.21.15.145:0/1106532005 shutdown_connections 2024-09-11T11:02:31.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.662+0000 7fde36a4f980 1 -- 172.21.15.145:0/1106532005 wait complete. 2024-09-11T11:02:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.674+0000 7fde36a4f980 1 Processor -- start 2024-09-11T11:02:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.674+0000 7fde36a4f980 1 -- start start 2024-09-11T11:02:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c640c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557b8c57a200 con 0x557b8c6cb580 2024-09-11T11:02:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c640c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c640c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56546/0 (socket says 172.21.15.145:56546) 2024-09-11T11:02:31.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 -- 172.21.15.145:0/3050479173 learned_addr learned my addr 172.21.15.145:0/3050479173 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 -- 172.21.15.145:0/3050479173 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8c6411e0 con 0x557b8c6cb580 2024-09-11T11:02:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 --2- 172.21.15.145:0/3050479173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c640c10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fde1c001e50 tx=0x7fde1c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc63d2038960d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fdd2260c640 1 -- 172.21.15.145:0/3050479173 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c00e5d0 con 0x557b8c6cb580 2024-09-11T11:02:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fdd2260c640 1 -- 172.21.15.145:0/3050479173 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c00e770 con 0x557b8c6cb580 2024-09-11T11:02:31.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fdd2260c640 1 -- 172.21.15.145:0/3050479173 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c00eab0 con 0x557b8c6cb580 2024-09-11T11:02:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 -- 172.21.15.145:0/3050479173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 msgr2=0x557b8c640c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 --2- 172.21.15.145:0/3050479173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c640c10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fde1c001e50 tx=0x7fde1c001e80 comp rx=0 tx=0).stop 2024-09-11T11:02:31.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 -- 172.21.15.145:0/3050479173 shutdown_connections 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 --2- 172.21.15.145:0/3050479173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c640c10 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 -- 172.21.15.145:0/3050479173 >> 172.21.15.145:0/3050479173 conn(0x557b8c6c70a0 msgr2=0x557b8c7b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 -- 172.21.15.145:0/3050479173 shutdown_connections 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 -- 172.21.15.145:0/3050479173 wait complete. 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 Processor -- start 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 -- start start 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c7bed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde36a4f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557b8c6d2d40 con 0x557b8c6cb580 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c7bed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c7bed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56558/0 (socket says 172.21.15.145:56558) 2024-09-11T11:02:31.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 -- 172.21.15.145:0/2543193839 learned_addr learned my addr 172.21.15.145:0/2543193839 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.678+0000 7fde3455f640 1 -- 172.21.15.145:0/2543193839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8c7bf290 con 0x557b8c6cb580 2024-09-11T11:02:31.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde3455f640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c7bed50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x557b8c7b8c20 tx=0x7fde1c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fdd20e09640 1 -- 172.21.15.145:0/2543193839 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c001260 con 0x557b8c6cb580 2024-09-11T11:02:31.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b8c7bf520 con 0x557b8c6cb580 2024-09-11T11:02:31.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fdd20e09640 1 -- 172.21.15.145:0/2543193839 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c00fa40 con 0x557b8c6cb580 2024-09-11T11:02:31.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fdd20e09640 1 -- 172.21.15.145:0/2543193839 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c00fd80 con 0x557b8c6cb580 2024-09-11T11:02:31.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8c7c2200 con 0x557b8c6cb580 2024-09-11T11:02:31.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fdd20e09640 1 -- 172.21.15.145:0/2543193839 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fde1c017070 con 0x557b8c6cb580 2024-09-11T11:02:31.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fdd20e09640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd1c034650 0x7fdd1c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fdd20e09640 1 -- 172.21.15.145:0/2543193839 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fde1c015020 con 0x557b8c6cb580 2024-09-11T11:02:31.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde33d5e640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd1c034650 0x7fdd1c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c6cf900 0x557b8c7c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c7c63b0 con 0x557b8c6cf900 2024-09-11T11:02:31.685 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde34d60640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c6cf900 0x557b8c7c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde33d5e640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd1c034650 0x7fdd1c036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde240ab000 tx=0x7fde240a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde34d60640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c6cf900 0x557b8c7c5d40 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde34d60640 1 -- 172.21.15.145:0/2543193839 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c6cf900 2024-09-11T11:02:31.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7c7180 0x557b8c7c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c7c9bb0 con 0x557b8c7c7180 2024-09-11T11:02:31.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.682+0000 7fde3455f640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7c7180 0x557b8c7c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde3455f640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7c7180 0x557b8c7c9570 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde3455f640 1 -- 172.21.15.145:0/2543193839 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde1c02e070 con 0x557b8c7c7180 2024-09-11T11:02:31.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c7cb460 con 0x557b8c7c7180 2024-09-11T11:02:31.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde3455f640 1 -- 172.21.15.145:0/2543193839 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fde1c02e070 con 0x557b8c7c7180 2024-09-11T11:02:31.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c7ca690 con 0x557b8c7c7180 2024-09-11T11:02:31.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde3455f640 1 -- 172.21.15.145:0/2543193839 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde1c02e070 con 0x557b8c7c7180 2024-09-11T11:02:31.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557b8c7cc810 0x557b8c7cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c7cf140 con 0x557b8c7cc810 2024-09-11T11:02:31.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde33d5e640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557b8c7cc810 0x557b8c7cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde33d5e640 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557b8c7cc810 0x557b8c7cec00 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde33d5e640 1 -- 172.21.15.145:0/2543193839 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fde240bc040 con 0x557b8c7cc810 2024-09-11T11:02:31.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde36a4f980 1 Processor -- start 2024-09-11T11:02:31.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde36a4f980 1 -- start start 2024-09-11T11:02:31.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde36a4f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7dcb40 0x557b8c7dcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.686+0000 7fde36a4f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557b8c5d3800 con 0x557b8c7dcb40 2024-09-11T11:02:31.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7dcb40 0x557b8c7dcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7dcb40 0x557b8c7dcf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56574/0 (socket says 172.21.15.145:56574) 2024-09-11T11:02:31.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde3455f640 1 -- 172.21.15.145:0/2265068243 learned_addr learned my addr 172.21.15.145:0/2265068243 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde3455f640 1 -- 172.21.15.145:0/2265068243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8c7dd4a0 con 0x557b8c7dcb40 2024-09-11T11:02:31.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde3455f640 1 --2- 172.21.15.145:0/2265068243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7dcb40 0x557b8c7dcf60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fde1c048ee0 tx=0x7fde1c017d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fdd19ffb640 1 -- 172.21.15.145:0/2265068243 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c01a980 con 0x557b8c7dcb40 2024-09-11T11:02:31.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fdd19ffb640 1 -- 172.21.15.145:0/2265068243 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c04ab90 con 0x557b8c7dcb40 2024-09-11T11:02:31.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fdd19ffb640 1 -- 172.21.15.145:0/2265068243 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c042020 con 0x557b8c7dcb40 2024-09-11T11:02:31.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde36a4f980 1 -- 172.21.15.145:0/2265068243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b8c7dd730 con 0x557b8c7dcb40 2024-09-11T11:02:31.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde36a4f980 1 -- 172.21.15.145:0/2265068243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8c7dd730 con 0x557b8c7dcb40 2024-09-11T11:02:31.693 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fdd19ffb640 1 -- 172.21.15.145:0/2265068243 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fde1c0421c0 con 0x557b8c7dcb40 2024-09-11T11:02:31.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fdd19ffb640 1 --2- 172.21.15.145:0/2265068243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd0c034650 0x7fdd0c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fdd19ffb640 1 -- 172.21.15.145:0/2265068243 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fde1c03e040 con 0x557b8c7dcb40 2024-09-11T11:02:31.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde33d5e640 1 --2- 172.21.15.145:0/2265068243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd0c034650 0x7fdd0c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde36a4f980 1 Processor -- start 2024-09-11T11:02:31.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde36a4f980 1 -- start start 2024-09-11T11:02:31.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde36a4f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde33d5e640 1 --2- 172.21.15.145:0/2265068243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd0c034650 0x7fdd0c036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x557b8c7c3340 tx=0x7fde24005e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.690+0000 7fde36a4f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557b8c641560 con 0x557b8c7e9310 2024-09-11T11:02:31.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7e96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56582/0 (socket says 172.21.15.145:56582) 2024-09-11T11:02:31.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 -- 172.21.15.145:0/74178757 learned_addr learned my addr 172.21.15.145:0/74178757 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 -- 172.21.15.145:0/74178757 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8c7e9cc0 con 0x557b8c7e9310 2024-09-11T11:02:31.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 --2- 172.21.15.145:0/74178757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7e96f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fde1c053b60 tx=0x7fde1c0538b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed80a7e6fd1f8387 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fdd0b7fe640 1 -- 172.21.15.145:0/74178757 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c05a040 con 0x557b8c7e9310 2024-09-11T11:02:31.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fdd0b7fe640 1 -- 172.21.15.145:0/74178757 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c0283f0 con 0x557b8c7e9310 2024-09-11T11:02:31.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fdd0b7fe640 1 -- 172.21.15.145:0/74178757 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c053c50 con 0x557b8c7e9310 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- 172.21.15.145:0/74178757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 msgr2=0x557b8c7e96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 --2- 172.21.15.145:0/74178757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7e96f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fde1c053b60 tx=0x7fde1c0538b0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- 172.21.15.145:0/74178757 shutdown_connections 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 --2- 172.21.15.145:0/74178757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7e96f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- 172.21.15.145:0/74178757 >> 172.21.15.145:0/74178757 conn(0x557b8c7e56f0 msgr2=0x557b8c7e37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- 172.21.15.145:0/74178757 shutdown_connections 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- 172.21.15.145:0/74178757 wait complete. 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 Processor -- start 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- start start 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.698 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557b8c7ea160 con 0x557b8c7e9310 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7f04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56594/0 (socket says 172.21.15.145:56594) 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 learned_addr learned my addr 172.21.15.145:0/57893713 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b8c7f09f0 con 0x557b8c7e9310 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde3455f640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7f04b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0539b0 tx=0x7fde1c021f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fdd09ffb640 1 -- 172.21.15.145:0/57893713 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c010df0 con 0x557b8c7e9310 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fdd09ffb640 1 -- 172.21.15.145:0/57893713 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde1c06e030 con 0x557b8c7e9310 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557b8c7f09f0 con 0x557b8c7e9310 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fdd09ffb640 1 -- 172.21.15.145:0/57893713 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde1c047290 con 0x557b8c7e9310 2024-09-11T11:02:31.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.694+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b8c7f09f0 con 0x557b8c7e9310 2024-09-11T11:02:31.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fdd09ffb640 1 -- 172.21.15.145:0/57893713 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fde1c047430 con 0x557b8c7e9310 2024-09-11T11:02:31.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fdd09ffb640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdcfc034650 0x7fdcfc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fdd09ffb640 1 -- 172.21.15.145:0/57893713 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7fde1c074bf0 con 0x557b8c7e9310 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde33d5e640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdcfc034650 0x7fdcfc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c7fb5e0 0x557b8c7fdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c7fe1f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde34d60640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c7fb5e0 0x557b8c7fdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde33d5e640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdcfc034650 0x7fdcfc036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fde2401b0d0 tx=0x7fde240a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde34d60640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c7fb5e0 0x557b8c7fdaa0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 20 realm 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c7faa10 con 0x557b8c7fb5e0 2024-09-11T11:02:31.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c7fecb0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7ffa90 0x557b8c801e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c802530 con 0x557b8c7ffa90 2024-09-11T11:02:31.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.698+0000 7fde3455f640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7ffa90 0x557b8c801e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde3455f640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7ffa90 0x557b8c801e80 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fde1c07a070 con 0x557b8c7ffa90 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde36a4f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c802d80 con 0x557b8c7ffa90 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fde1c07a070 con 0x557b8c7ffa90 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde36a4f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde36a4f980 20 searching for the correct realm 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557b8c804af0 0x557b8c806ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c804af0 2024-09-11T11:02:31.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde33d5e640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557b8c804af0 0x557b8c806ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde33d5e640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557b8c804af0 0x557b8c806ee0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.706 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fde1c07a070 con 0x557b8c7ffa90 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde3455f640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fde1c069050 0x7fde1c028610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x7fde1c069050 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde34d60640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fde1c069050 0x7fde1c028610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.702+0000 7fde34d60640 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fde1c069050 0x7fde1c028610 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c804af0 2024-09-11T11:02:31.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c07a070 con 0x557b8c7ffa90 2024-09-11T11:02:31.709 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c07a070 con 0x557b8c7ffa90 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x7fde1c069050 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x7fde1c069050 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.706+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c804af0 2024-09-11T11:02:31.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.712 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c804af0 2024-09-11T11:02:31.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c804af0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x7fde1c069050 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.715 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7fb5e0 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x7fde1c069050 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c804af0 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x7fde1c069050 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.710+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.716 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.719 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c804af0 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807590 con 0x557b8c7ffa90 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:31.720 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c803700 con 0x557b8c7fb5e0 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c803340 con 0x557b8c7ffa90 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.714+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8040a0 con 0x7fde1c069050 2024-09-11T11:02:31.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 zone default found 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 4 Realm: () 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 zonegroup default 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c807ea0 con 0x7fde1c069050 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.722 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80a150 con 0x557b8c804af0 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80a4f0 con 0x557b8c804af0 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 started sync module instance, tier type = 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:31.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c809590 con 0x557b8c7ffa90 2024-09-11T11:02:31.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93989126576864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c809590 con 0x557b8c7ffa90 2024-09-11T11:02:31.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.718+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80aeb0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.722+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.722+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93989126580736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80ae20 con 0x557b8c7fb5e0 2024-09-11T11:02:31.724 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.722+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80be00 con 0x557b8c7ffa90 2024-09-11T11:02:31.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.722+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93989126576864] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.722+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93989126580736] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.722+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.722+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93989126582944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80bdc0 con 0x557b8c7ffa90 2024-09-11T11:02:31.725 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.722+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80c6a0 con 0x7fde1c069050 2024-09-11T11:02:31.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.726+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.726+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93989126586864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80bdc0 con 0x7fde1c069050 2024-09-11T11:02:31.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.726+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80d130 con 0x557b8c7ffa90 2024-09-11T11:02:31.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.726+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93989126586864] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.728 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.726+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93989126582944] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.726+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.726+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93989126584560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80d130 con 0x557b8c7ffa90 2024-09-11T11:02:31.729 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.726+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80d520 con 0x557b8c804af0 2024-09-11T11:02:31.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93989126587920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80dd70 con 0x557b8c804af0 2024-09-11T11:02:31.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80e730 con 0x557b8c804af0 2024-09-11T11:02:31.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93989126584560] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.731 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93989126587920] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93989126595200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80eb50 con 0x557b8c804af0 2024-09-11T11:02:31.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80f3e0 con 0x7fde1c069050 2024-09-11T11:02:31.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93989126595200] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93989126589536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c80f7d0 con 0x7fde1c069050 2024-09-11T11:02:31.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 20 add_watcher() i=0 2024-09-11T11:02:31.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 20 add_watcher() i=1 2024-09-11T11:02:31.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 20 add_watcher() i=2 2024-09-11T11:02:31.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 20 add_watcher() i=3 2024-09-11T11:02:31.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 20 add_watcher() i=4 2024-09-11T11:02:31.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 20 add_watcher() i=5 2024-09-11T11:02:31.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.730+0000 7fde36a4f980 20 add_watcher() i=6 2024-09-11T11:02:31.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93989126589536] v34'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde36a4f980 20 add_watcher() i=7 2024-09-11T11:02:31.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde36a4f980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:31.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c812c00 con 0x557b8c7fb5e0 2024-09-11T11:02:31.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93989126598384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c810120 con 0x557b8c7fb5e0 2024-09-11T11:02:31.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93989126598384] v34'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fdcea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:31.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde36a4f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:31.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde36a4f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:31.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.734+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c812890 con 0x557b8c7ffa90 2024-09-11T11:02:31.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.738+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.738+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c812850 con 0x7fde1c069050 2024-09-11T11:02:31.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.738+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.738+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81bc50 con 0x557b8c804af0 2024-09-11T11:02:31.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.742+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.742+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81bc50 con 0x557b8c7fb5e0 2024-09-11T11:02:31.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.742+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.742+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81c670 con 0x557b8c7ffa90 2024-09-11T11:02:31.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.746+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.746+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81c670 con 0x557b8c804af0 2024-09-11T11:02:31.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.746+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.746+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81cbe0 con 0x557b8c7ffa90 2024-09-11T11:02:31.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.750+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.750+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81cbe0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.750+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.750+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d090 con 0x557b8c7ffa90 2024-09-11T11:02:31.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.754+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.754+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d090 con 0x557b8c7ffa90 2024-09-11T11:02:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.754+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.754+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d090 con 0x557b8c7ffa90 2024-09-11T11:02:31.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.758+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.758+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d090 con 0x557b8c804af0 2024-09-11T11:02:31.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.758+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.758+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d600 con 0x557b8c7ffa90 2024-09-11T11:02:31.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.762+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.762+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d600 con 0x557b8c7fb5e0 2024-09-11T11:02:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.762+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.762+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d690 con 0x557b8c7fb5e0 2024-09-11T11:02:31.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.766+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.766+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d720 con 0x557b8c7ffa90 2024-09-11T11:02:31.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.766+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'62 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.770+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d720 con 0x557b8c7ffa90 2024-09-11T11:02:31.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.770+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.770+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d720 con 0x557b8c804af0 2024-09-11T11:02:31.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.774+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.774+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d8f0 con 0x557b8c7ffa90 2024-09-11T11:02:31.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.774+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.774+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81d8f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.778+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.778+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c7ffa90 2024-09-11T11:02:31.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.778+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'63 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.778+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c7ffa90 2024-09-11T11:02:31.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.782+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.782+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c804af0 2024-09-11T11:02:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.782+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.782+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c7ffa90 2024-09-11T11:02:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.786+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.786+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c804af0 2024-09-11T11:02:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.790+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.790+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c804af0 2024-09-11T11:02:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.790+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.790+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c804af0 2024-09-11T11:02:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.794+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.794+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c7ffa90 2024-09-11T11:02:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.794+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.794+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.798+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.798+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c7ffa90 2024-09-11T11:02:31.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.798+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'64 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.798+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81dcd0 con 0x7fde1c069050 2024-09-11T11:02:31.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fdce97e2640 20 reqs_thread_entry: start 2024-09-11T11:02:31.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fde36a4f980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:31.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fde36a4f980 20 Filter name: none 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fdc5affd640 20 reqs_thread_entry: start 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fde36a4f980 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.802+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c838d00 con 0x7fde1c069050 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:02:31.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c81b690 con 0x557b8c7ffa90 2024-09-11T11:02:31.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 : miss 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 8.1a 8:5a37c305:root::.bucket.meta.myfoo6%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c83b470 con 0x557b8c804af0 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(96 .bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv5 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 info.flags=0x17 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 to cache LRU end 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-11T11:02:31.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 2024-09-11T11:02:31.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 4.5 4:a056f2df:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8930 con 0x557b8c7ffa90 2024-09-11T11:02:31.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(97 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0 [call out=85b] v0'0 uv14 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.806+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:98 4.3a 4:5d04c75d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8930 con 0x557b8c804af0 2024-09-11T11:02:31.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(98 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:99 4.35 4:ae22deb2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x557b8c7fb5e0 2024-09-11T11:02:31.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(99 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 4.19 4:990a4740:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x557b8c804af0 2024-09-11T11:02:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(100 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 4.3a 4:5eb79869:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x557b8c804af0 2024-09-11T11:02:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(101 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:102 4.3d 4:be1067ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x557b8c7ffa90 2024-09-11T11:02:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(102 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:103 4.11 4:89f6661e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x7fde1c069050 2024-09-11T11:02:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(103 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:104 4.1e 4:79aca478:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x557b8c7fb5e0 2024-09-11T11:02:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(104 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.810+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:105 4.3e 4:7d8e0d30:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x557b8c7ffa90 2024-09-11T11:02:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(105 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:106 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x7fde1c069050 2024-09-11T11:02:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(106 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [call out=345b] v0'0 uv5 ondisk = 0) ==== 194+0+345 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 10 cls_bucket_list_unordered: got thirteen 2024-09-11T11:02:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:107 4.8 4:117b87dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8970 con 0x557b8c804af0 2024-09-11T11:02:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(107 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 20 get_obj_state: octx=0x7fde1c005f10 obj=myfoo6:thirteen state=0x557b8c8b69d8 s->prefetch_data=0 2024-09-11T11:02:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:108 3.22 3:46aa9246:::27698d38-fc40-410e-96d8-191ffc71147c.4235.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b7800 con 0x557b8c804af0 2024-09-11T11:02:31.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(108 27698d38-fc40-410e-96d8-191ffc71147c.4235.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 10 manifest: total_size = 8 2024-09-11T11:02:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 20 get_obj_state: setting s->obj_tag to _xvrP1Ue8ECVQtSGQ6z9ZPESEPNVevwD 2024-09-11T11:02:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 20 get_obj_state: octx=0x7fde1c005f10 obj=myfoo6:thirteen state=0x557b8c8b69d8 s->prefetch_data=0 2024-09-11T11:02:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 20 prepare_atomic_modification: state is not atomic. state=0x557b8c8b69d8 2024-09-11T11:02:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 2024-09-11T11:02:31.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:109 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b80c0 con 0x7fde1c069050 2024-09-11T11:02:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(109 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [stat,call,call] v34'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.814+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:110 3.22 3:46aa9246:::27698d38-fc40-410e-96d8-191ffc71147c.4235.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b80c0 con 0x557b8c804af0 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(110 27698d38-fc40-410e-96d8-191ffc71147c.4235.9_thirteen [call] v34'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:111 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8030 con 0x7fde1c069050 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 20 list_objects_ordered: starting attempt 1 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:112 4.5 4:a056f2df:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8030 con 0x557b8c7ffa90 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:113 4.3a 4:5d04c75d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c844f10 con 0x557b8c804af0 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:114 4.35 4:ae22deb2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c847860 con 0x557b8c7fb5e0 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:115 4.19 4:990a4740:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8030 con 0x557b8c804af0 2024-09-11T11:02:31.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:116 4.3a 4:5eb79869:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84c6d0 con 0x557b8c804af0 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:117 4.3d 4:be1067ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8b8030 con 0x557b8c7ffa90 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:118 4.11 4:89f6661e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84c6d0 con 0x7fde1c069050 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(114 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c0083f0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(115 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== osd_op_reply(113 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(116 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:119 4.1e 4:79aca478:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842a40 con 0x557b8c7fb5e0 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(118 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c0083f0 con 0x7fde1c069050 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:120 4.3e 4:7d8e0d30:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a820 con 0x557b8c7ffa90 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:121 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84b160 con 0x7fde1c069050 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:122 4.8 4:117b87dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84b6d0 con 0x557b8c804af0 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(112 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0 [call out=85b] v0'0 uv14 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(117 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(122 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(119 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c041060 con 0x557b8c7fb5e0 2024-09-11T11:02:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(111 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [stat,call,call] v34'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fde2c041060 con 0x7fde1c069050 2024-09-11T11:02:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fdd0b7fe640 20 handle_completion(): completion ok for obj=thirteen 2024-09-11T11:02:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(120 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(121 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fde2c041060 con 0x7fde1c069050 2024-09-11T11:02:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-11T11:02:31.826 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[27698d38-fc40-410e-96d8-191ffc71147c.4235.9])"; uploads.size()=0; is_truncated=0 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:123 4.5 4:a056f2df:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a370 con 0x557b8c7ffa90 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:124 4.3a 4:5d04c75d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84acb0 con 0x557b8c804af0 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:125 4.35 4:ae22deb2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8473b0 con 0x557b8c7fb5e0 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.818+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:126 4.19 4:990a4740:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c841580 con 0x557b8c804af0 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:127 4.3a 4:5eb79869:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842a00 con 0x557b8c804af0 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:128 4.3d 4:be1067ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a370 con 0x557b8c7ffa90 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:129 4.11 4:89f6661e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a370 con 0x7fde1c069050 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:130 4.1e 4:79aca478:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a370 con 0x557b8c7fb5e0 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:131 4.3e 4:7d8e0d30:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8473b0 con 0x557b8c7ffa90 2024-09-11T11:02:31.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:132 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c8473b0 con 0x7fde1c069050 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:133 4.8 4:117b87dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c857c10 con 0x557b8c804af0 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(125 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c041060 con 0x557b8c7fb5e0 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== osd_op_reply(124 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== osd_op_reply(126 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== osd_op_reply(127 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4 [call out=85b] v0'0 uv8 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(129 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c041060 con 0x7fde1c069050 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(128 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 23 ==== osd_op_reply(132 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fde2c041060 con 0x7fde1c069050 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(130 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde2c041060 con 0x557b8c7fb5e0 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(123 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0 [call out=85b] v0'0 uv14 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(131 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== osd_op_reply(133 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a780 con 0x557b8c7ffa90 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(134 bud.buckets [call] v34'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a780 con 0x557b8c7fb5e0 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 32 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv19 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7fde2c041060 con 0x557b8c7fb5e0 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 20 rados_obj.operate() r=0 bl.length=166 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-11T11:02:31.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.822+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a780 con 0x557b8c7fb5e0 2024-09-11T11:02:31.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 33 ==== osd_op_reply(136 myfoo6 [call,call,delete] v34'20 uv20 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fde2c041060 con 0x557b8c7fb5e0 2024-09-11T11:02:31.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde36a4f980 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde36a4f980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93989126841040 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a6f0 con 0x7fde1c069050 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 24 ==== watch-notify(notify (1) cookie 93989126586864 notify 146028888090 ret 0) ==== 192+0+0 (crc 0 0 0) 0x557b8c81c560 con 0x7fde1c069050 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fdd0b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888090 cookie 93989126586864 notifier 4759 bl.length()=150 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fdd0b7fe640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdcf8003d70 con 0x7fde1c069050 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 25 ==== osd_op_reply(137 notify.3 [notify cookie 93989126841040 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde2c041060 con 0x7fde1c069050 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 26 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c041060 con 0x7fde1c069050 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 27 ==== watch-notify(notify_complete (2) cookie 93989126841040 notify 146028888090 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b8c81bc50 con 0x7fde1c069050 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:139 8.1a 8:5a37c305:root::.bucket.meta.myfoo6%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84c730 con 0x557b8c804af0 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 37 ==== osd_op_reply(139 .bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 [call,call,delete] v34'6 uv6 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7fde240ca070 con 0x557b8c804af0 2024-09-11T11:02:31.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde36a4f980 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9 from cache 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde36a4f980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:27698d38-fc40-410e-96d8-191ffc71147c.4235.9, ofs0, ns] 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:140 7.9 7:93e5b521:::notify.7:head [notify cookie 93989126779872 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a780 con 0x7fde1c069050 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 28 ==== watch-notify(notify (1) cookie 93989126589536 notify 146028888091 ret 0) ==== 249+0+0 (crc 0 0 0) 0x557b8c81bc50 con 0x7fde1c069050 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 29 ==== osd_op_reply(140 notify.7 [notify cookie 93989126779872 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde2c04c040 con 0x7fde1c069050 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fdd0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888091 cookie 93989126589536 notifier 4759 bl.length()=207 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.826+0000 7fdd0affd640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:141 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdc680032d0 con 0x7fde1c069050 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 30 ==== watch-notify(notify_complete (2) cookie 93989126779872 notify 146028888091 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b8c81c390 con 0x7fde1c069050 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:142 4.5 4:a056f2df:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a2d0 con 0x557b8c7ffa90 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 31 ==== osd_op_reply(141 notify.7 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x7fde1c069050 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:143 4.3a 4:5d04c75d:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c839900 con 0x557b8c804af0 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:144 4.35 4:ae22deb2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c83a150 con 0x557b8c7fb5e0 2024-09-11T11:02:31.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:145 4.19 4:990a4740:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c83a4f0 con 0x557b8c804af0 2024-09-11T11:02:31.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:146 4.3a 4:5eb79869:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842350 con 0x557b8c804af0 2024-09-11T11:02:31.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:147 4.3d 4:be1067ee:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a2d0 con 0x557b8c7ffa90 2024-09-11T11:02:31.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:148 4.11 4:89f6661e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c840ed0 con 0x7fde1c069050 2024-09-11T11:02:31.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:149 4.1e 4:79aca478:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84b270 con 0x557b8c7fb5e0 2024-09-11T11:02:31.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:150 4.3e 4:7d8e0d30:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c839900 con 0x557b8c7ffa90 2024-09-11T11:02:31.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:151 4.37 4:ef8706d1:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c83a150 con 0x7fde1c069050 2024-09-11T11:02:31.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:152 4.8 4:117b87dc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84a2d0 con 0x557b8c804af0 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 38 ==== osd_op_reply(152 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.10 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 32 ==== osd_op_reply(151 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.9 [delete] v34'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x7fde1c069050 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 39 ==== osd_op_reply(145 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.3 [delete] v34'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 45 ==== osd_op_reply(147 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.5 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 40 ==== osd_op_reply(143 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.1 [delete] v34'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 46 ==== osd_op_reply(142 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.0 [delete] v34'16 uv16 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 47 ==== osd_op_reply(150 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.8 [delete] v34'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.830+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 33 ==== osd_op_reply(148 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.6 [delete] v34'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x7fde1c069050 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 41 ==== osd_op_reply(146 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.4 [delete] v34'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 34 ==== osd_op_reply(149 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.7 [delete] v34'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x557b8c7fb5e0 2024-09-11T11:02:31.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 35 ==== osd_op_reply(144 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.9.2 [delete] v34'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x557b8c7fb5e0 2024-09-11T11:02:31.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde36a4f980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/27698d38-fc40-410e-96d8-191ffc71147c.4235.9 : miss 2024-09-11T11:02:31.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde36a4f980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:153 6.6 6:64f875ad:::pubsub..bucket.myfoo6%2f27698d38-fc40-410e-96d8-191ffc71147c.4235.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842350 con 0x557b8c804af0 2024-09-11T11:02:31.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 42 ==== osd_op_reply(153 pubsub..bucket.myfoo6/27698d38-fc40-410e-96d8-191ffc71147c.4235.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde36a4f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde36a4f980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/27698d38-fc40-410e-96d8-191ffc71147c.4235.9 info.flags=0x0 2024-09-11T11:02:31.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde36a4f980 10 adding default.rgw.log++pubsub..bucket.myfoo6/27698d38-fc40-410e-96d8-191ffc71147c.4235.9 to cache LRU end 2024-09-11T11:02:31.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:154 6.6 6:64f875ad:::pubsub..bucket.myfoo6%2f27698d38-fc40-410e-96d8-191ffc71147c.4235.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84b270 con 0x557b8c804af0 2024-09-11T11:02:31.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 43 ==== osd_op_reply(154 pubsub..bucket.myfoo6/27698d38-fc40-410e-96d8-191ffc71147c.4235.9 [delete] v34'13 uv12 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.834+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c83a4f0 con 0x557b8c7ffa90 2024-09-11T11:02:31.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 48 ==== osd_op_reply(155 bud.buckets [call] v34'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fde36a4f980 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-11T11:02:31.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84b270 con 0x557b8c7fb5e0 2024-09-11T11:02:31.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 36 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v34'11 uv11 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x557b8c7fb5e0 2024-09-11T11:02:31.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fde36a4f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-11T11:02:31.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 93989126850224 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84b270 con 0x557b8c804af0 2024-09-11T11:02:31.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 44 ==== watch-notify(notify (1) cookie 93989126587920 notify 146028888084 ret 0) ==== 212+0+0 (crc 0 0 0) 0x557b8c83aa70 con 0x557b8c804af0 2024-09-11T11:02:31.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fdd0b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888084 cookie 93989126587920 notifier 4759 bl.length()=170 2024-09-11T11:02:31.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 45 ==== osd_op_reply(157 notify.5 [notify cookie 93989126850224 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.838+0000 7fdd0b7fe640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdcf8003d70 con 0x557b8c804af0 2024-09-11T11:02:31.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 46 ==== watch-notify(notify_complete (2) cookie 93989126850224 notify 146028888084 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b8c81c1c0 con 0x557b8c804af0 2024-09-11T11:02:31.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde36a4f980 10 removing email index: 2024-09-11T11:02:31.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde36a4f980 10 removing user buckets index 2024-09-11T11:02:31.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 47 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842780 con 0x557b8c7ffa90 2024-09-11T11:02:31.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 49 ==== osd_op_reply(159 bud.buckets [delete] v34'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde36a4f980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-11T11:02:31.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93989126850224 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842780 con 0x557b8c804af0 2024-09-11T11:02:31.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 48 ==== watch-notify(notify (1) cookie 93989126595200 notify 146028888085 ret 0) ==== 202+0+0 (crc 0 0 0) 0x557b8c81c1c0 con 0x557b8c804af0 2024-09-11T11:02:31.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fdd0b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888085 cookie 93989126595200 notifier 4759 bl.length()=160 2024-09-11T11:02:31.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fdd0b7fe640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdcf8003d70 con 0x557b8c804af0 2024-09-11T11:02:31.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 49 ==== osd_op_reply(160 notify.6 [notify cookie 93989126850224 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 50 ==== watch-notify(notify_complete (2) cookie 93989126850224 notify 146028888085 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b8c81ca10 con 0x557b8c804af0 2024-09-11T11:02:31.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde36a4f980 10 removing user index: bud 2024-09-11T11:02:31.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 51 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.842+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842780 con 0x7fde1c069050 2024-09-11T11:02:31.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 34 ==== osd_op_reply(162 bud [call,call,delete] v34'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x7fde1c069050 2024-09-11T11:02:31.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde36a4f980 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-11T11:02:31.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde36a4f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-11T11:02:31.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93989126830048 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842780 con 0x557b8c804af0 2024-09-11T11:02:31.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 52 ==== watch-notify(notify (1) cookie 93989126587920 notify 146028888086 ret 0) ==== 194+0+0 (crc 0 0 0) 0x557b8c81ca10 con 0x557b8c804af0 2024-09-11T11:02:31.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fdd0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888086 cookie 93989126587920 notifier 4759 bl.length()=152 2024-09-11T11:02:31.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 53 ==== osd_op_reply(163 notify.5 [notify cookie 93989126830048 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fdd0affd640 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7fdc680032b0 con 0x557b8c804af0 2024-09-11T11:02:31.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 54 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 55 ==== watch-notify(notify_complete (2) cookie 93989126830048 notify 146028888086 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557b8c81be20 con 0x557b8c804af0 2024-09-11T11:02:31.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fdcea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:31.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.846+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93989126598384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c842780 con 0x557b8c7fb5e0 2024-09-11T11:02:31.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.850+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 37 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93989126598384] v34'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x557b8c7fb5e0 2024-09-11T11:02:31.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.850+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93989126576864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84ac30 con 0x557b8c7ffa90 2024-09-11T11:02:31.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.850+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 50 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93989126576864] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.850+0000 7fde36a4f980 20 remove_watcher() i=0 2024-09-11T11:02:31.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.850+0000 7fde36a4f980 2 removed watcher, disabling cache 2024-09-11T11:02:31.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.850+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93989126580736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84ac30 con 0x557b8c7fb5e0 2024-09-11T11:02:31.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.1 v2:172.21.15.145:6808/1879781812 38 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93989126580736] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x557b8c7fb5e0 2024-09-11T11:02:31.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde36a4f980 20 remove_watcher() i=1 2024-09-11T11:02:31.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93989126582944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84ac30 con 0x557b8c7ffa90 2024-09-11T11:02:31.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 51 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93989126582944] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde36a4f980 20 remove_watcher() i=2 2024-09-11T11:02:31.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93989126586864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84ac30 con 0x7fde1c069050 2024-09-11T11:02:31.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93989126586864] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x7fde1c069050 2024-09-11T11:02:31.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde36a4f980 20 remove_watcher() i=3 2024-09-11T11:02:31.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.854+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93989126584560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84ac30 con 0x557b8c7ffa90 2024-09-11T11:02:31.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.858+0000 7fde3455f640 1 -- 172.21.15.145:0/57893713 <== osd.0 v2:172.21.15.102:6800/3035634142 52 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93989126584560] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde1c08e040 con 0x557b8c7ffa90 2024-09-11T11:02:31.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.858+0000 7fde36a4f980 20 remove_watcher() i=4 2024-09-11T11:02:31.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.858+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93989126587920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84ac30 con 0x557b8c804af0 2024-09-11T11:02:31.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.858+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 56 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93989126587920] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.858+0000 7fde36a4f980 20 remove_watcher() i=5 2024-09-11T11:02:31.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.858+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93989126595200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84ac30 con 0x557b8c804af0 2024-09-11T11:02:31.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde33d5e640 1 -- 172.21.15.145:0/57893713 <== osd.3 v2:172.21.15.145:6800/493661776 57 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93989126595200] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde240f1040 con 0x557b8c804af0 2024-09-11T11:02:31.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 20 remove_watcher() i=6 2024-09-11T11:02:31.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93989126589536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x557b8c84ac30 con 0x7fde1c069050 2024-09-11T11:02:31.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 <== osd.2 v2:172.21.15.145:6816/446921044 36 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93989126589536] v34'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fde2c04c040 con 0x7fde1c069050 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 20 remove_watcher() i=7 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7ffa90 msgr2=0x557b8c801e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7ffa90 0x557b8c801e80 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c7fb5e0 msgr2=0x557b8c7fdaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c7fb5e0 0x557b8c7fdaa0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fde1c069050 msgr2=0x7fde1c028610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fde1c069050 0x7fde1c028610 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557b8c804af0 msgr2=0x557b8c806ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557b8c804af0 0x557b8c806ee0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdcfc034650 msgr2=0x7fdcfc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdcfc034650 0x7fdcfc036b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fde2401b0d0 tx=0x7fde240a6000 comp rx=0 tx=0).stop 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 msgr2=0x557b8c7f04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde34d60640 1 -- 172.21.15.145:0/57893713 reap_dead start 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7f04b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0539b0 tx=0x7fde1c021f80 comp rx=0 tx=0).stop 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 shutdown_connections 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/57893713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7e9310 0x557b8c7f04b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 >> 172.21.15.145:0/57893713 conn(0x557b8c7e56f0 msgr2=0x557b8c7e37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 shutdown_connections 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/57893713 wait complete. 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2265068243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd0c034650 msgr2=0x7fdd0c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2265068243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd0c034650 0x7fdd0c036b10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x557b8c7c3340 tx=0x7fde24005e50 comp rx=0 tx=0).stop 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2265068243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7dcb40 msgr2=0x557b8c7dcf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2265068243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7dcb40 0x557b8c7dcf60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fde1c048ee0 tx=0x7fde1c017d50 comp rx=0 tx=0).stop 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2265068243 shutdown_connections 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2265068243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd0c034650 0x7fdd0c036b10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2265068243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c7dcb40 0x557b8c7dcf60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2265068243 >> 172.21.15.145:0/2265068243 conn(0x557b8c7d1c90 msgr2=0x557b8c7d4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2265068243 shutdown_connections 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2265068243 wait complete. 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7c7180 msgr2=0x557b8c7c9570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557b8c7c7180 0x557b8c7c9570 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c6cf900 msgr2=0x557b8c7c5d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557b8c6cf900 0x557b8c7c5d40 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557b8c7cc810 msgr2=0x557b8c7cec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557b8c7cc810 0x557b8c7cec00 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd1c034650 msgr2=0x7fdd1c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdd1c034650 0x7fdd1c036b10 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fde240ab000 tx=0x7fde240a5000 comp rx=0 tx=0).stop 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 msgr2=0x557b8c7bed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 --2- 172.21.15.145:0/2543193839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557b8c6cb580 0x557b8c7bed50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x557b8c7b8c20 tx=0x7fde1c000bd0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde34d60640 1 -- 172.21.15.145:0/2543193839 reap_dead start 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 shutdown_connections 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 >> 172.21.15.145:0/2543193839 conn(0x557b8c6c70a0 msgr2=0x557b8c7b10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 shutdown_connections 2024-09-11T11:02:31.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.862+0000 7fde36a4f980 1 -- 172.21.15.145:0/2543193839 wait complete. 2024-09-11T11:02:31.877 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-11T11:02:31.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-11T11:02:31.877 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-11T11:02:31.948 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:02:31.948 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:02:31.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.946+0000 7f04a36a2980 1 Processor -- start 2024-09-11T11:02:31.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.946+0000 7f04a36a2980 1 -- start start 2024-09-11T11:02:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.946+0000 7f04a36a2980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556355f63920 0x556355f65d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.946+0000 7f04a36a2980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556355de8ae0 con 0x556355f5f550 2024-09-11T11:02:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.946+0000 7f04a36a2980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x556355e0ce30 con 0x556355f63920 2024-09-11T11:02:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a09b1640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x556355f63920 0x556355f65d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a11b2640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x556355f5f550 0x556355f5f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:59268/0 (socket says 172.21.15.145:59268) 2024-09-11T11:02:31.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a11b2640 1 -- 172.21.15.145:0/181816909 learned_addr learned my addr 172.21.15.145:0/181816909 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:02:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a09b1640 1 -- 172.21.15.145:0/181816909 >> v1:172.21.15.102:6789/0 conn(0x556355f5f550 legacy=0x556355f5f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a09b1640 1 -- 172.21.15.145:0/181816909 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556355f67260 con 0x556355f63920 2024-09-11T11:02:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a09b1640 1 --2- 172.21.15.145:0/181816909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f63920 0x556355f65d10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f049800a480 tx=0x7f049801b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29ee48df0e6860d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f0493fff640 1 -- 172.21.15.145:0/181816909 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04980b0070 con 0x556355f63920 2024-09-11T11:02:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f0493fff640 1 -- 172.21.15.145:0/181816909 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04980ab540 con 0x556355f63920 2024-09-11T11:02:31.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f0493fff640 1 -- 172.21.15.145:0/181816909 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04980ab840 con 0x556355f63920 2024-09-11T11:02:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a36a2980 1 -- 172.21.15.145:0/181816909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f63920 msgr2=0x556355f65d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a36a2980 1 --2- 172.21.15.145:0/181816909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f63920 0x556355f65d10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f049800a480 tx=0x7f049801b280 comp rx=0 tx=0).stop 2024-09-11T11:02:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a36a2980 1 -- 172.21.15.145:0/181816909 shutdown_connections 2024-09-11T11:02:31.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a36a2980 1 --2- 172.21.15.145:0/181816909 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f63920 0x556355f65d10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a36a2980 1 -- 172.21.15.145:0/181816909 >> 172.21.15.145:0/181816909 conn(0x556355f5b070 msgr2=0x556355f5d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a36a2980 1 -- 172.21.15.145:0/181816909 shutdown_connections 2024-09-11T11:02:31.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.950+0000 7f04a36a2980 1 -- 172.21.15.145:0/181816909 wait complete. 2024-09-11T11:02:31.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 Processor -- start 2024-09-11T11:02:31.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- start start 2024-09-11T11:02:31.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356049850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556355e0e200 con 0x556355f5f550 2024-09-11T11:02:31.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356049850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356049850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56606/0 (socket says 172.21.15.145:56606) 2024-09-11T11:02:31.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a11b2640 1 -- 172.21.15.145:0/654987106 learned_addr learned my addr 172.21.15.145:0/654987106 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a11b2640 1 -- 172.21.15.145:0/654987106 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556356049e20 con 0x556355f5f550 2024-09-11T11:02:31.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a11b2640 1 --2- 172.21.15.145:0/654987106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356049850 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f049c0015f0 tx=0x7f049c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9598acb05eb5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f038f606640 1 -- 172.21.15.145:0/654987106 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c004530 con 0x556355f5f550 2024-09-11T11:02:31.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f038f606640 1 -- 172.21.15.145:0/654987106 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c0046f0 con 0x556355f5f550 2024-09-11T11:02:31.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f038f606640 1 -- 172.21.15.145:0/654987106 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c004a90 con 0x556355f5f550 2024-09-11T11:02:31.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- 172.21.15.145:0/654987106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 msgr2=0x556356049850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 --2- 172.21.15.145:0/654987106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356049850 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f049c0015f0 tx=0x7f049c001ab0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- 172.21.15.145:0/654987106 shutdown_connections 2024-09-11T11:02:31.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 --2- 172.21.15.145:0/654987106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356049850 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- 172.21.15.145:0/654987106 >> 172.21.15.145:0/654987106 conn(0x556355f5b070 msgr2=0x556356045480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- 172.21.15.145:0/654987106 shutdown_connections 2024-09-11T11:02:31.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- 172.21.15.145:0/654987106 wait complete. 2024-09-11T11:02:31.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 Processor -- start 2024-09-11T11:02:31.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- start start 2024-09-11T11:02:31.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356050be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.966+0000 7f04a36a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556355f66d60 con 0x556355f5f550 2024-09-11T11:02:31.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356050be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356050be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56612/0 (socket says 172.21.15.145:56612) 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a11b2640 1 -- 172.21.15.145:0/1040876243 learned_addr learned my addr 172.21.15.145:0/1040876243 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a11b2640 1 -- 172.21.15.145:0/1040876243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556356051120 con 0x556355f5f550 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a11b2640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356050be0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x55635604aa30 tx=0x7f049c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f038de03640 1 -- 172.21.15.145:0/1040876243 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c013760 con 0x556355f5f550 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f038de03640 1 -- 172.21.15.145:0/1040876243 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c013900 con 0x556355f5f550 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563560513b0 con 0x556355f5f550 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f038de03640 1 -- 172.21.15.145:0/1040876243 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c013be0 con 0x556355f5f550 2024-09-11T11:02:31.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556356054090 con 0x556355f5f550 2024-09-11T11:02:31.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f038de03640 1 -- 172.21.15.145:0/1040876243 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f049c010070 con 0x556355f5f550 2024-09-11T11:02:31.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f038de03640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f03880346a0 0x7f0388036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f038de03640 1 -- 172.21.15.145:0/1040876243 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f049c018070 con 0x556355f5f550 2024-09-11T11:02:31.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f03880346a0 0x7f0388036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556355f63920 0x556356057bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356058240 con 0x556355f63920 2024-09-11T11:02:31.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a19b3640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556355f63920 0x556356057bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f03880346a0 0x7f0388036b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04980ad000 tx=0x7f04980a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a19b3640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556355f63920 0x556356057bd0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a19b3640 1 -- 172.21.15.145:0/1040876243 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x556355f63920 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356059030 0x55635605b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.970+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55635605ba50 con 0x556356059030 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a11b2640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356059030 0x55635605b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a11b2640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356059030 0x55635605b420 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a11b2640 1 -- 172.21.15.145:0/1040876243 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f049c01b030 con 0x556356059030 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55635605d300 con 0x556356059030 2024-09-11T11:02:31.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a11b2640 1 -- 172.21.15.145:0/1040876243 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f049c01b030 con 0x556356059030 2024-09-11T11:02:31.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55635605c470 con 0x556356059030 2024-09-11T11:02:31.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a11b2640 1 -- 172.21.15.145:0/1040876243 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f049c01b030 con 0x556356059030 2024-09-11T11:02:31.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55635605cee0 0x556356060720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356060eb0 con 0x55635605cee0 2024-09-11T11:02:31.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55635605cee0 0x556356060720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.974+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55635605cee0 0x556356060720 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a09b1640 1 -- 172.21.15.145:0/1040876243 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04980b3040 con 0x55635605cee0 2024-09-11T11:02:31.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 Processor -- start 2024-09-11T11:02:31.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 -- start start 2024-09-11T11:02:31.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635606e9a0 0x55635606edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556355e67800 con 0x55635606e9a0 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635606e9a0 0x55635606edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635606e9a0 0x55635606edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56620/0 (socket says 172.21.15.145:56620) 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a11b2640 1 -- 172.21.15.145:0/1482525513 learned_addr learned my addr 172.21.15.145:0/1482525513 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a11b2640 1 -- 172.21.15.145:0/1482525513 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635606f300 con 0x55635606e9a0 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a11b2640 1 --2- 172.21.15.145:0/1482525513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635606e9a0 0x55635606edc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f049c049f90 tx=0x7f049c029840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f0386ffd640 1 -- 172.21.15.145:0/1482525513 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c012e10 con 0x55635606e9a0 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f0386ffd640 1 -- 172.21.15.145:0/1482525513 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c0128f0 con 0x55635606e9a0 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 -- 172.21.15.145:0/1482525513 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55635606f590 con 0x55635606e9a0 2024-09-11T11:02:31.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f0386ffd640 1 -- 172.21.15.145:0/1482525513 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c020490 con 0x55635606e9a0 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 -- 172.21.15.145:0/1482525513 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55635606f590 con 0x55635606e9a0 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f0386ffd640 1 -- 172.21.15.145:0/1482525513 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f049c050060 con 0x55635606e9a0 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f0386ffd640 1 --2- 172.21.15.145:0/1482525513 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0378034650 0x7f0378036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f0386ffd640 1 -- 172.21.15.145:0/1482525513 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f049c03d040 con 0x55635606e9a0 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1482525513 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0378034650 0x7f0378036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 Processor -- start 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 -- start start 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1482525513 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0378034650 0x7f0378036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5563560551d0 tx=0x7f0498005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x55635607b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.978+0000 7f04a36a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55635604a1a0 con 0x55635607b0f0 2024-09-11T11:02:31.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x55635607b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x55635607b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56634/0 (socket says 172.21.15.145:56634) 2024-09-11T11:02:31.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 -- 172.21.15.145:0/2067082732 learned_addr learned my addr 172.21.15.145:0/2067082732 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 -- 172.21.15.145:0/2067082732 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55635607bac0 con 0x55635607b0f0 2024-09-11T11:02:31.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 --2- 172.21.15.145:0/2067082732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x55635607b4f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f049c0046c0 tx=0x7f049c034e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33182855219fdf47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f0384ff9640 1 -- 172.21.15.145:0/2067082732 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c058040 con 0x55635607b0f0 2024-09-11T11:02:31.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f0384ff9640 1 -- 172.21.15.145:0/2067082732 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c00acf0 con 0x55635607b0f0 2024-09-11T11:02:31.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f0384ff9640 1 -- 172.21.15.145:0/2067082732 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c010c70 con 0x55635607b0f0 2024-09-11T11:02:31.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 -- 172.21.15.145:0/2067082732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 msgr2=0x55635607b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:31.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 --2- 172.21.15.145:0/2067082732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x55635607b4f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f049c0046c0 tx=0x7f049c034e60 comp rx=0 tx=0).stop 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 -- 172.21.15.145:0/2067082732 shutdown_connections 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 --2- 172.21.15.145:0/2067082732 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x55635607b4f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 -- 172.21.15.145:0/2067082732 >> 172.21.15.145:0/2067082732 conn(0x556356077520 msgr2=0x556356075620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 -- 172.21.15.145:0/2067082732 shutdown_connections 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 -- 172.21.15.145:0/2067082732 wait complete. 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 Processor -- start 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 -- start start 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x556356082370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a36a2980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55635607bf90 con 0x55635607b0f0 2024-09-11T11:02:31.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x556356082370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x556356082370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:56644/0 (socket says 172.21.15.145:56644) 2024-09-11T11:02:31.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 learned_addr learned my addr 172.21.15.145:0/1437520467 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:02:31.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563560828b0 con 0x55635607b0f0 2024-09-11T11:02:31.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.982+0000 7f04a11b2640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x556356082370 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f049c05f040 tx=0x7f049c02b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f0376ffd640 1 -- 172.21.15.145:0/1437520467 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c010940 con 0x55635607b0f0 2024-09-11T11:02:31.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5563560828b0 con 0x55635607b0f0 2024-09-11T11:02:31.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f0376ffd640 1 -- 172.21.15.145:0/1437520467 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c053ca0 con 0x55635607b0f0 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563560828b0 con 0x55635607b0f0 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f0376ffd640 1 -- 172.21.15.145:0/1437520467 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c0347c0 con 0x55635607b0f0 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f0376ffd640 1 -- 172.21.15.145:0/1437520467 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f049c00ba10 con 0x55635607b0f0 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f0376ffd640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f036c034650 0x7f036c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f0376ffd640 1 -- 172.21.15.145:0/1437520467 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5996+0+0 (secure 0 0 0) 0x7f049c062070 con 0x55635607b0f0 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f036c034650 0x7f036c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55635608d340 0x55635608f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55635608ff50 con 0x55635608d340 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a19b3640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55635608d340 0x55635608f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f036c034650 0x7f036c036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0498018eb0 tx=0x7f04980b9040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a19b3640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55635608d340 0x55635608f800 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 20 realm 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55635608c830 con 0x55635608d340 2024-09-11T11:02:31.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356090a20 con 0x55635608d340 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356091800 0x556356093bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.986+0000 7f04a11b2640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356091800 0x556356093bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a11b2640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356091800 0x556356093bf0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:31.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a36a2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356094ac0 con 0x556356091800 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a36a2980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a36a2980 20 searching for the correct realm 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556356096330 0x5563560987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356098ec0 con 0x556356096330 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556356096330 0x5563560987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a09b1640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556356096330 0x5563560987f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356098ec0 con 0x556356091800 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 34 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a11b2640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f049c040600 0x7f049c04f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x7f049c040600 2024-09-11T11:02:31.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a19b3640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f049c040600 0x7f049c04f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:02:32.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a19b3640 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f049c040600 0x7f049c04f6e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.990+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356096330 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:32.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x7f049c040600 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x7f049c040600 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 34 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:32.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356096330 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.994+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356096330 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 34 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356096330 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x7f049c040600 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x55635608d340 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x7f049c040600 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356096330 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x7f049c040600 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:31.998+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:32.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356096330 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 34 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 34 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e34) -- 0x556356094270 con 0x556356091800 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 34 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:02:32.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356094760 con 0x55635608d340 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356094b50 con 0x556356091800 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:02:32.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356094b50 con 0x7f049c040600 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 zone default found 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 4 Realm: () 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 zonegroup default 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356099340 con 0x7f049c040600 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55635609b0c0 con 0x556356096330 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55635609b540 con 0x556356096330 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:32.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 started sync module instance, tier type = 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.002+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609a560 con 0x556356091800 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.006+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.006+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93885133597280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609a560 con 0x556356091800 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.006+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609bfc0 con 0x55635608d340 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.006+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.006+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93885133601552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609bf30 con 0x55635608d340 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.006+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609cf20 con 0x556356091800 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.006+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93885133597280] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.006+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93885133601552] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93885133603760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609cf20 con 0x556356091800 2024-09-11T11:02:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609d7c0 con 0x7f049c040600 2024-09-11T11:02:32.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93885133607696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609cf20 con 0x7f049c040600 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609e240 con 0x556356091800 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93885133607696] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93885133603760] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93885133594800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609dd50 con 0x556356091800 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.010+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609eae0 con 0x556356096330 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93885133612592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609dd50 con 0x556356096330 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609f950 con 0x556356096330 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93885133594800] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93885133612592] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93885133616288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609fcf0 con 0x556356096330 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560a0540 con 0x7f049c040600 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93885133616288] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v34'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93885133618416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560a05c0 con 0x7f049c040600 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 20 add_watcher() i=0 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 20 add_watcher() i=1 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 20 add_watcher() i=2 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 20 add_watcher() i=3 2024-09-11T11:02:32.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 20 add_watcher() i=4 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 20 add_watcher() i=5 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.014+0000 7f04a36a2980 20 add_watcher() i=6 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93885133618416] v34'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a36a2980 20 add_watcher() i=7 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a36a2980 2 all 8 watchers are set, enabling cache 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560a3950 con 0x55635608d340 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93885133632288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560a0730 con 0x55635608d340 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93885133632288] v34'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f03577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a36a2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a36a2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:02:32.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.018+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560a2ca0 con 0x556356091800 2024-09-11T11:02:32.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.022+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.027 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.022+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560a2d70 con 0x7f049c040600 2024-09-11T11:02:32.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.022+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.022+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560acc00 con 0x556356096330 2024-09-11T11:02:32.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.022+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.022+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ad0b0 con 0x55635608d340 2024-09-11T11:02:32.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.026+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v34'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.026+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ac170 con 0x556356091800 2024-09-11T11:02:32.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.026+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v34'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.026+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ac170 con 0x556356096330 2024-09-11T11:02:32.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.030+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v34'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.030+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560adc10 con 0x556356091800 2024-09-11T11:02:32.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.030+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.030+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560adc10 con 0x55635608d340 2024-09-11T11:02:32.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.034+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v34'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.034+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae0c0 con 0x556356091800 2024-09-11T11:02:32.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.034+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v34'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.037 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.034+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae0c0 con 0x556356091800 2024-09-11T11:02:32.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.038+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.038+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae0c0 con 0x556356091800 2024-09-11T11:02:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.038+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v34'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.038+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae0c0 con 0x556356096330 2024-09-11T11:02:32.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.042+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v34'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.042+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae320 con 0x556356091800 2024-09-11T11:02:32.044 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.042+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.042+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x55635608d340 2024-09-11T11:02:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.042+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v34'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.042+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x55635608d340 2024-09-11T11:02:32.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.046+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v34'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.046+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x556356091800 2024-09-11T11:02:32.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.046+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v34'65 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.046+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x556356091800 2024-09-11T11:02:32.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.050+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v34'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.050+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x556356096330 2024-09-11T11:02:32.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.054+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v34'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.054+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x556356091800 2024-09-11T11:02:32.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.054+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.054+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x55635608d340 2024-09-11T11:02:32.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.058+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v34'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.058+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x556356091800 2024-09-11T11:02:32.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.058+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v34'66 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.058+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x556356091800 2024-09-11T11:02:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.062+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v34'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.062+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae7d0 con 0x556356096330 2024-09-11T11:02:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.062+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v34'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.062+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x556356091800 2024-09-11T11:02:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.066+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v34'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.066+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x556356096330 2024-09-11T11:02:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.066+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v34'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.066+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x556356096330 2024-09-11T11:02:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.066+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v34'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.066+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x556356096330 2024-09-11T11:02:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.070+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v34'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.070+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x556356091800 2024-09-11T11:02:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.074+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v34'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.074+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x55635608d340 2024-09-11T11:02:32.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.074+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v34'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.074+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x556356091800 2024-09-11T11:02:32.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v34'67 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x55635608d340 2024-09-11T11:02:32.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v34'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ae860 con 0x7f049c040600 2024-09-11T11:02:32.081 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v34'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f03567e4640 20 reqs_thread_entry: start 2024-09-11T11:02:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a36a2980 20 init_complete bucket index max shards: 11 2024-09-11T11:02:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a36a2980 20 Filter name: none 2024-09-11T11:02:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f02c7fff640 20 reqs_thread_entry: start 2024-09-11T11:02:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a36a2980 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-11T11:02:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.078+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560ab570 con 0x7f049c040600 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 20 rados_obj.operate() r=0 bl.length=380 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560ab050 con 0x55635608d340 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:27698d38-fc40-410e-96d8-191ffc71147c.4235.10 : miss 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 8.15 8:ad1c5116:root::.bucket.meta.myfoo7%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560cc070 con 0x556356096330 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(96 .bucket.meta.myfoo7:27698d38-fc40-410e-96d8-191ffc71147c.4235.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 20 rados_obj.operate() r=0 bl.length=382 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:27698d38-fc40-410e-96d8-191ffc71147c.4235.10 info.flags=0x17 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:27698d38-fc40-410e-96d8-191ffc71147c.4235.10 to cache LRU end 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:27698d38-fc40-410e-96d8-191ffc71147c.4235.10 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:97 4.7 4:e37d2eff:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356149560 con 0x55635608d340 2024-09-11T11:02:32.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(97 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f04940083f0 con 0x55635608d340 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:98 4.13 4:c80943ab:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356149560 con 0x7f049c040600 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(98 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 4.0 4:036d89c2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563561495a0 con 0x7f049c040600 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(99 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.2 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f04940083f0 con 0x7f049c040600 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:100 4.28 4:15eef51b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563561495a0 con 0x556356091800 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(100 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:101 4.15 4:aa92ed13:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563561495e0 con 0x556356096330 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(101 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:102 4.1d 4:ba1c1a1a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356149600 con 0x556356096330 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(102 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5 [call out=378b] v0'0 uv11 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 10 cls_bucket_list_unordered: got fourteen 2024-09-11T11:02:32.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.082+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:103 4.26 4:646d8ecb:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356149600 con 0x55635608d340 2024-09-11T11:02:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(103 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:104 4.1a 4:5acda9b5:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356149600 con 0x556356091800 2024-09-11T11:02:32.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(104 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 4.35 4:ac0f97fc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356149600 con 0x55635608d340 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(105 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:106 4.11 4:8b6bd6bd:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356149600 con 0x7f049c040600 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(106 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:107 4.5 4:a30c5e9e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356149600 con 0x556356091800 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(107 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.10 [call out=85b] v0'0 uv15 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f049c05b040 con 0x556356091800 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 20 get_obj_state: octx=0x7f049c053ac0 obj=myfoo7:fourteen state=0x5563561475e8 s->prefetch_data=0 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 3.14 3:2863dd9c:::27698d38-fc40-410e-96d8-191ffc71147c.4235.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x556356148410 con 0x556356091800 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(108 27698d38-fc40-410e-96d8-191ffc71147c.4235.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7f049c09f380 con 0x556356091800 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 10 manifest: total_size = 8 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 20 get_obj_state: setting s->obj_tag to 27698d38-fc40-410e-96d8-191ffc71147c.4235.15277832541346300189 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 20 get_obj_state: octx=0x7f049c053ac0 obj=myfoo7:fourteen state=0x5563561475e8 s->prefetch_data=0 2024-09-11T11:02:32.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 20 prepare_atomic_modification: state is not atomic. state=0x5563561475e8 2024-09-11T11:02:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5 2024-09-11T11:02:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.086+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:109 4.1d 4:ba1c1a1a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556356148d10 con 0x556356096330 2024-09-11T11:02:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(109 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5 [stat,call,call] v34'12 uv12 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:110 3.14 3:2863dd9c:::27698d38-fc40-410e-96d8-191ffc71147c.4235.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x556356148d10 con 0x556356091800 2024-09-11T11:02:32.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(110 27698d38-fc40-410e-96d8-191ffc71147c.4235.10_fourteen [call] v34'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f049c09f380 con 0x556356091800 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:111 4.1d 4:ba1c1a1a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560d0c20 con 0x556356096330 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 20 list_objects_ordered: starting attempt 1 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:112 4.7 4:e37d2eff:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560d0c20 con 0x55635608d340 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:113 4.13 4:c80943ab:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560d4e80 con 0x7f049c040600 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:114 4.0 4:036d89c2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560d0c20 con 0x7f049c040600 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:115 4.28 4:15eef51b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560d4e80 con 0x556356091800 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:116 4.15 4:aa92ed13:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560dc1e0 con 0x556356096330 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:117 4.1d 4:ba1c1a1a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560deb80 con 0x556356096330 2024-09-11T11:02:32.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:118 4.26 4:646d8ecb:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e19e0 con 0x55635608d340 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:119 4.1a 4:5acda9b5:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e47f0 con 0x556356091800 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:120 4.35 4:ac0f97fc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e71a0 con 0x55635608d340 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:121 4.11 4:8b6bd6bd:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e9c30 con 0x7f049c040600 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:122 4.5 4:a30c5e9e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x556356091800 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(113 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(114 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.2 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(112 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(121 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(116 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(118 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 32 ==== osd_op_reply(120 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(111 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5 [stat,call,call] v34'13 uv13 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.090+0000 7f0384ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(115 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f049c09f380 con 0x556356091800 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(117 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(119 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f049c09f380 con 0x556356091800 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(122 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.10 [call out=85b] v0'0 uv15 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f049c09f380 con 0x556356091800 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[27698d38-fc40-410e-96d8-191ffc71147c.4235.10])"; uploads.size()=0; is_truncated=0 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:123 4.7 4:e37d2eff:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560d4ee0 con 0x55635608d340 2024-09-11T11:02:32.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:124 4.13 4:c80943ab:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x7f049c040600 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:125 4.0 4:036d89c2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e19e0 con 0x7f049c040600 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:126 4.28 4:15eef51b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1eb0 con 0x556356091800 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:127 4.15 4:aa92ed13:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e4350 con 0x556356096330 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:128 4.1d 4:ba1c1a1a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560d4ee0 con 0x556356096330 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:129 4.26 4:646d8ecb:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560cdbf0 con 0x55635608d340 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:130 4.1a 4:5acda9b5:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x556356091800 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:131 4.35 4:ac0f97fc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1eb0 con 0x55635608d340 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:132 4.11 4:8b6bd6bd:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e4350 con 0x7f049c040600 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:133 4.5 4:a30c5e9e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x556356091800 2024-09-11T11:02:32.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(127 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.4 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 33 ==== osd_op_reply(123 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(124 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.1 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 23 ==== osd_op_reply(125 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.2 [call out=85b] v0'0 uv10 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== osd_op_reply(128 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5 [call out=124b] v0'0 uv13 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 34 ==== osd_op_reply(129 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 35 ==== osd_op_reply(131 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.8 [call out=85b] v0'0 uv4 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 24 ==== osd_op_reply(132 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.9 [call out=85b] v0'0 uv6 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(133 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.10 [call out=85b] v0'0 uv15 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(126 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(130 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.7 [call out=85b] v0'0 uv2 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x55635608d340 2024-09-11T11:02:32.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 36 ==== osd_op_reply(134 fud.buckets [call] v34'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-11T11:02:32.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x7f049c040600 2024-09-11T11:02:32.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 25 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 20 rados_obj.operate() r=0 bl.length=168 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.094+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x7f049c040600 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 26 ==== osd_op_reply(136 myfoo7 [call,call,delete] v34'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93885133933152 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x7f049c040600 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 27 ==== watch-notify(notify (1) cookie 93885133607696 notify 146028888092 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5563560adde0 con 0x7f049c040600 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f0384ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888092 cookie 93885133607696 notifier 4766 bl.length()=150 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f0384ff9640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0364003d70 con 0x7f049c040600 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 28 ==== osd_op_reply(137 notify.3 [notify cookie 93885133933152 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 29 ==== watch-notify(notify_complete (2) cookie 93885133933152 notify 146028888092 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5563560abeb0 con 0x7f049c040600 2024-09-11T11:02:32.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 30 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:139 8.15 8:ad1c5116:root::.bucket.meta.myfoo7%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x556356096330 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(139 .bucket.meta.myfoo7:27698d38-fc40-410e-96d8-191ffc71147c.4235.10 [call,call,delete] v34'4 uv4 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:27698d38-fc40-410e-96d8-191ffc71147c.4235.10 from cache 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:27698d38-fc40-410e-96d8-191ffc71147c.4235.10, ofs0, ns] 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93885133887968 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x556356096330 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== watch-notify(notify (1) cookie 93885133616288 notify 146028888087 ret 0) ==== 250+0+0 (crc 0 0 0) 0x5563560cb5f0 con 0x556356096330 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== osd_op_reply(140 notify.6 [notify cookie 93885133887968 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f0377fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888087 cookie 93885133616288 notifier 4766 bl.length()=208 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f0377fff640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f02d4003330 con 0x556356096330 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== watch-notify(notify_complete (2) cookie 93885133887968 notify 146028888087 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5563560abce0 con 0x556356096330 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:142 4.7 4:e37d2eff:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x55635608d340 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:143 4.13 4:c80943ab:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x7f049c040600 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:144 4.0 4:036d89c2:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ea5b0 con 0x7f049c040600 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:145 4.28 4:15eef51b:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x556356091800 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:146 4.15 4:aa92ed13:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x556356096330 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:147 4.1d 4:ba1c1a1a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ea5b0 con 0x556356096330 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:148 4.26 4:646d8ecb:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560eb220 con 0x55635608d340 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:149 4.1a 4:5acda9b5:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560eca60 con 0x556356091800 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:150 4.35 4:ac0f97fc:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560ebf20 con 0x55635608d340 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:151 4.11 4:8b6bd6bd:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x7f049c040600 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.098+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:152 4.5 4:a30c5e9e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560eb220 con 0x556356091800 2024-09-11T11:02:32.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 37 ==== osd_op_reply(142 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.0 [delete] v34'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 38 ==== osd_op_reply(148 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.6 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 31 ==== osd_op_reply(144 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.2 [delete] v34'11 uv11 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== osd_op_reply(147 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.5 [delete] v34'14 uv14 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 32 ==== osd_op_reply(143 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.1 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 45 ==== osd_op_reply(152 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.10 [delete] v34'17 uv17 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 46 ==== osd_op_reply(149 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.7 [delete] v34'3 uv3 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 33 ==== osd_op_reply(151 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.9 [delete] v34'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 47 ==== osd_op_reply(145 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.3 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 37 ==== osd_op_reply(146 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.4 [delete] v34'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 39 ==== osd_op_reply(150 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.10.8 [delete] v34'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a36a2980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/27698d38-fc40-410e-96d8-191ffc71147c.4235.10 : miss 2024-09-11T11:02:32.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a36a2980 20 rados->read ofs=0 len=0 2024-09-11T11:02:32.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:153 6.2 6:43ef8157:::pubsub..bucket.myfoo7%2f27698d38-fc40-410e-96d8-191ffc71147c.4235.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x556356096330 2024-09-11T11:02:32.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 38 ==== osd_op_reply(153 pubsub..bucket.myfoo7/27698d38-fc40-410e-96d8-191ffc71147c.4235.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a36a2980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:02:32.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a36a2980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/27698d38-fc40-410e-96d8-191ffc71147c.4235.10 info.flags=0x0 2024-09-11T11:02:32.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a36a2980 10 adding default.rgw.log++pubsub..bucket.myfoo7/27698d38-fc40-410e-96d8-191ffc71147c.4235.10 to cache LRU end 2024-09-11T11:02:32.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:154 6.2 6:43ef8157:::pubsub..bucket.myfoo7%2f27698d38-fc40-410e-96d8-191ffc71147c.4235.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x556356096330 2024-09-11T11:02:32.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 39 ==== osd_op_reply(154 pubsub..bucket.myfoo7/27698d38-fc40-410e-96d8-191ffc71147c.4235.10 [delete] v34'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.102+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x55635608d340 2024-09-11T11:02:32.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 40 ==== osd_op_reply(155 fud.buckets [call] v34'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a36a2980 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-11T11:02:32.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x556356096330 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 40 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v34'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a36a2980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 93885133886080 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560cbfe0 con 0x556356091800 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 48 ==== watch-notify(notify (1) cookie 93885133603760 notify 146028888108 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5563560adc10 con 0x556356091800 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f0377fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888108 cookie 93885133603760 notifier 4766 bl.length()=170 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f0377fff640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f02d4003310 con 0x556356091800 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 49 ==== osd_op_reply(157 notify.2 [notify cookie 93885133886080 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 50 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 51 ==== watch-notify(notify_complete (2) cookie 93885133886080 notify 146028888108 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f049c046040 con 0x556356091800 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a36a2980 10 removing email index: 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a36a2980 10 removing user buckets index 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.106+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x55635608d340 2024-09-11T11:02:32.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 41 ==== osd_op_reply(159 fud.buckets [delete] v34'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a36a2980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93885133886080 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560cbfe0 con 0x556356096330 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 41 ==== watch-notify(notify (1) cookie 93885133616288 notify 146028888088 ret 0) ==== 202+0+0 (crc 0 0 0) 0x5563560abce0 con 0x556356096330 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f0384ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888088 cookie 93885133616288 notifier 4766 bl.length()=160 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f0384ff9640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f0364003d70 con 0x556356096330 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 42 ==== osd_op_reply(160 notify.6 [notify cookie 93885133886080 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 43 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 44 ==== watch-notify(notify_complete (2) cookie 93885133886080 notify 146028888088 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5563560ac510 con 0x556356096330 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a36a2980 10 removing user index: fud 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560e1280 con 0x7f049c040600 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 34 ==== osd_op_reply(162 fud [call,call,delete] v34'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a36a2980 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-11T11:02:32.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a36a2980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-11T11:02:32.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93885133886080 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5563560cbfe0 con 0x556356096330 2024-09-11T11:02:32.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 45 ==== watch-notify(notify (1) cookie 93885133612592 notify 146028888089 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5563560ac510 con 0x556356096330 2024-09-11T11:02:32.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f0377fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 146028888089 cookie 93885133612592 notifier 4766 bl.length()=152 2024-09-11T11:02:32.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 46 ==== osd_op_reply(163 notify.5 [notify cookie 93885133886080 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.110+0000 7f0377fff640 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x7f02d4003310 con 0x556356096330 2024-09-11T11:02:32.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.114+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.114+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 48 ==== watch-notify(notify_complete (2) cookie 93885133886080 notify 146028888089 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5563560a2530 con 0x556356096330 2024-09-11T11:02:32.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.114+0000 7f03577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:02:32.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.114+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93885133632288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560aced0 con 0x55635608d340 2024-09-11T11:02:32.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.114+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 42 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93885133632288] v34'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.114+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93885133597280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560aced0 con 0x556356091800 2024-09-11T11:02:32.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.118+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 52 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93885133597280] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.118+0000 7f04a36a2980 20 remove_watcher() i=0 2024-09-11T11:02:32.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.118+0000 7f04a36a2980 2 removed watcher, disabling cache 2024-09-11T11:02:32.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.118+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93885133601552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560aced0 con 0x55635608d340 2024-09-11T11:02:32.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.118+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.1 v2:172.21.15.145:6808/1879781812 43 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93885133601552] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0494040040 con 0x55635608d340 2024-09-11T11:02:32.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.118+0000 7f04a36a2980 20 remove_watcher() i=1 2024-09-11T11:02:32.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.118+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93885133603760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560aced0 con 0x556356091800 2024-09-11T11:02:32.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 53 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93885133603760] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a36a2980 20 remove_watcher() i=2 2024-09-11T11:02:32.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93885133607696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560aced0 con 0x7f049c040600 2024-09-11T11:02:32.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 35 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93885133607696] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a36a2980 20 remove_watcher() i=3 2024-09-11T11:02:32.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93885133594800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560aced0 con 0x556356091800 2024-09-11T11:02:32.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a11b2640 1 -- 172.21.15.145:0/1437520467 <== osd.0 v2:172.21.15.102:6800/3035634142 54 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93885133594800] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049c0a5040 con 0x556356091800 2024-09-11T11:02:32.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a36a2980 20 remove_watcher() i=4 2024-09-11T11:02:32.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.122+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93885133612592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609a0b0 con 0x556356096330 2024-09-11T11:02:32.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 49 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93885133612592] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 20 remove_watcher() i=5 2024-09-11T11:02:32.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93885133616288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x5563560aced0 con 0x556356096330 2024-09-11T11:02:32.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a09b1640 1 -- 172.21.15.145:0/1437520467 <== osd.3 v2:172.21.15.145:6800/493661776 50 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93885133616288] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04980c9030 con 0x556356096330 2024-09-11T11:02:32.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 20 remove_watcher() i=6 2024-09-11T11:02:32.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93885133618416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34) -- 0x55635609a0b0 con 0x7f049c040600 2024-09-11T11:02:32.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 <== osd.2 v2:172.21.15.145:6816/446921044 36 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93885133618416] v34'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0494040040 con 0x7f049c040600 2024-09-11T11:02:32.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 20 remove_watcher() i=7 2024-09-11T11:02:32.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356091800 msgr2=0x556356093bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356091800 0x556356093bf0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55635608d340 msgr2=0x55635608f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.131 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55635608d340 0x55635608f800 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f049c040600 msgr2=0x7f049c04f6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f049c040600 0x7f049c04f6e0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556356096330 msgr2=0x5563560987f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x556356096330 0x5563560987f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f036c034650 msgr2=0x7f036c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f036c034650 0x7f036c036b10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0498018eb0 tx=0x7f04980b9040 comp rx=0 tx=0).stop 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 msgr2=0x556356082370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a19b3640 1 -- 172.21.15.145:0/1437520467 reap_dead start 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x556356082370 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f049c05f040 tx=0x7f049c02b110 comp rx=0 tx=0).stop 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 shutdown_connections 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1437520467 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635607b0f0 0x556356082370 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 >> 172.21.15.145:0/1437520467 conn(0x556356077520 msgr2=0x5563560755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:32.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 shutdown_connections 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1437520467 wait complete. 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1482525513 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0378034650 msgr2=0x7f0378036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1482525513 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0378034650 0x7f0378036b10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5563560551d0 tx=0x7f0498005a10 comp rx=0 tx=0).stop 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1482525513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635606e9a0 msgr2=0x55635606edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1482525513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635606e9a0 0x55635606edc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f049c049f90 tx=0x7f049c029840 comp rx=0 tx=0).stop 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1482525513 shutdown_connections 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1482525513 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0378034650 0x7f0378036b10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1482525513 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55635606e9a0 0x55635606edc0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1482525513 >> 172.21.15.145:0/1482525513 conn(0x556356063af0 msgr2=0x556356066570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1482525513 shutdown_connections 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1482525513 wait complete. 2024-09-11T11:02:32.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356059030 msgr2=0x55635605b420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556356059030 0x55635605b420 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556355f63920 msgr2=0x556356057bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x556355f63920 0x556356057bd0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55635605cee0 msgr2=0x556356060720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.126+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55635605cee0 0x556356060720 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f03880346a0 msgr2=0x7f0388036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f03880346a0 0x7f0388036b60 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04980ad000 tx=0x7f04980a5040 comp rx=0 tx=0).stop 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 msgr2=0x556356050be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a36a2980 1 --2- 172.21.15.145:0/1040876243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x556355f5f550 0x556356050be0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x55635604aa30 tx=0x7f049c000f50 comp rx=0 tx=0).stop 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a19b3640 1 -- 172.21.15.145:0/1040876243 reap_dead start 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 shutdown_connections 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 >> 172.21.15.145:0/1040876243 conn(0x556355f5b070 msgr2=0x556356044000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:02:32.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 shutdown_connections 2024-09-11T11:02:32.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:02:32.130+0000 7f04a36a2980 1 -- 172.21.15.145:0/1040876243 wait complete. 2024-09-11T11:03:12.142 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-11T11:03:12.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-11T11:03:12.144 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-11T11:03:12.183 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:12.183 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:12.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fd16fe980 1 Processor -- start 2024-09-11T11:03:12.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fd16fe980 1 -- start start 2024-09-11T11:03:12.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fd16fe980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555753635290 0x5557536c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fd16fe980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555753548ae0 con 0x5557536c38e0 2024-09-11T11:03:12.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fd16fe980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55575356ce30 con 0x555753635290 2024-09-11T11:03:12.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fcf20e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555753635290 0x5557536c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fcf20e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x555753635290 0x5557536c33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37124/0 (socket says 172.21.15.145:37124) 2024-09-11T11:03:12.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fcf20e640 1 -- 172.21.15.145:0/2279286554 learned_addr learned my addr 172.21.15.145:0/2279286554 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fcea0d640 1 --1- 172.21.15.145:0/2279286554 >> v1:172.21.15.102:6789/0 conn(0x5557536c38e0 0x5557536c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52016/0 (socket says 172.21.15.145:52016) 2024-09-11T11:03:12.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fcf20e640 1 -- 172.21.15.145:0/2279286554 >> v1:172.21.15.102:6789/0 conn(0x5557536c38e0 legacy=0x5557536c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fce20c640 1 -- 172.21.15.145:0/2279286554 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518824438 0 0) 0x555753548ae0 con 0x5557536c38e0 2024-09-11T11:03:12.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.181+0000 7f7fcf20e640 1 -- 172.21.15.145:0/2279286554 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555753635820 con 0x555753635290 2024-09-11T11:03:12.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/2279286554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557536c33a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000a5c0 tx=0x7f7fc001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f512072b10eac6e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fce20c640 1 -- 172.21.15.145:0/2279286554 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00a6070 con 0x555753635290 2024-09-11T11:03:12.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fce20c640 1 -- 172.21.15.145:0/2279286554 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc00af070 con 0x555753635290 2024-09-11T11:03:12.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fce20c640 1 -- 172.21.15.145:0/2279286554 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00aa5c0 con 0x555753635290 2024-09-11T11:03:12.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2279286554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 msgr2=0x5557536c33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/2279286554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557536c33a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000a5c0 tx=0x7f7fc001b340 comp rx=0 tx=0).stop 2024-09-11T11:03:12.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2279286554 shutdown_connections 2024-09-11T11:03:12.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/2279286554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557536c33a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2279286554 >> 172.21.15.145:0/2279286554 conn(0x5557536bb090 msgr2=0x5557536bd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2279286554 shutdown_connections 2024-09-11T11:03:12.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.185+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2279286554 wait complete. 2024-09-11T11:03:12.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.201+0000 7f7fd16fe980 1 Processor -- start 2024-09-11T11:03:12.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.201+0000 7f7fd16fe980 1 -- start start 2024-09-11T11:03:12.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.201+0000 7f7fd16fe980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537ab790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.201+0000 7f7fd16fe980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55575356e200 con 0x555753635290 2024-09-11T11:03:12.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.201+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.201+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537ab790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37134/0 (socket says 172.21.15.145:37134) 2024-09-11T11:03:12.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.201+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1547776819 learned_addr learned my addr 172.21.15.145:0/1547776819 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1547776819 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557537abd60 con 0x555753635290 2024-09-11T11:03:12.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/1547776819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537ab790 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0017f50 tx=0x7f7fc0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c14fd011b89a7dd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7ebd60a640 1 -- 172.21.15.145:0/1547776819 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00aa9c0 con 0x555753635290 2024-09-11T11:03:12.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7ebd60a640 1 -- 172.21.15.145:0/1547776819 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc00aab60 con 0x555753635290 2024-09-11T11:03:12.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7ebd60a640 1 -- 172.21.15.145:0/1547776819 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00aae40 con 0x555753635290 2024-09-11T11:03:12.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1547776819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 msgr2=0x5557537ab790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1547776819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537ab790 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0017f50 tx=0x7f7fc0003030 comp rx=0 tx=0).stop 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1547776819 shutdown_connections 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1547776819 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537ab790 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1547776819 >> 172.21.15.145:0/1547776819 conn(0x5557536bb090 msgr2=0x5557537a73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1547776819 shutdown_connections 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1547776819 wait complete. 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 Processor -- start 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 -- start start 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fd16fe980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557536c7f00 con 0x555753635290 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37140/0 (socket says 172.21.15.145:37140) 2024-09-11T11:03:12.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1588456429 learned_addr learned my addr 172.21.15.145:0/1588456429 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1588456429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557537b2f60 con 0x555753635290 2024-09-11T11:03:12.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.205+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537b2a20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0000c10 tx=0x7f7fc00180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7ebbe07640 1 -- 172.21.15.145:0/1588456429 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00ca020 con 0x555753635290 2024-09-11T11:03:12.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7ebbe07640 1 -- 172.21.15.145:0/1588456429 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc00bd6a0 con 0x555753635290 2024-09-11T11:03:12.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7ebbe07640 1 -- 172.21.15.145:0/1588456429 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00bd9e0 con 0x555753635290 2024-09-11T11:03:12.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557537b31f0 con 0x555753635290 2024-09-11T11:03:12.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557537b5ed0 con 0x555753635290 2024-09-11T11:03:12.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7ebbe07640 1 -- 172.21.15.145:0/1588456429 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fc00cd020 con 0x555753635290 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7ebbe07640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7eb4034650 0x7f7eb4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7ebbe07640 1 -- 172.21.15.145:0/1588456429 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f7fc00e5180 con 0x555753635290 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7eb4034650 0x7f7eb4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557536c38e0 0x5557537b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537ba040 con 0x5557536c38e0 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fcfa0f640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557536c38e0 0x5557537b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7eb4034650 0x7f7eb4036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000c10 tx=0x7f7fc40013c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fcfa0f640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557536c38e0 0x5557537b99d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1588456429 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557536c38e0 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537badf0 0x5557537bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537bd810 con 0x5557537badf0 2024-09-11T11:03:12.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.209+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537badf0 0x5557537bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537badf0 0x5557537bd1e0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1588456429 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fc00c6960 con 0x5557537badf0 2024-09-11T11:03:12.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537bf0c0 con 0x5557537badf0 2024-09-11T11:03:12.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1588456429 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7fc00c6960 con 0x5557537badf0 2024-09-11T11:03:12.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537be2f0 con 0x5557537badf0 2024-09-11T11:03:12.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1588456429 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fc00c6960 con 0x5557537badf0 2024-09-11T11:03:12.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557537c0470 0x5557537c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537c2da0 con 0x5557537c0470 2024-09-11T11:03:12.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557537c0470 0x5557537c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557537c0470 0x5557537c2860 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1588456429 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7fc400f680 con 0x5557537c0470 2024-09-11T11:03:12.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fd16fe980 1 Processor -- start 2024-09-11T11:03:12.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fd16fe980 1 -- start start 2024-09-11T11:03:12.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fd16fe980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557536c0d00 0x5557536bf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.213+0000 7f7fd16fe980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557535c7800 con 0x5557536c0d00 2024-09-11T11:03:12.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557536c0d00 0x5557536bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557536c0d00 0x5557536bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37154/0 (socket says 172.21.15.145:37154) 2024-09-11T11:03:12.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fcf20e640 1 -- 172.21.15.145:0/2681868663 learned_addr learned my addr 172.21.15.145:0/2681868663 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fcf20e640 1 -- 172.21.15.145:0/2681868663 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557536c1120 con 0x5557536c0d00 2024-09-11T11:03:12.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/2681868663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557536c0d00 0x5557536bf380 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00e35a0 tx=0x7f7fc00bcfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7eb9602640 1 -- 172.21.15.145:0/2681868663 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00bdd90 con 0x5557536c0d00 2024-09-11T11:03:12.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7eb9602640 1 -- 172.21.15.145:0/2681868663 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc00ce730 con 0x5557536c0d00 2024-09-11T11:03:12.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7eb9602640 1 -- 172.21.15.145:0/2681868663 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00cea10 con 0x5557536c0d00 2024-09-11T11:03:12.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2681868663 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557536bf920 con 0x5557536c0d00 2024-09-11T11:03:12.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2681868663 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557536bfdf0 con 0x5557536c0d00 2024-09-11T11:03:12.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7eb9602640 1 -- 172.21.15.145:0/2681868663 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fc00a4a10 con 0x5557536c0d00 2024-09-11T11:03:12.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7eb9602640 1 --2- 172.21.15.145:0/2681868663 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7ea80346a0 0x7f7ea8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7eb9602640 1 -- 172.21.15.145:0/2681868663 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f7fc00f0c40 con 0x5557536c0d00 2024-09-11T11:03:12.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/2681868663 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7ea80346a0 0x7f7ea8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fd16fe980 1 Processor -- start 2024-09-11T11:03:12.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.217+0000 7f7fd16fe980 1 -- start start 2024-09-11T11:03:12.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537df7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/2681868663 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7ea80346a0 0x7f7ea8036b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5557537c31a0 tx=0x7f7fc4006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557537ac020 con 0x5557537df410 2024-09-11T11:03:12.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537df7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537df7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37162/0 (socket says 172.21.15.145:37162) 2024-09-11T11:03:12.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcf20e640 1 -- 172.21.15.145:0/2461092314 learned_addr learned my addr 172.21.15.145:0/2461092314 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcf20e640 1 -- 172.21.15.145:0/2461092314 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557537dfdc0 con 0x5557537df410 2024-09-11T11:03:12.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/2461092314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537df7f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0002f10 tx=0x7f7fc00c0d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=608ed78401948372 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7eb2ffd640 1 -- 172.21.15.145:0/2461092314 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0107070 con 0x5557537df410 2024-09-11T11:03:12.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7eb2ffd640 1 -- 172.21.15.145:0/2461092314 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc00e5450 con 0x5557537df410 2024-09-11T11:03:12.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7eb2ffd640 1 -- 172.21.15.145:0/2461092314 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc00e5d40 con 0x5557537df410 2024-09-11T11:03:12.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2461092314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 msgr2=0x5557537df7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/2461092314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537df7f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0002f10 tx=0x7f7fc00c0d90 comp rx=0 tx=0).stop 2024-09-11T11:03:12.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2461092314 shutdown_connections 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/2461092314 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537df7f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2461092314 >> 172.21.15.145:0/2461092314 conn(0x5557537db7f0 msgr2=0x5557537d98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2461092314 shutdown_connections 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2461092314 wait complete. 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 Processor -- start 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 -- start start 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537e65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fd16fe980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5557537e0260 con 0x5557537df410 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537e65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcf20e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537e65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37166/0 (socket says 172.21.15.145:37166) 2024-09-11T11:03:12.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.221+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 learned_addr learned my addr 172.21.15.145:0/1154508809 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557537e6b20 con 0x5557537df410 2024-09-11T11:03:12.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537e65e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00e5820 tx=0x7f7fc00e5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7eb17fa640 1 -- 172.21.15.145:0/1154508809 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0110020 con 0x5557537df410 2024-09-11T11:03:12.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7eb17fa640 1 -- 172.21.15.145:0/1154508809 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc00e5d40 con 0x5557537df410 2024-09-11T11:03:12.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557537e6b20 con 0x5557537df410 2024-09-11T11:03:12.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7eb17fa640 1 -- 172.21.15.145:0/1154508809 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7fc0107040 con 0x5557537df410 2024-09-11T11:03:12.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557537e6b20 con 0x5557537df410 2024-09-11T11:03:12.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7eb17fa640 1 -- 172.21.15.145:0/1154508809 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7fc0113020 con 0x5557537df410 2024-09-11T11:03:12.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7eb17fa640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7e98034650 0x7f7e98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7eb17fa640 1 -- 172.21.15.145:0/1154508809 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f7fc00ff070 con 0x5557537df410 2024-09-11T11:03:12.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7e98034650 0x7f7e98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557537f1510 0x5557537f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537f4120 con 0x5557537f1510 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fcfa0f640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557537f1510 0x5557537f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7e98034650 0x7f7e98036b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400ba80 tx=0x7f7fc4023040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fcfa0f640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557537f1510 0x5557537f39d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 20 realm 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537f0940 con 0x5557537f1510 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:12.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.225+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537f4be0 con 0x5557537f1510 2024-09-11T11:03:12.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537f59c0 0x5557537f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8440 con 0x5557537f59c0 2024-09-11T11:03:12.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537f59c0 0x5557537f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537f59c0 0x5557537f7db0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 20 searching for the correct realm 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557537faa00 0x5557537fcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537fd470 con 0x5557537faa00 2024-09-11T11:03:12.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557537faa00 0x5557537fcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcea0d640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557537faa00 0x5557537fcdf0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.229+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537fd470 con 0x5557537f59c0 2024-09-11T11:03:12.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcf20e640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7fc0120040 0x7f7fc00a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x7f7fc0120040 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7fc0120040 0x7f7fc00a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7fc0120040 0x7f7fc00a5a00 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537faa00 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.233+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x7f7fc0120040 2024-09-11T11:03:12.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x7f7fc0120040 2024-09-11T11:03:12.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537faa00 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537faa00 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.237+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.244 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537faa00 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x7f7fc0120040 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f1510 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x7f7fc0120040 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537faa00 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x7f7fc0120040 2024-09-11T11:03:12.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537faa00 2024-09-11T11:03:12.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.241+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5557537f8c90 con 0x5557537f59c0 2024-09-11T11:03:12.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:12.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:12.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:12.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:12.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:12.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:12.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537f94e0 con 0x5557537f1510 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537f98d0 con 0x5557537f59c0 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537f98d0 con 0x7f7fc0120040 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:12.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 zone default found 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 4 Realm: () 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 zonegroup default 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537fd8f0 con 0x7f7fc0120040 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537ff700 con 0x5557537faa00 2024-09-11T11:03:12.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.245+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5557537ffc50 con 0x5557537faa00 2024-09-11T11:03:12.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.249+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.249+0000 7f7fd16fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.249+0000 7f7fd16fe980 20 started sync module instance, tier type = 2024-09-11T11:03:12.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.249+0000 7f7fd16fe980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:12.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.249+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557537feb10 con 0x5557537f59c0 2024-09-11T11:03:12.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.249+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.249+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93833551409200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557537feb10 con 0x5557537f59c0 2024-09-11T11:03:12.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.249+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557538006d0 con 0x5557537f1510 2024-09-11T11:03:12.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93833551413792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753800640 con 0x5557537f1510 2024-09-11T11:03:12.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753801620 con 0x5557537f59c0 2024-09-11T11:03:12.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93833551409200] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93833551413792] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93833551416048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557538015e0 con 0x5557537f59c0 2024-09-11T11:03:12.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753801a80 con 0x7f7fc0120040 2024-09-11T11:03:12.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93833551406688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753801a40 con 0x7f7fc0120040 2024-09-11T11:03:12.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.253+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753802940 con 0x5557537f59c0 2024-09-11T11:03:12.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93833551416048] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93833551406688] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93833551421040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753802490 con 0x5557537f59c0 2024-09-11T11:03:12.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5557538031e0 con 0x5557537faa00 2024-09-11T11:03:12.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93833551424816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753802490 con 0x5557537faa00 2024-09-11T11:03:12.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753804050 con 0x5557537faa00 2024-09-11T11:03:12.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.257+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93833551421040] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.261+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93833551424816] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.261+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.261+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93833551428512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753803690 con 0x5557537faa00 2024-09-11T11:03:12.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.261+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753804b00 con 0x7f7fc0120040 2024-09-11T11:03:12.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93833551428512] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93833551417616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753804ac0 con 0x7f7fc0120040 2024-09-11T11:03:12.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 20 add_watcher() i=0 2024-09-11T11:03:12.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 20 add_watcher() i=1 2024-09-11T11:03:12.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 20 add_watcher() i=2 2024-09-11T11:03:12.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 20 add_watcher() i=3 2024-09-11T11:03:12.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 20 add_watcher() i=4 2024-09-11T11:03:12.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 20 add_watcher() i=5 2024-09-11T11:03:12.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 20 add_watcher() i=6 2024-09-11T11:03:12.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93833551417616] v36'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 20 add_watcher() i=7 2024-09-11T11:03:12.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:12.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x555753807fe0 con 0x5557537f1510 2024-09-11T11:03:12.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.265+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93833551431648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x555753805500 con 0x5557537f1510 2024-09-11T11:03:12.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93833551431648] v36'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7e85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:12.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:12.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:12.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 5 note: GC not initialized 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7e84fe1640 20 reqs_thread_entry: start 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 20 Filter name: none 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7dfe7fc640 20 reqs_thread_entry: start 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55575382b690 con 0x5557537f1510 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:03:12.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:03:12.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:03:12.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:12.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537faa00 2024-09-11T11:03:12.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 usage.10 [call] v36'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.273 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.269+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537faa00 2024-09-11T11:03:12.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.273+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(64 usage.10 [call] v36'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.273+0000 7f7e85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:12.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.273+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93833551431648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537f1510 2024-09-11T11:03:12.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.273+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93833551431648] v36'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.273+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93833551409200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537f59c0 2024-09-11T11:03:12.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.277+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93833551409200] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.277+0000 7f7fd16fe980 20 remove_watcher() i=0 2024-09-11T11:03:12.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.277+0000 7f7fd16fe980 2 removed watcher, disabling cache 2024-09-11T11:03:12.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.277+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93833551413792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537f1510 2024-09-11T11:03:12.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.277+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93833551413792] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x5557537f1510 2024-09-11T11:03:12.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.277+0000 7f7fd16fe980 20 remove_watcher() i=1 2024-09-11T11:03:12.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.277+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93833551416048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537f59c0 2024-09-11T11:03:12.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.281+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93833551416048] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.281+0000 7f7fd16fe980 20 remove_watcher() i=2 2024-09-11T11:03:12.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.281+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93833551406688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x7f7fc0120040 2024-09-11T11:03:12.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.281+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93833551406688] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.281+0000 7f7fd16fe980 20 remove_watcher() i=3 2024-09-11T11:03:12.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.281+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93833551421040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537f59c0 2024-09-11T11:03:12.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fcf20e640 1 -- 172.21.15.145:0/1154508809 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93833551421040] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc010a040 con 0x5557537f59c0 2024-09-11T11:03:12.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fd16fe980 20 remove_watcher() i=4 2024-09-11T11:03:12.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93833551424816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537faa00 2024-09-11T11:03:12.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93833551424816] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fd16fe980 20 remove_watcher() i=5 2024-09-11T11:03:12.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93833551428512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x5557537faa00 2024-09-11T11:03:12.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fcea0d640 1 -- 172.21.15.145:0/1154508809 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93833551428512] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc4037040 con 0x5557537faa00 2024-09-11T11:03:12.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fd16fe980 20 remove_watcher() i=6 2024-09-11T11:03:12.289 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.285+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93833551417616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55575382b170 con 0x7f7fc0120040 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93833551417616] v36'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7fc800a4d0 con 0x7f7fc0120040 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 20 remove_watcher() i=7 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537f59c0 msgr2=0x5557537f7db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537f59c0 0x5557537f7db0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557537f1510 msgr2=0x5557537f39d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557537f1510 0x5557537f39d0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7fc0120040 msgr2=0x7f7fc00a5a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f7fc0120040 0x7f7fc00a5a00 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557537faa00 msgr2=0x5557537fcdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5557537faa00 0x5557537fcdf0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7e98034650 msgr2=0x7f7e98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7e98034650 0x7f7e98036b10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400ba80 tx=0x7f7fc4023040 comp rx=0 tx=0).stop 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 msgr2=0x5557537e65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1154508809 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557537df410 0x5557537e65e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00e5820 tx=0x7f7fc00e5f10 comp rx=0 tx=0).stop 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1154508809 reap_dead start 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 shutdown_connections 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 >> 172.21.15.145:0/1154508809 conn(0x5557537db7f0 msgr2=0x5557537d98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 shutdown_connections 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1154508809 wait complete. 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2681868663 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7ea80346a0 msgr2=0x7f7ea8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/2681868663 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7ea80346a0 0x7f7ea8036b60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x5557537c31a0 tx=0x7f7fc4006000 comp rx=0 tx=0).stop 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2681868663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557536c0d00 msgr2=0x5557536bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/2681868663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557536c0d00 0x5557536bf380 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f7fc00e35a0 tx=0x7f7fc00bcfb0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2681868663 shutdown_connections 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/2681868663 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7ea80346a0 0x7f7ea8036b60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/2681868663 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5557536c0d00 0x5557536bf380 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2681868663 >> 172.21.15.145:0/2681868663 conn(0x5557537c5980 msgr2=0x5557537c8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2681868663 shutdown_connections 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/2681868663 wait complete. 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537badf0 msgr2=0x5557537bd1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5557537badf0 0x5557537bd1e0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557536c38e0 msgr2=0x5557537b99d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5557536c38e0 0x5557537b99d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557537c0470 msgr2=0x5557537c2860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5557537c0470 0x5557537c2860 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7eb4034650 msgr2=0x7f7eb4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7eb4034650 0x7f7eb4036b10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4000c10 tx=0x7f7fc40013c0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 msgr2=0x5557537b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 --2- 172.21.15.145:0/1588456429 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x555753635290 0x5557537b2a20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0000c10 tx=0x7f7fc00180e0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fcfa0f640 1 -- 172.21.15.145:0/1588456429 reap_dead start 2024-09-11T11:03:12.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 shutdown_connections 2024-09-11T11:03:12.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 >> 172.21.15.145:0/1588456429 conn(0x5557536bb090 msgr2=0x5557537a5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 shutdown_connections 2024-09-11T11:03:12.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.289+0000 7f7fd16fe980 1 -- 172.21.15.145:0/1588456429 wait complete. 2024-09-11T11:03:12.304 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-11T11:03:12.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-11T11:03:12.304 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-11T11:03:12.377 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:12.377 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:12.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b61331980 1 Processor -- start 2024-09-11T11:03:12.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b61331980 1 -- start start 2024-09-11T11:03:12.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b61331980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x561850b6f8e0 0x561850b6fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.378 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b61331980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5618509f5ae0 con 0x561850b70230 2024-09-11T11:03:12.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b61331980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x561850a19e30 con 0x561850b6f8e0 2024-09-11T11:03:12.379 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b5ee41640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x561850b6f8e0 0x561850b6fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b5ee41640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x561850b6f8e0 0x561850b6fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37176/0 (socket says 172.21.15.145:37176) 2024-09-11T11:03:12.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b5ee41640 1 -- 172.21.15.145:0/3447608116 learned_addr learned my addr 172.21.15.145:0/3447608116 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b5e640640 1 --1- 172.21.15.145:0/3447608116 >> v1:172.21.15.102:6789/0 conn(0x561850b70230 0x561850b74c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52028/0 (socket says 172.21.15.145:52028) 2024-09-11T11:03:12.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b5ee41640 1 -- 172.21.15.145:0/3447608116 >> v1:172.21.15.102:6789/0 conn(0x561850b70230 legacy=0x561850b74c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.377+0000 7f5b5ee41640 1 -- 172.21.15.145:0/3447608116 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561850b774b0 con 0x561850b6f8e0 2024-09-11T11:03:12.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/3447608116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b6f8e0 0x561850b6fcc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000a4e0 tx=0x7f5b5001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d69243dadf14847 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b5de3f640 1 -- 172.21.15.145:0/3447608116 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500aa540 con 0x561850b6f8e0 2024-09-11T11:03:12.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b5de3f640 1 -- 172.21.15.145:0/3447608116 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b500aa6e0 con 0x561850b6f8e0 2024-09-11T11:03:12.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b5de3f640 1 -- 172.21.15.145:0/3447608116 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500aaa40 con 0x561850b6f8e0 2024-09-11T11:03:12.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b61331980 1 -- 172.21.15.145:0/3447608116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b6f8e0 msgr2=0x561850b6fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b61331980 1 --2- 172.21.15.145:0/3447608116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b6f8e0 0x561850b6fcc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000a4e0 tx=0x7f5b5001b090 comp rx=0 tx=0).stop 2024-09-11T11:03:12.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b61331980 1 -- 172.21.15.145:0/3447608116 shutdown_connections 2024-09-11T11:03:12.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b61331980 1 --2- 172.21.15.145:0/3447608116 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b6f8e0 0x561850b6fcc0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b61331980 1 -- 172.21.15.145:0/3447608116 >> 172.21.15.145:0/3447608116 conn(0x561850ae3230 msgr2=0x561850ae3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b61331980 1 -- 172.21.15.145:0/3447608116 shutdown_connections 2024-09-11T11:03:12.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.381+0000 7f5b61331980 1 -- 172.21.15.145:0/3447608116 wait complete. 2024-09-11T11:03:12.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 Processor -- start 2024-09-11T11:03:12.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 -- start start 2024-09-11T11:03:12.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c5ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561850a1b200 con 0x561850b70230 2024-09-11T11:03:12.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c5ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c5ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37190/0 (socket says 172.21.15.145:37190) 2024-09-11T11:03:12.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b5ee41640 1 -- 172.21.15.145:0/54923018 learned_addr learned my addr 172.21.15.145:0/54923018 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b5ee41640 1 -- 172.21.15.145:0/54923018 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561850c5b300 con 0x561850b70230 2024-09-11T11:03:12.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/54923018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c5ad30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5b50019740 tx=0x7f5b500033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7289c0b39d0a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5a4ce09640 1 -- 172.21.15.145:0/54923018 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500b9070 con 0x561850b70230 2024-09-11T11:03:12.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5a4ce09640 1 -- 172.21.15.145:0/54923018 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b500aa990 con 0x561850b70230 2024-09-11T11:03:12.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5a4ce09640 1 -- 172.21.15.145:0/54923018 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500aac70 con 0x561850b70230 2024-09-11T11:03:12.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 -- 172.21.15.145:0/54923018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 msgr2=0x561850c5ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 --2- 172.21.15.145:0/54923018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c5ad30 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f5b50019740 tx=0x7f5b500033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 -- 172.21.15.145:0/54923018 shutdown_connections 2024-09-11T11:03:12.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 --2- 172.21.15.145:0/54923018 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c5ad30 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 -- 172.21.15.145:0/54923018 >> 172.21.15.145:0/54923018 conn(0x561850ae3230 msgr2=0x561850c568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 -- 172.21.15.145:0/54923018 shutdown_connections 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 -- 172.21.15.145:0/54923018 wait complete. 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.397+0000 7f5b61331980 1 Processor -- start 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b61331980 1 -- start start 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b61331980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c61f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b61331980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561850b76ef0 con 0x561850b70230 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c61f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c61f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37194/0 (socket says 172.21.15.145:37194) 2024-09-11T11:03:12.403 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b5ee41640 1 -- 172.21.15.145:0/430791600 learned_addr learned my addr 172.21.15.145:0/430791600 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b5ee41640 1 -- 172.21.15.145:0/430791600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561850c624d0 con 0x561850b70230 2024-09-11T11:03:12.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c61f90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5b50019740 tx=0x7f5b50017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5a4b606640 1 -- 172.21.15.145:0/430791600 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500b9070 con 0x561850b70230 2024-09-11T11:03:12.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561850c62760 con 0x561850b70230 2024-09-11T11:03:12.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5a4b606640 1 -- 172.21.15.145:0/430791600 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b500b58c0 con 0x561850b70230 2024-09-11T11:03:12.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5a4b606640 1 -- 172.21.15.145:0/430791600 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500b5bc0 con 0x561850b70230 2024-09-11T11:03:12.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561850c65440 con 0x561850b70230 2024-09-11T11:03:12.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5a4b606640 1 -- 172.21.15.145:0/430791600 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b500b3040 con 0x561850b70230 2024-09-11T11:03:12.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5a4b606640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a44034650 0x7f5a44036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5a4b606640 1 -- 172.21.15.145:0/430791600 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f5b500c4030 con 0x561850b70230 2024-09-11T11:03:12.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b5e640640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a44034650 0x7f5a44036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b61331980 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c67080 0x561850c69470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850c69a40 con 0x561850c67080 2024-09-11T11:03:12.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b5f642640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c67080 0x561850c69470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.401+0000 7f5b5e640640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a44034650 0x7f5a44036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5b48001e50 tx=0x7f5b480013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b5f642640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c67080 0x561850c69470 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b5f642640 1 -- 172.21.15.145:0/430791600 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c67080 2024-09-11T11:03:12.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b61331980 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850c6a7f0 0x561850c6cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850c6d240 con 0x561850c6a7f0 2024-09-11T11:03:12.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850c6a7f0 0x561850c6cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850c6a7f0 0x561850c6cbe0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b5ee41640 1 -- 172.21.15.145:0/430791600 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b500b5d60 con 0x561850c6a7f0 2024-09-11T11:03:12.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850c6eaf0 con 0x561850c6a7f0 2024-09-11T11:03:12.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b5ee41640 1 -- 172.21.15.145:0/430791600 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5b500d0390 con 0x561850c6a7f0 2024-09-11T11:03:12.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850c6dd20 con 0x561850c6a7f0 2024-09-11T11:03:12.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b5ee41640 1 -- 172.21.15.145:0/430791600 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b500d0390 con 0x561850c6a7f0 2024-09-11T11:03:12.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b61331980 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561850c6fea0 0x561850c72290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850c727d0 con 0x561850c6fea0 2024-09-11T11:03:12.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.405+0000 7f5b5e640640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561850c6fea0 0x561850c72290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b5e640640 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561850c6fea0 0x561850c72290 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b5e640640 1 -- 172.21.15.145:0/430791600 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5b4800f700 con 0x561850c6fea0 2024-09-11T11:03:12.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b61331980 1 Processor -- start 2024-09-11T11:03:12.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b61331980 1 -- start start 2024-09-11T11:03:12.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b61331980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c801d0 0x561850c805f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b61331980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561850a74800 con 0x561850c801d0 2024-09-11T11:03:12.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c801d0 0x561850c805f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c801d0 0x561850c805f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37200/0 (socket says 172.21.15.145:37200) 2024-09-11T11:03:12.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1919946349 learned_addr learned my addr 172.21.15.145:0/1919946349 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1919946349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561850c80b30 con 0x561850c801d0 2024-09-11T11:03:12.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/1919946349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c801d0 0x561850c805f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5b500e2f60 tx=0x7f5b500bec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5a48e01640 1 -- 172.21.15.145:0/1919946349 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500be280 con 0x561850c801d0 2024-09-11T11:03:12.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5a48e01640 1 -- 172.21.15.145:0/1919946349 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b500e8070 con 0x561850c801d0 2024-09-11T11:03:12.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5a48e01640 1 -- 172.21.15.145:0/1919946349 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500be550 con 0x561850c801d0 2024-09-11T11:03:12.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b61331980 1 -- 172.21.15.145:0/1919946349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561850c80dc0 con 0x561850c801d0 2024-09-11T11:03:12.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5b61331980 1 -- 172.21.15.145:0/1919946349 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561850c80dc0 con 0x561850c801d0 2024-09-11T11:03:12.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.409+0000 7f5a48e01640 1 -- 172.21.15.145:0/1919946349 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b500ea030 con 0x561850c801d0 2024-09-11T11:03:12.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5a48e01640 1 --2- 172.21.15.145:0/1919946349 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a380346a0 0x7f5a38036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5a48e01640 1 -- 172.21.15.145:0/1919946349 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f5b500edc20 con 0x561850c801d0 2024-09-11T11:03:12.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5e640640 1 --2- 172.21.15.145:0/1919946349 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a380346a0 0x7f5a38036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 Processor -- start 2024-09-11T11:03:12.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- start start 2024-09-11T11:03:12.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5e640640 1 --2- 172.21.15.145:0/1919946349 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a380346a0 0x7f5a38036b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x561850c66580 tx=0x7f5b4800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c8cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561850c5b5c0 con 0x561850c8c910 2024-09-11T11:03:12.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c8cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c8cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37212/0 (socket says 172.21.15.145:37212) 2024-09-11T11:03:12.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5ee41640 1 -- 172.21.15.145:0/2934550889 learned_addr learned my addr 172.21.15.145:0/2934550889 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5ee41640 1 -- 172.21.15.145:0/2934550889 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561850c8d2e0 con 0x561850c8c910 2024-09-11T11:03:12.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/2934550889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c8cd10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5b500a9e40 tx=0x7f5b500c0fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e3b9f957fe664d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5a427fc640 1 -- 172.21.15.145:0/2934550889 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500dad10 con 0x561850c8c910 2024-09-11T11:03:12.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5a427fc640 1 -- 172.21.15.145:0/2934550889 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b500a95e0 con 0x561850c8c910 2024-09-11T11:03:12.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5a427fc640 1 -- 172.21.15.145:0/2934550889 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500e11c0 con 0x561850c8c910 2024-09-11T11:03:12.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- 172.21.15.145:0/2934550889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 msgr2=0x561850c8cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 --2- 172.21.15.145:0/2934550889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c8cd10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f5b500a9e40 tx=0x7f5b500c0fd0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- 172.21.15.145:0/2934550889 shutdown_connections 2024-09-11T11:03:12.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 --2- 172.21.15.145:0/2934550889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c8cd10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- 172.21.15.145:0/2934550889 >> 172.21.15.145:0/2934550889 conn(0x561850c88d40 msgr2=0x561850c86e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- 172.21.15.145:0/2934550889 shutdown_connections 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- 172.21.15.145:0/2934550889 wait complete. 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 Processor -- start 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- start start 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c93b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b61331980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561850c8d7b0 con 0x561850c8c910 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c93b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5ee41640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c93b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37214/0 (socket says 172.21.15.145:37214) 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.413+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 learned_addr learned my addr 172.21.15.145:0/1532766940 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561850c94080 con 0x561850c8c910 2024-09-11T11:03:12.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c93b40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5b500cfcf0 tx=0x7f5b500bafd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5a40ff9640 1 -- 172.21.15.145:0/1532766940 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500b12b0 con 0x561850c8c910 2024-09-11T11:03:12.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561850c94080 con 0x561850c8c910 2024-09-11T11:03:12.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5a40ff9640 1 -- 172.21.15.145:0/1532766940 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b500b1450 con 0x561850c8c910 2024-09-11T11:03:12.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5a40ff9640 1 -- 172.21.15.145:0/1532766940 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b500b1640 con 0x561850c8c910 2024-09-11T11:03:12.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561850c94080 con 0x561850c8c910 2024-09-11T11:03:12.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5a40ff9640 1 -- 172.21.15.145:0/1532766940 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5b500b18a0 con 0x561850c8c910 2024-09-11T11:03:12.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5a40ff9640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a28034600 0x7f5a28036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5a40ff9640 1 -- 172.21.15.145:0/1532766940 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f5b50106070 con 0x561850c8c910 2024-09-11T11:03:12.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b5e640640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a28034600 0x7f5a28036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c9eaf0 0x561850ca0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850ca16e0 con 0x561850c9eaf0 2024-09-11T11:03:12.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b5f642640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c9eaf0 0x561850ca0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b5f642640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c9eaf0 0x561850ca0f90 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b5e640640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a28034600 0x7f5a28036ac0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x561850c6ea80 tx=0x7f5b48010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 20 realm 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850c9dfe0 con 0x561850c9eaf0 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.417+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850ca21b0 con 0x561850c9eaf0 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850ca2d60 0x561850ca5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850ca5990 con 0x561850ca2d60 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850ca2d60 0x561850ca5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850ca2d60 0x561850ca5220 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850ca6230 con 0x561850ca2d60 2024-09-11T11:03:12.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 20 searching for the correct realm 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561850ca7fa0 0x561850caa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca7fa0 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5e640640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561850ca7fa0 0x561850caa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5e640640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561850ca7fa0 0x561850caa390 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.421+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5ee41640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5b50109030 0x7f5b50112870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x7f5b50109030 2024-09-11T11:03:12.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5b50109030 0x7f5b50112870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5b50109030 0x7f5b50112870 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca7fa0 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.425+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x7f5b50109030 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.432 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x7f5b50109030 2024-09-11T11:03:12.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca7fa0 2024-09-11T11:03:12.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca7fa0 2024-09-11T11:03:12.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.429+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca7fa0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x7f5b50109030 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850c9eaf0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x7f5b50109030 2024-09-11T11:03:12.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca7fa0 2024-09-11T11:03:12.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x7f5b50109030 2024-09-11T11:03:12.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.433+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca7fa0 2024-09-11T11:03:12.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561850caaa10 con 0x561850ca2d60 2024-09-11T11:03:12.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:12.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:12.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:12.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:12.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:12.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:12.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850ca6be0 con 0x561850c9eaf0 2024-09-11T11:03:12.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850ca7030 con 0x561850ca2d60 2024-09-11T11:03:12.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:12.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850ca7450 con 0x7f5b50109030 2024-09-11T11:03:12.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:12.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 zone default found 2024-09-11T11:03:12.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 4 Realm: () 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 zonegroup default 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850caaec0 con 0x7f5b50109030 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.437+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850cad0f0 con 0x561850ca7fa0 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850cad490 con 0x561850ca7fa0 2024-09-11T11:03:12.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 20 started sync module instance, tier type = 2024-09-11T11:03:12.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:12.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cac530 con 0x561850ca2d60 2024-09-11T11:03:12.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94662434671184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cac530 con 0x561850ca2d60 2024-09-11T11:03:12.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.441+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cade50 con 0x561850c9eaf0 2024-09-11T11:03:12.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94662434675104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cae270 con 0x561850c9eaf0 2024-09-11T11:03:12.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850caed60 con 0x561850ca2d60 2024-09-11T11:03:12.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94662434671184] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.447 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94662434675104] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94662434678832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850caddc0 con 0x561850ca2d60 2024-09-11T11:03:12.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850caf600 con 0x7f5b50109030 2024-09-11T11:03:12.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94662434681168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850caddc0 con 0x7f5b50109030 2024-09-11T11:03:12.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.445+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb0080 con 0x561850ca2d60 2024-09-11T11:03:12.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94662434681168] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94662434678832] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94662434668672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cafb90 con 0x561850ca2d60 2024-09-11T11:03:12.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb0920 con 0x561850ca7fa0 2024-09-11T11:03:12.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94662434686064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cafb90 con 0x561850ca7fa0 2024-09-11T11:03:12.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb1790 con 0x561850ca7fa0 2024-09-11T11:03:12.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.449+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94662434668672] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94662434686064] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94662434689760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb0dd0 con 0x561850ca7fa0 2024-09-11T11:03:12.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb2230 con 0x7f5b50109030 2024-09-11T11:03:12.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94662434692352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb2230 con 0x7f5b50109030 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 20 add_watcher() i=0 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 20 add_watcher() i=1 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 20 add_watcher() i=2 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 20 add_watcher() i=3 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 20 add_watcher() i=4 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 20 add_watcher() i=5 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94662434689760] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 20 add_watcher() i=6 2024-09-11T11:03:12.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94662434692352] v36'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 20 add_watcher() i=7 2024-09-11T11:03:12.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:12.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.453+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850caf570 con 0x561850c9eaf0 2024-09-11T11:03:12.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94662434682224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb2c70 con 0x561850c9eaf0 2024-09-11T11:03:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94662434682224] v36'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5a157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 5 note: GC not initialized 2024-09-11T11:03:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f598ffff640 20 reqs_thread_entry: start 2024-09-11T11:03:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:12.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 20 Filter name: none 2024-09-11T11:03:12.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f598dffb640 20 reqs_thread_entry: start 2024-09-11T11:03:12.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850cd8920 con 0x561850c9eaf0 2024-09-11T11:03:12.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:03:12.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.457+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561850cd9e70 con 0x561850ca7fa0 2024-09-11T11:03:12.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.461+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.461+0000 7f5a157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:12.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.461+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94662434682224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb79e0 con 0x561850c9eaf0 2024-09-11T11:03:12.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.461+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94662434682224] v36'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.461+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94662434671184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850caf570 con 0x561850ca2d60 2024-09-11T11:03:12.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.465+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94662434671184] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.465+0000 7f5b61331980 20 remove_watcher() i=0 2024-09-11T11:03:12.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.465+0000 7f5b61331980 2 removed watcher, disabling cache 2024-09-11T11:03:12.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.465+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94662434675104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850caf570 con 0x561850c9eaf0 2024-09-11T11:03:12.469 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.465+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94662434675104] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x561850c9eaf0 2024-09-11T11:03:12.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.465+0000 7f5b61331980 20 remove_watcher() i=1 2024-09-11T11:03:12.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.465+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94662434678832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cad9a0 con 0x561850ca2d60 2024-09-11T11:03:12.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.469+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94662434678832] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.469+0000 7f5b61331980 20 remove_watcher() i=2 2024-09-11T11:03:12.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.469+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94662434681168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cad9a0 con 0x7f5b50109030 2024-09-11T11:03:12.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.469+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94662434681168] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.469+0000 7f5b61331980 20 remove_watcher() i=3 2024-09-11T11:03:12.473 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.469+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94662434668672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cad9a0 con 0x561850ca2d60 2024-09-11T11:03:12.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b5ee41640 1 -- 172.21.15.145:0/1532766940 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94662434668672] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b5010f020 con 0x561850ca2d60 2024-09-11T11:03:12.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b61331980 20 remove_watcher() i=4 2024-09-11T11:03:12.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94662434686064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cac080 con 0x561850ca7fa0 2024-09-11T11:03:12.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94662434686064] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b61331980 20 remove_watcher() i=5 2024-09-11T11:03:12.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94662434689760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cad9a0 con 0x561850ca7fa0 2024-09-11T11:03:12.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b5e640640 1 -- 172.21.15.145:0/1532766940 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94662434689760] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b48037040 con 0x561850ca7fa0 2024-09-11T11:03:12.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b61331980 20 remove_watcher() i=6 2024-09-11T11:03:12.477 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.473+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94662434692352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561850cb12e0 con 0x7f5b50109030 2024-09-11T11:03:12.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94662434692352] v36'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5b580083f0 con 0x7f5b50109030 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 20 remove_watcher() i=7 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850ca2d60 msgr2=0x561850ca5220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850ca2d60 0x561850ca5220 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c9eaf0 msgr2=0x561850ca0f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c9eaf0 0x561850ca0f90 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5b50109030 msgr2=0x7f5b50112870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f5b50109030 0x7f5b50112870 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561850ca7fa0 msgr2=0x561850caa390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561850ca7fa0 0x561850caa390 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a28034600 msgr2=0x7f5a28036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a28034600 0x7f5a28036ac0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x561850c6ea80 tx=0x7f5b48010000 comp rx=0 tx=0).stop 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 msgr2=0x561850c93b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b5f642640 1 -- 172.21.15.145:0/1532766940 reap_dead start 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c93b40 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f5b500cfcf0 tx=0x7f5b500bafd0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 shutdown_connections 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1532766940 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c8c910 0x561850c93b40 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 >> 172.21.15.145:0/1532766940 conn(0x561850c88d40 msgr2=0x561850c86e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 shutdown_connections 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1532766940 wait complete. 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1919946349 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a380346a0 msgr2=0x7f5a38036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1919946349 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a380346a0 0x7f5a38036b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x561850c66580 tx=0x7f5b4800f000 comp rx=0 tx=0).stop 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1919946349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c801d0 msgr2=0x561850c805f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1919946349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c801d0 0x561850c805f0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f5b500e2f60 tx=0x7f5b500bec50 comp rx=0 tx=0).stop 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1919946349 shutdown_connections 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1919946349 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a380346a0 0x7f5a38036b60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/1919946349 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850c801d0 0x561850c805f0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1919946349 >> 172.21.15.145:0/1919946349 conn(0x561850c75320 msgr2=0x561850c77da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1919946349 shutdown_connections 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/1919946349 wait complete. 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850c6a7f0 msgr2=0x561850c6cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561850c6a7f0 0x561850c6cbe0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c67080 msgr2=0x561850c69470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561850c67080 0x561850c69470 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561850c6fea0 msgr2=0x561850c72290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561850c6fea0 0x561850c72290 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a44034650 msgr2=0x7f5a44036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5a44034650 0x7f5a44036b10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5b48001e50 tx=0x7f5b480013b0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 msgr2=0x561850c61f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 --2- 172.21.15.145:0/430791600 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561850b70230 0x561850c61f90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f5b50019740 tx=0x7f5b50017e30 comp rx=0 tx=0).stop 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b5f642640 1 -- 172.21.15.145:0/430791600 reap_dead start 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 shutdown_connections 2024-09-11T11:03:12.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 >> 172.21.15.145:0/430791600 conn(0x561850ae3230 msgr2=0x561850c55440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 shutdown_connections 2024-09-11T11:03:12.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.477+0000 7f5b61331980 1 -- 172.21.15.145:0/430791600 wait complete. 2024-09-11T11:03:12.491 INFO:teuthology.orchestra.run.smithi145.stdout:{"entries":[],"summary":[]} 2024-09-11T11:03:12.491 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-11T11:03:12.491 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-11T11:03:12.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-11T11:03:12.492 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-11T11:03:12.566 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:12.566 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:12.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1336f9b980 1 Processor -- start 2024-09-11T11:03:12.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1336f9b980 1 -- start start 2024-09-11T11:03:12.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1336f9b980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55a9230608f0 0x55a923060cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1336f9b980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a922ee6ae0 con 0x55a923061240 2024-09-11T11:03:12.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1336f9b980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55a922f0ae30 con 0x55a9230608f0 2024-09-11T11:03:12.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1334aab640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55a9230608f0 0x55a923060cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.568 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1334aab640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55a9230608f0 0x55a923060cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37230/0 (socket says 172.21.15.145:37230) 2024-09-11T11:03:12.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1334aab640 1 -- 172.21.15.145:0/2308118451 learned_addr learned my addr 172.21.15.145:0/2308118451 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f13342aa640 1 --1- 172.21.15.145:0/2308118451 >> v1:172.21.15.102:6789/0 conn(0x55a923061240 0x55a923065c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52044/0 (socket says 172.21.15.145:52044) 2024-09-11T11:03:12.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1334aab640 1 -- 172.21.15.145:0/2308118451 >> v1:172.21.15.102:6789/0 conn(0x55a923061240 legacy=0x55a923065c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.565+0000 7f1334aab640 1 -- 172.21.15.145:0/2308118451 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9230684c0 con 0x55a9230608f0 2024-09-11T11:03:12.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1334aab640 1 --2- 172.21.15.145:0/2308118451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a923060cd0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f132c00a4e0 tx=0x7f132c01af20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c1e5a7b895cbf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1333aa9640 1 -- 172.21.15.145:0/2308118451 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0a3e60 con 0x55a9230608f0 2024-09-11T11:03:12.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1333aa9640 1 -- 172.21.15.145:0/2308118451 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0a7070 con 0x55a9230608f0 2024-09-11T11:03:12.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1333aa9640 1 -- 172.21.15.145:0/2308118451 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0ab540 con 0x55a9230608f0 2024-09-11T11:03:12.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1336f9b980 1 -- 172.21.15.145:0/2308118451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 msgr2=0x55a923060cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1336f9b980 1 --2- 172.21.15.145:0/2308118451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a923060cd0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f132c00a4e0 tx=0x7f132c01af20 comp rx=0 tx=0).stop 2024-09-11T11:03:12.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1336f9b980 1 -- 172.21.15.145:0/2308118451 shutdown_connections 2024-09-11T11:03:12.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1336f9b980 1 --2- 172.21.15.145:0/2308118451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a923060cd0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1336f9b980 1 -- 172.21.15.145:0/2308118451 >> 172.21.15.145:0/2308118451 conn(0x55a922fd4240 msgr2=0x55a922fd4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1336f9b980 1 -- 172.21.15.145:0/2308118451 shutdown_connections 2024-09-11T11:03:12.572 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.569+0000 7f1336f9b980 1 -- 172.21.15.145:0/2308118451 wait complete. 2024-09-11T11:03:12.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1336f9b980 1 Processor -- start 2024-09-11T11:03:12.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1336f9b980 1 -- start start 2024-09-11T11:03:12.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1336f9b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a92314bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1336f9b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a922f0c200 con 0x55a9230608f0 2024-09-11T11:03:12.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a92314bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a92314bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37232/0 (socket says 172.21.15.145:37232) 2024-09-11T11:03:12.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1334aab640 1 -- 172.21.15.145:0/2612423725 learned_addr learned my addr 172.21.15.145:0/2612423725 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1334aab640 1 -- 172.21.15.145:0/2612423725 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a92314c1b0 con 0x55a9230608f0 2024-09-11T11:03:12.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1334aab640 1 --2- 172.21.15.145:0/2612423725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a92314bbe0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f132c018b50 tx=0x7f132c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609c245853bd34c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1222e0d640 1 -- 172.21.15.145:0/2612423725 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0ab540 con 0x55a9230608f0 2024-09-11T11:03:12.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1222e0d640 1 -- 172.21.15.145:0/2612423725 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0ab6e0 con 0x55a9230608f0 2024-09-11T11:03:12.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.585+0000 7f1222e0d640 1 -- 172.21.15.145:0/2612423725 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0ab9e0 con 0x55a9230608f0 2024-09-11T11:03:12.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- 172.21.15.145:0/2612423725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 msgr2=0x55a92314bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 --2- 172.21.15.145:0/2612423725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a92314bbe0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f132c018b50 tx=0x7f132c0033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- 172.21.15.145:0/2612423725 shutdown_connections 2024-09-11T11:03:12.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 --2- 172.21.15.145:0/2612423725 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a92314bbe0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- 172.21.15.145:0/2612423725 >> 172.21.15.145:0/2612423725 conn(0x55a922fd4240 msgr2=0x55a923147810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- 172.21.15.145:0/2612423725 shutdown_connections 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- 172.21.15.145:0/2612423725 wait complete. 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 Processor -- start 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- start start 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a923152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a923067f00 con 0x55a9230608f0 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a923152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a923152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37236/0 (socket says 172.21.15.145:37236) 2024-09-11T11:03:12.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1334aab640 1 -- 172.21.15.145:0/1991497386 learned_addr learned my addr 172.21.15.145:0/1991497386 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1334aab640 1 -- 172.21.15.145:0/1991497386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a923153360 con 0x55a9230608f0 2024-09-11T11:03:12.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1334aab640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a923152e20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f132c018b50 tx=0x7f132c017cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f122160a640 1 -- 172.21.15.145:0/1991497386 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0c3020 con 0x55a9230608f0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f122160a640 1 -- 172.21.15.145:0/1991497386 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0bf7b0 con 0x55a9230608f0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a9231535f0 con 0x55a9230608f0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f122160a640 1 -- 172.21.15.145:0/1991497386 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0bfab0 con 0x55a9230608f0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9231562d0 con 0x55a9230608f0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f122160a640 1 -- 172.21.15.145:0/1991497386 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f132c0c6020 con 0x55a9230608f0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.589+0000 7f122160a640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f121c0346a0 0x7f121c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f122160a640 1 -- 172.21.15.145:0/1991497386 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f132c0ba040 con 0x55a9230608f0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f13342aa640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f121c0346a0 0x7f121c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1336f9b980 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a923061240 0x55a923159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92315a460 con 0x55a923061240 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f13352ac640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a923061240 0x55a923159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f13342aa640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f121c0346a0 0x7f121c036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b350 tx=0x7f131c001530 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f13352ac640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a923061240 0x55a923159f20 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f13352ac640 1 -- 172.21.15.145:0/1991497386 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a923061240 2024-09-11T11:03:12.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1336f9b980 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a92315b210 0x55a92315d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92315dc30 con 0x55a92315b210 2024-09-11T11:03:12.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1334aab640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a92315b210 0x55a92315d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1334aab640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a92315b210 0x55a92315d600 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1334aab640 1 -- 172.21.15.145:0/1991497386 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f132c0c8930 con 0x55a92315b210 2024-09-11T11:03:12.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92315f4e0 con 0x55a92315b210 2024-09-11T11:03:12.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1334aab640 1 -- 172.21.15.145:0/1991497386 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f132c0c8930 con 0x55a92315b210 2024-09-11T11:03:12.598 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.593+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92315e650 con 0x55a92315b210 2024-09-11T11:03:12.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1334aab640 1 -- 172.21.15.145:0/1991497386 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f132c0c8930 con 0x55a92315b210 2024-09-11T11:03:12.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1336f9b980 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a923160890 0x55a923162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231631c0 con 0x55a923160890 2024-09-11T11:03:12.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f13342aa640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a923160890 0x55a923162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f13342aa640 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a923160890 0x55a923162c80 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f13342aa640 1 -- 172.21.15.145:0/1991497386 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f131c00f8c0 con 0x55a923160890 2024-09-11T11:03:12.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1336f9b980 1 Processor -- start 2024-09-11T11:03:12.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1336f9b980 1 -- start start 2024-09-11T11:03:12.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1336f9b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a923170bb0 0x55a923170fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.600 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1336f9b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a922f65800 con 0x55a923170bb0 2024-09-11T11:03:12.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a923170bb0 0x55a923170fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a923170bb0 0x55a923170fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37244/0 (socket says 172.21.15.145:37244) 2024-09-11T11:03:12.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1334aab640 1 -- 172.21.15.145:0/3720044027 learned_addr learned my addr 172.21.15.145:0/3720044027 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1334aab640 1 -- 172.21.15.145:0/3720044027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a923171510 con 0x55a923170bb0 2024-09-11T11:03:12.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1334aab640 1 --2- 172.21.15.145:0/3720044027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a923170bb0 0x55a923170fd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f132c0033d0 tx=0x7f132c0aab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f121a7fc640 1 -- 172.21.15.145:0/3720044027 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0e8070 con 0x55a923170bb0 2024-09-11T11:03:12.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f121a7fc640 1 -- 172.21.15.145:0/3720044027 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0e13c0 con 0x55a923170bb0 2024-09-11T11:03:12.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1336f9b980 1 -- 172.21.15.145:0/3720044027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a923171740 con 0x55a923170bb0 2024-09-11T11:03:12.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f121a7fc640 1 -- 172.21.15.145:0/3720044027 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0e4050 con 0x55a923170bb0 2024-09-11T11:03:12.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.597+0000 7f1336f9b980 1 -- 172.21.15.145:0/3720044027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a923171740 con 0x55a923170bb0 2024-09-11T11:03:12.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f121a7fc640 1 -- 172.21.15.145:0/3720044027 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f132c0e0030 con 0x55a923170bb0 2024-09-11T11:03:12.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f121a7fc640 1 --2- 172.21.15.145:0/3720044027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f120c034650 0x7f120c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f121a7fc640 1 -- 172.21.15.145:0/3720044027 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f132c0b0050 con 0x55a923170bb0 2024-09-11T11:03:12.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f13342aa640 1 --2- 172.21.15.145:0/3720044027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f120c034650 0x7f120c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 Processor -- start 2024-09-11T11:03:12.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 -- start start 2024-09-11T11:03:12.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f13342aa640 1 --2- 172.21.15.145:0/3720044027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f120c034650 0x7f120c036b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55a923157410 tx=0x7f131c006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a92317d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.604 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a92314c470 con 0x55a92317d150 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a92317d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a92317d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37252/0 (socket says 172.21.15.145:37252) 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1334aab640 1 -- 172.21.15.145:0/3341916871 learned_addr learned my addr 172.21.15.145:0/3341916871 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1334aab640 1 -- 172.21.15.145:0/3341916871 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a92317db20 con 0x55a92317d150 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1334aab640 1 --2- 172.21.15.145:0/3341916871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a92317d550 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f132c0ab6b0 tx=0x7f132c0bd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf618f915eae59c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f120bfff640 1 -- 172.21.15.145:0/3341916871 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0d7e30 con 0x55a92317d150 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f120bfff640 1 -- 172.21.15.145:0/3341916871 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0be3d0 con 0x55a92317d150 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f120bfff640 1 -- 172.21.15.145:0/3341916871 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0d7bd0 con 0x55a92317d150 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 -- 172.21.15.145:0/3341916871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 msgr2=0x55a92317d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3341916871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a92317d550 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f132c0ab6b0 tx=0x7f132c0bd800 comp rx=0 tx=0).stop 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 -- 172.21.15.145:0/3341916871 shutdown_connections 2024-09-11T11:03:12.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3341916871 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a92317d550 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 -- 172.21.15.145:0/3341916871 >> 172.21.15.145:0/3341916871 conn(0x55a923179530 msgr2=0x55a923177630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 -- 172.21.15.145:0/3341916871 shutdown_connections 2024-09-11T11:03:12.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.601+0000 7f1336f9b980 1 -- 172.21.15.145:0/3341916871 wait complete. 2024-09-11T11:03:12.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 1 Processor -- start 2024-09-11T11:03:12.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 1 -- start start 2024-09-11T11:03:12.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a9231843d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55a92317dfa0 con 0x55a92317d150 2024-09-11T11:03:12.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a9231843d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1334aab640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a9231843d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37268/0 (socket says 172.21.15.145:37268) 2024-09-11T11:03:12.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 learned_addr learned my addr 172.21.15.145:0/3231789105 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a923184910 con 0x55a92317d150 2024-09-11T11:03:12.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1334aab640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a9231843d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f132c0a3b20 tx=0x7f132c0d93e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f120a7fc640 1 -- 172.21.15.145:0/3231789105 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c111070 con 0x55a92317d150 2024-09-11T11:03:12.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f120a7fc640 1 -- 172.21.15.145:0/3231789105 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f132c0d7e30 con 0x55a92317d150 2024-09-11T11:03:12.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a923184910 con 0x55a92317d150 2024-09-11T11:03:12.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a923184910 con 0x55a92317d150 2024-09-11T11:03:12.609 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f120a7fc640 1 -- 172.21.15.145:0/3231789105 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f132c0d90b0 con 0x55a92317d150 2024-09-11T11:03:12.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f120a7fc640 1 -- 172.21.15.145:0/3231789105 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f132c100020 con 0x55a92317d150 2024-09-11T11:03:12.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f120a7fc640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1200034650 0x7f1200036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f120a7fc640 1 -- 172.21.15.145:0/3231789105 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f132c116c00 con 0x55a92317d150 2024-09-11T11:03:12.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f13342aa640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1200034650 0x7f1200036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a92318f2e0 0x55a9231917a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a923191ef0 con 0x55a92318f2e0 2024-09-11T11:03:12.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.605+0000 7f13352ac640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a92318f2e0 0x55a9231917a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f13342aa640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1200034650 0x7f1200036b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f131c00ffd0 tx=0x7f131c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f13352ac640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a92318f2e0 0x55a9231917a0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 realm 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92318e760 con 0x55a92318f2e0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231929b0 con 0x55a92318f2e0 2024-09-11T11:03:12.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a923193790 0x55a923195b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a923196230 con 0x55a923193790 2024-09-11T11:03:12.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1334aab640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a923193790 0x55a923195b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1334aab640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a923193790 0x55a923195b80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a923196a80 con 0x55a923193790 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 20 searching for the correct realm 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a9231987f0 0x55a92319abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.609+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a9231987f0 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13342aa640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a9231987f0 0x55a92319abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13342aa640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a9231987f0 0x55a92319abe0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f1334aab640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f132c102040 0x7f132c0fb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x7f132c102040 2024-09-11T11:03:12.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f132c102040 0x7f132c0fb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f132c102040 0x7f132c0fb1b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.617 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a9231987f0 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.613+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x7f132c102040 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x7f132c102040 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a9231987f0 2024-09-11T11:03:12.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.617+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a9231987f0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a9231987f0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x7f132c102040 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a92318f2e0 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x7f132c102040 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a9231987f0 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x7f132c102040 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.621+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a9231987f0 2024-09-11T11:03:12.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55a92319b260 con 0x55a923193790 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a923197430 con 0x55a92318f2e0 2024-09-11T11:03:12.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a923197070 con 0x55a923193790 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.625+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a923197dd0 con 0x7f132c102040 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 zone default found 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 4 Realm: () 2024-09-11T11:03:12.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 zonegroup default 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92319bb70 con 0x7f132c102040 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92319de20 con 0x55a9231987f0 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92319e1c0 con 0x55a9231987f0 2024-09-11T11:03:12.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 started sync module instance, tier type = 2024-09-11T11:03:12.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:12.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.629+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92319d2b0 con 0x55a923193790 2024-09-11T11:03:12.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94184926730240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92319d2b0 con 0x55a923193790 2024-09-11T11:03:12.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92319ec10 con 0x55a92318f2e0 2024-09-11T11:03:12.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94184926734112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92319eb40 con 0x55a92318f2e0 2024-09-11T11:03:12.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92319fb00 con 0x55a923193790 2024-09-11T11:03:12.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94184926730240] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94184926734112] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94184926736432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92319f650 con 0x55a923193790 2024-09-11T11:03:12.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.633+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a03a0 con 0x7f132c102040 2024-09-11T11:03:12.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.637+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.637+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94184926740208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92319f650 con 0x7f132c102040 2024-09-11T11:03:12.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.637+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a0e90 con 0x55a923193790 2024-09-11T11:03:12.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.637+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94184926736432] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.637+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94184926740208] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.637+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.637+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94184926741264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a0e50 con 0x55a923193790 2024-09-11T11:03:12.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.637+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a1280 con 0x55a9231987f0 2024-09-11T11:03:12.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94184926727680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a1b20 con 0x55a9231987f0 2024-09-11T11:03:12.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a2520 con 0x55a9231987f0 2024-09-11T11:03:12.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94184926741264] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94184926727680] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94184926742880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a2910 con 0x55a9231987f0 2024-09-11T11:03:12.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a3160 con 0x7f132c102040 2024-09-11T11:03:12.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94184926751472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a35d0 con 0x7f132c102040 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 20 add_watcher() i=0 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 20 add_watcher() i=1 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 20 add_watcher() i=2 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 20 add_watcher() i=3 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 20 add_watcher() i=4 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 20 add_watcher() i=5 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94184926742880] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.641+0000 7f1336f9b980 20 add_watcher() i=6 2024-09-11T11:03:12.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94184926751472] v36'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f1336f9b980 20 add_watcher() i=7 2024-09-11T11:03:12.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f1336f9b980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:12.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a2030 con 0x55a92318f2e0 2024-09-11T11:03:12.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94184926748720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a3b20 con 0x55a92318f2e0 2024-09-11T11:03:12.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94184926748720] v36'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f11eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:12.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f1336f9b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:12.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f1336f9b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:12.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.645+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231aef50 con 0x55a923193790 2024-09-11T11:03:12.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.649+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.652 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.649+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231aeff0 con 0x7f132c102040 2024-09-11T11:03:12.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.649+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.649+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231af660 con 0x55a9231987f0 2024-09-11T11:03:12.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.653+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.653+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231afbd0 con 0x55a92318f2e0 2024-09-11T11:03:12.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.653+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.653+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0140 con 0x55a923193790 2024-09-11T11:03:12.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.657+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.657+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0140 con 0x55a9231987f0 2024-09-11T11:03:12.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.661+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.661+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b06b0 con 0x55a923193790 2024-09-11T11:03:12.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.661+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.661+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b06b0 con 0x55a92318f2e0 2024-09-11T11:03:12.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.665+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.665+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0a70 con 0x55a923193790 2024-09-11T11:03:12.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.665+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.665+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0a70 con 0x55a923193790 2024-09-11T11:03:12.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.669+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.671 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.669+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0a70 con 0x55a923193790 2024-09-11T11:03:12.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.673+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.674 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.673+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0a70 con 0x55a9231987f0 2024-09-11T11:03:12.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.673+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.673+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0f20 con 0x55a923193790 2024-09-11T11:03:12.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.677+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.677+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0f20 con 0x55a92318f2e0 2024-09-11T11:03:12.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.677+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.677+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b0fb0 con 0x55a92318f2e0 2024-09-11T11:03:12.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.681+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.681+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1040 con 0x55a923193790 2024-09-11T11:03:12.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.685+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'68 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.686 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.685+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1650 con 0x55a923193790 2024-09-11T11:03:12.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.685+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.689 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.685+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1590 con 0x55a9231987f0 2024-09-11T11:03:12.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.689+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.689+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1590 con 0x55a923193790 2024-09-11T11:03:12.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.689+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.689+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1590 con 0x55a92318f2e0 2024-09-11T11:03:12.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.693+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.693+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1590 con 0x55a923193790 2024-09-11T11:03:12.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.697+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'69 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.697+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1590 con 0x55a923193790 2024-09-11T11:03:12.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.701+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.703 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.701+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1590 con 0x55a9231987f0 2024-09-11T11:03:12.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.701+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.705 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.701+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b1590 con 0x55a923193790 2024-09-11T11:03:12.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.705+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.708 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.705+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b15e0 con 0x55a9231987f0 2024-09-11T11:03:12.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.709+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.711 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.709+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b15e0 con 0x55a9231987f0 2024-09-11T11:03:12.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.713+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.714 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.713+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b15e0 con 0x55a9231987f0 2024-09-11T11:03:12.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.713+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.717 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.713+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b15e0 con 0x55a923193790 2024-09-11T11:03:12.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.717+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.721 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.717+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b15e0 con 0x55a92318f2e0 2024-09-11T11:03:12.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.721+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.723 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.721+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b15e0 con 0x55a923193790 2024-09-11T11:03:12.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.725+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'70 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.727 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.725+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b15e0 con 0x55a92318f2e0 2024-09-11T11:03:12.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.725+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.730 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231b15e0 con 0x7f132c102040 2024-09-11T11:03:12.732 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f11ea7e4640 20 reqs_thread_entry: start 2024-09-11T11:03:12.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f1336f9b980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:12.733 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f1336f9b980 20 Filter name: none 2024-09-11T11:03:12.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f11e37fe640 20 reqs_thread_entry: start 2024-09-11T11:03:12.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f1336f9b980 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-11T11:03:12.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.734 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.729+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231ae160 con 0x55a92318f2e0 2024-09-11T11:03:12.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv17 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 20 rados_obj.operate() r=0 bl.length=391 2024-09-11T11:03:12.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-11T11:03:12.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-11T11:03:12.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:12.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231adbd0 con 0x7f132c102040 2024-09-11T11:03:12.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.735 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.7 : miss 2024-09-11T11:03:12.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 8.0 8:00b2d244:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231ceef0 con 0x55a9231987f0 2024-09-11T11:03:12.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(96 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 20 rados_obj.operate() r=0 bl.length=379 2024-09-11T11:03:12.736 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.7 info.flags=0x17 2024-09-11T11:03:12.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 adding default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.7 to cache LRU end 2024-09-11T11:03:12.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:12.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-11T11:03:12.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.7 2024-09-11T11:03:12.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:97 4.1a 4:5a01ad6e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324c3b0 con 0x55a923193790 2024-09-11T11:03:12.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(97 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.737 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:98 4.f 4:f06c1cbd:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324c3b0 con 0x55a92318f2e0 2024-09-11T11:03:12.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(98 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.733+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:99 4.3f 4:fef2ab95:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324c3b0 con 0x7f132c102040 2024-09-11T11:03:12.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(99 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.738 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 4.14 4:2834d649:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324c3b0 con 0x55a9231987f0 2024-09-11T11:03:12.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(100 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.739 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 4.5 4:a1c407ca:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324c450 con 0x55a923193790 2024-09-11T11:03:12.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(101 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4 [call out=425b] v0'0 uv13 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f1336f9b980 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-11T11:03:12.740 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:102 4.0 4:02011889:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324ca40 con 0x7f132c102040 2024-09-11T11:03:12.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(102 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f13240083f0 con 0x7f132c102040 2024-09-11T11:03:12.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:103 4.27 4:e41a44d6:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324ca40 con 0x55a92318f2e0 2024-09-11T11:03:12.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(103 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:104 4.f 4:f000f52a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324ca40 con 0x55a92318f2e0 2024-09-11T11:03:12.741 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(104 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f13240083f0 con 0x55a92318f2e0 2024-09-11T11:03:12.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.737+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:105 4.1f 4:f8ba618a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324ca40 con 0x55a923193790 2024-09-11T11:03:12.742 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(105 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:106 4.1d 4:b80299ad:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324cec0 con 0x55a9231987f0 2024-09-11T11:03:12.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(106 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.743 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:107 4.1d 4:bbb96950:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324cec0 con 0x55a9231987f0 2024-09-11T11:03:12.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(107 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 20 get_obj_state: octx=0x7f132c0d7ac0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55a92324a458 s->prefetch_data=0 2024-09-11T11:03:12.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:108 3.38 3:1febafab:::27698d38-fc40-410e-96d8-191ffc71147c.4235.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a92324b430 con 0x55a9231987f0 2024-09-11T11:03:12.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(108 27698d38-fc40-410e-96d8-191ffc71147c.4235.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv5 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.744 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 10 manifest: total_size = 6 2024-09-11T11:03:12.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 20 get_obj_state: setting s->obj_tag to 27698d38-fc40-410e-96d8-191ffc71147c.4235.7618768844479458094 2024-09-11T11:03:12.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 20 get_obj_state: octx=0x7f132c0d7ac0 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x55a92324a458 s->prefetch_data=0 2024-09-11T11:03:12.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 20 prepare_atomic_modification: state is not atomic. state=0x55a92324a458 2024-09-11T11:03:12.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 20 bucket index object: :.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4 2024-09-11T11:03:12.745 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.741+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:109 4.5 4:a1c407ca:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92324be50 con 0x55a923193790 2024-09-11T11:03:12.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(109 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4 [stat,call,call] v36'18 uv18 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:110 3.38 3:1febafab:::27698d38-fc40-410e-96d8-191ffc71147c.4235.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a92324be50 con 0x55a9231987f0 2024-09-11T11:03:12.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(110 27698d38-fc40-410e-96d8-191ffc71147c.4235.7_15f6f8dc036519d7fe15b39338f6e5db [call] v36'6 uv6 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:111 4.5 4:a1c407ca:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d3ca0 con 0x55a923193790 2024-09-11T11:03:12.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 20 list_objects_ordered: starting attempt 1 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:112 4.1a 4:5a01ad6e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d3ca0 con 0x55a923193790 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:113 4.f 4:f06c1cbd:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d3ca0 con 0x55a92318f2e0 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:114 4.3f 4:fef2ab95:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231db2b0 con 0x7f132c102040 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:115 4.14 4:2834d649:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231db2b0 con 0x55a9231987f0 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:116 4.5 4:a1c407ca:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e0260 con 0x55a923193790 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:117 4.0 4:02011889:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e2d00 con 0x7f132c102040 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.745+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:118 4.27 4:e41a44d6:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e5660 con 0x55a92318f2e0 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(112 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(115 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:119 4.f 4:f000f52a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e5660 con 0x55a92318f2e0 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:120 4.1f 4:f8ba618a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d48f0 con 0x55a923193790 2024-09-11T11:03:12.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(113 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:121 4.1d 4:b80299ad:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d7380 con 0x55a9231987f0 2024-09-11T11:03:12.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(114 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:122 4.1d 4:bbb96950:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231da050 con 0x55a9231987f0 2024-09-11T11:03:12.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(117 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(118 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 32 ==== osd_op_reply(119 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(121 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== osd_op_reply(122 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(120 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(111 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4 [stat,call,call] v36'19 uv19 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f120b7fe640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(116 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4 [call out=124b] v0'0 uv19 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.755 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[27698d38-fc40-410e-96d8-191ffc71147c.4235.7])"; uploads.size()=0; is_truncated=0 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:123 4.1a 4:5a01ad6e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231dd740 con 0x55a923193790 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:124 4.f 4:f06c1cbd:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d9fd0 con 0x55a92318f2e0 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:125 4.3f 4:fef2ab95:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d4440 con 0x7f132c102040 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:126 4.14 4:2834d649:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d9880 con 0x55a9231987f0 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:127 4.5 4:a1c407ca:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e5660 con 0x55a923193790 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:128 4.0 4:02011889:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231dd740 con 0x7f132c102040 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:129 4.27 4:e41a44d6:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231da540 con 0x55a92318f2e0 2024-09-11T11:03:12.756 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:130 4.f 4:f000f52a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231dae60 con 0x55a92318f2e0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:131 4.1f 4:f8ba618a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a923193790 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:132 4.1d 4:b80299ad:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231eaba0 con 0x55a9231987f0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:133 4.1d 4:bbb96950:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a9231987f0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(126 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.3 [call out=85b] v0'0 uv11 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(127 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4 [call out=124b] v0'0 uv19 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(131 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.8 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(132 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.9 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(123 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== osd_op_reply(133 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.10 [call out=85b] v0'0 uv8 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 33 ==== osd_op_reply(124 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.1 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 34 ==== osd_op_reply(129 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.6 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 35 ==== osd_op_reply(130 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.7 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.749+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(128 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.5 [call out=85b] v0'0 uv7 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.757 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(125 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.758 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x7f132c102040 2024-09-11T11:03:12.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(134 foo.buckets [call] v36'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-11T11:03:12.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.759 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x7f132c102040 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 23 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 20 rados_obj.operate() r=0 bl.length=165 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x7f132c102040 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 24 ==== osd_op_reply(136 myfoo [call,call,delete] v36'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 10 removing default.rgw.meta+root+myfoo from cache 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.753+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94184926951344 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a9231987f0 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== watch-notify(notify (1) cookie 94184926742880 notify 154618822682 ret 0) ==== 191+0+0 (crc 0 0 0) 0x55a9231ce440 con 0x55a9231987f0 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f120b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822682 cookie 94184926742880 notifier 4787 bl.length()=149 2024-09-11T11:03:12.760 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== osd_op_reply(137 notify.6 [notify cookie 94184926951344 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f120b7fe640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f115c0032d0 con 0x55a9231987f0 2024-09-11T11:03:12.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== watch-notify(notify_complete (2) cookie 94184926951344 notify 154618822682 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a9231b04e0 con 0x55a9231987f0 2024-09-11T11:03:12.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 37 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.761 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:139 8.0 8:00b2d244:root::.bucket.meta.myfoo%3a27698d38-fc40-410e-96d8-191ffc71147c.4235.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a9231987f0 2024-09-11T11:03:12.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 38 ==== osd_op_reply(139 .bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.7 [call,call,delete] v36'4 uv4 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f1336f9b980 10 removing default.rgw.meta+root+.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.7 from cache 2024-09-11T11:03:12.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f1336f9b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:27698d38-fc40-410e-96d8-191ffc71147c.4235.7, ofs0, ns] 2024-09-11T11:03:12.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 94184926932576 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a923193790 2024-09-11T11:03:12.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 45 ==== watch-notify(notify (1) cookie 94184926741264 notify 154618822701 ret 0) ==== 248+0+0 (crc 0 0 0) 0x55a9231b0a70 con 0x55a923193790 2024-09-11T11:03:12.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 46 ==== osd_op_reply(140 notify.4 [notify cookie 94184926932576 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f120bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822701 cookie 94184926741264 notifier 4787 bl.length()=206 2024-09-11T11:03:12.762 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.757+0000 7f120bfff640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f11f8003d70 con 0x55a923193790 2024-09-11T11:03:12.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 47 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 48 ==== watch-notify(notify_complete (2) cookie 94184926932576 notify 154618822701 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f132c0cd030 con 0x55a923193790 2024-09-11T11:03:12.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:142 4.1a 4:5a01ad6e:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a923193790 2024-09-11T11:03:12.763 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:143 4.f 4:f06c1cbd:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e7c60 con 0x55a92318f2e0 2024-09-11T11:03:12.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:144 4.3f 4:fef2ab95:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x7f132c102040 2024-09-11T11:03:12.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:145 4.14 4:2834d649:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d48c0 con 0x55a9231987f0 2024-09-11T11:03:12.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:146 4.5 4:a1c407ca:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a923193790 2024-09-11T11:03:12.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:147 4.0 4:02011889:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231daea0 con 0x7f132c102040 2024-09-11T11:03:12.764 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:148 4.27 4:e41a44d6:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d48c0 con 0x55a92318f2e0 2024-09-11T11:03:12.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:149 4.f 4:f000f52a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a92318f2e0 2024-09-11T11:03:12.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:150 4.1f 4:f8ba618a:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231daea0 con 0x55a923193790 2024-09-11T11:03:12.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:151 4.1d 4:b80299ad:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d48c0 con 0x55a9231987f0 2024-09-11T11:03:12.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:152 4.1d 4:bbb96950:::.dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231e82b0 con 0x55a9231987f0 2024-09-11T11:03:12.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 25 ==== osd_op_reply(144 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.2 [delete] v36'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.761+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 39 ==== osd_op_reply(145 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.3 [delete] v36'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 36 ==== osd_op_reply(148 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.6 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 26 ==== osd_op_reply(147 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.5 [delete] v36'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 49 ==== osd_op_reply(146 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.4 [delete] v36'20 uv20 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 37 ==== osd_op_reply(143 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.1 [delete] v36'5 uv5 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 50 ==== osd_op_reply(142 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.0 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 40 ==== osd_op_reply(151 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.9 [delete] v36'15 uv15 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 38 ==== osd_op_reply(149 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.7 [delete] v36'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 41 ==== osd_op_reply(152 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.10 [delete] v36'16 uv16 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 51 ==== osd_op_reply(150 .dir.27698d38-fc40-410e-96d8-191ffc71147c.4235.7.8 [delete] v36'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1336f9b980 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.7 : miss 2024-09-11T11:03:12.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1336f9b980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:153 6.14 6:2bb26e20:::pubsub..bucket.myfoo%2f27698d38-fc40-410e-96d8-191ffc71147c.4235.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231daea0 con 0x7f132c102040 2024-09-11T11:03:12.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 27 ==== osd_op_reply(153 pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1336f9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1336f9b980 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.7 info.flags=0x0 2024-09-11T11:03:12.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1336f9b980 10 adding default.rgw.log++pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.7 to cache LRU end 2024-09-11T11:03:12.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.765+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:154 6.14 6:2bb26e20:::pubsub..bucket.myfoo%2f27698d38-fc40-410e-96d8-191ffc71147c.4235.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d37b0 con 0x7f132c102040 2024-09-11T11:03:12.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.769+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 28 ==== osd_op_reply(154 pubsub..bucket.myfoo/27698d38-fc40-410e-96d8-191ffc71147c.4235.7 [delete] v36'11 uv10 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.769+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d37b0 con 0x7f132c102040 2024-09-11T11:03:12.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.769+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 29 ==== osd_op_reply(155 foo.buckets [call] v36'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.769+0000 7f1336f9b980 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-11T11:03:12.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.769+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d37b0 con 0x55a92318f2e0 2024-09-11T11:03:12.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 39 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v36'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f1336f9b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-11T11:03:12.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94184926932576 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231cdd90 con 0x7f132c102040 2024-09-11T11:03:12.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 30 ==== watch-notify(notify (1) cookie 94184926740208 notify 154618822685 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55a9231b06b0 con 0x7f132c102040 2024-09-11T11:03:12.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f120b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94184926740208 notifier 4787 bl.length()=170 2024-09-11T11:03:12.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f120b7fe640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f115c0032d0 con 0x7f132c102040 2024-09-11T11:03:12.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 31 ==== osd_op_reply(157 notify.3 [notify cookie 94184926932576 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 32 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 33 ==== watch-notify(notify_complete (2) cookie 94184926932576 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a9231afbd0 con 0x7f132c102040 2024-09-11T11:03:12.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f1336f9b980 10 removing email index: foo@foo.com 2024-09-11T11:03:12.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.773+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d37b0 con 0x55a92318f2e0 2024-09-11T11:03:12.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 40 ==== osd_op_reply(159 foo@foo.com [delete] v36'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f1336f9b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-11T11:03:12.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94184926932576 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231cdd90 con 0x7f132c102040 2024-09-11T11:03:12.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 34 ==== watch-notify(notify (1) cookie 94184926740208 notify 154618822686 ret 0) ==== 204+0+0 (crc 0 0 0) 0x55a9231afbd0 con 0x7f132c102040 2024-09-11T11:03:12.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f120bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822686 cookie 94184926740208 notifier 4787 bl.length()=162 2024-09-11T11:03:12.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 35 ==== osd_op_reply(160 notify.3 [notify cookie 94184926932576 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f120bfff640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f11f8003d70 con 0x7f132c102040 2024-09-11T11:03:12.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 36 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 37 ==== watch-notify(notify_complete (2) cookie 94184926932576 notify 154618822686 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a9231b0310 con 0x7f132c102040 2024-09-11T11:03:12.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f1336f9b980 10 removing user buckets index 2024-09-11T11:03:12.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d37b0 con 0x7f132c102040 2024-09-11T11:03:12.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 38 ==== osd_op_reply(162 foo.buckets [delete] v36'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f1336f9b980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-11T11:03:12.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94184926932576 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231cdd90 con 0x55a9231987f0 2024-09-11T11:03:12.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 42 ==== watch-notify(notify (1) cookie 94184926727680 notify 154618822683 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55a9231b04e0 con 0x55a9231987f0 2024-09-11T11:03:12.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f120b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822683 cookie 94184926727680 notifier 4787 bl.length()=160 2024-09-11T11:03:12.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f120b7fe640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f115c0032d0 con 0x55a9231987f0 2024-09-11T11:03:12.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.777+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 43 ==== osd_op_reply(163 notify.5 [notify cookie 94184926932576 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 44 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 45 ==== watch-notify(notify_complete (2) cookie 94184926932576 notify 154618822683 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a9231afda0 con 0x55a9231987f0 2024-09-11T11:03:12.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f1336f9b980 10 removing user index: foo 2024-09-11T11:03:12.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231d37b0 con 0x55a92318f2e0 2024-09-11T11:03:12.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 41 ==== osd_op_reply(165 foo [call,call,delete] v36'21 uv21 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f1336f9b980 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-11T11:03:12.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f1336f9b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-11T11:03:12.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94184926951344 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55a9231cdd90 con 0x55a923193790 2024-09-11T11:03:12.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 52 ==== watch-notify(notify (1) cookie 94184926741264 notify 154618822702 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f132c0cd030 con 0x55a923193790 2024-09-11T11:03:12.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f120bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822702 cookie 94184926741264 notifier 4787 bl.length()=152 2024-09-11T11:03:12.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 53 ==== osd_op_reply(166 notify.4 [notify cookie 94184926951344 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f120bfff640 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f11f8003d70 con 0x55a923193790 2024-09-11T11:03:12.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.781+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 54 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.785+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 55 ==== watch-notify(notify_complete (2) cookie 94184926951344 notify 154618822702 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55a9231535f0 con 0x55a923193790 2024-09-11T11:03:12.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.785+0000 7f11eb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:12.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.785+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94184926748720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x55a92318f2e0 2024-09-11T11:03:12.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.785+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 42 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94184926748720] v36'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.785+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94184926730240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x55a923193790 2024-09-11T11:03:12.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.789+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 56 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94184926730240] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.789+0000 7f1336f9b980 20 remove_watcher() i=0 2024-09-11T11:03:12.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.789+0000 7f1336f9b980 2 removed watcher, disabling cache 2024-09-11T11:03:12.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.789+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94184926734112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x55a92318f2e0 2024-09-11T11:03:12.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.789+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.1 v2:172.21.15.145:6808/1879781812 43 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94184926734112] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324042040 con 0x55a92318f2e0 2024-09-11T11:03:12.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.789+0000 7f1336f9b980 20 remove_watcher() i=1 2024-09-11T11:03:12.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.789+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94184926736432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x55a923193790 2024-09-11T11:03:12.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.793+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 57 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94184926736432] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.793+0000 7f1336f9b980 20 remove_watcher() i=2 2024-09-11T11:03:12.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.793+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94184926740208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x7f132c102040 2024-09-11T11:03:12.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.793+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 39 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94184926740208] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.793+0000 7f1336f9b980 20 remove_watcher() i=3 2024-09-11T11:03:12.797 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.793+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94184926741264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x55a923193790 2024-09-11T11:03:12.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.797+0000 7f1334aab640 1 -- 172.21.15.145:0/3231789105 <== osd.0 v2:172.21.15.102:6800/3035634142 58 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94184926741264] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f132c0ea070 con 0x55a923193790 2024-09-11T11:03:12.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.797+0000 7f1336f9b980 20 remove_watcher() i=4 2024-09-11T11:03:12.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.797+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94184926727680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x55a9231987f0 2024-09-11T11:03:12.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.797+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 46 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94184926727680] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.797+0000 7f1336f9b980 20 remove_watcher() i=5 2024-09-11T11:03:12.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.797+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94184926742880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x55a9231987f0 2024-09-11T11:03:12.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f13342aa640 1 -- 172.21.15.145:0/3231789105 <== osd.3 v2:172.21.15.145:6800/493661776 47 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94184926742880] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f131c037040 con 0x55a9231987f0 2024-09-11T11:03:12.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 20 remove_watcher() i=6 2024-09-11T11:03:12.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94184926751472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55a9231a9e80 con 0x7f132c102040 2024-09-11T11:03:12.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 <== osd.2 v2:172.21.15.145:6816/446921044 40 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94184926751472] v36'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1324042040 con 0x7f132c102040 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 20 remove_watcher() i=7 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a923193790 msgr2=0x55a923195b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a923193790 0x55a923195b80 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a92318f2e0 msgr2=0x55a9231917a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a92318f2e0 0x55a9231917a0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f132c102040 msgr2=0x7f132c0fb1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f132c102040 0x7f132c0fb1b0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a9231987f0 msgr2=0x55a92319abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55a9231987f0 0x55a92319abe0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1200034650 msgr2=0x7f1200036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1200034650 0x7f1200036b10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f131c00ffd0 tx=0x7f131c010000 comp rx=0 tx=0).stop 2024-09-11T11:03:12.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 msgr2=0x55a9231843d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f13352ac640 1 -- 172.21.15.145:0/3231789105 reap_dead start 2024-09-11T11:03:12.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a9231843d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f132c0a3b20 tx=0x7f132c0d93e0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 shutdown_connections 2024-09-11T11:03:12.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3231789105 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a92317d150 0x55a9231843d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 >> 172.21.15.145:0/3231789105 conn(0x55a923179530 msgr2=0x55a923177600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 shutdown_connections 2024-09-11T11:03:12.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3231789105 wait complete. 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3720044027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f120c034650 msgr2=0x7f120c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3720044027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f120c034650 0x7f120c036b10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55a923157410 tx=0x7f131c006000 comp rx=0 tx=0).stop 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3720044027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a923170bb0 msgr2=0x55a923170fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3720044027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a923170bb0 0x55a923170fd0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f132c0033d0 tx=0x7f132c0aab00 comp rx=0 tx=0).stop 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3720044027 shutdown_connections 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3720044027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f120c034650 0x7f120c036b10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 --2- 172.21.15.145:0/3720044027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a923170bb0 0x55a923170fd0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3720044027 >> 172.21.15.145:0/3720044027 conn(0x55a923165d00 msgr2=0x55a923168780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3720044027 shutdown_connections 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.801+0000 7f1336f9b980 1 -- 172.21.15.145:0/3720044027 wait complete. 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a92315b210 msgr2=0x55a92315d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55a92315b210 0x55a92315d600 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a923061240 msgr2=0x55a923159f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55a923061240 0x55a923159f20 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a923160890 msgr2=0x55a923162c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55a923160890 0x55a923162c80 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f121c0346a0 msgr2=0x7f121c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f121c0346a0 0x7f121c036b60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f131c00b350 tx=0x7f131c001530 comp rx=0 tx=0).stop 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 msgr2=0x55a923152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 --2- 172.21.15.145:0/1991497386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55a9230608f0 0x55a923152e20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f132c018b50 tx=0x7f132c017cc0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f13352ac640 1 -- 172.21.15.145:0/1991497386 reap_dead start 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 shutdown_connections 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 >> 172.21.15.145:0/1991497386 conn(0x55a922fd4240 msgr2=0x55a923146390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 shutdown_connections 2024-09-11T11:03:12.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.805+0000 7f1336f9b980 1 -- 172.21.15.145:0/1991497386 wait complete. 2024-09-11T11:03:12.818 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-11T11:03:12.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-11T11:03:12.819 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-11T11:03:12.896 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:12.897 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:12.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.893+0000 7fdd0d65a980 1 Processor -- start 2024-09-11T11:03:12.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.893+0000 7fdd0d65a980 1 -- start start 2024-09-11T11:03:12.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0d65a980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55653c2e8a50 0x55653c2eae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0d65a980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55653c16cae0 con 0x55653c258b00 2024-09-11T11:03:12.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0d65a980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55653c190e30 con 0x55653c2e8a50 2024-09-11T11:03:12.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a969640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55653c2e8a50 0x55653c2eae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a969640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55653c2e8a50 0x55653c2eae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37272/0 (socket says 172.21.15.145:37272) 2024-09-11T11:03:12.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a969640 1 -- 172.21.15.145:0/4155233815 learned_addr learned my addr 172.21.15.145:0/4155233815 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a969640 1 -- 172.21.15.145:0/4155233815 >> v1:172.21.15.102:6789/0 conn(0x55653c258b00 legacy=0x55653c2e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a969640 1 -- 172.21.15.145:0/4155233815 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c2ec390 con 0x55653c2e8a50 2024-09-11T11:03:12.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a969640 1 --2- 172.21.15.145:0/4155233815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c2e8a50 0x55653c2eae40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400a5c0 tx=0x7fdcf401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1439813945f5747 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a168640 1 -- 172.21.15.145:0/4155233815 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf40a6070 con 0x55653c2e8a50 2024-09-11T11:03:12.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a168640 1 -- 172.21.15.145:0/4155233815 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf40af070 con 0x55653c2e8a50 2024-09-11T11:03:12.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.897+0000 7fdd0a168640 1 -- 172.21.15.145:0/4155233815 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcf40aa5c0 con 0x55653c2e8a50 2024-09-11T11:03:12.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.901+0000 7fdd0d65a980 1 -- 172.21.15.145:0/4155233815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c2e8a50 msgr2=0x55653c2eae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.901+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/4155233815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c2e8a50 0x55653c2eae40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdcf400a5c0 tx=0x7fdcf401b340 comp rx=0 tx=0).stop 2024-09-11T11:03:12.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.901+0000 7fdd0d65a980 1 -- 172.21.15.145:0/4155233815 shutdown_connections 2024-09-11T11:03:12.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.901+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/4155233815 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c2e8a50 0x55653c2eae40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.901+0000 7fdd0d65a980 1 -- 172.21.15.145:0/4155233815 >> 172.21.15.145:0/4155233815 conn(0x55653c2df060 msgr2=0x55653c2e1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.901+0000 7fdd0d65a980 1 -- 172.21.15.145:0/4155233815 shutdown_connections 2024-09-11T11:03:12.903 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.901+0000 7fdd0d65a980 1 -- 172.21.15.145:0/4155233815 wait complete. 2024-09-11T11:03:12.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 Processor -- start 2024-09-11T11:03:12.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- start start 2024-09-11T11:03:12.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55653c192200 con 0x55653c258b00 2024-09-11T11:03:12.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3cfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37282/0 (socket says 172.21.15.145:37282) 2024-09-11T11:03:12.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1194754262 learned_addr learned my addr 172.21.15.145:0/1194754262 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1194754262 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c3d0020 con 0x55653c258b00 2024-09-11T11:03:12.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/1194754262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3cfa50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc001ea0 tx=0x7fdcfc00b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1657468b9e541f64 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdbf960a640 1 -- 172.21.15.145:0/1194754262 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc00a040 con 0x55653c258b00 2024-09-11T11:03:12.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdbf960a640 1 -- 172.21.15.145:0/1194754262 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcfc00f620 con 0x55653c258b00 2024-09-11T11:03:12.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdbf960a640 1 -- 172.21.15.145:0/1194754262 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc00f890 con 0x55653c258b00 2024-09-11T11:03:12.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1194754262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 msgr2=0x55653c3cfa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1194754262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3cfa50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc001ea0 tx=0x7fdcfc00b680 comp rx=0 tx=0).stop 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1194754262 shutdown_connections 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1194754262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3cfa50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1194754262 >> 172.21.15.145:0/1194754262 conn(0x55653c2df060 msgr2=0x55653c3cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1194754262 shutdown_connections 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1194754262 wait complete. 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 Processor -- start 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- start start 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3d6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.917+0000 7fdd0d65a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55653c2ebe30 con 0x55653c258b00 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3d6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3d6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37296/0 (socket says 172.21.15.145:37296) 2024-09-11T11:03:12.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0b16a640 1 -- 172.21.15.145:0/557336336 learned_addr learned my addr 172.21.15.145:0/557336336 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0b16a640 1 -- 172.21.15.145:0/557336336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c3d7360 con 0x55653c258b00 2024-09-11T11:03:12.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3d6e20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc001fd0 tx=0x7fdcfc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdbf7e07640 1 -- 172.21.15.145:0/557336336 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc001520 con 0x55653c258b00 2024-09-11T11:03:12.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55653c3d75f0 con 0x55653c258b00 2024-09-11T11:03:12.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdbf7e07640 1 -- 172.21.15.145:0/557336336 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcfc01ca10 con 0x55653c258b00 2024-09-11T11:03:12.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdbf7e07640 1 -- 172.21.15.145:0/557336336 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc01cd50 con 0x55653c258b00 2024-09-11T11:03:12.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653c3da2d0 con 0x55653c258b00 2024-09-11T11:03:12.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdbf7e07640 1 -- 172.21.15.145:0/557336336 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdcfc017050 con 0x55653c258b00 2024-09-11T11:03:12.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdbf7e07640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbf0034650 0x7fdbf0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdbf7e07640 1 -- 172.21.15.145:0/557336336 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fdcfc015020 con 0x55653c258b00 2024-09-11T11:03:12.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0a969640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbf0034650 0x7fdbf0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c2e8a50 0x55653c3ddf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c3de460 con 0x55653c2e8a50 2024-09-11T11:03:12.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0b96b640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c2e8a50 0x55653c3ddf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0a969640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbf0034650 0x7fdbf0036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40ae000 tx=0x7fdcf40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0b96b640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c2e8a50 0x55653c3ddf20 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.921+0000 7fdd0b96b640 1 -- 172.21.15.145:0/557336336 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c2e8a50 2024-09-11T11:03:12.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c3df230 0x55653c3e1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c3e1c60 con 0x55653c3df230 2024-09-11T11:03:12.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c3df230 0x55653c3e1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c3df230 0x55653c3e1620 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0b16a640 1 -- 172.21.15.145:0/557336336 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcfc02e070 con 0x55653c3df230 2024-09-11T11:03:12.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c3e3510 con 0x55653c3df230 2024-09-11T11:03:12.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0b16a640 1 -- 172.21.15.145:0/557336336 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdcfc02e070 con 0x55653c3df230 2024-09-11T11:03:12.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c3e2740 con 0x55653c3df230 2024-09-11T11:03:12.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0b16a640 1 -- 172.21.15.145:0/557336336 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcfc02e070 con 0x55653c3df230 2024-09-11T11:03:12.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55653c3e48c0 0x55653c3e6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c3e71f0 con 0x55653c3e48c0 2024-09-11T11:03:12.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0a969640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55653c3e48c0 0x55653c3e6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0a969640 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55653c3e48c0 0x55653c3e6cb0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.925+0000 7fdd0a969640 1 -- 172.21.15.145:0/557336336 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c3e48c0 2024-09-11T11:03:12.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0d65a980 1 Processor -- start 2024-09-11T11:03:12.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0d65a980 1 -- start start 2024-09-11T11:03:12.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0d65a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c3f4c80 0x55653c3f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0d65a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55653c1eb800 con 0x55653c3f4c80 2024-09-11T11:03:12.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c3f4c80 0x55653c3f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c3f4c80 0x55653c3f50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37304/0 (socket says 172.21.15.145:37304) 2024-09-11T11:03:12.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0b16a640 1 -- 172.21.15.145:0/2008796280 learned_addr learned my addr 172.21.15.145:0/2008796280 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0b16a640 1 -- 172.21.15.145:0/2008796280 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c3f55e0 con 0x55653c3f4c80 2024-09-11T11:03:12.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/2008796280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c3f4c80 0x55653c3f50a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0188c0 tx=0x7fdcfc018d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdbf5602640 1 -- 172.21.15.145:0/2008796280 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc01a480 con 0x55653c3f4c80 2024-09-11T11:03:12.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdbf5602640 1 -- 172.21.15.145:0/2008796280 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcfc01a620 con 0x55653c3f4c80 2024-09-11T11:03:12.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0d65a980 1 -- 172.21.15.145:0/2008796280 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55653c3f5870 con 0x55653c3f4c80 2024-09-11T11:03:12.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdbf5602640 1 -- 172.21.15.145:0/2008796280 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc01a900 con 0x55653c3f4c80 2024-09-11T11:03:12.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0d65a980 1 -- 172.21.15.145:0/2008796280 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653c3f84f0 con 0x55653c3f4c80 2024-09-11T11:03:12.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdbf5602640 1 -- 172.21.15.145:0/2008796280 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdcfc013130 con 0x55653c3f4c80 2024-09-11T11:03:12.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdbf5602640 1 --2- 172.21.15.145:0/2008796280 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbe40346f0 0x7fdbe4036bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdbf5602640 1 -- 172.21.15.145:0/2008796280 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fdcfc038070 con 0x55653c3f4c80 2024-09-11T11:03:12.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0a969640 1 --2- 172.21.15.145:0/2008796280 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbe40346f0 0x7fdbe4036bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.929+0000 7fdd0d65a980 1 Processor -- start 2024-09-11T11:03:12.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- start start 2024-09-11T11:03:12.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0a969640 1 --2- 172.21.15.145:0/2008796280 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbe40346f0 0x7fdbe4036bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4000c10 tx=0x7fdcf4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c401940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55653c3d03a0 con 0x55653c401560 2024-09-11T11:03:12.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c401940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c401940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37308/0 (socket says 172.21.15.145:37308) 2024-09-11T11:03:12.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 -- 172.21.15.145:0/3495961220 learned_addr learned my addr 172.21.15.145:0/3495961220 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 -- 172.21.15.145:0/3495961220 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c401f10 con 0x55653c401560 2024-09-11T11:03:12.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/3495961220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c401940 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc050030 tx=0x7fdcfc032460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163bc5d00380f695 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdbeeffd640 1 -- 172.21.15.145:0/3495961220 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc05c070 con 0x55653c401560 2024-09-11T11:03:12.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdbeeffd640 1 -- 172.21.15.145:0/3495961220 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcfc032820 con 0x55653c401560 2024-09-11T11:03:12.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdbeeffd640 1 -- 172.21.15.145:0/3495961220 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc0420a0 con 0x55653c401560 2024-09-11T11:03:12.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- 172.21.15.145:0/3495961220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 msgr2=0x55653c401940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/3495961220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c401940 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc050030 tx=0x7fdcfc032460 comp rx=0 tx=0).stop 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- 172.21.15.145:0/3495961220 shutdown_connections 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/3495961220 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c401940 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- 172.21.15.145:0/3495961220 >> 172.21.15.145:0/3495961220 conn(0x55653c3fd940 msgr2=0x55653c3fba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- 172.21.15.145:0/3495961220 shutdown_connections 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- 172.21.15.145:0/3495961220 wait complete. 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 Processor -- start 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- start start 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c408780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0d65a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55653c4023b0 con 0x55653c401560 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c408780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c408780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37324/0 (socket says 172.21.15.145:37324) 2024-09-11T11:03:12.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 learned_addr learned my addr 172.21.15.145:0/1075313221 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:12.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.933+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55653c408cc0 con 0x55653c401560 2024-09-11T11:03:12.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c408780 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc04efb0 tx=0x7fdcfc017f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdbed7fa640 1 -- 172.21.15.145:0/1075313221 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc05c050 con 0x55653c401560 2024-09-11T11:03:12.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdbed7fa640 1 -- 172.21.15.145:0/1075313221 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcfc041bd0 con 0x55653c401560 2024-09-11T11:03:12.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55653c408cc0 con 0x55653c401560 2024-09-11T11:03:12.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdbed7fa640 1 -- 172.21.15.145:0/1075313221 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdcfc04e480 con 0x55653c401560 2024-09-11T11:03:12.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55653c408cc0 con 0x55653c401560 2024-09-11T11:03:12.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdbed7fa640 1 -- 172.21.15.145:0/1075313221 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdcfc05f070 con 0x55653c401560 2024-09-11T11:03:12.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdbed7fa640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbd4034650 0x7fdbd4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdbed7fa640 1 -- 172.21.15.145:0/1075313221 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fdcfc069070 con 0x55653c401560 2024-09-11T11:03:12.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0a969640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbd4034650 0x7fdbd4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c4137a0 0x55653c415c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c4163b0 con 0x55653c4137a0 2024-09-11T11:03:12.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0b96b640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c4137a0 0x55653c415c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0a969640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbd4034650 0x7fdbd4036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40aa910 tx=0x7fdcf40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0b96b640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c4137a0 0x55653c415c60 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 20 realm 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c412c50 con 0x55653c4137a0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c416e80 con 0x55653c4137a0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c417a60 0x55653c419f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.937+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c41a690 con 0x55653c417a60 2024-09-11T11:03:12.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c417a60 0x55653c419f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c417a60 0x55653c419f20 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdcfc061d70 con 0x55653c417a60 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0d65a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdcfc061d70 con 0x55653c417a60 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0d65a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0d65a980 20 searching for the correct realm 2024-09-11T11:03:12.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55653c41cca0 0x55653c41f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41f710 con 0x55653c41cca0 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0a969640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55653c41cca0 0x55653c41f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0a969640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55653c41cca0 0x55653c41f090 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41f710 con 0x55653c417a60 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdcfc061d70 con 0x55653c417a60 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0b16a640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fdcfc013420 0x7fdcfc035870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.941+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x7fdcfc013420 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fdcfc013420 0x7fdcfc035870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:12.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fdcfc013420 0x7fdcfc035870 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:12.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c41cca0 2024-09-11T11:03:12.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc061d70 con 0x55653c417a60 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc061d70 con 0x55653c417a60 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x7fdcfc013420 2024-09-11T11:03:12.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.945+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x7fdcfc013420 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c41cca0 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c41cca0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c41cca0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.949+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x7fdcfc013420 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c4137a0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x7fdcfc013420 2024-09-11T11:03:12.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c41cca0 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x7fdcfc013420 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c41cca0 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.953+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55653c41af30 con 0x55653c417a60 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c41b780 con 0x55653c4137a0 2024-09-11T11:03:12.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c41bb70 con 0x55653c417a60 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c41bb70 con 0x7fdcfc013420 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 zone default found 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 4 Realm: () 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:12.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:12.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:12.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 zonegroup default 2024-09-11T11:03:12.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c41fbc0 con 0x7fdcfc013420 2024-09-11T11:03:12.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c421940 con 0x55653c41cca0 2024-09-11T11:03:12.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c421ce0 con 0x55653c41cca0 2024-09-11T11:03:12.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 started sync module instance, tier type = 2024-09-11T11:03:12.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:12.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.957+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c420de0 con 0x55653c417a60 2024-09-11T11:03:12.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.961+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.961+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93893291021104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c420de0 con 0x55653c417a60 2024-09-11T11:03:12.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.961+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c422570 con 0x55653c4137a0 2024-09-11T11:03:12.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.961+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.961+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93893291024512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c4224a0 con 0x55653c4137a0 2024-09-11T11:03:12.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.961+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c4234c0 con 0x55653c417a60 2024-09-11T11:03:12.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.961+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93893291021104] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.961+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93893291024512] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93893291026832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c423480 con 0x55653c417a60 2024-09-11T11:03:12.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c423d60 con 0x7fdcfc013420 2024-09-11T11:03:12.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93893291030704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c423480 con 0x7fdcfc013420 2024-09-11T11:03:12.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c424810 con 0x55653c417a60 2024-09-11T11:03:12.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93893291026832] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93893291030704] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93893291031760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c424810 con 0x55653c417a60 2024-09-11T11:03:12.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.965+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c424c00 con 0x55653c41cca0 2024-09-11T11:03:12.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.969+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.969+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93893291028400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c425450 con 0x55653c41cca0 2024-09-11T11:03:12.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.969+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c425e50 con 0x55653c41cca0 2024-09-11T11:03:12.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.969+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93893291031760] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.969+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93893291028400] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.969+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.969+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93893291033376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c426240 con 0x55653c41cca0 2024-09-11T11:03:12.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.969+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c426a90 con 0x7fdcfc013420 2024-09-11T11:03:12.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93893291041824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c426e30 con 0x7fdcfc013420 2024-09-11T11:03:12.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 20 add_watcher() i=0 2024-09-11T11:03:12.974 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 20 add_watcher() i=1 2024-09-11T11:03:12.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 20 add_watcher() i=2 2024-09-11T11:03:12.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 20 add_watcher() i=3 2024-09-11T11:03:12.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 20 add_watcher() i=4 2024-09-11T11:03:12.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 20 add_watcher() i=5 2024-09-11T11:03:12.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93893291033376] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.975 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 20 add_watcher() i=6 2024-09-11T11:03:12.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93893291041824] v36'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 20 add_watcher() i=7 2024-09-11T11:03:12.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:12.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c425960 con 0x55653c4137a0 2024-09-11T11:03:12.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93893291039072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c4273a0 con 0x55653c4137a0 2024-09-11T11:03:12.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.973+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93893291039072] v36'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdbc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 5 note: GC not initialized 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdbc0fe1640 20 reqs_thread_entry: start 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 20 Filter name: none 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdb3a7fc640 20 reqs_thread_entry: start 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:12.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55653c44d020 con 0x55653c4137a0 2024-09-11T11:03:12.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:12.980 INFO:teuthology.orchestra.run.smithi145.stderr:could not fetch user info: no user info saved 2024-09-11T11:03:12.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdbc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:12.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.977+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93893291039072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x55653c4137a0 2024-09-11T11:03:12.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.981+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93893291039072] v36'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.981+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93893291021104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x55653c417a60 2024-09-11T11:03:12.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.981+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93893291021104] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.981+0000 7fdd0d65a980 20 remove_watcher() i=0 2024-09-11T11:03:12.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.981+0000 7fdd0d65a980 2 removed watcher, disabling cache 2024-09-11T11:03:12.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.981+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93893291024512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x55653c4137a0 2024-09-11T11:03:12.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93893291024512] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x55653c4137a0 2024-09-11T11:03:12.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0d65a980 20 remove_watcher() i=1 2024-09-11T11:03:12.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93893291026832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x55653c417a60 2024-09-11T11:03:12.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93893291026832] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0d65a980 20 remove_watcher() i=2 2024-09-11T11:03:12.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93893291030704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x7fdcfc013420 2024-09-11T11:03:12.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93893291030704] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0d65a980 20 remove_watcher() i=3 2024-09-11T11:03:12.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.985+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93893291031760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x55653c417a60 2024-09-11T11:03:12.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.989+0000 7fdd0b16a640 1 -- 172.21.15.145:0/1075313221 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93893291031760] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcfc088040 con 0x55653c417a60 2024-09-11T11:03:12.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.989+0000 7fdd0d65a980 20 remove_watcher() i=4 2024-09-11T11:03:12.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.989+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93893291028400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x55653c41cca0 2024-09-11T11:03:12.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.989+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93893291028400] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.989+0000 7fdd0d65a980 20 remove_watcher() i=5 2024-09-11T11:03:12.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.989+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93893291033376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x55653c41cca0 2024-09-11T11:03:12.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0a969640 1 -- 172.21.15.145:0/1075313221 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93893291033376] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdcf40aaae0 con 0x55653c41cca0 2024-09-11T11:03:12.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 20 remove_watcher() i=6 2024-09-11T11:03:12.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93893291041824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55653c44cfe0 con 0x7fdcfc013420 2024-09-11T11:03:12.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93893291041824] v36'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdd0400a4d0 con 0x7fdcfc013420 2024-09-11T11:03:12.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 20 remove_watcher() i=7 2024-09-11T11:03:12.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c417a60 msgr2=0x55653c419f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c417a60 0x55653c419f20 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c4137a0 msgr2=0x55653c415c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c4137a0 0x55653c415c60 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fdcfc013420 msgr2=0x7fdcfc035870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fdcfc013420 0x7fdcfc035870 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55653c41cca0 msgr2=0x55653c41f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55653c41cca0 0x55653c41f090 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbd4034650 msgr2=0x7fdbd4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbd4034650 0x7fdbd4036b10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40aa910 tx=0x7fdcf40c1040 comp rx=0 tx=0).stop 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0b96b640 1 -- 172.21.15.145:0/1075313221 reap_dead start 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 msgr2=0x55653c408780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:12.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c408780 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc04efb0 tx=0x7fdcfc017f70 comp rx=0 tx=0).stop 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 shutdown_connections 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/1075313221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c401560 0x55653c408780 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 >> 172.21.15.145:0/1075313221 conn(0x55653c3fd940 msgr2=0x55653c3fba10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 shutdown_connections 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/1075313221 wait complete. 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/2008796280 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbe40346f0 msgr2=0x7fdbe4036bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/2008796280 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbe40346f0 0x7fdbe4036bb0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4000c10 tx=0x7fdcf4005ad0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/2008796280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c3f4c80 msgr2=0x55653c3f50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/2008796280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c3f4c80 0x55653c3f50a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0188c0 tx=0x7fdcfc018d50 comp rx=0 tx=0).stop 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/2008796280 shutdown_connections 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/2008796280 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbe40346f0 0x7fdbe4036bb0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/2008796280 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c3f4c80 0x55653c3f50a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/2008796280 >> 172.21.15.145:0/2008796280 conn(0x55653c3e9dd0 msgr2=0x55653c3ec850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/2008796280 shutdown_connections 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/2008796280 wait complete. 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c3df230 msgr2=0x55653c3e1620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55653c3df230 0x55653c3e1620 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c2e8a50 msgr2=0x55653c3ddf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55653c2e8a50 0x55653c3ddf20 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55653c3e48c0 msgr2=0x55653c3e6cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55653c3e48c0 0x55653c3e6cb0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbf0034650 msgr2=0x7fdbf0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdbf0034650 0x7fdbf0036b10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40ae000 tx=0x7fdcf40a6000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 msgr2=0x55653c3d6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 --2- 172.21.15.145:0/557336336 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55653c258b00 0x55653c3d6e20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc001fd0 tx=0x7fdcfc000bd0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0b96b640 1 -- 172.21.15.145:0/557336336 reap_dead start 2024-09-11T11:03:13.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 shutdown_connections 2024-09-11T11:03:13.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.993+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 >> 172.21.15.145:0/557336336 conn(0x55653c2df060 msgr2=0x55653c3ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.997+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 shutdown_connections 2024-09-11T11:03:13.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:12.997+0000 7fdd0d65a980 1 -- 172.21.15.145:0/557336336 wait complete. 2024-09-11T11:03:13.008 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T11:03:13.009 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-11T11:03:13.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-11T11:03:13.009 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-11T11:03:13.084 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:13.084 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:13.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.081+0000 7f566a522980 1 Processor -- start 2024-09-11T11:03:13.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.081+0000 7f566a522980 1 -- start start 2024-09-11T11:03:13.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.081+0000 7f566a522980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55df6388eee0 0x55df638912d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.081+0000 7f566a522980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df63710ae0 con 0x55df637fd3e0 2024-09-11T11:03:13.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.081+0000 7f566a522980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55df63734e30 con 0x55df6388eee0 2024-09-11T11:03:13.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.081+0000 7f5668032640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55df637fd3e0 0x55df6388d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52054/0 (socket says 172.21.15.145:52054) 2024-09-11T11:03:13.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.081+0000 7f5668032640 1 -- 172.21.15.145:0/1575509690 learned_addr learned my addr 172.21.15.145:0/1575509690 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:03:13.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.081+0000 7f5667831640 1 --2- 172.21.15.145:0/1575509690 >> v2:172.21.15.102:3300/0 conn(0x55df6388eee0 0x55df638912d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f5667030640 1 -- 172.21.15.145:0/1575509690 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559835673 0 0) 0x55df63710ae0 con 0x55df637fd3e0 2024-09-11T11:03:13.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f5667030640 1 -- 172.21.15.145:0/1575509690 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5650001e20 con 0x55df637fd3e0 2024-09-11T11:03:13.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f5667831640 1 -- 172.21.15.145:0/1575509690 >> v1:172.21.15.102:6789/0 conn(0x55df637fd3e0 legacy=0x55df6388d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f5667831640 1 -- 172.21.15.145:0/1575509690 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df637fd7c0 con 0x55df6388eee0 2024-09-11T11:03:13.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f5667831640 1 --2- 172.21.15.145:0/1575509690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df6388eee0 0x55df638912d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f565c00a420 tx=0x7f565c01afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0b051814cd7d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f5667030640 1 -- 172.21.15.145:0/1575509690 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c0af070 con 0x55df6388eee0 2024-09-11T11:03:13.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f5667030640 1 -- 172.21.15.145:0/1575509690 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c0aa530 con 0x55df6388eee0 2024-09-11T11:03:13.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f5667030640 1 -- 172.21.15.145:0/1575509690 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565c0aa850 con 0x55df6388eee0 2024-09-11T11:03:13.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f566a522980 1 -- 172.21.15.145:0/1575509690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df6388eee0 msgr2=0x55df638912d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f566a522980 1 --2- 172.21.15.145:0/1575509690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df6388eee0 0x55df638912d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f565c00a420 tx=0x7f565c01afd0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f566a522980 1 -- 172.21.15.145:0/1575509690 shutdown_connections 2024-09-11T11:03:13.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f566a522980 1 --2- 172.21.15.145:0/1575509690 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df6388eee0 0x55df638912d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f566a522980 1 -- 172.21.15.145:0/1575509690 >> 172.21.15.145:0/1575509690 conn(0x55df638830b0 msgr2=0x55df638854d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f566a522980 1 -- 172.21.15.145:0/1575509690 shutdown_connections 2024-09-11T11:03:13.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.085+0000 7f566a522980 1 -- 172.21.15.145:0/1575509690 wait complete. 2024-09-11T11:03:13.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 Processor -- start 2024-09-11T11:03:13.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- start start 2024-09-11T11:03:13.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df63975ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55df63736200 con 0x55df637fd3e0 2024-09-11T11:03:13.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f5668032640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df63975ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f5668032640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df63975ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37344/0 (socket says 172.21.15.145:37344) 2024-09-11T11:03:13.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f5668032640 1 -- 172.21.15.145:0/3483623024 learned_addr learned my addr 172.21.15.145:0/3483623024 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f5668032640 1 -- 172.21.15.145:0/3483623024 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df639760b0 con 0x55df637fd3e0 2024-09-11T11:03:13.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f5668032640 1 --2- 172.21.15.145:0/3483623024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df63975ae0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5658001dc0 tx=0x7f565800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329ccbfcddb72c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f555660c640 1 -- 172.21.15.145:0/3483623024 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5658012020 con 0x55df637fd3e0 2024-09-11T11:03:13.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f555660c640 1 -- 172.21.15.145:0/3483623024 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565800e7c0 con 0x55df637fd3e0 2024-09-11T11:03:13.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f555660c640 1 -- 172.21.15.145:0/3483623024 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565800eb40 con 0x55df637fd3e0 2024-09-11T11:03:13.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- 172.21.15.145:0/3483623024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 msgr2=0x55df63975ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 --2- 172.21.15.145:0/3483623024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df63975ae0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f5658001dc0 tx=0x7f565800b6d0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- 172.21.15.145:0/3483623024 shutdown_connections 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 --2- 172.21.15.145:0/3483623024 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df63975ae0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- 172.21.15.145:0/3483623024 >> 172.21.15.145:0/3483623024 conn(0x55df638830b0 msgr2=0x55df63971710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- 172.21.15.145:0/3483623024 shutdown_connections 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- 172.21.15.145:0/3483623024 wait complete. 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 Processor -- start 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- start start 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df6397ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f566a522980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55df63894240 con 0x55df637fd3e0 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f5668032640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df6397ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.105+0000 7f5668032640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df6397ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37358/0 (socket says 172.21.15.145:37358) 2024-09-11T11:03:13.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668032640 1 -- 172.21.15.145:0/785701590 learned_addr learned my addr 172.21.15.145:0/785701590 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668032640 1 -- 172.21.15.145:0/785701590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6397d3d0 con 0x55df637fd3e0 2024-09-11T11:03:13.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668032640 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df6397ce90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55df63976cc0 tx=0x7f5658000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5554e09640 1 -- 172.21.15.145:0/785701590 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5658012030 con 0x55df637fd3e0 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5554e09640 1 -- 172.21.15.145:0/785701590 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5658001440 con 0x55df637fd3e0 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df6397d660 con 0x55df637fd3e0 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5554e09640 1 -- 172.21.15.145:0/785701590 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f565801aaf0 con 0x55df637fd3e0 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df63980340 con 0x55df637fd3e0 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f566a522980 1 Processor -- start 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f566a522980 1 -- start start 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f566a522980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df6398a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f566a522980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55df6378f800 con 0x55df63989c50 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5554e09640 1 -- 172.21.15.145:0/785701590 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5658015020 con 0x55df637fd3e0 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668833640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df6398a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5554e09640 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5550034650 0x7f5550036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668833640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df6398a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37360/0 (socket says 172.21.15.145:37360) 2024-09-11T11:03:13.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668833640 1 -- 172.21.15.145:0/2151524365 learned_addr learned my addr 172.21.15.145:0/2151524365 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5554e09640 1 -- 172.21.15.145:0/785701590 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f5658020030 con 0x55df637fd3e0 2024-09-11T11:03:13.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668032640 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5550034650 0x7f5550036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668833640 1 -- 172.21.15.145:0/2151524365 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6398a590 con 0x55df63989c50 2024-09-11T11:03:13.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668032640 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5550034650 0x7f5550036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f565800c8f0 tx=0x7f5658015f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f5668833640 1 --2- 172.21.15.145:0/2151524365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df6398a050 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f566000a440 tx=0x7f566000a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eceaa24c8cfd79a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f554e7fc640 1 -- 172.21.15.145:0/2151524365 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660008850 con 0x55df63989c50 2024-09-11T11:03:13.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f554e7fc640 1 -- 172.21.15.145:0/2151524365 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5660008a10 con 0x55df63989c50 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.109+0000 7f554e7fc640 1 -- 172.21.15.145:0/2151524365 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660008d30 con 0x55df63989c50 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- 172.21.15.145:0/2151524365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 msgr2=0x55df6398a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 --2- 172.21.15.145:0/2151524365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df6398a050 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f566000a440 tx=0x7f566000a900 comp rx=0 tx=0).stop 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- 172.21.15.145:0/2151524365 shutdown_connections 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 --2- 172.21.15.145:0/2151524365 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df6398a050 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- 172.21.15.145:0/2151524365 >> 172.21.15.145:0/2151524365 conn(0x55df6388eee0 msgr2=0x55df63985560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- 172.21.15.145:0/2151524365 shutdown_connections 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- 172.21.15.145:0/2151524365 wait complete. 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 Processor -- start 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- start start 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df63990fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55df6398af70 con 0x55df63989c50 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f5668833640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df63990fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f5668833640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df63990fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37372/0 (socket says 172.21.15.145:37372) 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f5668833640 1 -- 172.21.15.145:0/1630956506 learned_addr learned my addr 172.21.15.145:0/1630956506 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f5668833640 1 -- 172.21.15.145:0/1630956506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df639914f0 con 0x55df63989c50 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f5668833640 1 --2- 172.21.15.145:0/1630956506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df63990fb0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x55df6398aa00 tx=0x7f5660003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f554cff9640 1 -- 172.21.15.145:0/1630956506 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660013a70 con 0x55df63989c50 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- 172.21.15.145:0/1630956506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df63991780 con 0x55df63989c50 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f554cff9640 1 -- 172.21.15.145:0/1630956506 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5660023070 con 0x55df63989c50 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f554cff9640 1 -- 172.21.15.145:0/1630956506 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5660013d40 con 0x55df63989c50 2024-09-11T11:03:13.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 1 -- 172.21.15.145:0/1630956506 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df63994460 con 0x55df63989c50 2024-09-11T11:03:13.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f554cff9640 1 -- 172.21.15.145:0/1630956506 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5660028460 con 0x55df63989c50 2024-09-11T11:03:13.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f566a522980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f554cff9640 1 --2- 172.21.15.145:0/1630956506 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5540034650 0x7f5540036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.113+0000 7f554cff9640 1 -- 172.21.15.145:0/1630956506 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f5660049f40 con 0x55df63989c50 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f566a522980 1 Processor -- start 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5668833640 1 --2- 172.21.15.145:0/1630956506 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5540034650 0x7f5540036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f566a522980 1 -- start start 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f566a522980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df639aa830 0x55df639aac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f566a522980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55df63976430 con 0x55df639aa830 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5668833640 1 --2- 172.21.15.145:0/1630956506 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5540034650 0x7f5540036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5660013fd0 tx=0x7f5660013f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5668032640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df639aa830 0x55df639aac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5668032640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df639aa830 0x55df639aac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37380/0 (socket says 172.21.15.145:37380) 2024-09-11T11:03:13.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5668032640 1 -- 172.21.15.145:0/3583256241 learned_addr learned my addr 172.21.15.145:0/3583256241 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5668032640 1 -- 172.21.15.145:0/3583256241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df639ab220 con 0x55df639aa830 2024-09-11T11:03:13.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5668032640 1 --2- 172.21.15.145:0/3583256241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df639aa830 0x55df639aac50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f565802efd0 tx=0x7f56580484c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f552cfe1640 1 -- 172.21.15.145:0/3583256241 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5658048070 con 0x55df639aa830 2024-09-11T11:03:13.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f566a522980 1 -- 172.21.15.145:0/3583256241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df639adea0 con 0x55df639aa830 2024-09-11T11:03:13.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f552cfe1640 1 -- 172.21.15.145:0/3583256241 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565800ddd0 con 0x55df639aa830 2024-09-11T11:03:13.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f552cfe1640 1 -- 172.21.15.145:0/3583256241 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5658009360 con 0x55df639aa830 2024-09-11T11:03:13.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f566a522980 1 -- 172.21.15.145:0/3583256241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df639ae250 con 0x55df639aa830 2024-09-11T11:03:13.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f552cfe1640 1 -- 172.21.15.145:0/3583256241 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5658009070 con 0x55df639aa830 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f552cfe1640 1 --2- 172.21.15.145:0/3583256241 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54a8034650 0x7f54a8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f552cfe1640 1 -- 172.21.15.145:0/3583256241 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f5658035040 con 0x55df639aa830 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5667831640 1 --2- 172.21.15.145:0/3583256241 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54a8034650 0x7f54a8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f54b67fc640 20 reqs_thread_entry: start 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f566a522980 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55df639b0410 0x55df639b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55df639b2f30 con 0x55df639b0410 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.117+0000 7f5667831640 1 --2- 172.21.15.145:0/3583256241 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54a8034650 0x7f54a8036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f565c0ac000 tx=0x7f565c0a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f5668833640 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55df639b0410 0x55df639b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f5668833640 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55df639b0410 0x55df639b2860 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f5668833640 1 -- 172.21.15.145:0/785701590 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f566001e7a0 con 0x55df639b0410 2024-09-11T11:03:13.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55df639b47f0 con 0x55df639b0410 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f5668833640 1 -- 172.21.15.145:0/785701590 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(2 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f566001e7a0 con 0x55df639b0410 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/1630956506 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5540034650 msgr2=0x7f5540036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 --2- 172.21.15.145:0/1630956506 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5540034650 0x7f5540036b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5660013fd0 tx=0x7f5660013f60 comp rx=0 tx=0).stop 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/1630956506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 msgr2=0x55df63990fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 --2- 172.21.15.145:0/1630956506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df63990fb0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x55df6398aa00 tx=0x7f5660003000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/1630956506 shutdown_connections 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 --2- 172.21.15.145:0/1630956506 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5540034650 0x7f5540036b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 --2- 172.21.15.145:0/1630956506 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df63989c50 0x55df63990fb0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/1630956506 >> 172.21.15.145:0/1630956506 conn(0x55df6388eee0 msgr2=0x55df639850d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/1630956506 shutdown_connections 2024-09-11T11:03:13.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/1630956506 wait complete. 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/3583256241 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54a8034650 msgr2=0x7f54a8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 --2- 172.21.15.145:0/3583256241 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54a8034650 0x7f54a8036b10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f565c0ac000 tx=0x7f565c0a5000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/3583256241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df639aa830 msgr2=0x55df639aac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 --2- 172.21.15.145:0/3583256241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df639aa830 0x55df639aac50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f565802efd0 tx=0x7f56580484c0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/3583256241 shutdown_connections 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 --2- 172.21.15.145:0/3583256241 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f54a8034650 0x7f54a8036b10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 --2- 172.21.15.145:0/3583256241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df639aa830 0x55df639aac50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/3583256241 >> 172.21.15.145:0/3583256241 conn(0x55df6399f8a0 msgr2=0x55df639a2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.121+0000 7f566a522980 1 -- 172.21.15.145:0/3583256241 shutdown_connections 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 -- 172.21.15.145:0/3583256241 wait complete. 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55df639b0410 msgr2=0x55df639b2860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55df639b0410 0x55df639b2860 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5550034650 msgr2=0x7f5550036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5550034650 0x7f5550036b10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f565800c8f0 tx=0x7f5658015f20 comp rx=0 tx=0).stop 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 msgr2=0x55df6397ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df6397ce90 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x55df63976cc0 tx=0x7f5658000bd0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 shutdown_connections 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55df639b0410 0x55df639b2860 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5550034650 0x7f5550036b10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 --2- 172.21.15.145:0/785701590 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55df637fd3e0 0x55df6397ce90 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 >> 172.21.15.145:0/785701590 conn(0x55df638830b0 msgr2=0x55df63970290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 shutdown_connections 2024-09-11T11:03:13.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.125+0000 7f566a522980 1 -- 172.21.15.145:0/785701590 wait complete. 2024-09-11T11:03:13.136 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"27698d38-fc40-410e-96d8-191ffc71147c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-11T11:03:13.137 DEBUG:tasks.util.rgw: json result: {'id': '27698d38-fc40-410e-96d8-191ffc71147c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-11T11:03:13.137 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-11T11:03:13.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-11T11:03:13.137 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-11T11:03:13.212 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:13.212 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:13.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.209+0000 7f5489f6e980 1 Processor -- start 2024-09-11T11:03:13.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.209+0000 7f5489f6e980 1 -- start start 2024-09-11T11:03:13.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.209+0000 7f5489f6e980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ebf8867560 0x55ebf8867940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.209+0000 7f5489f6e980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ebf86f0ae0 con 0x55ebf8867eb0 2024-09-11T11:03:13.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.209+0000 7f5489f6e980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55ebf8714e30 con 0x55ebf8867560 2024-09-11T11:03:13.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5487a7e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ebf8867560 0x55ebf8867940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.214 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5487a7e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ebf8867560 0x55ebf8867940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37388/0 (socket says 172.21.15.145:37388) 2024-09-11T11:03:13.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5487a7e640 1 -- 172.21.15.145:0/3253303127 learned_addr learned my addr 172.21.15.145:0/3253303127 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5487a7e640 1 -- 172.21.15.145:0/3253303127 >> v1:172.21.15.102:6789/0 conn(0x55ebf8867eb0 legacy=0x55ebf886c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.215 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5487a7e640 1 -- 172.21.15.145:0/3253303127 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf886f130 con 0x55ebf8867560 2024-09-11T11:03:13.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5487a7e640 1 --2- 172.21.15.145:0/3253303127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf8867940 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f548000a4e0 tx=0x7f548001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d6406548e2f547 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5486a7c640 1 -- 172.21.15.145:0/3253303127 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800aa540 con 0x55ebf8867560 2024-09-11T11:03:13.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5486a7c640 1 -- 172.21.15.145:0/3253303127 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54800aa6e0 con 0x55ebf8867560 2024-09-11T11:03:13.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5486a7c640 1 -- 172.21.15.145:0/3253303127 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800aaa40 con 0x55ebf8867560 2024-09-11T11:03:13.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5489f6e980 1 -- 172.21.15.145:0/3253303127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 msgr2=0x55ebf8867940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3253303127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf8867940 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f548000a4e0 tx=0x7f548001b090 comp rx=0 tx=0).stop 2024-09-11T11:03:13.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5489f6e980 1 -- 172.21.15.145:0/3253303127 shutdown_connections 2024-09-11T11:03:13.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.213+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3253303127 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf8867940 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.217+0000 7f5489f6e980 1 -- 172.21.15.145:0/3253303127 >> 172.21.15.145:0/3253303127 conn(0x55ebf8863080 msgr2=0x55ebf88654a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.217+0000 7f5489f6e980 1 -- 172.21.15.145:0/3253303127 shutdown_connections 2024-09-11T11:03:13.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.217+0000 7f5489f6e980 1 -- 172.21.15.145:0/3253303127 wait complete. 2024-09-11T11:03:13.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 Processor -- start 2024-09-11T11:03:13.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- start start 2024-09-11T11:03:13.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf87dcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ebf8716200 con 0x55ebf8867560 2024-09-11T11:03:13.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5487a7e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf87dcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5487a7e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf87dcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37398/0 (socket says 172.21.15.145:37398) 2024-09-11T11:03:13.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5487a7e640 1 -- 172.21.15.145:0/923636000 learned_addr learned my addr 172.21.15.145:0/923636000 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5487a7e640 1 -- 172.21.15.145:0/923636000 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf87dd1c0 con 0x55ebf8867560 2024-09-11T11:03:13.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5487a7e640 1 --2- 172.21.15.145:0/923636000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf87dcbf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5480017ca0 tx=0x7f54800033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acae02c275b9120a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5375e0b640 1 -- 172.21.15.145:0/923636000 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800b9070 con 0x55ebf8867560 2024-09-11T11:03:13.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5375e0b640 1 -- 172.21.15.145:0/923636000 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54800aaa80 con 0x55ebf8867560 2024-09-11T11:03:13.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5375e0b640 1 -- 172.21.15.145:0/923636000 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800aad60 con 0x55ebf8867560 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- 172.21.15.145:0/923636000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 msgr2=0x55ebf87dcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 --2- 172.21.15.145:0/923636000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf87dcbf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f5480017ca0 tx=0x7f54800033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- 172.21.15.145:0/923636000 shutdown_connections 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 --2- 172.21.15.145:0/923636000 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf87dcbf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- 172.21.15.145:0/923636000 >> 172.21.15.145:0/923636000 conn(0x55ebf8863080 msgr2=0x55ebf894e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- 172.21.15.145:0/923636000 shutdown_connections 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- 172.21.15.145:0/923636000 wait complete. 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 Processor -- start 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- start start 2024-09-11T11:03:13.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf895abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5489f6e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ebf886eb70 con 0x55ebf8867560 2024-09-11T11:03:13.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5487a7e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf895abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5487a7e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf895abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37412/0 (socket says 172.21.15.145:37412) 2024-09-11T11:03:13.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.233+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 learned_addr learned my addr 172.21.15.145:0/3897421877 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf895b100 con 0x55ebf8867560 2024-09-11T11:03:13.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5487a7e640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf895abc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f548001aec0 tx=0x7f5480017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536ffff640 1 -- 172.21.15.145:0/3897421877 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800cc070 con 0x55ebf8867560 2024-09-11T11:03:13.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536ffff640 1 -- 172.21.15.145:0/3897421877 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54800c7410 con 0x55ebf8867560 2024-09-11T11:03:13.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebf895b390 con 0x55ebf8867560 2024-09-11T11:03:13.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536ffff640 1 -- 172.21.15.145:0/3897421877 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800b9070 con 0x55ebf8867560 2024-09-11T11:03:13.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebf895e070 con 0x55ebf8867560 2024-09-11T11:03:13.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 Processor -- start 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- start start 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf8967da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ebf876f800 con 0x55ebf89679a0 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536ffff640 1 -- 172.21.15.145:0/3897421877 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f54800b3040 con 0x55ebf8867560 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f548827f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf8967da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f548827f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf8967da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37416/0 (socket says 172.21.15.145:37416) 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f548827f640 1 -- 172.21.15.145:0/3937927086 learned_addr learned my addr 172.21.15.145:0/3937927086 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536ffff640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5370034650 0x7f5370036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536ffff640 1 -- 172.21.15.145:0/3897421877 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f54800c4070 con 0x55ebf8867560 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5487a7e640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5370034650 0x7f5370036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f548827f640 1 -- 172.21.15.145:0/3937927086 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf89682e0 con 0x55ebf89679a0 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5487a7e640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5370034650 0x7f5370036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f54800b4fd0 tx=0x7f54800b4f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f548827f640 1 --2- 172.21.15.145:0/3937927086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf8967da0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f547800a440 tx=0x7f547800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef39cbffba3edad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536dffb640 1 -- 172.21.15.145:0/3937927086 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478008850 con 0x55ebf89679a0 2024-09-11T11:03:13.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536dffb640 1 -- 172.21.15.145:0/3937927086 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5478008a10 con 0x55ebf89679a0 2024-09-11T11:03:13.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f536dffb640 1 -- 172.21.15.145:0/3937927086 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478008d30 con 0x55ebf89679a0 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- 172.21.15.145:0/3937927086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 msgr2=0x55ebf8967da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3937927086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf8967da0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f547800a440 tx=0x7f547800a900 comp rx=0 tx=0).stop 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- 172.21.15.145:0/3937927086 shutdown_connections 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3937927086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf8967da0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- 172.21.15.145:0/3937927086 >> 172.21.15.145:0/3937927086 conn(0x55ebf8867eb0 msgr2=0x55ebf89632b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- 172.21.15.145:0/3937927086 shutdown_connections 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.237+0000 7f5489f6e980 1 -- 172.21.15.145:0/3937927086 wait complete. 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5489f6e980 1 Processor -- start 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5489f6e980 1 -- start start 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5489f6e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf896ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5489f6e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ebf8968cc0 con 0x55ebf89679a0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f548827f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf896ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f548827f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf896ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37430/0 (socket says 172.21.15.145:37430) 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f548827f640 1 -- 172.21.15.145:0/2809641048 learned_addr learned my addr 172.21.15.145:0/2809641048 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f548827f640 1 -- 172.21.15.145:0/2809641048 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf896f2a0 con 0x55ebf89679a0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f548827f640 1 --2- 172.21.15.145:0/2809641048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf896ed60 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x55ebf8968750 tx=0x7f5478003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5367fff640 1 -- 172.21.15.145:0/2809641048 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478013a70 con 0x55ebf89679a0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5367fff640 1 -- 172.21.15.145:0/2809641048 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5478023070 con 0x55ebf89679a0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5489f6e980 1 -- 172.21.15.145:0/2809641048 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebf896f530 con 0x55ebf89679a0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5367fff640 1 -- 172.21.15.145:0/2809641048 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478013d40 con 0x55ebf89679a0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5489f6e980 1 -- 172.21.15.145:0/2809641048 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebf8972210 con 0x55ebf89679a0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5367fff640 1 -- 172.21.15.145:0/2809641048 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f5478028460 con 0x55ebf89679a0 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5367fff640 1 --2- 172.21.15.145:0/2809641048 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53600346a0 0x7f5360036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5367fff640 1 -- 172.21.15.145:0/2809641048 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f5478049fc0 con 0x55ebf89679a0 2024-09-11T11:03:13.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5489f6e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:13.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f5489f6e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:13.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.241+0000 7f548727d640 1 --2- 172.21.15.145:0/2809641048 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53600346a0 0x7f5360036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5489f6e980 1 Processor -- start 2024-09-11T11:03:13.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5489f6e980 1 -- start start 2024-09-11T11:03:13.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f548727d640 1 --2- 172.21.15.145:0/2809641048 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53600346a0 0x7f5360036b60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5470000f70 tx=0x7f54700013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5489f6e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8954220 0x55ebf8952800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5489f6e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ebf87dd480 con 0x55ebf8954220 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5487a7e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8954220 0x55ebf8952800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5487a7e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8954220 0x55ebf8952800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37446/0 (socket says 172.21.15.145:37446) 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5487a7e640 1 -- 172.21.15.145:0/79872570 learned_addr learned my addr 172.21.15.145:0/79872570 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5487a7e640 1 -- 172.21.15.145:0/79872570 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebf8952d40 con 0x55ebf8954220 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5487a7e640 1 --2- 172.21.15.145:0/79872570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8954220 0x55ebf8952800 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5480018cc0 tx=0x7f54800bd7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f52d7fff640 1 -- 172.21.15.145:0/79872570 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800e1050 con 0x55ebf8954220 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5489f6e980 1 -- 172.21.15.145:0/79872570 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebf8953030 con 0x55ebf8954220 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f52d7fff640 1 -- 172.21.15.145:0/79872570 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54800e8070 con 0x55ebf8954220 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f52d7fff640 1 -- 172.21.15.145:0/79872570 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54800ce770 con 0x55ebf8954220 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f5489f6e980 1 -- 172.21.15.145:0/79872570 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebf8953500 con 0x55ebf8954220 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f52d7fff640 1 -- 172.21.15.145:0/79872570 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f54800ce910 con 0x55ebf8954220 2024-09-11T11:03:13.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f52d7fff640 1 --2- 172.21.15.145:0/79872570 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f52c8034650 0x7f52c8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f52d7fff640 1 -- 172.21.15.145:0/79872570 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f54800d6040 con 0x55ebf8954220 2024-09-11T11:03:13.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.245+0000 7f548727d640 1 --2- 172.21.15.145:0/79872570 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f52c8034650 0x7f52c8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f52d5ffb640 20 reqs_thread_entry: start 2024-09-11T11:03:13.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ebf8990490 0x55ebf8992880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebf8992e90 con 0x55ebf8990490 2024-09-11T11:03:13.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f548727d640 1 --2- 172.21.15.145:0/79872570 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f52c8034650 0x7f52c8036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55ebf8963e50 tx=0x7f5470006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f548827f640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ebf8990490 0x55ebf8992880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f548827f640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ebf8990490 0x55ebf8992880 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ebf8993c30 0x55ebf8996020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebf8996630 con 0x55ebf8993c30 2024-09-11T11:03:13.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5487a7e640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ebf8993c30 0x55ebf8996020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5487a7e640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ebf8993c30 0x55ebf8996020 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebf8997ee0 con 0x55ebf8993c30 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.249+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899e6d0 con 0x55ebf8990490 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:NOTICE: set zone's realm_id= 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ebf89a2730 0x55ebf899df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf89a2730 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548727d640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ebf89a2730 0x55ebf899df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548727d640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ebf89a2730 0x55ebf899df60 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(5 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000d040 con 0x55ebf89a2730 2024-09-11T11:03:13.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(6 [pgnls start_epoch 36 out=107b] v32'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f5487a7e640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f54800da070 0x7f54800c2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x7f54800da070 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f54800da070 0x7f54800c2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f54800da070 0x7f54800c2890 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(7 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x7f54800da070 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf89a2730 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000d040 con 0x55ebf89a2730 2024-09-11T11:03:13.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.253+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x7f54800da070 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x7f54800da070 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x7f54800da070 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(17 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f5478028930 con 0x7f54800da070 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(18 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf89a2730 2024-09-11T11:03:13.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000d040 con 0x55ebf89a2730 2024-09-11T11:03:13.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.257+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf89a2730 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000d040 con 0x55ebf89a2730 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=74b] v25'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf89a2730 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000d040 con 0x55ebf89a2730 2024-09-11T11:03:13.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x7f54800da070 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x7f54800da070 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8990490 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x7f54800da070 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x7f54800da070 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf89a2730 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000d040 con 0x55ebf89a2730 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x7f54800da070 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5478028930 con 0x7f54800da070 2024-09-11T11:03:13.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.261+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf89a2730 2024-09-11T11:03:13.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f547000d040 con 0x55ebf89a2730 2024-09-11T11:03:13.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f548727d640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(35 [pgnls start_epoch 36 out=115b] v25'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ebf899fd00 con 0x55ebf8993c30 2024-09-11T11:03:13.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(36 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebf8998280 con 0x55ebf8993c30 2024-09-11T11:03:13.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:38 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ebf89a0580 con 0x55ebf8993c30 2024-09-11T11:03:13.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(38 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.265+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebf89a0920 con 0x55ebf8993c30 2024-09-11T11:03:13.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.269+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(39 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [create,call,writefull 0~1155] v36'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.269+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebf89a0920 con 0x55ebf8993c30 2024-09-11T11:03:13.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5487a7e640 1 -- 172.21.15.145:0/3897421877 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v36'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f54800c7730 con 0x55ebf8993c30 2024-09-11T11:03:13.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ebf89a0920 con 0x55ebf8990490 2024-09-11T11:03:13.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v36'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f5478028930 con 0x55ebf8990490 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/2809641048 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53600346a0 msgr2=0x7f5360036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 --2- 172.21.15.145:0/2809641048 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53600346a0 0x7f5360036b60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5470000f70 tx=0x7f54700013a0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/2809641048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 msgr2=0x55ebf896ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 --2- 172.21.15.145:0/2809641048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf896ed60 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x55ebf8968750 tx=0x7f5478003000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/2809641048 shutdown_connections 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 --2- 172.21.15.145:0/2809641048 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f53600346a0 0x7f5360036b60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 --2- 172.21.15.145:0/2809641048 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf89679a0 0x55ebf896ed60 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/2809641048 >> 172.21.15.145:0/2809641048 conn(0x55ebf8867eb0 msgr2=0x55ebf8962e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/2809641048 shutdown_connections 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/2809641048 wait complete. 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/79872570 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f52c8034650 msgr2=0x7f52c8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 --2- 172.21.15.145:0/79872570 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f52c8034650 0x7f52c8036b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55ebf8963e50 tx=0x7f5470006000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/79872570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8954220 msgr2=0x55ebf8952800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 --2- 172.21.15.145:0/79872570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8954220 0x55ebf8952800 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5480018cc0 tx=0x7f54800bd7d0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/79872570 shutdown_connections 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 --2- 172.21.15.145:0/79872570 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f52c8034650 0x7f52c8036b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 --2- 172.21.15.145:0/79872570 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8954220 0x55ebf8952800 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/79872570 >> 172.21.15.145:0/79872570 conn(0x55ebf897d590 msgr2=0x55ebf897fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/79872570 shutdown_connections 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.273+0000 7f5489f6e980 1 -- 172.21.15.145:0/79872570 wait complete. 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ebf8993c30 msgr2=0x55ebf8996020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ebf8993c30 0x55ebf8996020 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ebf8990490 msgr2=0x55ebf8992880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ebf8990490 0x55ebf8992880 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f54800da070 msgr2=0x7f54800c2890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f54800da070 0x7f54800c2890 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ebf89a2730 msgr2=0x55ebf899df60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ebf89a2730 0x55ebf899df60 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5370034650 msgr2=0x7f5370036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f5370034650 0x7f5370036b10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f54800b4fd0 tx=0x7f54800b4f00 comp rx=0 tx=0).stop 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 msgr2=0x55ebf895abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 --2- 172.21.15.145:0/3897421877 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ebf8867560 0x55ebf895abc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f548001aec0 tx=0x7f5480017e30 comp rx=0 tx=0).stop 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 reap_dead start 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f548827f640 1 -- 172.21.15.145:0/3897421877 reap_dead start 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 shutdown_connections 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 >> 172.21.15.145:0/3897421877 conn(0x55ebf8863080 msgr2=0x55ebf894d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 shutdown_connections 2024-09-11T11:03:13.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.277+0000 7f5489f6e980 1 -- 172.21.15.145:0/3897421877 wait complete. 2024-09-11T11:03:13.289 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"27698d38-fc40-410e-96d8-191ffc71147c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-11T11:03:13.289 DEBUG:tasks.util.rgw: json result: {'id': '27698d38-fc40-410e-96d8-191ffc71147c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-11T11:03:13.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-11T11:03:13.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-11T11:03:13.290 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-11T11:03:13.360 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:13.360 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:13.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.357+0000 7fa35079e980 1 Processor -- start 2024-09-11T11:03:13.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.357+0000 7fa35079e980 1 -- start start 2024-09-11T11:03:13.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.357+0000 7fa35079e980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559965c3d8e0 0x559965c3fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.357+0000 7fa35079e980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559965ac2ae0 con 0x559965c39560 2024-09-11T11:03:13.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.357+0000 7fa35079e980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x559965ae6e30 con 0x559965c3d8e0 2024-09-11T11:03:13.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34daad640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559965c3d8e0 0x559965c3fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34daad640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x559965c3d8e0 0x559965c3fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37460/0 (socket says 172.21.15.145:37460) 2024-09-11T11:03:13.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34daad640 1 -- 172.21.15.145:0/1830146183 learned_addr learned my addr 172.21.15.145:0/1830146183 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34e2ae640 1 --1- 172.21.15.145:0/1830146183 >> v1:172.21.15.102:6789/0 conn(0x559965c39560 0x559965c39940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52078/0 (socket says 172.21.15.145:52078) 2024-09-11T11:03:13.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34daad640 1 -- 172.21.15.145:0/1830146183 >> v1:172.21.15.102:6789/0 conn(0x559965c39560 legacy=0x559965c39940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34daad640 1 -- 172.21.15.145:0/1830146183 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559965c41220 con 0x559965c3d8e0 2024-09-11T11:03:13.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34daad640 1 --2- 172.21.15.145:0/1830146183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c3d8e0 0x559965c3fcd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa33800a5c0 tx=0x7fa33801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3fd4d1de5bbcd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34d2ac640 1 -- 172.21.15.145:0/1830146183 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3380a6070 con 0x559965c3d8e0 2024-09-11T11:03:13.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34d2ac640 1 -- 172.21.15.145:0/1830146183 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3380af070 con 0x559965c3d8e0 2024-09-11T11:03:13.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa34d2ac640 1 -- 172.21.15.145:0/1830146183 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3380aa5c0 con 0x559965c3d8e0 2024-09-11T11:03:13.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa35079e980 1 -- 172.21.15.145:0/1830146183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c3d8e0 msgr2=0x559965c3fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa35079e980 1 --2- 172.21.15.145:0/1830146183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c3d8e0 0x559965c3fcd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa33800a5c0 tx=0x7fa33801b340 comp rx=0 tx=0).stop 2024-09-11T11:03:13.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa35079e980 1 -- 172.21.15.145:0/1830146183 shutdown_connections 2024-09-11T11:03:13.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa35079e980 1 --2- 172.21.15.145:0/1830146183 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c3d8e0 0x559965c3fcd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa35079e980 1 -- 172.21.15.145:0/1830146183 >> 172.21.15.145:0/1830146183 conn(0x559965c35080 msgr2=0x559965c374a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.361+0000 7fa35079e980 1 -- 172.21.15.145:0/1830146183 shutdown_connections 2024-09-11T11:03:13.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.365+0000 7fa35079e980 1 -- 172.21.15.145:0/1830146183 wait complete. 2024-09-11T11:03:13.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.377+0000 7fa35079e980 1 Processor -- start 2024-09-11T11:03:13.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.377+0000 7fa35079e980 1 -- start start 2024-09-11T11:03:13.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.377+0000 7fa35079e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d27bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.377+0000 7fa35079e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559965ae8200 con 0x559965c39560 2024-09-11T11:03:13.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d27bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d27bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37476/0 (socket says 172.21.15.145:37476) 2024-09-11T11:03:13.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 -- 172.21.15.145:0/3776381354 learned_addr learned my addr 172.21.15.145:0/3776381354 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 -- 172.21.15.145:0/3776381354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559965d281c0 con 0x559965c39560 2024-09-11T11:03:13.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 --2- 172.21.15.145:0/3776381354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d27bf0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa348006e50 tx=0x7fa34800b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b76a736e7de3b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa23c608640 1 -- 172.21.15.145:0/3776381354 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa348008750 con 0x559965c39560 2024-09-11T11:03:13.385 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa23c608640 1 -- 172.21.15.145:0/3776381354 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3480088f0 con 0x559965c39560 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa23c608640 1 -- 172.21.15.145:0/3776381354 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa348008c90 con 0x559965c39560 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 -- 172.21.15.145:0/3776381354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 msgr2=0x559965d27bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 --2- 172.21.15.145:0/3776381354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d27bf0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fa348006e50 tx=0x7fa34800b800 comp rx=0 tx=0).stop 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 -- 172.21.15.145:0/3776381354 shutdown_connections 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 --2- 172.21.15.145:0/3776381354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d27bf0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 -- 172.21.15.145:0/3776381354 >> 172.21.15.145:0/3776381354 conn(0x559965c35080 msgr2=0x559965d1f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 -- 172.21.15.145:0/3776381354 shutdown_connections 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 -- 172.21.15.145:0/3776381354 wait complete. 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 Processor -- start 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 -- start start 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d2ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.386 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa35079e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559965c40d20 con 0x559965c39560 2024-09-11T11:03:13.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d2ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d2ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37478/0 (socket says 172.21.15.145:37478) 2024-09-11T11:03:13.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 -- 172.21.15.145:0/1402783497 learned_addr learned my addr 172.21.15.145:0/1402783497 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 -- 172.21.15.145:0/1402783497 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559965d2f480 con 0x559965c39560 2024-09-11T11:03:13.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.381+0000 7fa34e2ae640 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d2ef40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa348005270 tx=0x7fa348000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa23ae05640 1 -- 172.21.15.145:0/1402783497 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa348022020 con 0x559965c39560 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa23ae05640 1 -- 172.21.15.145:0/1402783497 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa348019040 con 0x559965c39560 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559965d2f710 con 0x559965c39560 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa23ae05640 1 -- 172.21.15.145:0/1402783497 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa348013b70 con 0x559965c39560 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559965d323f0 con 0x559965c39560 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 Processor -- start 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- start start 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d3c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559965b41800 con 0x559965d3bd00 2024-09-11T11:03:13.392 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa34eaaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa23ae05640 1 -- 172.21.15.145:0/1402783497 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa348025020 con 0x559965c39560 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa34eaaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d3c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37486/0 (socket says 172.21.15.145:37486) 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa34eaaf640 1 -- 172.21.15.145:0/4099335579 learned_addr learned my addr 172.21.15.145:0/4099335579 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa23ae05640 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa234034650 0x7fa234036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa23ae05640 1 -- 172.21.15.145:0/1402783497 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fa348049e70 con 0x559965c39560 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa34e2ae640 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa234034650 0x7fa234036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa34eaaf640 1 -- 172.21.15.145:0/4099335579 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559965d3c640 con 0x559965d3bd00 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa34eaaf640 1 --2- 172.21.15.145:0/4099335579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d3c100 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa34000a430 tx=0x7fa34000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6c1c4c89bec633 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa34e2ae640 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa234034650 0x7fa234036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa348007eb0 tx=0x7fa348012f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa238e01640 1 -- 172.21.15.145:0/4099335579 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34000f6e0 con 0x559965d3bd00 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa238e01640 1 -- 172.21.15.145:0/4099335579 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa340015070 con 0x559965d3bd00 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa238e01640 1 -- 172.21.15.145:0/4099335579 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34000fa10 con 0x559965d3bd00 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- 172.21.15.145:0/4099335579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 msgr2=0x559965d3c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 --2- 172.21.15.145:0/4099335579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d3c100 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa34000a430 tx=0x7fa34000a8f0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- 172.21.15.145:0/4099335579 shutdown_connections 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 --2- 172.21.15.145:0/4099335579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d3c100 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- 172.21.15.145:0/4099335579 >> 172.21.15.145:0/4099335579 conn(0x559965c3d8e0 msgr2=0x559965d37610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- 172.21.15.145:0/4099335579 shutdown_connections 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- 172.21.15.145:0/4099335579 wait complete. 2024-09-11T11:03:13.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 Processor -- start 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- start start 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d43100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.385+0000 7fa35079e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559965d3d020 con 0x559965d3bd00 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34eaaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d43100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34eaaf640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d43100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37502/0 (socket says 172.21.15.145:37502) 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34eaaf640 1 -- 172.21.15.145:0/3627190340 learned_addr learned my addr 172.21.15.145:0/3627190340 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34eaaf640 1 -- 172.21.15.145:0/3627190340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559965d43640 con 0x559965d3bd00 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34eaaf640 1 --2- 172.21.15.145:0/3627190340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d43100 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x559965d3cab0 tx=0x7fa340003380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa232ffd640 1 -- 172.21.15.145:0/3627190340 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa34000fe00 con 0x559965d3bd00 2024-09-11T11:03:13.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa35079e980 1 -- 172.21.15.145:0/3627190340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559965d438d0 con 0x559965d3bd00 2024-09-11T11:03:13.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa232ffd640 1 -- 172.21.15.145:0/3627190340 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa340010a20 con 0x559965d3bd00 2024-09-11T11:03:13.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa35079e980 1 -- 172.21.15.145:0/3627190340 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559965d465b0 con 0x559965d3bd00 2024-09-11T11:03:13.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa232ffd640 1 -- 172.21.15.145:0/3627190340 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa340010d80 con 0x559965d3bd00 2024-09-11T11:03:13.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa35079e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:13.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa35079e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa232ffd640 1 -- 172.21.15.145:0/3627190340 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa34001a480 con 0x559965d3bd00 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa232ffd640 1 --2- 172.21.15.145:0/3627190340 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa228034650 0x7fa228036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa35079e980 1 Processor -- start 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa232ffd640 1 -- 172.21.15.145:0/3627190340 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fa34004a410 con 0x559965d3bd00 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34eaaf640 1 --2- 172.21.15.145:0/3627190340 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa228034650 0x7fa228036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa35079e980 1 -- start start 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa35079e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d5c980 0x559965d5cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa35079e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x559965d28540 con 0x559965d5c980 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34eaaf640 1 --2- 172.21.15.145:0/3627190340 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa228034650 0x7fa228036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa340010fd0 tx=0x7fa340010f20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34e2ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d5c980 0x559965d5cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34e2ae640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d5c980 0x559965d5cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37514/0 (socket says 172.21.15.145:37514) 2024-09-11T11:03:13.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.389+0000 7fa34e2ae640 1 -- 172.21.15.145:0/2591483580 learned_addr learned my addr 172.21.15.145:0/2591483580 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa34e2ae640 1 -- 172.21.15.145:0/2591483580 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559965d5d370 con 0x559965d5c980 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa34e2ae640 1 --2- 172.21.15.145:0/2591483580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d5c980 0x559965d5cda0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa348013690 tx=0x7fa34801ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa212fe5640 1 -- 172.21.15.145:0/2591483580 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3480288e0 con 0x559965d5c980 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa212fe5640 1 -- 172.21.15.145:0/2591483580 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa348028a80 con 0x559965d5c980 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa212fe5640 1 -- 172.21.15.145:0/2591483580 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa348028d80 con 0x559965d5c980 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa35079e980 1 -- 172.21.15.145:0/2591483580 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559965d5ff70 con 0x559965d5c980 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa35079e980 1 -- 172.21.15.145:0/2591483580 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559965d60320 con 0x559965d5c980 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa212fe5640 1 -- 172.21.15.145:0/2591483580 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa34803c040 con 0x559965d5c980 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa212fe5640 1 --2- 172.21.15.145:0/2591483580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa190034650 0x7fa190036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa212fe5640 1 -- 172.21.15.145:0/2591483580 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fa3480340b0 con 0x559965d5c980 2024-09-11T11:03:13.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa34daad640 1 --2- 172.21.15.145:0/2591483580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa190034650 0x7fa190036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa210fe1640 20 reqs_thread_entry: start 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559965d624e0 0x559965d648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559965d64f70 con 0x559965d624e0 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa34daad640 1 --2- 172.21.15.145:0/2591483580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa190034650 0x7fa190036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3380ae000 tx=0x7fa3380a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa34eaaf640 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559965d624e0 0x559965d648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa34eaaf640 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559965d624e0 0x559965d648f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa34eaaf640 1 -- 172.21.15.145:0/1402783497 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa34000e070 con 0x559965d624e0 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559965d65d30 0x559965d68120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559965d68760 con 0x559965d65d30 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.393+0000 7fa34e2ae640 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559965d65d30 0x559965d68120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa34e2ae640 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559965d65d30 0x559965d68120 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa34e2ae640 1 -- 172.21.15.145:0/1402783497 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa34803fd40 con 0x559965d65d30 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x559965d6a010 con 0x559965d65d30 2024-09-11T11:03:13.402 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa34e2ae640 1 -- 172.21.15.145:0/1402783497 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fa34803fd40 con 0x559965d65d30 2024-09-11T11:03:13.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/3627190340 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa228034650 msgr2=0x7fa228036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.404 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/3627190340 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa228034650 0x7fa228036b10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa340010fd0 tx=0x7fa340010f20 comp rx=0 tx=0).stop 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/3627190340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 msgr2=0x559965d43100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/3627190340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d43100 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x559965d3cab0 tx=0x7fa340003380 comp rx=0 tx=0).stop 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/3627190340 shutdown_connections 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/3627190340 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa228034650 0x7fa228036b10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/3627190340 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d3bd00 0x559965d43100 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/3627190340 >> 172.21.15.145:0/3627190340 conn(0x559965c3d8e0 msgr2=0x559965d371e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/3627190340 shutdown_connections 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/3627190340 wait complete. 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/2591483580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa190034650 msgr2=0x7fa190036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/2591483580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa190034650 0x7fa190036b10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3380ae000 tx=0x7fa3380a6000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/2591483580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d5c980 msgr2=0x559965d5cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/2591483580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d5c980 0x559965d5cda0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa348013690 tx=0x7fa34801ef90 comp rx=0 tx=0).stop 2024-09-11T11:03:13.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/2591483580 shutdown_connections 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/2591483580 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa190034650 0x7fa190036b10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/2591483580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965d5c980 0x559965d5cda0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/2591483580 >> 172.21.15.145:0/2591483580 conn(0x559965d51950 msgr2=0x559965d54240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/2591483580 shutdown_connections 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/2591483580 wait complete. 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559965d65d30 msgr2=0x559965d68120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559965d65d30 0x559965d68120 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559965d624e0 msgr2=0x559965d648f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.397+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559965d624e0 0x559965d648f0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa234034650 msgr2=0x7fa234036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa234034650 0x7fa234036b10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa348007eb0 tx=0x7fa348012f70 comp rx=0 tx=0).stop 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 msgr2=0x559965d2ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d2ef40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fa348005270 tx=0x7fa348000bd0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 shutdown_connections 2024-09-11T11:03:13.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x559965d65d30 0x559965d68120 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x559965d624e0 0x559965d648f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fa234034650 0x7fa234036b10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 --2- 172.21.15.145:0/1402783497 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559965c39560 0x559965d2ef40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 >> 172.21.15.145:0/1402783497 conn(0x559965c35080 msgr2=0x559965d1df90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 shutdown_connections 2024-09-11T11:03:13.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.401+0000 7fa35079e980 1 -- 172.21.15.145:0/1402783497 wait complete. 2024-09-11T11:03:13.412 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"27698d38-fc40-410e-96d8-191ffc71147c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-11T11:03:13.412 DEBUG:tasks.util.rgw: json result: {'id': '27698d38-fc40-410e-96d8-191ffc71147c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-11T11:03:13.412 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-11T11:03:13.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-11T11:03:13.413 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-11T11:03:13.490 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:13.490 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:13.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14136e0980 1 Processor -- start 2024-09-11T11:03:13.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14136e0980 1 -- start start 2024-09-11T11:03:13.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14136e0980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5605039e5b70 0x5605039e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14136e0980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560503869ae0 con 0x5605039dfaa0 2024-09-11T11:03:13.491 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14136e0980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x56050388de30 con 0x5605039e5b70 2024-09-11T11:03:13.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14109ef640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5605039e5b70 0x5605039e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14111f0640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x5605039dfaa0 0x5605039dfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52090/0 (socket says 172.21.15.145:52090) 2024-09-11T11:03:13.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14109ef640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5605039e5b70 0x5605039e7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37518/0 (socket says 172.21.15.145:37518) 2024-09-11T11:03:13.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14111f0640 1 -- 172.21.15.145:0/2310162739 learned_addr learned my addr 172.21.15.145:0/2310162739 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:03:13.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14109ef640 1 -- 172.21.15.145:0/2310162739 >> v1:172.21.15.102:6789/0 conn(0x5605039dfaa0 legacy=0x5605039dfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.489+0000 7f14109ef640 1 -- 172.21.15.145:0/2310162739 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605039e0590 con 0x5605039e5b70 2024-09-11T11:03:13.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f14109ef640 1 --2- 172.21.15.145:0/2310162739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e5b70 0x5605039e7f60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00a480 tx=0x7f13fc01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410c8c6cb97d662f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f140bfff640 1 -- 172.21.15.145:0/2310162739 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13fc0b0070 con 0x5605039e5b70 2024-09-11T11:03:13.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f140bfff640 1 -- 172.21.15.145:0/2310162739 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13fc0ab540 con 0x5605039e5b70 2024-09-11T11:03:13.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f140bfff640 1 -- 172.21.15.145:0/2310162739 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13fc0ab840 con 0x5605039e5b70 2024-09-11T11:03:13.495 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f14136e0980 1 -- 172.21.15.145:0/2310162739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e5b70 msgr2=0x5605039e7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f14136e0980 1 --2- 172.21.15.145:0/2310162739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e5b70 0x5605039e7f60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00a480 tx=0x7f13fc01b280 comp rx=0 tx=0).stop 2024-09-11T11:03:13.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f14136e0980 1 -- 172.21.15.145:0/2310162739 shutdown_connections 2024-09-11T11:03:13.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f14136e0980 1 --2- 172.21.15.145:0/2310162739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e5b70 0x5605039e7f60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f14136e0980 1 -- 172.21.15.145:0/2310162739 >> 172.21.15.145:0/2310162739 conn(0x5605039db780 msgr2=0x5605039ddba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f14136e0980 1 -- 172.21.15.145:0/2310162739 shutdown_connections 2024-09-11T11:03:13.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.493+0000 7f14136e0980 1 -- 172.21.15.145:0/2310162739 wait complete. 2024-09-11T11:03:13.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.505+0000 7f14136e0980 1 Processor -- start 2024-09-11T11:03:13.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.505+0000 7f14136e0980 1 -- start start 2024-09-11T11:03:13.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.505+0000 7f14136e0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503acca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.505+0000 7f14136e0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56050388f200 con 0x5605039dfaa0 2024-09-11T11:03:13.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.505+0000 7f14111f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503acca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.505+0000 7f14111f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503acca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37526/0 (socket says 172.21.15.145:37526) 2024-09-11T11:03:13.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.505+0000 7f14111f0640 1 -- 172.21.15.145:0/2987097406 learned_addr learned my addr 172.21.15.145:0/2987097406 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.510 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14111f0640 1 -- 172.21.15.145:0/2987097406 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560503acd060 con 0x5605039dfaa0 2024-09-11T11:03:13.511 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14111f0640 1 --2- 172.21.15.145:0/2987097406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503acca90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f14040015f0 tx=0x7f1404001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701c42055df5a155 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f12ff606640 1 -- 172.21.15.145:0/2987097406 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404004530 con 0x5605039dfaa0 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f12ff606640 1 -- 172.21.15.145:0/2987097406 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14040046f0 con 0x5605039dfaa0 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f12ff606640 1 -- 172.21.15.145:0/2987097406 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404004a90 con 0x5605039dfaa0 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- 172.21.15.145:0/2987097406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 msgr2=0x560503acca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 --2- 172.21.15.145:0/2987097406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503acca90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f14040015f0 tx=0x7f1404001ab0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- 172.21.15.145:0/2987097406 shutdown_connections 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 --2- 172.21.15.145:0/2987097406 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503acca90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- 172.21.15.145:0/2987097406 >> 172.21.15.145:0/2987097406 conn(0x5605039db780 msgr2=0x560503ac86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- 172.21.15.145:0/2987097406 shutdown_connections 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- 172.21.15.145:0/2987097406 wait complete. 2024-09-11T11:03:13.513 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 Processor -- start 2024-09-11T11:03:13.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- start start 2024-09-11T11:03:13.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503ad3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5605039eafc0 con 0x5605039dfaa0 2024-09-11T11:03:13.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14111f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503ad3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14111f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503ad3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37528/0 (socket says 172.21.15.145:37528) 2024-09-11T11:03:13.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14111f0640 1 -- 172.21.15.145:0/714091483 learned_addr learned my addr 172.21.15.145:0/714091483 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14111f0640 1 -- 172.21.15.145:0/714091483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560503ad43a0 con 0x5605039dfaa0 2024-09-11T11:03:13.514 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14111f0640 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503ad3e60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x560503acdc70 tx=0x7f1404000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.518 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f12fde03640 1 -- 172.21.15.145:0/714091483 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404013760 con 0x5605039dfaa0 2024-09-11T11:03:13.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560503ad4630 con 0x5605039dfaa0 2024-09-11T11:03:13.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f12fde03640 1 -- 172.21.15.145:0/714091483 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1404013900 con 0x5605039dfaa0 2024-09-11T11:03:13.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f12fde03640 1 -- 172.21.15.145:0/714091483 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404013be0 con 0x5605039dfaa0 2024-09-11T11:03:13.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.509+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560503ad7310 con 0x5605039dfaa0 2024-09-11T11:03:13.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 Processor -- start 2024-09-11T11:03:13.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- start start 2024-09-11T11:03:13.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x5605039e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.519 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5605038e8800 con 0x5605039e2590 2024-09-11T11:03:13.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f12fde03640 1 -- 172.21.15.145:0/714091483 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1404010070 con 0x5605039dfaa0 2024-09-11T11:03:13.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x5605039e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f12fde03640 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12f8034650 0x7f12f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x5605039e0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37534/0 (socket says 172.21.15.145:37534) 2024-09-11T11:03:13.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 -- 172.21.15.145:0/667690217 learned_addr learned my addr 172.21.15.145:0/667690217 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f12fde03640 1 -- 172.21.15.145:0/714091483 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1404018070 con 0x5605039dfaa0 2024-09-11T11:03:13.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14111f0640 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12f8034650 0x7f12f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.520 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 -- 172.21.15.145:0/667690217 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605039e1050 con 0x5605039e2590 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14111f0640 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12f8034650 0x7f12f8036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f140401e560 tx=0x7f140401e4b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 --2- 172.21.15.145:0/667690217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x5605039e0b10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f140c00a440 tx=0x7f140c00a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aacd3b6264c76a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f12f77fe640 1 -- 172.21.15.145:0/667690217 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f140c008850 con 0x5605039e2590 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f12f77fe640 1 -- 172.21.15.145:0/667690217 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c008a10 con 0x5605039e2590 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f12f77fe640 1 -- 172.21.15.145:0/667690217 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f140c008d30 con 0x5605039e2590 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- 172.21.15.145:0/667690217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 msgr2=0x5605039e0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 --2- 172.21.15.145:0/667690217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x5605039e0b10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f140c00a440 tx=0x7f140c00a900 comp rx=0 tx=0).stop 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- 172.21.15.145:0/667690217 shutdown_connections 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 --2- 172.21.15.145:0/667690217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x5605039e0b10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- 172.21.15.145:0/667690217 >> 172.21.15.145:0/667690217 conn(0x5605039e5b70 msgr2=0x560503adc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- 172.21.15.145:0/667690217 shutdown_connections 2024-09-11T11:03:13.521 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- 172.21.15.145:0/667690217 wait complete. 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 Processor -- start 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- start start 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x560503aea170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14136e0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5605039e1370 con 0x5605039e2590 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x560503aea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x560503aea170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37536/0 (socket says 172.21.15.145:37536) 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 -- 172.21.15.145:0/2118929482 learned_addr learned my addr 172.21.15.145:0/2118929482 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 -- 172.21.15.145:0/2118929482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560503aea6b0 con 0x5605039e2590 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.513+0000 7f14119f1640 1 --2- 172.21.15.145:0/2118929482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x560503aea170 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f140c010000 tx=0x7f140c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.522 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12f5ffb640 1 -- 172.21.15.145:0/2118929482 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f140c013a70 con 0x5605039e2590 2024-09-11T11:03:13.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 1 -- 172.21.15.145:0/2118929482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560503aea940 con 0x5605039e2590 2024-09-11T11:03:13.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12f5ffb640 1 -- 172.21.15.145:0/2118929482 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c023070 con 0x5605039e2590 2024-09-11T11:03:13.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 1 -- 172.21.15.145:0/2118929482 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560503aed620 con 0x5605039e2590 2024-09-11T11:03:13.523 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12f5ffb640 1 -- 172.21.15.145:0/2118929482 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f140c013d40 con 0x5605039e2590 2024-09-11T11:03:13.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:13.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:13.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12f5ffb640 1 -- 172.21.15.145:0/2118929482 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f140c028460 con 0x5605039e2590 2024-09-11T11:03:13.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 1 Processor -- start 2024-09-11T11:03:13.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 1 -- start start 2024-09-11T11:03:13.526 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12f5ffb640 1 --2- 172.21.15.145:0/2118929482 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12e8034650 0x7f12e8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12f5ffb640 1 -- 172.21.15.145:0/2118929482 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f140c049f30 con 0x5605039e2590 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14119f1640 1 --2- 172.21.15.145:0/2118929482 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12e8034650 0x7f12e8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560503b03a60 0x560503b03e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x560503acd3e0 con 0x560503b03a60 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14119f1640 1 --2- 172.21.15.145:0/2118929482 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12e8034650 0x7f12e8036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f140c01e590 tx=0x7f140c01e520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14111f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560503b03a60 0x560503b03e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14111f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560503b03a60 0x560503b03e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37548/0 (socket says 172.21.15.145:37548) 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14111f0640 1 -- 172.21.15.145:0/953384430 learned_addr learned my addr 172.21.15.145:0/953384430 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14111f0640 1 -- 172.21.15.145:0/953384430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560503b043c0 con 0x560503b03a60 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14111f0640 1 --2- 172.21.15.145:0/953384430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560503b03a60 0x560503b03e80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f14040483b0 tx=0x7f1404010660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.527 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12d5fe3640 1 -- 172.21.15.145:0/953384430 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404010e50 con 0x560503b03a60 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12d5fe3640 1 -- 172.21.15.145:0/953384430 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140404d070 con 0x560503b03a60 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f12d5fe3640 1 -- 172.21.15.145:0/953384430 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1404049830 con 0x560503b03a60 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 1 -- 172.21.15.145:0/953384430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560503b046b0 con 0x560503b03a60 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.517+0000 7f14136e0980 1 -- 172.21.15.145:0/953384430 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560503b07370 con 0x560503b03a60 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f12d5fe3640 1 -- 172.21.15.145:0/953384430 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1404049aa0 con 0x560503b03a60 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f12d5fe3640 1 --2- 172.21.15.145:0/953384430 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12540347f0 0x7f1254036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f12d5fe3640 1 -- 172.21.15.145:0/953384430 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1404053c60 con 0x560503b03a60 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14109ef640 1 --2- 172.21.15.145:0/953384430 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12540347f0 0x7f1254036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f124f7fe640 20 reqs_thread_entry: start 2024-09-11T11:03:13.528 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14136e0980 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560503b099f0 0x560503b0bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560503b0c320 con 0x560503b099f0 2024-09-11T11:03:13.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14109ef640 1 --2- 172.21.15.145:0/953384430 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12540347f0 0x7f1254036cb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00a480 tx=0x7f13fc0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14119f1640 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560503b099f0 0x560503b0bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14119f1640 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560503b099f0 0x560503b0bde0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14119f1640 1 -- 172.21.15.145:0/714091483 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f140c01e7a0 con 0x560503b099f0 2024-09-11T11:03:13.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x560503b0db80 con 0x560503b099f0 2024-09-11T11:03:13.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14119f1640 1 -- 172.21.15.145:0/714091483 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(2 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f140c01e7a0 con 0x560503b099f0 2024-09-11T11:03:13.529 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.521+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x560503b12640 con 0x560503b099f0 2024-09-11T11:03:13.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14119f1640 1 -- 172.21.15.145:0/714091483 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [stat,call,call,writefull 0~993] v36'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f140c01e7a0 con 0x560503b099f0 2024-09-11T11:03:13.531 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/2118929482 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12e8034650 msgr2=0x7f12e8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/2118929482 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12e8034650 0x7f12e8036b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f140c01e590 tx=0x7f140c01e520 comp rx=0 tx=0).stop 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/2118929482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 msgr2=0x560503aea170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/2118929482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x560503aea170 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f140c010000 tx=0x7f140c003000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/2118929482 shutdown_connections 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/2118929482 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12e8034650 0x7f12e8036b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/2118929482 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039e2590 0x560503aea170 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/2118929482 >> 172.21.15.145:0/2118929482 conn(0x5605039e5b70 msgr2=0x560503adf370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/2118929482 shutdown_connections 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/2118929482 wait complete. 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/953384430 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12540347f0 msgr2=0x7f1254036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.532 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/953384430 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12540347f0 0x7f1254036cb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f13fc00a480 tx=0x7f13fc0a5040 comp rx=0 tx=0).stop 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/953384430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560503b03a60 msgr2=0x560503b03e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/953384430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560503b03a60 0x560503b03e80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f14040483b0 tx=0x7f1404010660 comp rx=0 tx=0).stop 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/953384430 shutdown_connections 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/953384430 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12540347f0 0x7f1254036cb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/953384430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560503b03a60 0x560503b03e80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/953384430 >> 172.21.15.145:0/953384430 conn(0x560503af8a30 msgr2=0x560503afb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/953384430 shutdown_connections 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/953384430 wait complete. 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560503b099f0 msgr2=0x560503b0bde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560503b099f0 0x560503b0bde0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12f8034650 msgr2=0x7f12f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12f8034650 0x7f12f8036b10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f140401e560 tx=0x7f140401e4b0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.533 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 msgr2=0x560503ad3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503ad3e60 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x560503acdc70 tx=0x7f1404000f50 comp rx=0 tx=0).stop 2024-09-11T11:03:13.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 shutdown_connections 2024-09-11T11:03:13.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x560503b099f0 0x560503b0bde0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f12f8034650 0x7f12f8036b10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 --2- 172.21.15.145:0/714091483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5605039dfaa0 0x560503ad3e60 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 >> 172.21.15.145:0/714091483 conn(0x5605039db780 msgr2=0x560503ac7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 shutdown_connections 2024-09-11T11:03:13.534 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.525+0000 7f14136e0980 1 -- 172.21.15.145:0/714091483 wait complete. 2024-09-11T11:03:13.539 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"27698d38-fc40-410e-96d8-191ffc71147c","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-11T11:03:13.539 DEBUG:tasks.util.rgw: json result: {'id': '27698d38-fc40-410e-96d8-191ffc71147c', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-11T11:03:13.539 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-11T11:03:13.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-11T11:03:13.539 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-11T11:03:13.613 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:13.613 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:13.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3322e2a980 1 Processor -- start 2024-09-11T11:03:13.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3322e2a980 1 -- start start 2024-09-11T11:03:13.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3322e2a980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f5219f3a80 0x55f5219f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3322e2a980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f521877ae0 con 0x55f521963ab0 2024-09-11T11:03:13.615 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3322e2a980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55f52189be30 con 0x55f5219f3a80 2024-09-11T11:03:13.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3320139640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f5219f3a80 0x55f5219f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3320139640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55f5219f3a80 0x55f5219f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37562/0 (socket says 172.21.15.145:37562) 2024-09-11T11:03:13.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3320139640 1 -- 172.21.15.145:0/2202494100 learned_addr learned my addr 172.21.15.145:0/2202494100 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3320139640 1 -- 172.21.15.145:0/2202494100 >> v1:172.21.15.102:6789/0 conn(0x55f521963ab0 legacy=0x55f5219f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.616 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.613+0000 7f3320139640 1 -- 172.21.15.145:0/2202494100 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5219f73c0 con 0x55f5219f3a80 2024-09-11T11:03:13.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f3320139640 1 --2- 172.21.15.145:0/2202494100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 0x55f5219f5e70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f330800a4e0 tx=0x7f330801b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794f443a20d56d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f331f938640 1 -- 172.21.15.145:0/2202494100 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33080aa540 con 0x55f5219f3a80 2024-09-11T11:03:13.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f331f938640 1 -- 172.21.15.145:0/2202494100 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33080aa6e0 con 0x55f5219f3a80 2024-09-11T11:03:13.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f331f938640 1 -- 172.21.15.145:0/2202494100 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33080aaa40 con 0x55f5219f3a80 2024-09-11T11:03:13.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f3322e2a980 1 -- 172.21.15.145:0/2202494100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 msgr2=0x55f5219f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f3322e2a980 1 --2- 172.21.15.145:0/2202494100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 0x55f5219f5e70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f330800a4e0 tx=0x7f330801b090 comp rx=0 tx=0).stop 2024-09-11T11:03:13.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f3322e2a980 1 -- 172.21.15.145:0/2202494100 shutdown_connections 2024-09-11T11:03:13.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f3322e2a980 1 --2- 172.21.15.145:0/2202494100 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 0x55f5219f5e70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f3322e2a980 1 -- 172.21.15.145:0/2202494100 >> 172.21.15.145:0/2202494100 conn(0x55f5219ea050 msgr2=0x55f5219ec470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f3322e2a980 1 -- 172.21.15.145:0/2202494100 shutdown_connections 2024-09-11T11:03:13.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.617+0000 7f3322e2a980 1 -- 172.21.15.145:0/2202494100 wait complete. 2024-09-11T11:03:13.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f3322e2a980 1 Processor -- start 2024-09-11T11:03:13.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f3322e2a980 1 -- start start 2024-09-11T11:03:13.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f3322e2a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521963ab0 0x55f521adaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f3322e2a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f52189d200 con 0x55f521963ab0 2024-09-11T11:03:13.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f332093a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521963ab0 0x55f521adaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f332093a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521963ab0 0x55f521adaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37570/0 (socket says 172.21.15.145:37570) 2024-09-11T11:03:13.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f332093a640 1 -- 172.21.15.145:0/1883340050 learned_addr learned my addr 172.21.15.145:0/1883340050 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f332093a640 1 -- 172.21.15.145:0/1883340050 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f521adb020 con 0x55f521963ab0 2024-09-11T11:03:13.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f332093a640 1 --2- 172.21.15.145:0/1883340050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521963ab0 0x55f521adaa50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f331000b1f0 tx=0x7f331000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c1dc41a9c1f502 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.629+0000 7f320ee0d640 1 -- 172.21.15.145:0/1883340050 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f331000a040 con 0x55f521963ab0 2024-09-11T11:03:13.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f320ee0d640 1 -- 172.21.15.145:0/1883340050 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331000f750 con 0x55f521963ab0 2024-09-11T11:03:13.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f320ee0d640 1 -- 172.21.15.145:0/1883340050 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f331000fa70 con 0x55f521963ab0 2024-09-11T11:03:13.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- 172.21.15.145:0/1883340050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521963ab0 msgr2=0x55f521adaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1883340050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521963ab0 0x55f521adaa50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f331000b1f0 tx=0x7f331000b6b0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- 172.21.15.145:0/1883340050 shutdown_connections 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1883340050 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521963ab0 0x55f521adaa50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- 172.21.15.145:0/1883340050 >> 172.21.15.145:0/1883340050 conn(0x55f5219ea050 msgr2=0x55f521ad6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- 172.21.15.145:0/1883340050 shutdown_connections 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- 172.21.15.145:0/1883340050 wait complete. 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 Processor -- start 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- start start 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 0x55f521ae2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f5219f6e00 con 0x55f5219f3a80 2024-09-11T11:03:13.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f332093a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 0x55f521ae2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f332093a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 0x55f521ae2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37580/0 (socket says 172.21.15.145:37580) 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f332093a640 1 -- 172.21.15.145:0/1132700279 learned_addr learned my addr 172.21.15.145:0/1132700279 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f332093a640 1 -- 172.21.15.145:0/1132700279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f521ae25b0 con 0x55f5219f3a80 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f332093a640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 0x55f521ae2070 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f331000b6f0 tx=0x7f3310000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f320d60a640 1 -- 172.21.15.145:0/1132700279 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3310001300 con 0x55f5219f3a80 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f521ae2840 con 0x55f5219f3a80 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f320d60a640 1 -- 172.21.15.145:0/1132700279 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f331001c920 con 0x55f5219f3a80 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f320d60a640 1 -- 172.21.15.145:0/1132700279 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f331001cc00 con 0x55f5219f3a80 2024-09-11T11:03:13.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f521ae5520 con 0x55f5219f3a80 2024-09-11T11:03:13.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 Processor -- start 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- start start 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521aef670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.633+0000 7f3322e2a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f5218f6800 con 0x55f521aef270 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521aef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f320d60a640 1 -- 172.21.15.145:0/1132700279 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3310017050 con 0x55f5219f3a80 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521aef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37594/0 (socket says 172.21.15.145:37594) 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 -- 172.21.15.145:0/1520731547 learned_addr learned my addr 172.21.15.145:0/1520731547 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f320d60a640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3208034650 0x7f3208036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f320d60a640 1 -- 172.21.15.145:0/1132700279 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f3310015020 con 0x55f5219f3a80 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332093a640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3208034650 0x7f3208036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 -- 172.21.15.145:0/1520731547 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f521aefbb0 con 0x55f521aef270 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332093a640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3208034650 0x7f3208036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f331001d5c0 tx=0x7f331001d450 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 --2- 172.21.15.145:0/1520731547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521aef670 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f331800a440 tx=0x7f331800a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3f284c1be13aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3206ffd640 1 -- 172.21.15.145:0/1520731547 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3318008850 con 0x55f521aef270 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3206ffd640 1 -- 172.21.15.145:0/1520731547 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3318008a10 con 0x55f521aef270 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3206ffd640 1 -- 172.21.15.145:0/1520731547 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3318008d30 con 0x55f521aef270 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- 172.21.15.145:0/1520731547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 msgr2=0x55f521aef670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1520731547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521aef670 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f331800a440 tx=0x7f331800a900 comp rx=0 tx=0).stop 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- 172.21.15.145:0/1520731547 shutdown_connections 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1520731547 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521aef670 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- 172.21.15.145:0/1520731547 >> 172.21.15.145:0/1520731547 conn(0x55f521aea770 msgr2=0x55f521aed5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- 172.21.15.145:0/1520731547 shutdown_connections 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- 172.21.15.145:0/1520731547 wait complete. 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 Processor -- start 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- start start 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521af65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f521aefe40 con 0x55f521aef270 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521af65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521af65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37608/0 (socket says 172.21.15.145:37608) 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 -- 172.21.15.145:0/545136716 learned_addr learned my addr 172.21.15.145:0/545136716 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 -- 172.21.15.145:0/545136716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f521af6ae0 con 0x55f521aef270 2024-09-11T11:03:13.646 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f332113b640 1 --2- 172.21.15.145:0/545136716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521af65a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55f521af0020 tx=0x7f3318003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f32057fa640 1 -- 172.21.15.145:0/545136716 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3318013a70 con 0x55f521aef270 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f32057fa640 1 -- 172.21.15.145:0/545136716 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3318023070 con 0x55f521aef270 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- 172.21.15.145:0/545136716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f521af6d70 con 0x55f521aef270 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f32057fa640 1 -- 172.21.15.145:0/545136716 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3318013d40 con 0x55f521aef270 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.637+0000 7f3322e2a980 1 -- 172.21.15.145:0/545136716 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f521af9a50 con 0x55f521aef270 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f32057fa640 1 -- 172.21.15.145:0/545136716 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3318028460 con 0x55f521aef270 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f3322e2a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f3322e2a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f32057fa640 1 --2- 172.21.15.145:0/545136716 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f31f8034650 0x7f31f8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f32057fa640 1 -- 172.21.15.145:0/545136716 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f3318049fc0 con 0x55f521aef270 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f3322e2a980 1 Processor -- start 2024-09-11T11:03:13.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f332113b640 1 --2- 172.21.15.145:0/545136716 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f31f8034650 0x7f31f8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f3322e2a980 1 -- start start 2024-09-11T11:03:13.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f3322e2a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521b0fec0 0x55f521b102e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f3322e2a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55f521adb3a0 con 0x55f521b0fec0 2024-09-11T11:03:13.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f332113b640 1 --2- 172.21.15.145:0/545136716 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f31f8034650 0x7f31f8036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3318013fd0 tx=0x7f3318013f60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f332093a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521b0fec0 0x55f521b102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f332093a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521b0fec0 0x55f521b102e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37624/0 (socket says 172.21.15.145:37624) 2024-09-11T11:03:13.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f332093a640 1 -- 172.21.15.145:0/3482925963 learned_addr learned my addr 172.21.15.145:0/3482925963 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f332093a640 1 -- 172.21.15.145:0/3482925963 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f521b108b0 con 0x55f521b0fec0 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f332093a640 1 --2- 172.21.15.145:0/3482925963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521b0fec0 0x55f521b102e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3310001720 tx=0x7f331000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f31e57e2640 1 -- 172.21.15.145:0/3482925963 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f331001ad20 con 0x55f521b0fec0 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f3322e2a980 1 -- 172.21.15.145:0/3482925963 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f521b13460 con 0x55f521b0fec0 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f31e57e2640 1 -- 172.21.15.145:0/3482925963 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33100199d0 con 0x55f521b0fec0 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f31e57e2640 1 -- 172.21.15.145:0/3482925963 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33100485f0 con 0x55f521b0fec0 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.641+0000 7f3322e2a980 1 -- 172.21.15.145:0/3482925963 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f521b13810 con 0x55f521b0fec0 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f31e57e2640 1 -- 172.21.15.145:0/3482925963 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3310048820 con 0x55f521b0fec0 2024-09-11T11:03:13.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f31e57e2640 1 --2- 172.21.15.145:0/3482925963 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c034650 0x7f315c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f31e57e2640 1 -- 172.21.15.145:0/3482925963 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f3310038070 con 0x55f521b0fec0 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3320139640 1 --2- 172.21.15.145:0/3482925963 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c034650 0x7f315c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3166ffd640 20 reqs_thread_entry: start 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f521b159d0 0x55f521b17dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f521b18440 con 0x55f521b159d0 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3320139640 1 --2- 172.21.15.145:0/3482925963 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c034650 0x7f315c036b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f33080ab000 tx=0x7f33080a5000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f332113b640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f521b159d0 0x55f521b17dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f332113b640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f521b159d0 0x55f521b17dc0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f332113b640 1 -- 172.21.15.145:0/1132700279 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f331801e7a0 con 0x55f521b159d0 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f521b19010 0x55f521b1b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f521b1bbb0 con 0x55f521b19010 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f332093a640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f521b19010 0x55f521b1b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f332093a640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f521b19010 0x55f521b1b4d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f332093a640 1 -- 172.21.15.145:0/1132700279 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f331004c020 con 0x55f521b19010 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f521b1d920 0x55f521b1fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:3 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55f521b20410 con 0x55f521b1d920 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3320139640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f521b1d920 0x55f521b1fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3320139640 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f521b1d920 0x55f521b1fd10 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.645+0000 7f3320139640 1 -- 172.21.15.145:0/1132700279 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(3 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f33080bc040 con 0x55f521b1d920 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/545136716 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f31f8034650 msgr2=0x7f31f8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/545136716 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f31f8034650 0x7f31f8036b10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3318013fd0 tx=0x7f3318013f60 comp rx=0 tx=0).stop 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/545136716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 msgr2=0x55f521af65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/545136716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521af65a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x55f521af0020 tx=0x7f3318003000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/545136716 shutdown_connections 2024-09-11T11:03:13.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/545136716 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f31f8034650 0x7f31f8036b10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/545136716 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521aef270 0x55f521af65a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/545136716 >> 172.21.15.145:0/545136716 conn(0x55f521aea770 msgr2=0x55f521ae8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/545136716 shutdown_connections 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/545136716 wait complete. 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/3482925963 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c034650 msgr2=0x7f315c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/3482925963 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c034650 0x7f315c036b10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f33080ab000 tx=0x7f33080a5000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/3482925963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521b0fec0 msgr2=0x55f521b102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/3482925963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521b0fec0 0x55f521b102e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3310001720 tx=0x7f331000ef90 comp rx=0 tx=0).stop 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/3482925963 shutdown_connections 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/3482925963 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c034650 0x7f315c036b10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/3482925963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f521b0fec0 0x55f521b102e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/3482925963 >> 172.21.15.145:0/3482925963 conn(0x55f521b04e90 msgr2=0x55f521b07780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/3482925963 shutdown_connections 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/3482925963 wait complete. 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f521b19010 msgr2=0x55f521b1b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55f521b19010 0x55f521b1b4d0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f521b159d0 msgr2=0x55f521b17dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55f521b159d0 0x55f521b17dc0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f521b1d920 msgr2=0x55f521b1fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55f521b1d920 0x55f521b1fd10 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3208034650 msgr2=0x7f3208036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3208034650 0x7f3208036b10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f331001d5c0 tx=0x7f331001d450 comp rx=0 tx=0).stop 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 msgr2=0x55f521ae2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 --2- 172.21.15.145:0/1132700279 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55f5219f3a80 0x55f521ae2070 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f331000b6f0 tx=0x7f3310000ee0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.657 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f332113b640 1 -- 172.21.15.145:0/1132700279 reap_dead start 2024-09-11T11:03:13.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 shutdown_connections 2024-09-11T11:03:13.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 >> 172.21.15.145:0/1132700279 conn(0x55f5219ea050 msgr2=0x55f521ad5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 shutdown_connections 2024-09-11T11:03:13.658 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.649+0000 7f3322e2a980 1 -- 172.21.15.145:0/1132700279 wait complete. 2024-09-11T11:03:13.660 INFO:teuthology.orchestra.run.smithi145.stdout:{"id":"2267e615-29e0-4503-94c5-a003ba7e8ee3","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"27698d38-fc40-410e-96d8-191ffc71147c","zones":[{"id":"27698d38-fc40-410e-96d8-191ffc71147c","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-11T11:03:13.661 DEBUG:tasks.util.rgw: json result: {'id': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '27698d38-fc40-410e-96d8-191ffc71147c', 'zones': [{'id': '27698d38-fc40-410e-96d8-191ffc71147c', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-11T11:03:13.664 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-11T11:03:13.682 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-11T11:03:13.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-11T11:03:13.682 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-11T11:03:13.747 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:13.748 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:13.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87fc75980 1 Processor -- start 2024-09-11T11:03:13.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87fc75980 1 -- start start 2024-09-11T11:03:13.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87fc75980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x561d18bb1630 0x561d18bb1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87fc75980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561d18a39ae0 con 0x561d18bb1f80 2024-09-11T11:03:13.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87fc75980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x561d18a5de30 con 0x561d18bb1630 2024-09-11T11:03:13.749 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87d785640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x561d18bb1630 0x561d18bb1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87d785640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x561d18bb1630 0x561d18bb1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37628/0 (socket says 172.21.15.145:37628) 2024-09-11T11:03:13.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87d785640 1 -- 172.21.15.145:0/2624490258 learned_addr learned my addr 172.21.15.145:0/2624490258 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87d785640 1 -- 172.21.15.145:0/2624490258 >> v1:172.21.15.102:6789/0 conn(0x561d18bb1f80 legacy=0x561d18bb69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.745+0000 7fb87d785640 1 -- 172.21.15.145:0/2624490258 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d18bb9200 con 0x561d18bb1630 2024-09-11T11:03:13.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb87d785640 1 --2- 172.21.15.145:0/2624490258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18bb1a10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a4e0 tx=0x7fb87001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105abdcb295a101b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb877fff640 1 -- 172.21.15.145:0/2624490258 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700aa540 con 0x561d18bb1630 2024-09-11T11:03:13.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb877fff640 1 -- 172.21.15.145:0/2624490258 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700aa6e0 con 0x561d18bb1630 2024-09-11T11:03:13.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb877fff640 1 -- 172.21.15.145:0/2624490258 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700aaa40 con 0x561d18bb1630 2024-09-11T11:03:13.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb87fc75980 1 -- 172.21.15.145:0/2624490258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 msgr2=0x561d18bb1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb87fc75980 1 --2- 172.21.15.145:0/2624490258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18bb1a10 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb87000a4e0 tx=0x7fb87001b090 comp rx=0 tx=0).stop 2024-09-11T11:03:13.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb87fc75980 1 -- 172.21.15.145:0/2624490258 shutdown_connections 2024-09-11T11:03:13.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb87fc75980 1 --2- 172.21.15.145:0/2624490258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18bb1a10 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb87fc75980 1 -- 172.21.15.145:0/2624490258 >> 172.21.15.145:0/2624490258 conn(0x561d18bad150 msgr2=0x561d18baf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb87fc75980 1 -- 172.21.15.145:0/2624490258 shutdown_connections 2024-09-11T11:03:13.753 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.749+0000 7fb87fc75980 1 -- 172.21.15.145:0/2624490258 wait complete. 2024-09-11T11:03:13.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 Processor -- start 2024-09-11T11:03:13.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- start start 2024-09-11T11:03:13.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18b28310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561d18a5f200 con 0x561d18bb1630 2024-09-11T11:03:13.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18b28310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18b28310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37642/0 (socket says 172.21.15.145:37642) 2024-09-11T11:03:13.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87d785640 1 -- 172.21.15.145:0/940088153 learned_addr learned my addr 172.21.15.145:0/940088153 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87d785640 1 -- 172.21.15.145:0/940088153 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d18b288e0 con 0x561d18bb1630 2024-09-11T11:03:13.767 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87d785640 1 --2- 172.21.15.145:0/940088153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18b28310 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb870017ca0 tx=0x7fb8700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44dd4bb325b5c7fa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb76b606640 1 -- 172.21.15.145:0/940088153 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700b9030 con 0x561d18bb1630 2024-09-11T11:03:13.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb76b606640 1 -- 172.21.15.145:0/940088153 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700aaac0 con 0x561d18bb1630 2024-09-11T11:03:13.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb76b606640 1 -- 172.21.15.145:0/940088153 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700aada0 con 0x561d18bb1630 2024-09-11T11:03:13.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- 172.21.15.145:0/940088153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 msgr2=0x561d18b28310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 --2- 172.21.15.145:0/940088153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18b28310 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb870017ca0 tx=0x7fb8700033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- 172.21.15.145:0/940088153 shutdown_connections 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 --2- 172.21.15.145:0/940088153 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18b28310 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- 172.21.15.145:0/940088153 >> 172.21.15.145:0/940088153 conn(0x561d18bad150 msgr2=0x561d18c986c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- 172.21.15.145:0/940088153 shutdown_connections 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- 172.21.15.145:0/940088153 wait complete. 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 Processor -- start 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- start start 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18ca5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87fc75980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561d18bb8c40 con 0x561d18bb1630 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18ca5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18ca5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37650/0 (socket says 172.21.15.145:37650) 2024-09-11T11:03:13.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.765+0000 7fb87d785640 1 -- 172.21.15.145:0/489815354 learned_addr learned my addr 172.21.15.145:0/489815354 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87d785640 1 -- 172.21.15.145:0/489815354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d18ca6450 con 0x561d18bb1630 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87d785640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18ca5f10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb870005cc0 tx=0x7fb870017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb769e03640 1 -- 172.21.15.145:0/489815354 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700b9030 con 0x561d18bb1630 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d18ca66e0 con 0x561d18bb1630 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb769e03640 1 -- 172.21.15.145:0/489815354 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700c3070 con 0x561d18bb1630 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb769e03640 1 -- 172.21.15.145:0/489815354 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700bf750 con 0x561d18bb1630 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d18ca93c0 con 0x561d18bb1630 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb769e03640 1 -- 172.21.15.145:0/489815354 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8700c5030 con 0x561d18bb1630 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb769e03640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb764034650 0x7fb764036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb769e03640 1 -- 172.21.15.145:0/489815354 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fb8700ba070 con 0x561d18bb1630 2024-09-11T11:03:13.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87cf84640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb764034650 0x7fb764036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87fc75980 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18bb1f80 0x561d18cad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cad550 con 0x561d18bb1f80 2024-09-11T11:03:13.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87df86640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18bb1f80 0x561d18cad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87cf84640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb764034650 0x7fb764036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb868000f70 tx=0x7fb868001420 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87df86640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18bb1f80 0x561d18cad010 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87df86640 1 -- 172.21.15.145:0/489815354 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18bb1f80 2024-09-11T11:03:13.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87fc75980 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18cae330 0x561d18cb0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cb0d60 con 0x561d18cae330 2024-09-11T11:03:13.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87d785640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18cae330 0x561d18cb0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.769+0000 7fb87d785640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18cae330 0x561d18cb0720 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87d785640 1 -- 172.21.15.145:0/489815354 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8700ce070 con 0x561d18cae330 2024-09-11T11:03:13.775 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cb2610 con 0x561d18cae330 2024-09-11T11:03:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87d785640 1 -- 172.21.15.145:0/489815354 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb8700ce070 con 0x561d18cae330 2024-09-11T11:03:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cb1840 con 0x561d18cae330 2024-09-11T11:03:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87d785640 1 -- 172.21.15.145:0/489815354 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8700ce070 con 0x561d18cae330 2024-09-11T11:03:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87fc75980 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561d18cb39c0 0x561d18cb5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cb62f0 con 0x561d18cb39c0 2024-09-11T11:03:13.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87cf84640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561d18cb39c0 0x561d18cb5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87cf84640 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561d18cb39c0 0x561d18cb5db0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87cf84640 1 -- 172.21.15.145:0/489815354 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb86800d040 con 0x561d18cb39c0 2024-09-11T11:03:13.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87fc75980 1 Processor -- start 2024-09-11T11:03:13.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87fc75980 1 -- start start 2024-09-11T11:03:13.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87fc75980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cc3d80 0x561d18cc41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87fc75980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561d18ab8800 con 0x561d18cc3d80 2024-09-11T11:03:13.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cc3d80 0x561d18cc41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cc3d80 0x561d18cc41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37658/0 (socket says 172.21.15.145:37658) 2024-09-11T11:03:13.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.773+0000 7fb87d785640 1 -- 172.21.15.145:0/1330664487 learned_addr learned my addr 172.21.15.145:0/1330664487 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87d785640 1 -- 172.21.15.145:0/1330664487 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d18cc46e0 con 0x561d18cc3d80 2024-09-11T11:03:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87d785640 1 --2- 172.21.15.145:0/1330664487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cc3d80 0x561d18cc41a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb8700e35a0 tx=0x7fb8700c6d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb762ffd640 1 -- 172.21.15.145:0/1330664487 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700bfd00 con 0x561d18cc3d80 2024-09-11T11:03:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87fc75980 1 -- 172.21.15.145:0/1330664487 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d18cc4970 con 0x561d18cc3d80 2024-09-11T11:03:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb762ffd640 1 -- 172.21.15.145:0/1330664487 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700b43a0 con 0x561d18cc3d80 2024-09-11T11:03:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb762ffd640 1 -- 172.21.15.145:0/1330664487 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700b4680 con 0x561d18cc3d80 2024-09-11T11:03:13.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87fc75980 1 -- 172.21.15.145:0/1330664487 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d18cc75f0 con 0x561d18cc3d80 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb762ffd640 1 -- 172.21.15.145:0/1330664487 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8700b3040 con 0x561d18cc3d80 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb762ffd640 1 --2- 172.21.15.145:0/1330664487 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7540345b0 0x7fb754036a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb762ffd640 1 -- 172.21.15.145:0/1330664487 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fb8700e4e30 con 0x561d18cc3d80 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87cf84640 1 --2- 172.21.15.145:0/1330664487 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7540345b0 0x7fb754036a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87fc75980 1 Processor -- start 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87fc75980 1 -- start start 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87fc75980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87fc75980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561d18b26a40 con 0x561d18cd0670 2024-09-11T11:03:13.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87cf84640 1 --2- 172.21.15.145:0/1330664487 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7540345b0 0x7fb754036a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561d18cb66f0 tx=0x7fb868006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37674/0 (socket says 172.21.15.145:37674) 2024-09-11T11:03:13.782 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87d785640 1 -- 172.21.15.145:0/2456477241 learned_addr learned my addr 172.21.15.145:0/2456477241 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87d785640 1 -- 172.21.15.145:0/2456477241 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d18cd1020 con 0x561d18cd0670 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.777+0000 7fb87d785640 1 --2- 172.21.15.145:0/2456477241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd0a50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb8700e5210 tx=0x7fb8700c1f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a980f7f5fee901 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb760ff9640 1 -- 172.21.15.145:0/2456477241 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700d03e0 con 0x561d18cd0670 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb760ff9640 1 -- 172.21.15.145:0/2456477241 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700d1e10 con 0x561d18cd0670 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb760ff9640 1 -- 172.21.15.145:0/2456477241 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700d4b50 con 0x561d18cd0670 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- 172.21.15.145:0/2456477241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 msgr2=0x561d18cd0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 --2- 172.21.15.145:0/2456477241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd0a50 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb8700e5210 tx=0x7fb8700c1f50 comp rx=0 tx=0).stop 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- 172.21.15.145:0/2456477241 shutdown_connections 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 --2- 172.21.15.145:0/2456477241 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd0a50 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- 172.21.15.145:0/2456477241 >> 172.21.15.145:0/2456477241 conn(0x561d18ccca50 msgr2=0x561d18ccab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- 172.21.15.145:0/2456477241 shutdown_connections 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- 172.21.15.145:0/2456477241 wait complete. 2024-09-11T11:03:13.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 Processor -- start 2024-09-11T11:03:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- start start 2024-09-11T11:03:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x561d18cd14c0 con 0x561d18cd0670 2024-09-11T11:03:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87d785640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37684/0 (socket says 172.21.15.145:37684) 2024-09-11T11:03:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 learned_addr learned my addr 172.21.15.145:0/3900885697 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.785 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d18cd7d10 con 0x561d18cd0670 2024-09-11T11:03:13.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87d785640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd77d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb8700e5210 tx=0x7fb8700c6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb752ffd640 1 -- 172.21.15.145:0/3900885697 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700f5040 con 0x561d18cd0670 2024-09-11T11:03:13.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561d18cd7d10 con 0x561d18cd0670 2024-09-11T11:03:13.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d18cd81e0 con 0x561d18cd0670 2024-09-11T11:03:13.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb752ffd640 1 -- 172.21.15.145:0/3900885697 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8700d03e0 con 0x561d18cd0670 2024-09-11T11:03:13.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb752ffd640 1 -- 172.21.15.145:0/3900885697 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8700ebad0 con 0x561d18cd0670 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb752ffd640 1 -- 172.21.15.145:0/3900885697 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fb8700ebc70 con 0x561d18cd0670 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.781+0000 7fb752ffd640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7480346a0 0x7fb748036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb752ffd640 1 -- 172.21.15.145:0/3900885697 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fb8700f8030 con 0x561d18cd0670 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87cf84640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7480346a0 0x7fb748036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18ce2950 0x561d18ce4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18ce5560 con 0x561d18ce2950 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87df86640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18ce2950 0x561d18ce4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87cf84640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7480346a0 0x7fb748036b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb8680207d0 tx=0x7fb868011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87df86640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18ce2950 0x561d18ce4e10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 realm 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18ce1d80 con 0x561d18ce2950 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18ce6030 con 0x561d18ce2950 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18ce6e10 0x561d18ce9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18ce9890 con 0x561d18ce6e10 2024-09-11T11:03:13.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87d785640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18ce6e10 0x561d18ce9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87d785640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18ce6e10 0x561d18ce9200 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8700dd020 con 0x561d18ce6e10 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.785+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cea0e0 con 0x561d18ce6e10 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb8700dd020 con 0x561d18ce6e10 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87fc75980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87fc75980 20 searching for the correct realm 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561d18cebe50 0x561d18cee240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18cebe50 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87cf84640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561d18cebe50 0x561d18cee240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87cf84640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561d18cebe50 0x561d18cee240 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb8700dd020 con 0x561d18ce6e10 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87d785640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8700f1460 0x7fb8700c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x7fb8700f1460 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8700f1460 0x7fb8700c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8700f1460 0x7fb8700c10e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18cebe50 2024-09-11T11:03:13.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.796 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.789+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8700dd020 con 0x561d18ce6e10 2024-09-11T11:03:13.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8700dd020 con 0x561d18ce6e10 2024-09-11T11:03:13.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x7fb8700f1460 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x7fb8700f1460 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18cebe50 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.793+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18cebe50 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18cebe50 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x7fb8700f1460 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce2950 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x7fb8700f1460 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18cebe50 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x7fb8700f1460 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.803 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18cebe50 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.797+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x561d18cee8c0 con 0x561d18ce6e10 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18ceaa90 con 0x561d18ce2950 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cea6d0 con 0x561d18ce6e10 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18ceb430 con 0x7fb8700f1460 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 zone default found 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 4 Realm: () 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 zonegroup default 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cef1f0 con 0x7fb8700f1460 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf1470 con 0x561d18cebe50 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf1810 con 0x561d18cebe50 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 started sync module instance, tier type = 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:13.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.801+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf0900 con 0x561d18ce6e10 2024-09-11T11:03:13.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.805+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.805+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94682970263040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf0900 con 0x561d18ce6e10 2024-09-11T11:03:13.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.805+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf2260 con 0x561d18ce2950 2024-09-11T11:03:13.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.805+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.805+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94682970266992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf2190 con 0x561d18ce2950 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.805+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf3160 con 0x561d18ce6e10 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.805+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94682970263040] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94682970266992] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94682970269264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf2c70 con 0x561d18ce6e10 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf3a30 con 0x7fb8700f1460 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94682970273152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf2c70 con 0x7fb8700f1460 2024-09-11T11:03:13.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf44b0 con 0x561d18ce6e10 2024-09-11T11:03:13.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94682970273152] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.809+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94682970269264] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94682970260560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf3fc0 con 0x561d18ce6e10 2024-09-11T11:03:13.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf4d50 con 0x561d18cebe50 2024-09-11T11:03:13.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94682970278048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf3fc0 con 0x561d18cebe50 2024-09-11T11:03:13.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf5bc0 con 0x561d18cebe50 2024-09-11T11:03:13.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94682970260560] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94682970278048] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94682970280176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf5710 con 0x561d18cebe50 2024-09-11T11:03:13.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf5f60 con 0x7fb8700f1460 2024-09-11T11:03:13.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.813+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94682970280176] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94682970281744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf6350 con 0x7fb8700f1460 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 20 add_watcher() i=0 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 20 add_watcher() i=1 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 20 add_watcher() i=2 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 20 add_watcher() i=3 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 20 add_watcher() i=4 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 20 add_watcher() i=5 2024-09-11T11:03:13.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 20 add_watcher() i=6 2024-09-11T11:03:13.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94682970281744] v36'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 20 add_watcher() i=7 2024-09-11T11:03:13.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:13.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf94c0 con 0x561d18ce2950 2024-09-11T11:03:13.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.817+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94682970283472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf67b0 con 0x561d18ce2950 2024-09-11T11:03:13.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94682970283472] v36'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb7337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:13.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 5 note: GC not initialized 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb7327e4640 20 reqs_thread_entry: start 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 20 Filter name: none 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb6a3fff640 20 reqs_thread_entry: start 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18d1cb50 con 0x561d18ce2950 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 20 rados->read ofs=0 len=0 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18d1b2f0 con 0x561d18ce2950 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-11T11:03:13.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18d1bcf0 con 0x561d18ce2950 2024-09-11T11:03:13.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v36'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:13.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:13.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:13.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94682970437392 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18d206b0 con 0x561d18ce6e10 2024-09-11T11:03:13.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94682970260560 notify 154618822703 ret 0) ==== 691+0+0 (crc 0 0 0) 0x561d18cc4970 con 0x561d18ce6e10 2024-09-11T11:03:13.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb760ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822703 cookie 94682970260560 notifier 4836 bl.length()=649 2024-09-11T11:03:13.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb760ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb760ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb760ff9640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb740003eb0 con 0x561d18ce6e10 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(65 notify.4 [notify cookie 94682970437392 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.821+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94682970437392 notify 154618822703 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561d18cc46e0 con 0x561d18ce6e10 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18d1b710 con 0x561d18ce2950 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v36'22 uv22 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87fc75980 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87fc75980 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87fc75980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-11T11:03:13.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94682970437312 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x561d18d20ae0 con 0x561d18ce6e10 2024-09-11T11:03:13.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify (1) cookie 94682970269264 notify 154618822704 ret 0) ==== 219+0+0 (crc 0 0 0) 0x561d18cc46e0 con 0x561d18ce6e10 2024-09-11T11:03:13.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb753fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822704 cookie 94682970269264 notifier 4836 bl.length()=177 2024-09-11T11:03:13.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb753fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-11T11:03:13.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb753fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-11T11:03:13.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb753fff640 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fb6b0003410 con 0x561d18ce6e10 2024-09-11T11:03:13.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(68 notify.2 [notify cookie 94682970437312 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== watch-notify(notify_complete (2) cookie 94682970437312 notify 154618822704 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561d18ca93c0 con 0x561d18ce6e10 2024-09-11T11:03:13.830 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:13.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb7337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:13.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.825+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94682970283472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18d1a8f0 con 0x561d18ce2950 2024-09-11T11:03:13.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.829+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94682970283472] v36'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.831 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.829+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94682970263040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18d1a8f0 con 0x561d18ce6e10 2024-09-11T11:03:13.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.829+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94682970263040] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.829+0000 7fb87fc75980 20 remove_watcher() i=0 2024-09-11T11:03:13.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.829+0000 7fb87fc75980 2 removed watcher, disabling cache 2024-09-11T11:03:13.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.829+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94682970266992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf0e00 con 0x561d18ce2950 2024-09-11T11:03:13.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94682970266992] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x561d18ce2950 2024-09-11T11:03:13.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87fc75980 20 remove_watcher() i=1 2024-09-11T11:03:13.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94682970269264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18d1a8f0 con 0x561d18ce6e10 2024-09-11T11:03:13.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94682970269264] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87fc75980 20 remove_watcher() i=2 2024-09-11T11:03:13.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94682970273152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf1d70 con 0x7fb8700f1460 2024-09-11T11:03:13.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94682970273152] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87fc75980 20 remove_watcher() i=3 2024-09-11T11:03:13.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.833+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94682970260560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf0e00 con 0x561d18ce6e10 2024-09-11T11:03:13.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87d785640 1 -- 172.21.15.145:0/3900885697 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94682970260560] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb870124040 con 0x561d18ce6e10 2024-09-11T11:03:13.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87fc75980 20 remove_watcher() i=4 2024-09-11T11:03:13.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94682970278048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf2650 con 0x561d18cebe50 2024-09-11T11:03:13.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94682970278048] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87fc75980 20 remove_watcher() i=5 2024-09-11T11:03:13.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94682970280176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18d1a8f0 con 0x561d18cebe50 2024-09-11T11:03:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87cf84640 1 -- 172.21.15.145:0/3900885697 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94682970280176] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb868036040 con 0x561d18cebe50 2024-09-11T11:03:13.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87fc75980 20 remove_watcher() i=6 2024-09-11T11:03:13.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.837+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94682970281744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x561d18cf3580 con 0x7fb8700f1460 2024-09-11T11:03:13.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94682970281744] v36'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8780083f0 con 0x7fb8700f1460 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 20 remove_watcher() i=7 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18ce6e10 msgr2=0x561d18ce9200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18ce6e10 0x561d18ce9200 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18ce2950 msgr2=0x561d18ce4e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18ce2950 0x561d18ce4e10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8700f1460 msgr2=0x7fb8700c10e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fb8700f1460 0x7fb8700c10e0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561d18cebe50 msgr2=0x561d18cee240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x561d18cebe50 0x561d18cee240 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7480346a0 msgr2=0x7fb748036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7480346a0 0x7fb748036b60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb8680207d0 tx=0x7fb868011000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87df86640 1 -- 172.21.15.145:0/3900885697 reap_dead start 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 msgr2=0x561d18cd77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd77d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb8700e5210 tx=0x7fb8700c6000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 shutdown_connections 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/3900885697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cd0670 0x561d18cd77d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 >> 172.21.15.145:0/3900885697 conn(0x561d18ccca50 msgr2=0x561d18ccab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 shutdown_connections 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/3900885697 wait complete. 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/1330664487 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7540345b0 msgr2=0x7fb754036a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/1330664487 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7540345b0 0x7fb754036a70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x561d18cb66f0 tx=0x7fb868006000 comp rx=0 tx=0).stop 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/1330664487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cc3d80 msgr2=0x561d18cc41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/1330664487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cc3d80 0x561d18cc41a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb8700e35a0 tx=0x7fb8700c6d30 comp rx=0 tx=0).stop 2024-09-11T11:03:13.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/1330664487 shutdown_connections 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/1330664487 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb7540345b0 0x7fb754036a70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/1330664487 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18cc3d80 0x561d18cc41a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/1330664487 >> 172.21.15.145:0/1330664487 conn(0x561d18cb8ed0 msgr2=0x561d18cbb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/1330664487 shutdown_connections 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/1330664487 wait complete. 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18cae330 msgr2=0x561d18cb0720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x561d18cae330 0x561d18cb0720 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18bb1f80 msgr2=0x561d18cad010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x561d18bb1f80 0x561d18cad010 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561d18cb39c0 msgr2=0x561d18cb5db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x561d18cb39c0 0x561d18cb5db0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb764034650 msgr2=0x7fb764036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fb764034650 0x7fb764036b10 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb868000f70 tx=0x7fb868001420 comp rx=0 tx=0).stop 2024-09-11T11:03:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 msgr2=0x561d18ca5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 --2- 172.21.15.145:0/489815354 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x561d18bb1630 0x561d18ca5f10 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb870005cc0 tx=0x7fb870017e30 comp rx=0 tx=0).stop 2024-09-11T11:03:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87df86640 1 -- 172.21.15.145:0/489815354 reap_dead start 2024-09-11T11:03:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 shutdown_connections 2024-09-11T11:03:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 >> 172.21.15.145:0/489815354 conn(0x561d18bad150 msgr2=0x561d18c98300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 shutdown_connections 2024-09-11T11:03:13.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.841+0000 7fb87fc75980 1 -- 172.21.15.145:0/489815354 wait complete. 2024-09-11T11:03:13.853 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:13.854 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:13.854 ERROR:root:0 2024-09-11T11:03:13.855 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:13.861 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000429c36f131467f95-0066e178f1-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:03:13.861 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-11T11:03:13.874 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:13.874 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-11T11:03:13.889 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-11T11:03:13.890 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-11T11:03:13.908 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-11T11:03:13.908 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-11T11:03:13.919 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-11T11:03:13.919 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:13.923 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:13.924 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-11T11:03:13.928 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:13.929 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-11T11:03:13.929 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-11T11:03:13.929 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-11T11:03:13.963 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:13.963 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:13.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c3c70980 1 Processor -- start 2024-09-11T11:03:13.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c3c70980 1 -- start start 2024-09-11T11:03:13.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c3c70980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56489f431660 0x56489f431a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c3c70980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56489f2b9ae0 con 0x56489f431fb0 2024-09-11T11:03:13.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c3c70980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x56489f2dde30 con 0x56489f431660 2024-09-11T11:03:13.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c1780640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56489f431660 0x56489f431a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c1780640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56489f431660 0x56489f431a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37700/0 (socket says 172.21.15.145:37700) 2024-09-11T11:03:13.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c1780640 1 -- 172.21.15.145:0/1435321550 learned_addr learned my addr 172.21.15.145:0/1435321550 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c0f7f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x56489f431fb0 0x56489f4369e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52100/0 (socket says 172.21.15.145:52100) 2024-09-11T11:03:13.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c1780640 1 -- 172.21.15.145:0/1435321550 >> v1:172.21.15.102:6789/0 conn(0x56489f431fb0 legacy=0x56489f4369e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.965 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.961+0000 7f00c1780640 1 -- 172.21.15.145:0/1435321550 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489f439230 con 0x56489f431660 2024-09-11T11:03:13.967 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00c1780640 1 --2- 172.21.15.145:0/1435321550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f431a40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f00b400a5c0 tx=0x7f00b401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1228d46c24ba2f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00bbfff640 1 -- 172.21.15.145:0/1435321550 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40a6070 con 0x56489f431660 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00bbfff640 1 -- 172.21.15.145:0/1435321550 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40af070 con 0x56489f431660 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00bbfff640 1 -- 172.21.15.145:0/1435321550 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40aa5c0 con 0x56489f431660 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00c3c70980 1 -- 172.21.15.145:0/1435321550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 msgr2=0x56489f431a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1435321550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f431a40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f00b400a5c0 tx=0x7f00b401b340 comp rx=0 tx=0).stop 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00c3c70980 1 -- 172.21.15.145:0/1435321550 shutdown_connections 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1435321550 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f431a40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00c3c70980 1 -- 172.21.15.145:0/1435321550 >> 172.21.15.145:0/1435321550 conn(0x56489f42d180 msgr2=0x56489f42f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00c3c70980 1 -- 172.21.15.145:0/1435321550 shutdown_connections 2024-09-11T11:03:13.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.965+0000 7f00c3c70980 1 -- 172.21.15.145:0/1435321550 wait complete. 2024-09-11T11:03:13.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.977+0000 7f00c3c70980 1 Processor -- start 2024-09-11T11:03:13.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.977+0000 7f00c3c70980 1 -- start start 2024-09-11T11:03:13.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.977+0000 7f00c3c70980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f51cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.977+0000 7f00c3c70980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56489f2df200 con 0x56489f431660 2024-09-11T11:03:13.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.977+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f51cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.977+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f51cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37704/0 (socket says 172.21.15.145:37704) 2024-09-11T11:03:13.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c1780640 1 -- 172.21.15.145:0/4095561975 learned_addr learned my addr 172.21.15.145:0/4095561975 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c1780640 1 -- 172.21.15.145:0/4095561975 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489f51d080 con 0x56489f431660 2024-09-11T11:03:13.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c1780640 1 --2- 172.21.15.145:0/4095561975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f51cab0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f00b40199f0 tx=0x7f00b4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb84b0ebbaecedc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7effaf606640 1 -- 172.21.15.145:0/4095561975 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40aaa00 con 0x56489f431660 2024-09-11T11:03:13.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7effaf606640 1 -- 172.21.15.145:0/4095561975 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40aaba0 con 0x56489f431660 2024-09-11T11:03:13.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7effaf606640 1 -- 172.21.15.145:0/4095561975 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40bd3f0 con 0x56489f431660 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- 172.21.15.145:0/4095561975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 msgr2=0x56489f51cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 --2- 172.21.15.145:0/4095561975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f51cab0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f00b40199f0 tx=0x7f00b4003030 comp rx=0 tx=0).stop 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- 172.21.15.145:0/4095561975 shutdown_connections 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 --2- 172.21.15.145:0/4095561975 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f51cab0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- 172.21.15.145:0/4095561975 >> 172.21.15.145:0/4095561975 conn(0x56489f42d180 msgr2=0x56489f5186e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- 172.21.15.145:0/4095561975 shutdown_connections 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- 172.21.15.145:0/4095561975 wait complete. 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 Processor -- start 2024-09-11T11:03:13.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- start start 2024-09-11T11:03:13.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f523ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56489f438c70 con 0x56489f431660 2024-09-11T11:03:13.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f523ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f523ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37708/0 (socket says 172.21.15.145:37708) 2024-09-11T11:03:13.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c1780640 1 -- 172.21.15.145:0/1015278622 learned_addr learned my addr 172.21.15.145:0/1015278622 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c1780640 1 -- 172.21.15.145:0/1015278622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489f524220 con 0x56489f431660 2024-09-11T11:03:13.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c1780640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f523ce0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f00b40199f0 tx=0x7f00b40180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7effade03640 1 -- 172.21.15.145:0/1015278622 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40bd7c0 con 0x56489f431660 2024-09-11T11:03:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7effade03640 1 -- 172.21.15.145:0/1015278622 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40bd960 con 0x56489f431660 2024-09-11T11:03:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56489f5244b0 con 0x56489f431660 2024-09-11T11:03:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7effade03640 1 -- 172.21.15.145:0/1015278622 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40bdc40 con 0x56489f431660 2024-09-11T11:03:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.981+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56489f527190 con 0x56489f431660 2024-09-11T11:03:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7effade03640 1 -- 172.21.15.145:0/1015278622 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b40ce020 con 0x56489f431660 2024-09-11T11:03:13.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7effade03640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7effa8034650 0x7effa8036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7effade03640 1 -- 172.21.15.145:0/1015278622 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f00b40cc020 con 0x56489f431660 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7effa8034650 0x7effa8036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f431fb0 0x56489f52acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f52b310 con 0x56489f431fb0 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c1f81640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f431fb0 0x56489f52acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7effa8034650 0x7effa8036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f00ac000f70 tx=0x7f00ac001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c1f81640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f431fb0 0x56489f52acd0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c1f81640 1 -- 172.21.15.145:0/1015278622 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f431fb0 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f52c0e0 0x56489f52e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f52eb10 con 0x56489f52c0e0 2024-09-11T11:03:13.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c1780640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f52c0e0 0x56489f52e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c1780640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f52c0e0 0x56489f52e4d0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c1780640 1 -- 172.21.15.145:0/1015278622 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f52c0e0 2024-09-11T11:03:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.985+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f5303c0 con 0x56489f52c0e0 2024-09-11T11:03:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c1780640 1 -- 172.21.15.145:0/1015278622 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f52c0e0 2024-09-11T11:03:13.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f52f5f0 con 0x56489f52c0e0 2024-09-11T11:03:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c1780640 1 -- 172.21.15.145:0/1015278622 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f52c0e0 2024-09-11T11:03:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56489f531770 0x56489f533b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f5340a0 con 0x56489f531770 2024-09-11T11:03:13.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56489f531770 0x56489f533b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56489f531770 0x56489f533b60 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c0f7f640 1 -- 172.21.15.145:0/1015278622 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f00ac00f6a0 con 0x56489f531770 2024-09-11T11:03:13.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c3c70980 1 Processor -- start 2024-09-11T11:03:13.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c3c70980 1 -- start start 2024-09-11T11:03:13.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c3c70980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f3a7d60 0x56489f3a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c3c70980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56489f338800 con 0x56489f3a7d60 2024-09-11T11:03:13.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f3a7d60 0x56489f3a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f3a7d60 0x56489f3a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37712/0 (socket says 172.21.15.145:37712) 2024-09-11T11:03:13.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c1780640 1 -- 172.21.15.145:0/3303761927 learned_addr learned my addr 172.21.15.145:0/3303761927 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.989+0000 7f00c1780640 1 -- 172.21.15.145:0/3303761927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489f3a8180 con 0x56489f3a7d60 2024-09-11T11:03:13.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c1780640 1 --2- 172.21.15.145:0/3303761927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f3a7d60 0x56489f3a63e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c10 tx=0x7f00b40bce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa6ffd640 1 -- 172.21.15.145:0/3303761927 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40cf970 con 0x56489f3a7d60 2024-09-11T11:03:13.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c3c70980 1 -- 172.21.15.145:0/3303761927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56489f3a6980 con 0x56489f3a7d60 2024-09-11T11:03:13.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa6ffd640 1 -- 172.21.15.145:0/3303761927 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40cfb10 con 0x56489f3a7d60 2024-09-11T11:03:13.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa6ffd640 1 -- 172.21.15.145:0/3303761927 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40cfdf0 con 0x56489f3a7d60 2024-09-11T11:03:13.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c3c70980 1 -- 172.21.15.145:0/3303761927 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56489f3a6e50 con 0x56489f3a7d60 2024-09-11T11:03:13.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa6ffd640 1 -- 172.21.15.145:0/3303761927 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b40c6480 con 0x56489f3a7d60 2024-09-11T11:03:13.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa6ffd640 1 --2- 172.21.15.145:0/3303761927 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa6ffd640 1 -- 172.21.15.145:0/3303761927 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f00b40bf0d0 con 0x56489f3a7d60 2024-09-11T11:03:13.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/3303761927 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c3c70980 1 Processor -- start 2024-09-11T11:03:13.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c3c70980 1 -- start start 2024-09-11T11:03:13.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/3303761927 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff98034650 0x7eff98036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x56489f5344a0 tx=0x7f00ac00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c3c70980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f550ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:13.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c3c70980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56489f51d340 con 0x56489f5506d0 2024-09-11T11:03:13.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f550ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:13.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f550ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37726/0 (socket says 172.21.15.145:37726) 2024-09-11T11:03:13.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c1780640 1 -- 172.21.15.145:0/1261909294 learned_addr learned my addr 172.21.15.145:0/1261909294 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:13.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c1780640 1 -- 172.21.15.145:0/1261909294 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489f551080 con 0x56489f5506d0 2024-09-11T11:03:13.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7f00c1780640 1 --2- 172.21.15.145:0/1261909294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f550ab0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f00b40cffb0 tx=0x7f00b40bc9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6cf8eaa4e2d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:13.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa4ff9640 1 -- 172.21.15.145:0/1261909294 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40dea10 con 0x56489f5506d0 2024-09-11T11:03:13.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa4ff9640 1 -- 172.21.15.145:0/1261909294 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40c9c50 con 0x56489f5506d0 2024-09-11T11:03:13.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.993+0000 7effa4ff9640 1 -- 172.21.15.145:0/1261909294 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40bc3a0 con 0x56489f5506d0 2024-09-11T11:03:14.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- 172.21.15.145:0/1261909294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 msgr2=0x56489f550ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1261909294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f550ab0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f00b40cffb0 tx=0x7f00b40bc9f0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- 172.21.15.145:0/1261909294 shutdown_connections 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1261909294 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f550ab0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- 172.21.15.145:0/1261909294 >> 172.21.15.145:0/1261909294 conn(0x56489f54ca00 msgr2=0x56489f54ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- 172.21.15.145:0/1261909294 shutdown_connections 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- 172.21.15.145:0/1261909294 wait complete. 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 Processor -- start 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- start start 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f557800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56489f551410 con 0x56489f5506d0 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f557800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c1780640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f557800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37742/0 (socket says 172.21.15.145:37742) 2024-09-11T11:03:14.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 learned_addr learned my addr 172.21.15.145:0/2973276277 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56489f557d40 con 0x56489f5506d0 2024-09-11T11:03:14.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c1780640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f557800 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f00b40cffb0 tx=0x7f00b40aded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7eff96ffd640 1 -- 172.21.15.145:0/2973276277 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b410f070 con 0x56489f5506d0 2024-09-11T11:03:14.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56489f557d40 con 0x56489f5506d0 2024-09-11T11:03:14.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7eff96ffd640 1 -- 172.21.15.145:0/2973276277 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00b40c6950 con 0x56489f5506d0 2024-09-11T11:03:14.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7eff96ffd640 1 -- 172.21.15.145:0/2973276277 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b40dea10 con 0x56489f5506d0 2024-09-11T11:03:14.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56489f557d40 con 0x56489f5506d0 2024-09-11T11:03:14.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7eff96ffd640 1 -- 172.21.15.145:0/2973276277 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f00b4107070 con 0x56489f5506d0 2024-09-11T11:03:14.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7eff96ffd640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff8c034650 0x7eff8c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:13.997+0000 7eff96ffd640 1 -- 172.21.15.145:0/2973276277 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f00b4105020 con 0x56489f5506d0 2024-09-11T11:03:14.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff8c034650 0x7eff8c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f562980 0x56489f564e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.005 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f565590 con 0x56489f562980 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1f81640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f562980 0x56489f564e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff8c034650 0x7eff8c036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c010 tx=0x7f00ac010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1f81640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f562980 0x56489f564e40 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 realm 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f561db0 con 0x56489f562980 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:14.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f566050 con 0x56489f562980 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f566e30 0x56489f569220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f5698d0 con 0x56489f566e30 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1780640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f566e30 0x56489f569220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1780640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f566e30 0x56489f569220 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f56a120 con 0x56489f566e30 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 20 searching for the correct realm 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56489f56be90 0x56489f56e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f56be90 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.001+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56489f56be90 0x56489f56e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c0f7f640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56489f56be90 0x56489f56e280 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1780640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f00b4009040 0x7f00b40db440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x7f00b4009040 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f00b4009040 0x7f00b40db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f00b4009040 0x7f00b40db440 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f56be90 2024-09-11T11:03:14.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.005+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x7f00b4009040 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x7f00b4009040 2024-09-11T11:03:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f56be90 2024-09-11T11:03:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f56be90 2024-09-11T11:03:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.009+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f56be90 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x7f00b4009040 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f562980 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x7f00b4009040 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f56be90 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x7f00b4009040 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f56be90 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.013+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56489f56e8b0 con 0x56489f566e30 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f56aad0 con 0x56489f562980 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f56b370 con 0x56489f566e30 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f56a710 con 0x7f00b4009040 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 zone default found 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 4 Realm: () 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 zonegroup default 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f56f1e0 con 0x7f00b4009040 2024-09-11T11:03:14.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f570f60 con 0x56489f56be90 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f5714a0 con 0x56489f56be90 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 started sync module instance, tier type = 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:14.026 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.017+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f570400 con 0x56489f566e30 2024-09-11T11:03:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.021+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.021+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94869910915328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f570400 con 0x56489f566e30 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.021+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f571f60 con 0x56489f562980 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.021+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.021+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94869910919792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f572380 con 0x56489f562980 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.021+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f572e80 con 0x56489f566e30 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.021+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94869910915328] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.021+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94869910919792] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.025+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.025+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94869910923632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f572e40 con 0x56489f566e30 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.025+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f573720 con 0x7f00b4009040 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.025+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.025+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94869910925936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f572e40 con 0x7f00b4009040 2024-09-11T11:03:14.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.025+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f574160 con 0x56489f566e30 2024-09-11T11:03:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.025+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94869910925936] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.025+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94869910923632] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94869910912848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f573cb0 con 0x56489f566e30 2024-09-11T11:03:14.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f574a00 con 0x56489f56be90 2024-09-11T11:03:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94869910930768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f573cb0 con 0x56489f56be90 2024-09-11T11:03:14.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f575870 con 0x56489f56be90 2024-09-11T11:03:14.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94869910930768] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94869910912848] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94869910932896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f575c10 con 0x56489f56be90 2024-09-11T11:03:14.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.029+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f576460 con 0x7f00b4009040 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94869910932896] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94869910936592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f5764e0 con 0x7f00b4009040 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c3c70980 20 add_watcher() i=0 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c3c70980 20 add_watcher() i=1 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c3c70980 20 add_watcher() i=2 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c3c70980 20 add_watcher() i=3 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c3c70980 20 add_watcher() i=4 2024-09-11T11:03:14.034 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c3c70980 20 add_watcher() i=5 2024-09-11T11:03:14.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.033+0000 7f00c3c70980 20 add_watcher() i=6 2024-09-11T11:03:14.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94869910936592] v36'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 20 add_watcher() i=7 2024-09-11T11:03:14.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:14.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f579730 con 0x56489f562980 2024-09-11T11:03:14.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94869910938016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f576a70 con 0x56489f562980 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94869910938016] v36'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7eff777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 5 note: GC not initialized 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7eff767e4640 20 reqs_thread_entry: start 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 20 Filter name: none 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7efee7fff640 20 reqs_thread_entry: start 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:14.046 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.041+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f59ce90 con 0x56489f562980 2024-09-11T11:03:14.047 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 20 rados_obj.operate() r=0 bl.length=473 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f5a3790 con 0x56489f562980 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:14.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94869911122432 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56489f59eea0 con 0x56489f566e30 2024-09-11T11:03:14.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94869910912848 notify 154618822706 ret 0) ==== 678+0+0 (crc 0 0 0) 0x56489f3a6980 con 0x56489f566e30 2024-09-11T11:03:14.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7effa4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822706 cookie 94869910912848 notifier 4843 bl.length()=636 2024-09-11T11:03:14.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7effa4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:14.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7effa4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:14.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7effa4ff9640 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7eff84003eb0 con 0x56489f566e30 2024-09-11T11:03:14.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94869911122432 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.045+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== watch-notify(notify_complete (2) cookie 94869911122432 notify 154618822706 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56489f3a8180 con 0x56489f566e30 2024-09-11T11:03:14.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.049+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.050 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:14.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.049+0000 7eff777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.049+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94869910938016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f59ac90 con 0x56489f562980 2024-09-11T11:03:14.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.049+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94869910938016] v36'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.049+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94869910915328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f59ac90 con 0x56489f566e30 2024-09-11T11:03:14.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.053+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94869910915328] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.053+0000 7f00c3c70980 20 remove_watcher() i=0 2024-09-11T11:03:14.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.053+0000 7f00c3c70980 2 removed watcher, disabling cache 2024-09-11T11:03:14.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.053+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94869910919792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f59ac90 con 0x56489f562980 2024-09-11T11:03:14.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.053+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94869910919792] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x56489f562980 2024-09-11T11:03:14.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.053+0000 7f00c3c70980 20 remove_watcher() i=1 2024-09-11T11:03:14.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.053+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94869910923632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f571a70 con 0x56489f566e30 2024-09-11T11:03:14.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.057+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94869910923632] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.057+0000 7f00c3c70980 20 remove_watcher() i=2 2024-09-11T11:03:14.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.057+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94869910925936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f59ac90 con 0x7f00b4009040 2024-09-11T11:03:14.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.057+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94869910925936] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.057+0000 7f00c3c70980 20 remove_watcher() i=3 2024-09-11T11:03:14.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.057+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94869910912848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f572970 con 0x56489f566e30 2024-09-11T11:03:14.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c1780640 1 -- 172.21.15.145:0/2973276277 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94869910912848] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00b40e5050 con 0x56489f566e30 2024-09-11T11:03:14.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 20 remove_watcher() i=4 2024-09-11T11:03:14.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94869910930768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f571a70 con 0x56489f56be90 2024-09-11T11:03:14.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94869910930768] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 20 remove_watcher() i=5 2024-09-11T11:03:14.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94869910932896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f573270 con 0x56489f56be90 2024-09-11T11:03:14.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c0f7f640 1 -- 172.21.15.145:0/2973276277 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94869910932896] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00ac037040 con 0x56489f56be90 2024-09-11T11:03:14.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 20 remove_watcher() i=6 2024-09-11T11:03:14.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94869910936592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56489f59ac90 con 0x7f00b4009040 2024-09-11T11:03:14.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94869910936592] v36'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f00bc00a4d0 con 0x7f00b4009040 2024-09-11T11:03:14.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 20 remove_watcher() i=7 2024-09-11T11:03:14.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f566e30 msgr2=0x56489f569220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f566e30 0x56489f569220 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f562980 msgr2=0x56489f564e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f562980 0x56489f564e40 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f00b4009040 msgr2=0x7f00b40db440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f00b4009040 0x7f00b40db440 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56489f56be90 msgr2=0x56489f56e280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56489f56be90 0x56489f56e280 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff8c034650 msgr2=0x7eff8c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff8c034650 0x7eff8c036b10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00c010 tx=0x7f00ac010000 comp rx=0 tx=0).stop 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 msgr2=0x56489f557800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f557800 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f00b40cffb0 tx=0x7f00b40aded0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c1f81640 1 -- 172.21.15.145:0/2973276277 reap_dead start 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 shutdown_connections 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 --2- 172.21.15.145:0/2973276277 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f5506d0 0x56489f557800 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 >> 172.21.15.145:0/2973276277 conn(0x56489f54ca00 msgr2=0x56489f54aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 shutdown_connections 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.061+0000 7f00c3c70980 1 -- 172.21.15.145:0/2973276277 wait complete. 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/3303761927 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff98034650 msgr2=0x7eff98036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/3303761927 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff98034650 0x7eff98036b10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x56489f5344a0 tx=0x7f00ac00f000 comp rx=0 tx=0).stop 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/3303761927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f3a7d60 msgr2=0x56489f3a63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/3303761927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f3a7d60 0x56489f3a63e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c10 tx=0x7f00b40bce30 comp rx=0 tx=0).stop 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/3303761927 shutdown_connections 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/3303761927 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7eff98034650 0x7eff98036b10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/3303761927 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f3a7d60 0x56489f3a63e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/3303761927 >> 172.21.15.145:0/3303761927 conn(0x56489f536c80 msgr2=0x56489f539700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/3303761927 shutdown_connections 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/3303761927 wait complete. 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f52c0e0 msgr2=0x56489f52e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56489f52c0e0 0x56489f52e4d0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f431fb0 msgr2=0x56489f52acd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56489f431fb0 0x56489f52acd0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56489f531770 msgr2=0x56489f533b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56489f531770 0x56489f533b60 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7effa8034650 msgr2=0x7effa8036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7effa8034650 0x7effa8036b10 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f00ac000f70 tx=0x7f00ac001380 comp rx=0 tx=0).stop 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 msgr2=0x56489f523ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.070 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 --2- 172.21.15.145:0/1015278622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56489f431660 0x56489f523ce0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f00b40199f0 tx=0x7f00b40180e0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c1f81640 1 -- 172.21.15.145:0/1015278622 reap_dead start 2024-09-11T11:03:14.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 shutdown_connections 2024-09-11T11:03:14.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 >> 172.21.15.145:0/1015278622 conn(0x56489f42d180 msgr2=0x56489f517260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 shutdown_connections 2024-09-11T11:03:14.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.065+0000 7f00c3c70980 1 -- 172.21.15.145:0/1015278622 wait complete. 2024-09-11T11:03:14.076 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:14.076 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:14.076 ERROR:root:0 2024-09-11T11:03:14.076 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-11T11:03:14.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-11T11:03:14.076 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-11T11:03:14.160 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:14.160 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:14.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.157+0000 7f6d25199980 1 Processor -- start 2024-09-11T11:03:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.157+0000 7f6d25199980 1 -- start start 2024-09-11T11:03:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.157+0000 7f6d25199980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56456fa7fe30 0x56456fa82220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.157+0000 7f6d25199980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56456f901ae0 con 0x56456f9eda60 2024-09-11T11:03:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.157+0000 7f6d25199980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x56456f925e30 con 0x56456fa7fe30 2024-09-11T11:03:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.157+0000 7f6d224a8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56456fa7fe30 0x56456fa82220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.157+0000 7f6d22ca9640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x56456f9eda60 0x56456fa7e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52104/0 (socket says 172.21.15.145:52104) 2024-09-11T11:03:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d224a8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56456fa7fe30 0x56456fa82220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37756/0 (socket says 172.21.15.145:37756) 2024-09-11T11:03:14.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d22ca9640 1 -- 172.21.15.145:0/925933200 learned_addr learned my addr 172.21.15.145:0/925933200 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:03:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d224a8640 1 -- 172.21.15.145:0/925933200 >> v1:172.21.15.102:6789/0 conn(0x56456f9eda60 legacy=0x56456fa7e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d224a8640 1 -- 172.21.15.145:0/925933200 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456f9ede40 con 0x56456fa7fe30 2024-09-11T11:03:14.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d224a8640 1 --2- 172.21.15.145:0/925933200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fa7fe30 0x56456fa82220 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00a480 tx=0x7f6d0c01b280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac6fb07effafb9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d21ca7640 1 -- 172.21.15.145:0/925933200 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d0c0b0070 con 0x56456fa7fe30 2024-09-11T11:03:14.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d21ca7640 1 -- 172.21.15.145:0/925933200 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c0ab540 con 0x56456fa7fe30 2024-09-11T11:03:14.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d21ca7640 1 -- 172.21.15.145:0/925933200 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d0c0ab840 con 0x56456fa7fe30 2024-09-11T11:03:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d25199980 1 -- 172.21.15.145:0/925933200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fa7fe30 msgr2=0x56456fa82220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d25199980 1 --2- 172.21.15.145:0/925933200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fa7fe30 0x56456fa82220 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c00a480 tx=0x7f6d0c01b280 comp rx=0 tx=0).stop 2024-09-11T11:03:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d25199980 1 -- 172.21.15.145:0/925933200 shutdown_connections 2024-09-11T11:03:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d25199980 1 --2- 172.21.15.145:0/925933200 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fa7fe30 0x56456fa82220 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d25199980 1 -- 172.21.15.145:0/925933200 >> 172.21.15.145:0/925933200 conn(0x56456fa74000 msgr2=0x56456fa76420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d25199980 1 -- 172.21.15.145:0/925933200 shutdown_connections 2024-09-11T11:03:14.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.161+0000 7f6d25199980 1 -- 172.21.15.145:0/925933200 wait complete. 2024-09-11T11:03:14.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 Processor -- start 2024-09-11T11:03:14.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 -- start start 2024-09-11T11:03:14.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb66c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56456f927200 con 0x56456f9eda60 2024-09-11T11:03:14.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb66c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb66c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37760/0 (socket says 172.21.15.145:37760) 2024-09-11T11:03:14.180 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d22ca9640 1 -- 172.21.15.145:0/202312188 learned_addr learned my addr 172.21.15.145:0/202312188 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d22ca9640 1 -- 172.21.15.145:0/202312188 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456fb67220 con 0x56456f9eda60 2024-09-11T11:03:14.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/202312188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb66c50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0015f0 tx=0x7f6d1c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1503abaaf4222a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6c10e09640 1 -- 172.21.15.145:0/202312188 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c004530 con 0x56456f9eda60 2024-09-11T11:03:14.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6c10e09640 1 -- 172.21.15.145:0/202312188 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c0046f0 con 0x56456f9eda60 2024-09-11T11:03:14.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6c10e09640 1 -- 172.21.15.145:0/202312188 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c004a90 con 0x56456f9eda60 2024-09-11T11:03:14.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 -- 172.21.15.145:0/202312188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 msgr2=0x56456fb66c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 --2- 172.21.15.145:0/202312188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb66c50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c0015f0 tx=0x7f6d1c001ab0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 -- 172.21.15.145:0/202312188 shutdown_connections 2024-09-11T11:03:14.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 --2- 172.21.15.145:0/202312188 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb66c50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 -- 172.21.15.145:0/202312188 >> 172.21.15.145:0/202312188 conn(0x56456fa74000 msgr2=0x56456fb62880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 -- 172.21.15.145:0/202312188 shutdown_connections 2024-09-11T11:03:14.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 -- 172.21.15.145:0/202312188 wait complete. 2024-09-11T11:03:14.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 Processor -- start 2024-09-11T11:03:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 -- start start 2024-09-11T11:03:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.177+0000 7f6d25199980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb6dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d25199980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56456fa851f0 con 0x56456f9eda60 2024-09-11T11:03:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb6dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb6dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37768/0 (socket says 172.21.15.145:37768) 2024-09-11T11:03:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d22ca9640 1 -- 172.21.15.145:0/471792551 learned_addr learned my addr 172.21.15.145:0/471792551 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d22ca9640 1 -- 172.21.15.145:0/471792551 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456fb6e520 con 0x56456f9eda60 2024-09-11T11:03:14.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb6dfe0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x56456fb67e30 tx=0x7f6d1c000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6c0f606640 1 -- 172.21.15.145:0/471792551 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c013760 con 0x56456f9eda60 2024-09-11T11:03:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6c0f606640 1 -- 172.21.15.145:0/471792551 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c013900 con 0x56456f9eda60 2024-09-11T11:03:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56456fb6e7b0 con 0x56456f9eda60 2024-09-11T11:03:14.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6c0f606640 1 -- 172.21.15.145:0/471792551 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c013be0 con 0x56456f9eda60 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456fb71490 con 0x56456f9eda60 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6c0f606640 1 -- 172.21.15.145:0/471792551 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d1c010070 con 0x56456f9eda60 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6c0f606640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c080346a0 0x7f6c08036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6c0f606640 1 -- 172.21.15.145:0/471792551 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f6d1c018070 con 0x56456f9eda60 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d224a8640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c080346a0 0x7f6c08036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d25199980 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fa7fe30 0x56456fb74fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fb75640 con 0x56456fa7fe30 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d234aa640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fa7fe30 0x56456fb74fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d224a8640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c080346a0 0x7f6c08036b60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0ad000 tx=0x7f6d0c0a5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d234aa640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fa7fe30 0x56456fb74fd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d234aa640 1 -- 172.21.15.145:0/471792551 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fa7fe30 2024-09-11T11:03:14.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d25199980 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fb76410 0x56456fb78800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.181+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fb78e40 con 0x56456fb76410 2024-09-11T11:03:14.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fb76410 0x56456fb78800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fb76410 0x56456fb78800 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d22ca9640 1 -- 172.21.15.145:0/471792551 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d1c01b030 con 0x56456fb76410 2024-09-11T11:03:14.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fb7a6f0 con 0x56456fb76410 2024-09-11T11:03:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d22ca9640 1 -- 172.21.15.145:0/471792551 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d1c01b030 con 0x56456fb76410 2024-09-11T11:03:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fb79860 con 0x56456fb76410 2024-09-11T11:03:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d22ca9640 1 -- 172.21.15.145:0/471792551 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d1c01b030 con 0x56456fb76410 2024-09-11T11:03:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d25199980 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56456fb7a2d0 0x56456fb7db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fb7e2a0 con 0x56456fb7a2d0 2024-09-11T11:03:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d224a8640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56456fb7a2d0 0x56456fb7db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d224a8640 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56456fb7a2d0 0x56456fb7db10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.192 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.185+0000 7f6d224a8640 1 -- 172.21.15.145:0/471792551 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d0c0b3040 con 0x56456fb7a2d0 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 Processor -- start 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 -- start start 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb8bd90 0x56456fb8c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56456f980800 con 0x56456fb8bd90 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb8bd90 0x56456fb8c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb8bd90 0x56456fb8c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37784/0 (socket says 172.21.15.145:37784) 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d22ca9640 1 -- 172.21.15.145:0/2091519617 learned_addr learned my addr 172.21.15.145:0/2091519617 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d22ca9640 1 -- 172.21.15.145:0/2091519617 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456fb8c6f0 con 0x56456fb8bd90 2024-09-11T11:03:14.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/2091519617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb8bd90 0x56456fb8c1b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c048380 tx=0x7f6d1c020440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6c0ce01640 1 -- 172.21.15.145:0/2091519617 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c0413c0 con 0x56456fb8bd90 2024-09-11T11:03:14.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 -- 172.21.15.145:0/2091519617 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56456fb8c980 con 0x56456fb8bd90 2024-09-11T11:03:14.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6c0ce01640 1 -- 172.21.15.145:0/2091519617 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c041560 con 0x56456fb8bd90 2024-09-11T11:03:14.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 -- 172.21.15.145:0/2091519617 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456fb8c980 con 0x56456fb8bd90 2024-09-11T11:03:14.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6c0ce01640 1 -- 172.21.15.145:0/2091519617 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c010940 con 0x56456fb8bd90 2024-09-11T11:03:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6c0ce01640 1 -- 172.21.15.145:0/2091519617 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d1c010ae0 con 0x56456fb8bd90 2024-09-11T11:03:14.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6c0ce01640 1 --2- 172.21.15.145:0/2091519617 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bfc034650 0x7f6bfc036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6c0ce01640 1 -- 172.21.15.145:0/2091519617 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f6d1c054c20 con 0x56456fb8bd90 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d224a8640 1 --2- 172.21.15.145:0/2091519617 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bfc034650 0x7f6bfc036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 Processor -- start 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 -- start start 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb98980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d25199980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56456fb675a0 con 0x56456fb98580 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.189+0000 7f6d224a8640 1 --2- 172.21.15.145:0/2091519617 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bfc034650 0x7f6bfc036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x56456fb725d0 tx=0x7f6d0c005a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb98980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb98980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37796/0 (socket says 172.21.15.145:37796) 2024-09-11T11:03:14.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 -- 172.21.15.145:0/3798595674 learned_addr learned my addr 172.21.15.145:0/3798595674 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 -- 172.21.15.145:0/3798595674 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456fb98f50 con 0x56456fb98580 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/3798595674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb98980 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c012aa0 tx=0x7f6d1c034b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf8c5c76d211132 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6c067fc640 1 -- 172.21.15.145:0/3798595674 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c062030 con 0x56456fb98580 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6c067fc640 1 -- 172.21.15.145:0/3798595674 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c04e030 con 0x56456fb98580 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6c067fc640 1 -- 172.21.15.145:0/3798595674 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c059040 con 0x56456fb98580 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- 172.21.15.145:0/3798595674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 msgr2=0x56456fb98980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 --2- 172.21.15.145:0/3798595674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb98980 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c012aa0 tx=0x7f6d1c034b90 comp rx=0 tx=0).stop 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- 172.21.15.145:0/3798595674 shutdown_connections 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 --2- 172.21.15.145:0/3798595674 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb98980 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- 172.21.15.145:0/3798595674 >> 172.21.15.145:0/3798595674 conn(0x56456fb94960 msgr2=0x56456fb92a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- 172.21.15.145:0/3798595674 shutdown_connections 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- 172.21.15.145:0/3798595674 wait complete. 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 Processor -- start 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- start start 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb9f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56456fb993d0 con 0x56456fb98580 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb9f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb9f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37800/0 (socket says 172.21.15.145:37800) 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 learned_addr learned my addr 172.21.15.145:0/255567980 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.204 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56456fb9fce0 con 0x56456fb98580 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb9f7a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c041b20 tx=0x7f6d1c03dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6c04ff9640 1 -- 172.21.15.145:0/255567980 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c06f070 con 0x56456fb98580 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56456fb9fce0 con 0x56456fb98580 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6c04ff9640 1 -- 172.21.15.145:0/255567980 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c045b10 con 0x56456fb98580 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6c04ff9640 1 -- 172.21.15.145:0/255567980 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1c062030 con 0x56456fb98580 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.193+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56456fba0150 con 0x56456fb98580 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6c04ff9640 1 -- 172.21.15.145:0/255567980 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f6d1c072070 con 0x56456fb98580 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6c04ff9640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bec0346a0 0x7f6bec036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6c04ff9640 1 -- 172.21.15.145:0/255567980 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f6d1c063070 con 0x56456fb98580 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d224a8640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bec0346a0 0x7f6bec036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fbaa720 0x56456fbacbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbad330 con 0x56456fbaa720 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d234aa640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fbaa720 0x56456fbacbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d224a8640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bec0346a0 0x7f6bec036b60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c018eb0 tx=0x7f6d0c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d234aa640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fbaa720 0x56456fbacbe0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 20 realm 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fba9bd0 con 0x56456fbaa720 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbaddf0 con 0x56456fbaa720 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.207 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fbaebd0 0x56456fbb0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb1650 con 0x56456fbaebd0 2024-09-11T11:03:14.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fbaebd0 0x56456fbb0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.197+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fbaebd0 0x56456fbb0fc0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d25199980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb1b90 con 0x56456fbaebd0 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d25199980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d25199980 20 searching for the correct realm 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56456fbb3370 0x56456fbb5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb5f00 con 0x56456fbb3370 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d224a8640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56456fbb3370 0x56456fbb5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.220 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d224a8640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56456fbb3370 0x56456fbb5830 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb5f00 con 0x56456fbaebd0 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d22ca9640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6d1c074070 0x7f6d1c071a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x7f6d1c074070 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d234aa640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6d1c074070 0x7f6d1c071a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d234aa640 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6d1c074070 0x7f6d1c071a90 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.221 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbb3370 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.201+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaebd0 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaebd0 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x7f6d1c074070 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x7f6d1c074070 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaebd0 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbb3370 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.223 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.205+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaebd0 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbb3370 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.224 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbb3370 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x7f6d1c074070 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaa720 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x7f6d1c074070 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbb3370 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x7f6d1c074070 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaebd0 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaebd0 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.209+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbb3370 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaebd0 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7f6d1c067040 con 0x56456fbaebd0 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb17a0 con 0x56456fbaa720 2024-09-11T11:03:14.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb1b90 con 0x56456fbaebd0 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb1b90 con 0x7f6d1c074070 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 zone default found 2024-09-11T11:03:14.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 4 Realm: () 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 zonegroup default 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb6380 con 0x7f6d1c074070 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb8190 con 0x56456fbb3370 2024-09-11T11:03:14.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb8660 con 0x56456fbb3370 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 started sync module instance, tier type = 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.213+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb75a0 con 0x56456fbaebd0 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.217+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.217+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94856227289760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb75a0 con 0x56456fbaebd0 2024-09-11T11:03:14.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.217+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb90e0 con 0x56456fbaa720 2024-09-11T11:03:14.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.217+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.217+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94856227294256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb9500 con 0x56456fbaa720 2024-09-11T11:03:14.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.217+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb9ff0 con 0x56456fbaebd0 2024-09-11T11:03:14.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94856227294256] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94856227289760] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94856227297984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb9050 con 0x56456fbaebd0 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbba890 con 0x7f6d1c074070 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94856227300320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb9050 con 0x7f6d1c074070 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbb310 con 0x56456fbaebd0 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94856227297984] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.221+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94856227300320] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.225+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.225+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94856227301376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbae20 con 0x56456fbaebd0 2024-09-11T11:03:14.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.225+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbbbb0 con 0x56456fbb3370 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.225+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.225+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94856227305216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbae20 con 0x56456fbb3370 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.225+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbca20 con 0x56456fbb3370 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94856227305216] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94856227307344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbd270 con 0x56456fbb3370 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbdc30 con 0x7f6d1c074070 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94856227301376] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94856227307344] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94856227287280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbdc30 con 0x7f6d1c074070 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 20 add_watcher() i=0 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 20 add_watcher() i=1 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 20 add_watcher() i=2 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 20 add_watcher() i=3 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 20 add_watcher() i=4 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 20 add_watcher() i=5 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 20 add_watcher() i=6 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94856227287280] v36'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 20 add_watcher() i=7 2024-09-11T11:03:14.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbc0dc0 con 0x56456fbaa720 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.229+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94856227313536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbbe050 con 0x56456fbaa720 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94856227313536] v36'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6bd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 5 note: GC not initialized 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6b53fff640 20 reqs_thread_entry: start 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:14.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 20 Filter name: none 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6b51ffb640 20 reqs_thread_entry: start 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe4520 con 0x56456fbb3370 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-11T11:03:14.241 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe2cc0 con 0x56456fbb3370 2024-09-11T11:03:14.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-11T11:03:14.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-11T11:03:14.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-11T11:03:14.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-11T11:03:14.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.233+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe3560 con 0x56456fbb3370 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v36'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d25199980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d25199980 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d25199980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94856227467440 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe7fc0 con 0x56456fbaebd0 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94856227289760 notify 154618822707 ret 0) ==== 575+0+0 (crc 0 0 0) 0x56456fb8c6f0 con 0x56456fbaebd0 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(65 notify.0 [notify cookie 94856227467440 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6c067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822707 cookie 94856227289760 notifier 4850 bl.length()=533 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6c067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6c067fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-11T11:03:14.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6c067fc640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f6be8003eb0 con 0x56456fbaebd0 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94856227467440 notify 154618822707 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d1c046040 con 0x56456fbaebd0 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.237+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe30b0 con 0x56456fbb3370 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v36'5 uv5 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d25199980 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d25199980 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d25199980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94856227467360 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe7fc0 con 0x56456fbaa720 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== watch-notify(notify (1) cookie 94856227294256 notify 154618822656 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f6d1400a960 con 0x56456fbaa720 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6c067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822656 cookie 94856227294256 notifier 4850 bl.length()=176 2024-09-11T11:03:14.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6c067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-11T11:03:14.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6c067fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-11T11:03:14.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(68 notify.1 [notify cookie 94856227467360 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6c067fc640 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f6be8003eb0 con 0x56456fbaa720 2024-09-11T11:03:14.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== watch-notify(notify_complete (2) cookie 94856227467360 notify 154618822656 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d1400ac00 con 0x56456fbaa720 2024-09-11T11:03:14.247 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-11T11:03:14.237791Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:14.237775Z","tags":[],"group_ids":[]} 2024-09-11T11:03:14.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6bd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94856227313536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe2320 con 0x56456fbaa720 2024-09-11T11:03:14.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.241+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94856227313536] v36'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.245+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94856227289760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe2320 con 0x56456fbaebd0 2024-09-11T11:03:14.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.245+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94856227289760] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.245+0000 7f6d25199980 20 remove_watcher() i=0 2024-09-11T11:03:14.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.245+0000 7f6d25199980 2 removed watcher, disabling cache 2024-09-11T11:03:14.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.245+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94856227294256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb7aa0 con 0x56456fbaa720 2024-09-11T11:03:14.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.245+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94856227294256] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x56456fbaa720 2024-09-11T11:03:14.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.245+0000 7f6d25199980 20 remove_watcher() i=1 2024-09-11T11:03:14.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.245+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94856227297984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe2320 con 0x56456fbaebd0 2024-09-11T11:03:14.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.249+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94856227297984] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.249+0000 7f6d25199980 20 remove_watcher() i=2 2024-09-11T11:03:14.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.249+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94856227300320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb8c30 con 0x7f6d1c074070 2024-09-11T11:03:14.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.249+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94856227300320] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.249+0000 7f6d25199980 20 remove_watcher() i=3 2024-09-11T11:03:14.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.249+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94856227301376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb7aa0 con 0x56456fbaebd0 2024-09-11T11:03:14.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d22ca9640 1 -- 172.21.15.145:0/255567980 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94856227301376] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1c07b070 con 0x56456fbaebd0 2024-09-11T11:03:14.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 20 remove_watcher() i=4 2024-09-11T11:03:14.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94856227305216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbba890 con 0x56456fbb3370 2024-09-11T11:03:14.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94856227305216] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 20 remove_watcher() i=5 2024-09-11T11:03:14.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94856227307344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbe2320 con 0x56456fbb3370 2024-09-11T11:03:14.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d224a8640 1 -- 172.21.15.145:0/255567980 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94856227307344] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0c0d8070 con 0x56456fbb3370 2024-09-11T11:03:14.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 20 remove_watcher() i=6 2024-09-11T11:03:14.256 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94856227287280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56456fbb8c30 con 0x7f6d1c074070 2024-09-11T11:03:14.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94856227287280] v36'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d140083f0 con 0x7f6d1c074070 2024-09-11T11:03:14.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 20 remove_watcher() i=7 2024-09-11T11:03:14.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fbaebd0 msgr2=0x56456fbb0fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fbaebd0 0x56456fbb0fc0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fbaa720 msgr2=0x56456fbacbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fbaa720 0x56456fbacbe0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6d1c074070 msgr2=0x7f6d1c071a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f6d1c074070 0x7f6d1c071a90 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56456fbb3370 msgr2=0x56456fbb5830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56456fbb3370 0x56456fbb5830 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bec0346a0 msgr2=0x7f6bec036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bec0346a0 0x7f6bec036b60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c018eb0 tx=0x7f6d0c0a6000 comp rx=0 tx=0).stop 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 msgr2=0x56456fb9f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d25199980 1 --2- 172.21.15.145:0/255567980 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb98580 0x56456fb9f7a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c041b20 tx=0x7f6d1c03dfa0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 reap_dead start 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.253+0000 7f6d234aa640 1 -- 172.21.15.145:0/255567980 reap_dead start 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 shutdown_connections 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 >> 172.21.15.145:0/255567980 conn(0x56456fb94960 msgr2=0x56456fb92a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 shutdown_connections 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/255567980 wait complete. 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/2091519617 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bfc034650 msgr2=0x7f6bfc036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/2091519617 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bfc034650 0x7f6bfc036b10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x56456fb725d0 tx=0x7f6d0c005a10 comp rx=0 tx=0).stop 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/2091519617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb8bd90 msgr2=0x56456fb8c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/2091519617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb8bd90 0x56456fb8c1b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c048380 tx=0x7f6d1c020440 comp rx=0 tx=0).stop 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/2091519617 shutdown_connections 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/2091519617 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6bfc034650 0x7f6bfc036b10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/2091519617 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456fb8bd90 0x56456fb8c1b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/2091519617 >> 172.21.15.145:0/2091519617 conn(0x56456fb80ee0 msgr2=0x56456fb83960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/2091519617 shutdown_connections 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/2091519617 wait complete. 2024-09-11T11:03:14.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fb76410 msgr2=0x56456fb78800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56456fb76410 0x56456fb78800 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fa7fe30 msgr2=0x56456fb74fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56456fa7fe30 0x56456fb74fd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56456fb7a2d0 msgr2=0x56456fb7db10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56456fb7a2d0 0x56456fb7db10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c080346a0 msgr2=0x7f6c08036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f6c080346a0 0x7f6c08036b60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0ad000 tx=0x7f6d0c0a5040 comp rx=0 tx=0).stop 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 msgr2=0x56456fb6dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 --2- 172.21.15.145:0/471792551 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56456f9eda60 0x56456fb6dfe0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x56456fb67e30 tx=0x7f6d1c000f50 comp rx=0 tx=0).stop 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d234aa640 1 -- 172.21.15.145:0/471792551 reap_dead start 2024-09-11T11:03:14.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 shutdown_connections 2024-09-11T11:03:14.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 >> 172.21.15.145:0/471792551 conn(0x56456fa74000 msgr2=0x56456fb61400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 shutdown_connections 2024-09-11T11:03:14.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.257+0000 7f6d25199980 1 -- 172.21.15.145:0/471792551 wait complete. 2024-09-11T11:03:14.269 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-11T11:03:14.237791Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:14.237775Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:14.269 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-11T11:03:14.237791Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:14.237775Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:14.269 ERROR:root:0 2024-09-11T11:03:14.270 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:14.274 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:14.275 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-11T11:03:14.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-11T11:03:14.275 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-11T11:03:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:14.344 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:14.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.341+0000 7fd5a4b04980 1 Processor -- start 2024-09-11T11:03:14.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.341+0000 7fd5a4b04980 1 -- start start 2024-09-11T11:03:14.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.341+0000 7fd5a4b04980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55752192e7c0 0x55752192d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.341+0000 7fd5a4b04980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55752183fae0 con 0x55752192e3b0 2024-09-11T11:03:14.345 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.341+0000 7fd5a4b04980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x557521863e30 con 0x55752192e7c0 2024-09-11T11:03:14.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.341+0000 7fd5a1e13640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55752192e7c0 0x55752192d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.341+0000 7fd5a1e13640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55752192e7c0 0x55752192d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37804/0 (socket says 172.21.15.145:37804) 2024-09-11T11:03:14.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.341+0000 7fd5a1e13640 1 -- 172.21.15.145:0/3971379579 learned_addr learned my addr 172.21.15.145:0/3971379579 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a1e13640 1 -- 172.21.15.145:0/3971379579 >> v1:172.21.15.102:6789/0 conn(0x55752192e3b0 legacy=0x55752192cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a1e13640 1 -- 172.21.15.145:0/3971379579 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752192d8e0 con 0x55752192e7c0 2024-09-11T11:03:14.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/3971379579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e7c0 0x55752192d280 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00a5c0 tx=0x7fd58c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e1ba9897beadd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a1612640 1 -- 172.21.15.145:0/3971379579 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58c0a6070 con 0x55752192e7c0 2024-09-11T11:03:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a1612640 1 -- 172.21.15.145:0/3971379579 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58c0af070 con 0x55752192e7c0 2024-09-11T11:03:14.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a1612640 1 -- 172.21.15.145:0/3971379579 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd58c0aa5c0 con 0x55752192e7c0 2024-09-11T11:03:14.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3971379579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e7c0 msgr2=0x55752192d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/3971379579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e7c0 0x55752192d280 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00a5c0 tx=0x7fd58c01b340 comp rx=0 tx=0).stop 2024-09-11T11:03:14.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3971379579 shutdown_connections 2024-09-11T11:03:14.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/3971379579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e7c0 0x55752192d280 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3971379579 >> 172.21.15.145:0/3971379579 conn(0x5575219b31b0 msgr2=0x5575219b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3971379579 shutdown_connections 2024-09-11T11:03:14.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.345+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3971379579 wait complete. 2024-09-11T11:03:14.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 Processor -- start 2024-09-11T11:03:14.362 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- start start 2024-09-11T11:03:14.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aa4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557521865200 con 0x55752192e3b0 2024-09-11T11:03:14.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aa4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aa4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37812/0 (socket says 172.21.15.145:37812) 2024-09-11T11:03:14.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 -- 172.21.15.145:0/3898624461 learned_addr learned my addr 172.21.15.145:0/3898624461 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 -- 172.21.15.145:0/3898624461 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557521aa5170 con 0x55752192e3b0 2024-09-11T11:03:14.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 --2- 172.21.15.145:0/3898624461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aa4ba0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd5940015f0 tx=0x7fd594001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcee1524b1a77ece server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd490608640 1 -- 172.21.15.145:0/3898624461 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594016070 con 0x55752192e3b0 2024-09-11T11:03:14.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd490608640 1 -- 172.21.15.145:0/3898624461 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59400f640 con 0x55752192e3b0 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd490608640 1 -- 172.21.15.145:0/3898624461 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59400f960 con 0x55752192e3b0 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3898624461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 msgr2=0x557521aa4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/3898624461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aa4ba0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd5940015f0 tx=0x7fd594001ab0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3898624461 shutdown_connections 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/3898624461 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aa4ba0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3898624461 >> 172.21.15.145:0/3898624461 conn(0x5575219b31b0 msgr2=0x557521aa07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3898624461 shutdown_connections 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- 172.21.15.145:0/3898624461 wait complete. 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 Processor -- start 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- start start 2024-09-11T11:03:14.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aabf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a4b04980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5575219c3200 con 0x55752192e3b0 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aabf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aabf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37826/0 (socket says 172.21.15.145:37826) 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 -- 172.21.15.145:0/4088978285 learned_addr learned my addr 172.21.15.145:0/4088978285 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.361+0000 7fd5a2614640 1 -- 172.21.15.145:0/4088978285 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557521aac470 con 0x55752192e3b0 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a2614640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aabf30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd594001af0 tx=0x7fd594000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd48ee05640 1 -- 172.21.15.145:0/4088978285 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594016040 con 0x55752192e3b0 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557521aac700 con 0x55752192e3b0 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd48ee05640 1 -- 172.21.15.145:0/4088978285 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd594022070 con 0x55752192e3b0 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd48ee05640 1 -- 172.21.15.145:0/4088978285 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594006180 con 0x55752192e3b0 2024-09-11T11:03:14.368 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557521aaf3e0 con 0x55752192e3b0 2024-09-11T11:03:14.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd48ee05640 1 -- 172.21.15.145:0/4088978285 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd5940117c0 con 0x55752192e3b0 2024-09-11T11:03:14.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd48ee05640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd488034650 0x7fd488036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd48ee05640 1 -- 172.21.15.145:0/4088978285 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fd594049720 con 0x55752192e3b0 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd488034650 0x7fd488036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55752192e7c0 0x557521ab3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521ab35b0 con 0x55752192e7c0 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a2e15640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55752192e7c0 0x557521ab3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd488034650 0x7fd488036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0ae000 tx=0x7fd58c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a2e15640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55752192e7c0 0x557521ab3030 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a2e15640 1 -- 172.21.15.145:0/4088978285 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x55752192e7c0 2024-09-11T11:03:14.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521ab43d0 0x557521ab67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521ab6e00 con 0x557521ab43d0 2024-09-11T11:03:14.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a2614640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521ab43d0 0x557521ab67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.365+0000 7fd5a2614640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521ab43d0 0x557521ab67c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a2614640 1 -- 172.21.15.145:0/4088978285 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd59400f070 con 0x557521ab43d0 2024-09-11T11:03:14.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521ab86b0 con 0x557521ab43d0 2024-09-11T11:03:14.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a2614640 1 -- 172.21.15.145:0/4088978285 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd59400f070 con 0x557521ab43d0 2024-09-11T11:03:14.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521ab78e0 con 0x557521ab43d0 2024-09-11T11:03:14.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a2614640 1 -- 172.21.15.145:0/4088978285 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd59400f070 con 0x557521ab43d0 2024-09-11T11:03:14.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557521ab9a60 0x557521abbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521abc390 con 0x557521ab9a60 2024-09-11T11:03:14.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557521ab9a60 0x557521abbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.375 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557521ab9a60 0x557521abbe50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a1e13640 1 -- 172.21.15.145:0/4088978285 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521ab9a60 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a4b04980 1 Processor -- start 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a4b04980 1 -- start start 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a4b04980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ac9dc0 0x557521aca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a4b04980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5575218be800 con 0x557521ac9dc0 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ac9dc0 0x557521aca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ac9dc0 0x557521aca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37830/0 (socket says 172.21.15.145:37830) 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.369+0000 7fd5a2614640 1 -- 172.21.15.145:0/2473556643 learned_addr learned my addr 172.21.15.145:0/2473556643 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a2614640 1 -- 172.21.15.145:0/2473556643 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557521aca720 con 0x557521ac9dc0 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a2614640 1 --2- 172.21.15.145:0/2473556643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ac9dc0 0x557521aca1e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd594049a90 tx=0x7fd59401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.376 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd487fff640 1 -- 172.21.15.145:0/2473556643 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594005ca0 con 0x557521ac9dc0 2024-09-11T11:03:14.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd487fff640 1 -- 172.21.15.145:0/2473556643 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd594026cc0 con 0x557521ac9dc0 2024-09-11T11:03:14.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a4b04980 1 -- 172.21.15.145:0/2473556643 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557521aca9b0 con 0x557521ac9dc0 2024-09-11T11:03:14.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd487fff640 1 -- 172.21.15.145:0/2473556643 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594005e40 con 0x557521ac9dc0 2024-09-11T11:03:14.377 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a4b04980 1 -- 172.21.15.145:0/2473556643 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557521acd630 con 0x557521ac9dc0 2024-09-11T11:03:14.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd487fff640 1 -- 172.21.15.145:0/2473556643 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd594011c90 con 0x557521ac9dc0 2024-09-11T11:03:14.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd487fff640 1 --2- 172.21.15.145:0/2473556643 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd47c034650 0x7fd47c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd487fff640 1 -- 172.21.15.145:0/2473556643 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fd59401f3b0 con 0x557521ac9dc0 2024-09-11T11:03:14.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/2473556643 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd47c034650 0x7fd47c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.380 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a4b04980 1 Processor -- start 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a4b04980 1 -- start start 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/2473556643 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd47c034650 0x7fd47c036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd58c017f50 tx=0x7fd58c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a4b04980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521ad6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a4b04980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557521aa54f0 con 0x557521ad6740 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521ad6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521ad6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37836/0 (socket says 172.21.15.145:37836) 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a2614640 1 -- 172.21.15.145:0/1959455413 learned_addr learned my addr 172.21.15.145:0/1959455413 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.373+0000 7fd5a2614640 1 -- 172.21.15.145:0/1959455413 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557521ad7110 con 0x557521ad6740 2024-09-11T11:03:14.381 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a2614640 1 --2- 172.21.15.145:0/1959455413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521ad6b40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd594015f60 tx=0x7fd594052520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a4f2201596c03d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd485ffb640 1 -- 172.21.15.145:0/1959455413 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd59401f170 con 0x557521ad6740 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd485ffb640 1 -- 172.21.15.145:0/1959455413 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5940411f0 con 0x557521ad6740 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd485ffb640 1 -- 172.21.15.145:0/1959455413 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594049b00 con 0x557521ad6740 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- 172.21.15.145:0/1959455413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 msgr2=0x557521ad6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/1959455413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521ad6b40 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fd594015f60 tx=0x7fd594052520 comp rx=0 tx=0).stop 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- 172.21.15.145:0/1959455413 shutdown_connections 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/1959455413 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521ad6b40 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- 172.21.15.145:0/1959455413 >> 172.21.15.145:0/1959455413 conn(0x557521ad2ad0 msgr2=0x557521ad0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- 172.21.15.145:0/1959455413 shutdown_connections 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- 172.21.15.145:0/1959455413 wait complete. 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 Processor -- start 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- start start 2024-09-11T11:03:14.382 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521add8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x557521ad7660 con 0x557521ad6740 2024-09-11T11:03:14.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521add8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a2614640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521add8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37838/0 (socket says 172.21.15.145:37838) 2024-09-11T11:03:14.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 learned_addr learned my addr 172.21.15.145:0/762374646 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.383 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557521adddf0 con 0x557521ad6740 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a2614640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521add8b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd594014fd0 tx=0x7fd59401f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd473fff640 1 -- 172.21.15.145:0/762374646 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5940313d0 con 0x557521ad6740 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd473fff640 1 -- 172.21.15.145:0/762374646 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59406e030 con 0x557521ad6740 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557521adddf0 con 0x557521ad6740 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd473fff640 1 -- 172.21.15.145:0/762374646 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd594052850 con 0x557521ad6740 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.377+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557521ade260 con 0x557521ad6740 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd473fff640 1 -- 172.21.15.145:0/762374646 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd594065040 con 0x557521ad6740 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd473fff640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd46c0346a0 0x7fd46c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.387 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd473fff640 1 -- 172.21.15.145:0/762374646 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fd594063020 con 0x557521ad6740 2024-09-11T11:03:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd46c0346a0 0x7fd46c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557521ae8890 0x557521aead50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521aeb4a0 con 0x557521ae8890 2024-09-11T11:03:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a2e15640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557521ae8890 0x557521aead50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.388 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd46c0346a0 0x7fd46c036b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0ac040 tx=0x7fd58c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a2e15640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557521ae8890 0x557521aead50 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 20 realm 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521ae7cc0 con 0x557521ae8890 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.389 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521aebf60 con 0x557521ae8890 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521aecd40 0x557521aef130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521aef7c0 con 0x557521aecd40 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a2614640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521aecd40 0x557521aef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.381+0000 7fd5a2614640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521aecd40 0x557521aef130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd59403d070 con 0x557521aecd40 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a4b04980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521af0010 con 0x557521aecd40 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd59403d070 con 0x557521aecd40 2024-09-11T11:03:14.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a4b04980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:14.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a4b04980 20 searching for the correct realm 2024-09-11T11:03:14.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557521af1d80 0x557521af4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521af1d80 2024-09-11T11:03:14.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557521af1d80 0x557521af4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a1e13640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557521af1d80 0x557521af4170 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.396 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd59403d070 con 0x557521aecd40 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2614640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd594040070 0x7fd594052a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x7fd594040070 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd594040070 0x7fd594052a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd594040070 0x7fd594052a10 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521af1d80 2024-09-11T11:03:14.397 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.385+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59403d070 con 0x557521aecd40 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59403d070 con 0x557521aecd40 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x7fd594040070 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.398 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x7fd594040070 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521af1d80 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.389+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521af1d80 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.399 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521af1d80 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x7fd594040070 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521ae8890 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.400 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x7fd594040070 2024-09-11T11:03:14.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521af1d80 2024-09-11T11:03:14.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x7fd594040070 2024-09-11T11:03:14.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.401 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.393+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521af1d80 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x557521af47f0 con 0x557521aecd40 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:14.405 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521af0990 con 0x557521ae8890 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521af05d0 con 0x557521aecd40 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.406 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521af1330 con 0x7fd594040070 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 zone default found 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 4 Realm: () 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 zonegroup default 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521af5100 con 0x7fd594040070 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521af73b0 con 0x557521af1d80 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.397+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521af7750 con 0x557521af1d80 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a4b04980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a4b04980 20 started sync module instance, tier type = 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a4b04980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af67f0 con 0x557521aecd40 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93961564679408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af67f0 con 0x557521aecd40 2024-09-11T11:03:14.409 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af8110 con 0x557521ae8890 2024-09-11T11:03:14.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93961564683360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af8530 con 0x557521ae8890 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.401+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af9020 con 0x557521aecd40 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93961564679408] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93961564683360] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93961564687088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af8080 con 0x557521aecd40 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af98c0 con 0x7fd594040070 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93961564689424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af8080 con 0x7fd594040070 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521afa360 con 0x557521aecd40 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93961564687088] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.405+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93961564689424] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93961564690480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af8080 con 0x557521aecd40 2024-09-11T11:03:14.412 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521afa780 con 0x557521af1d80 2024-09-11T11:03:14.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93961564676928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521afafd0 con 0x557521af1d80 2024-09-11T11:03:14.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521afb990 con 0x557521af1d80 2024-09-11T11:03:14.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93961564690480] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93961564676928] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93961564697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521afbd80 con 0x557521af1d80 2024-09-11T11:03:14.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.409+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521afc5d0 con 0x7fd594040070 2024-09-11T11:03:14.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93961564700512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521afc9b0 con 0x7fd594040070 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 20 add_watcher() i=0 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 20 add_watcher() i=1 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 20 add_watcher() i=2 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 20 add_watcher() i=3 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 20 add_watcher() i=4 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 20 add_watcher() i=5 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93961564697824] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 20 add_watcher() i=6 2024-09-11T11:03:14.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93961564700512] v36'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 20 add_watcher() i=7 2024-09-11T11:03:14.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:14.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521af9e50 con 0x557521ae8890 2024-09-11T11:03:14.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.413+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93961564692048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521afcec0 con 0x557521ae8890 2024-09-11T11:03:14.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93961564692048] v36'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd458fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd5a4b04980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:14.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd5a4b04980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:14.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b08340 con 0x557521aecd40 2024-09-11T11:03:14.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b08450 con 0x7fd594040070 2024-09-11T11:03:14.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.417+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b08b60 con 0x557521af1d80 2024-09-11T11:03:14.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.421+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.423 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.421+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09010 con 0x557521ae8890 2024-09-11T11:03:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.421+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.421+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b06170 con 0x557521aecd40 2024-09-11T11:03:14.426 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.425+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.427 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.425+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b06170 con 0x557521af1d80 2024-09-11T11:03:14.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.425+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.425+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b06170 con 0x557521aecd40 2024-09-11T11:03:14.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.429+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.429+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b06170 con 0x557521ae8890 2024-09-11T11:03:14.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.429+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.429+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09d40 con 0x557521aecd40 2024-09-11T11:03:14.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.429+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.429+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09d40 con 0x557521aecd40 2024-09-11T11:03:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.433+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.436 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.433+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09d40 con 0x557521aecd40 2024-09-11T11:03:14.437 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.433+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.433+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09d40 con 0x557521af1d80 2024-09-11T11:03:14.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.437+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.437+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0a2b0 con 0x557521aecd40 2024-09-11T11:03:14.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.437+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.441 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.437+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0a2b0 con 0x557521ae8890 2024-09-11T11:03:14.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.437+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.442 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.441+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0a670 con 0x557521ae8890 2024-09-11T11:03:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.441+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.441+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521aecd40 2024-09-11T11:03:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.445+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'71 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.446 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.445+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09d40 con 0x557521aecd40 2024-09-11T11:03:14.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.445+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.445+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09d40 con 0x557521af1d80 2024-09-11T11:03:14.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.449+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.449+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09f10 con 0x557521aecd40 2024-09-11T11:03:14.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.449+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.449+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b09f10 con 0x557521ae8890 2024-09-11T11:03:14.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.453+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.453+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0a0e0 con 0x557521aecd40 2024-09-11T11:03:14.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.453+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'72 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.453+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0a0e0 con 0x557521aecd40 2024-09-11T11:03:14.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.457+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.457+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0a0e0 con 0x557521af1d80 2024-09-11T11:03:14.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.457+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.461 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.457+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521aecd40 2024-09-11T11:03:14.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.461+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.461+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521af1d80 2024-09-11T11:03:14.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.461+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.461+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521af1d80 2024-09-11T11:03:14.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.465+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.465+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521af1d80 2024-09-11T11:03:14.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.465+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.465+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521aecd40 2024-09-11T11:03:14.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.469+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.469+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521ae8890 2024-09-11T11:03:14.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.469+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.469+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521aecd40 2024-09-11T11:03:14.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.473+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'73 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.473+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x557521ae8890 2024-09-11T11:03:14.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.473+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.476 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.473+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b0ab20 con 0x7fd594040070 2024-09-11T11:03:14.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.473+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.473+0000 7fd3d37fe640 20 reqs_thread_entry: start 2024-09-11T11:03:14.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:14.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 20 Filter name: none 2024-09-11T11:03:14.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd3d17fa640 20 reqs_thread_entry: start 2024-09-11T11:03:14.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-11T11:03:14.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521b05650 con 0x557521af1d80 2024-09-11T11:03:14.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 20 rados_obj.operate() r=0 bl.length=349 2024-09-11T11:03:14.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-11T11:03:14.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-11T11:03:14.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:14.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521b051d0 con 0x557521af1d80 2024-09-11T11:03:14.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 10 removing key index: system_akey 2024-09-11T11:03:14.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b051d0 con 0x557521af1d80 2024-09-11T11:03:14.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(96 system_akey [delete] v36'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.481 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 93961564877056 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521b28aa0 con 0x557521ae8890 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== watch-notify(notify (1) cookie 93961564683360 notify 154618822657 ret 0) ==== 203+0+0 (crc 0 0 0) 0x557521b0a0e0 con 0x557521ae8890 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd485ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822657 cookie 93961564683360 notifier 4857 bl.length()=161 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd485ffb640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd468003d70 con 0x557521ae8890 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(97 notify.1 [notify cookie 93961564877056 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== watch-notify(notify_complete (2) cookie 93961564877056 notify 154618822657 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557521b09b70 con 0x557521ae8890 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 10 removing email index: 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 10 removing user buckets index 2024-09-11T11:03:14.482 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.477+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b265a0 con 0x557521af1d80 2024-09-11T11:03:14.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.481+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(99 system_user.buckets [delete] v36'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.483 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.481+0000 7fd5a4b04980 10 removing user index: system_user 2024-09-11T11:03:14.484 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.481+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b2a600 con 0x557521af1d80 2024-09-11T11:03:14.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.481+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(100 system_user [call,call,delete] v36'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.481+0000 7fd5a4b04980 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-11T11:03:14.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.481+0000 7fd5a4b04980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-11T11:03:14.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.481+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93961564872944 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x557521b27a50 con 0x557521aecd40 2024-09-11T11:03:14.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.485+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== watch-notify(notify (1) cookie 93961564679408 notify 154618822708 ret 0) ==== 202+0+0 (crc 0 0 0) 0x557521b05e00 con 0x557521aecd40 2024-09-11T11:03:14.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.485+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(101 notify.0 [notify cookie 93961564872944 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.485+0000 7fd4857fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822708 cookie 93961564679408 notifier 4857 bl.length()=160 2024-09-11T11:03:14.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.485+0000 7fd4857fa640 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd3d80032d0 con 0x557521aecd40 2024-09-11T11:03:14.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.485+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.485+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== watch-notify(notify_complete (2) cookie 93961564872944 notify 154618822708 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557521aca720 con 0x557521aecd40 2024-09-11T11:03:14.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.485+0000 7fd458fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.485+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93961564692048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521b040b0 con 0x557521ae8890 2024-09-11T11:03:14.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93961564692048] v36'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.490 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93961564679408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af9e50 con 0x557521aecd40 2024-09-11T11:03:14.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93961564679408] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a4b04980 20 remove_watcher() i=0 2024-09-11T11:03:14.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a4b04980 2 removed watcher, disabling cache 2024-09-11T11:03:14.492 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93961564683360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af6cf0 con 0x557521ae8890 2024-09-11T11:03:14.493 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93961564683360] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x557521ae8890 2024-09-11T11:03:14.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a4b04980 20 remove_watcher() i=1 2024-09-11T11:03:14.494 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.489+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93961564687088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af6cf0 con 0x557521aecd40 2024-09-11T11:03:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.493+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93961564687088] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.493+0000 7fd5a4b04980 20 remove_watcher() i=2 2024-09-11T11:03:14.496 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.493+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93961564689424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af8af0 con 0x7fd594040070 2024-09-11T11:03:14.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.493+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93961564689424] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.493+0000 7fd5a4b04980 20 remove_watcher() i=3 2024-09-11T11:03:14.497 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.493+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93961564690480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af6cf0 con 0x557521aecd40 2024-09-11T11:03:14.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a2614640 1 -- 172.21.15.145:0/762374646 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93961564690480] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59408e040 con 0x557521aecd40 2024-09-11T11:03:14.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a4b04980 20 remove_watcher() i=4 2024-09-11T11:03:14.499 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93961564676928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af8af0 con 0x557521af1d80 2024-09-11T11:03:14.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93961564676928] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a4b04980 20 remove_watcher() i=5 2024-09-11T11:03:14.500 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93961564697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af6cf0 con 0x557521af1d80 2024-09-11T11:03:14.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a1e13640 1 -- 172.21.15.145:0/762374646 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93961564697824] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd58c0aab40 con 0x557521af1d80 2024-09-11T11:03:14.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a4b04980 20 remove_watcher() i=6 2024-09-11T11:03:14.502 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.497+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93961564700512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x557521af6cf0 con 0x7fd594040070 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93961564700512] v36'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd59c0083f0 con 0x7fd594040070 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 20 remove_watcher() i=7 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521aecd40 msgr2=0x557521aef130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521aecd40 0x557521aef130 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557521ae8890 msgr2=0x557521aead50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x557521ae8890 0x557521aead50 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd594040070 msgr2=0x7fd594052a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd594040070 0x7fd594052a10 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557521af1d80 msgr2=0x557521af4170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.506 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x557521af1d80 0x557521af4170 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd46c0346a0 msgr2=0x7fd46c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd46c0346a0 0x7fd46c036b60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0ac040 tx=0x7fd58c0c1040 comp rx=0 tx=0).stop 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 msgr2=0x557521add8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a2e15640 1 -- 172.21.15.145:0/762374646 reap_dead start 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521add8b0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd594014fd0 tx=0x7fd59401f0d0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 shutdown_connections 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/762374646 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ad6740 0x557521add8b0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 >> 172.21.15.145:0/762374646 conn(0x557521ad2ad0 msgr2=0x557521ad0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 shutdown_connections 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/762374646 wait complete. 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/2473556643 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd47c034650 msgr2=0x7fd47c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/2473556643 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd47c034650 0x7fd47c036b10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd58c017f50 tx=0x7fd58c005ad0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.507 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/2473556643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ac9dc0 msgr2=0x557521aca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/2473556643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ac9dc0 0x557521aca1e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fd594049a90 tx=0x7fd59401c420 comp rx=0 tx=0).stop 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/2473556643 shutdown_connections 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/2473556643 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd47c034650 0x7fd47c036b10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/2473556643 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x557521ac9dc0 0x557521aca1e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/2473556643 >> 172.21.15.145:0/2473556643 conn(0x557521abef10 msgr2=0x557521ac1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/2473556643 shutdown_connections 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/2473556643 wait complete. 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521ab43d0 msgr2=0x557521ab67c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x557521ab43d0 0x557521ab67c0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55752192e7c0 msgr2=0x557521ab3030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55752192e7c0 0x557521ab3030 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557521ab9a60 msgr2=0x557521abbe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.508 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x557521ab9a60 0x557521abbe50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd488034650 msgr2=0x7fd488036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd488034650 0x7fd488036b10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd58c0ae000 tx=0x7fd58c0a6000 comp rx=0 tx=0).stop 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 msgr2=0x557521aabf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 --2- 172.21.15.145:0/4088978285 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55752192e3b0 0x557521aabf30 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd594001af0 tx=0x7fd594000f50 comp rx=0 tx=0).stop 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a2e15640 1 -- 172.21.15.145:0/4088978285 reap_dead start 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 shutdown_connections 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 >> 172.21.15.145:0/4088978285 conn(0x5575219b31b0 msgr2=0x557521a9f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 shutdown_connections 2024-09-11T11:03:14.509 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.501+0000 7fd5a4b04980 1 -- 172.21.15.145:0/4088978285 wait complete. 2024-09-11T11:03:14.514 ERROR:root:None 2024-09-11T11:03:14.514 ERROR:root:0 2024-09-11T11:03:14.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-11T11:03:14.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-11T11:03:14.515 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-11T11:03:14.601 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:14.601 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:14.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b96b83980 1 Processor -- start 2024-09-11T11:03:14.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b96b83980 1 -- start start 2024-09-11T11:03:14.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b96b83980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56552a0efe60 0x56552a0f2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b96b83980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565529f71ae0 con 0x56552a05e230 2024-09-11T11:03:14.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b96b83980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x565529f95e30 con 0x56552a0efe60 2024-09-11T11:03:14.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93e92640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56552a0efe60 0x56552a0f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93e92640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56552a0efe60 0x56552a0f2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37848/0 (socket says 172.21.15.145:37848) 2024-09-11T11:03:14.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b94693640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x56552a05e230 0x56552a0ee740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52124/0 (socket says 172.21.15.145:52124) 2024-09-11T11:03:14.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93e92640 1 -- 172.21.15.145:0/2645472588 learned_addr learned my addr 172.21.15.145:0/2645472588 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93e92640 1 -- 172.21.15.145:0/2645472588 >> v1:172.21.15.102:6789/0 conn(0x56552a05e230 legacy=0x56552a0ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93e92640 1 -- 172.21.15.145:0/2645472588 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a05e610 con 0x56552a0efe60 2024-09-11T11:03:14.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93e92640 1 --2- 172.21.15.145:0/2645472588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a0efe60 0x56552a0f2250 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00a5c0 tx=0x7f1b7c01b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d52227e018bccc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.605 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93691640 1 -- 172.21.15.145:0/2645472588 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7c0a6070 con 0x56552a0efe60 2024-09-11T11:03:14.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93691640 1 -- 172.21.15.145:0/2645472588 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7c0af070 con 0x56552a0efe60 2024-09-11T11:03:14.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.601+0000 7f1b93691640 1 -- 172.21.15.145:0/2645472588 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b7c0aa5c0 con 0x56552a0efe60 2024-09-11T11:03:14.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.605+0000 7f1b96b83980 1 -- 172.21.15.145:0/2645472588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a0efe60 msgr2=0x56552a0f2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.605+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2645472588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a0efe60 0x56552a0f2250 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00a5c0 tx=0x7f1b7c01b340 comp rx=0 tx=0).stop 2024-09-11T11:03:14.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.605+0000 7f1b96b83980 1 -- 172.21.15.145:0/2645472588 shutdown_connections 2024-09-11T11:03:14.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.605+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2645472588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a0efe60 0x56552a0f2250 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.605+0000 7f1b96b83980 1 -- 172.21.15.145:0/2645472588 >> 172.21.15.145:0/2645472588 conn(0x56552a0e4030 msgr2=0x56552a0e6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.605+0000 7f1b96b83980 1 -- 172.21.15.145:0/2645472588 shutdown_connections 2024-09-11T11:03:14.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.605+0000 7f1b96b83980 1 -- 172.21.15.145:0/2645472588 wait complete. 2024-09-11T11:03:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b96b83980 1 Processor -- start 2024-09-11T11:03:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b96b83980 1 -- start start 2024-09-11T11:03:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b96b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1d6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b96b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x565529f97200 con 0x56552a05e230 2024-09-11T11:03:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1d6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1d6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37858/0 (socket says 172.21.15.145:37858) 2024-09-11T11:03:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b94693640 1 -- 172.21.15.145:0/4133113897 learned_addr learned my addr 172.21.15.145:0/4133113897 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b94693640 1 -- 172.21.15.145:0/4133113897 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a1d7230 con 0x56552a05e230 2024-09-11T11:03:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1b94693640 1 --2- 172.21.15.145:0/4133113897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1d6c60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1b840015f0 tx=0x7f1b84001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a95a07220905a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1a8260c640 1 -- 172.21.15.145:0/4133113897 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b84013420 con 0x56552a05e230 2024-09-11T11:03:14.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1a8260c640 1 -- 172.21.15.145:0/4133113897 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b840135e0 con 0x56552a05e230 2024-09-11T11:03:14.622 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.617+0000 7f1a8260c640 1 -- 172.21.15.145:0/4133113897 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b84013940 con 0x56552a05e230 2024-09-11T11:03:14.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- 172.21.15.145:0/4133113897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 msgr2=0x56552a1d6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 --2- 172.21.15.145:0/4133113897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1d6c60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1b840015f0 tx=0x7f1b84001ab0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- 172.21.15.145:0/4133113897 shutdown_connections 2024-09-11T11:03:14.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 --2- 172.21.15.145:0/4133113897 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1d6c60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- 172.21.15.145:0/4133113897 >> 172.21.15.145:0/4133113897 conn(0x56552a0e4030 msgr2=0x56552a1d2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- 172.21.15.145:0/4133113897 shutdown_connections 2024-09-11T11:03:14.623 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- 172.21.15.145:0/4133113897 wait complete. 2024-09-11T11:03:14.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 Processor -- start 2024-09-11T11:03:14.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- start start 2024-09-11T11:03:14.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1ddf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56552a0f51c0 con 0x56552a05e230 2024-09-11T11:03:14.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1ddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1ddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37862/0 (socket says 172.21.15.145:37862) 2024-09-11T11:03:14.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b94693640 1 -- 172.21.15.145:0/1861751671 learned_addr learned my addr 172.21.15.145:0/1861751671 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b94693640 1 -- 172.21.15.145:0/1861751671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a1de4d0 con 0x56552a05e230 2024-09-11T11:03:14.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b94693640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1ddf90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1b84006640 tx=0x7f1b84000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1a80e09640 1 -- 172.21.15.145:0/1861751671 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b84022020 con 0x56552a05e230 2024-09-11T11:03:14.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56552a1de760 con 0x56552a05e230 2024-09-11T11:03:14.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1a80e09640 1 -- 172.21.15.145:0/1861751671 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b84006320 con 0x56552a05e230 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1a80e09640 1 -- 172.21.15.145:0/1861751671 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b84004af0 con 0x56552a05e230 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552a1e1440 con 0x56552a05e230 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1a80e09640 1 -- 172.21.15.145:0/1861751671 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1b84025020 con 0x56552a05e230 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1a80e09640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a7c034650 0x7f1a7c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1a80e09640 1 -- 172.21.15.145:0/1861751671 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1b84018030 con 0x56552a05e230 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b93e92640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a7c034650 0x7f1a7c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a0efe60 0x56552a1e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a1e55c0 con 0x56552a0efe60 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.621+0000 7f1b94e94640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a0efe60 0x56552a1e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b93e92640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a7c034650 0x7f1a7c036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0ae000 tx=0x7f1b7c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b94e94640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a0efe60 0x56552a1e4f80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b94e94640 1 -- 172.21.15.145:0/1861751671 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a0efe60 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a1e63b0 0x56552a1e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a1e8dd0 con 0x56552a1e63b0 2024-09-11T11:03:14.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b94693640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a1e63b0 0x56552a1e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b94693640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a1e63b0 0x56552a1e87a0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b94693640 1 -- 172.21.15.145:0/1861751671 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b8401b070 con 0x56552a1e63b0 2024-09-11T11:03:14.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a1ea680 con 0x56552a1e63b0 2024-09-11T11:03:14.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b94693640 1 -- 172.21.15.145:0/1861751671 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b8401b070 con 0x56552a1e63b0 2024-09-11T11:03:14.629 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a1e97f0 con 0x56552a1e63b0 2024-09-11T11:03:14.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b94693640 1 -- 172.21.15.145:0/1861751671 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b8401b070 con 0x56552a1e63b0 2024-09-11T11:03:14.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56552a1eba30 0x56552a1ede20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.625+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a1ee360 con 0x56552a1eba30 2024-09-11T11:03:14.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b93e92640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56552a1eba30 0x56552a1ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b93e92640 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56552a1eba30 0x56552a1ede20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b93e92640 1 -- 172.21.15.145:0/1861751671 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a1eba30 2024-09-11T11:03:14.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b96b83980 1 Processor -- start 2024-09-11T11:03:14.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b96b83980 1 -- start start 2024-09-11T11:03:14.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b96b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a1fbd10 0x56552a1fc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b96b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x565529ff0800 con 0x56552a1fbd10 2024-09-11T11:03:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a1fbd10 0x56552a1fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a1fbd10 0x56552a1fc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37870/0 (socket says 172.21.15.145:37870) 2024-09-11T11:03:14.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b94693640 1 -- 172.21.15.145:0/1935823276 learned_addr learned my addr 172.21.15.145:0/1935823276 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b94693640 1 -- 172.21.15.145:0/1935823276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a1fc670 con 0x56552a1fbd10 2024-09-11T11:03:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b94693640 1 --2- 172.21.15.145:0/1935823276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a1fbd10 0x56552a1fc130 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1b840484a0 tx=0x7f1b84005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1a79ffb640 1 -- 172.21.15.145:0/1935823276 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b8401d950 con 0x56552a1fbd10 2024-09-11T11:03:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b96b83980 1 -- 172.21.15.145:0/1935823276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56552a1fc900 con 0x56552a1fbd10 2024-09-11T11:03:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1a79ffb640 1 -- 172.21.15.145:0/1935823276 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8401daf0 con 0x56552a1fbd10 2024-09-11T11:03:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1a79ffb640 1 -- 172.21.15.145:0/1935823276 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b8401de10 con 0x56552a1fbd10 2024-09-11T11:03:14.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1b96b83980 1 -- 172.21.15.145:0/1935823276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552a1ff580 con 0x56552a1fbd10 2024-09-11T11:03:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1a79ffb640 1 -- 172.21.15.145:0/1935823276 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1b84046040 con 0x56552a1fbd10 2024-09-11T11:03:14.634 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1a79ffb640 1 --2- 172.21.15.145:0/1935823276 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a6c034650 0x7f1a6c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.629+0000 7f1a79ffb640 1 -- 172.21.15.145:0/1935823276 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1b84049160 con 0x56552a1fbd10 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b93e92640 1 --2- 172.21.15.145:0/1935823276 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a6c034650 0x7f1a6c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 Processor -- start 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- start start 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b93e92640 1 --2- 172.21.15.145:0/1935823276 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a6c034650 0x7f1a6c036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x56552a1e2580 tx=0x7f1b7c005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a2089d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56552a1d75b0 con 0x56552a2085d0 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a2089d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a2089d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37884/0 (socket says 172.21.15.145:37884) 2024-09-11T11:03:14.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 -- 172.21.15.145:0/3475855862 learned_addr learned my addr 172.21.15.145:0/3475855862 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.637 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 -- 172.21.15.145:0/3475855862 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a208fa0 con 0x56552a2085d0 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 --2- 172.21.15.145:0/3475855862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a2089d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1b84051030 tx=0x7f1b840419d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f3e99b010d3277 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1a737fe640 1 -- 172.21.15.145:0/3475855862 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b84048e10 con 0x56552a2085d0 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1a737fe640 1 -- 172.21.15.145:0/3475855862 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8402ad00 con 0x56552a2085d0 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1a737fe640 1 -- 172.21.15.145:0/3475855862 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b84041e50 con 0x56552a2085d0 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- 172.21.15.145:0/3475855862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 msgr2=0x56552a2089d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 --2- 172.21.15.145:0/3475855862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a2089d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1b84051030 tx=0x7f1b840419d0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- 172.21.15.145:0/3475855862 shutdown_connections 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 --2- 172.21.15.145:0/3475855862 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a2089d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- 172.21.15.145:0/3475855862 >> 172.21.15.145:0/3475855862 conn(0x56552a204a00 msgr2=0x56552a202b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- 172.21.15.145:0/3475855862 shutdown_connections 2024-09-11T11:03:14.638 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- 172.21.15.145:0/3475855862 wait complete. 2024-09-11T11:03:14.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 Processor -- start 2024-09-11T11:03:14.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- start start 2024-09-11T11:03:14.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a20f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b96b83980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56552a209470 con 0x56552a2085d0 2024-09-11T11:03:14.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a20f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a20f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37896/0 (socket says 172.21.15.145:37896) 2024-09-11T11:03:14.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 learned_addr learned my addr 172.21.15.145:0/2573429320 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.633+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56552a20fda0 con 0x56552a2085d0 2024-09-11T11:03:14.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b94693640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a20f860 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1b84033fb0 tx=0x7f1b8403cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1a71ffb640 1 -- 172.21.15.145:0/2573429320 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b84073070 con 0x56552a2085d0 2024-09-11T11:03:14.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56552a20fda0 con 0x56552a2085d0 2024-09-11T11:03:14.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1a71ffb640 1 -- 172.21.15.145:0/2573429320 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b8401e620 con 0x56552a2085d0 2024-09-11T11:03:14.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1a71ffb640 1 -- 172.21.15.145:0/2573429320 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b8401e900 con 0x56552a2085d0 2024-09-11T11:03:14.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56552a210210 con 0x56552a2085d0 2024-09-11T11:03:14.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1a71ffb640 1 -- 172.21.15.145:0/2573429320 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1b84076070 con 0x56552a2085d0 2024-09-11T11:03:14.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1a71ffb640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a640347f0 0x7f1a64036cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1a71ffb640 1 -- 172.21.15.145:0/2573429320 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1b84069030 con 0x56552a2085d0 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b93e92640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a640347f0 0x7f1a64036cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a21a960 0x56552a21ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a21d550 con 0x56552a21a960 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b94e94640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a21a960 0x56552a21ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b93e92640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a640347f0 0x7f1a64036cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0aafd0 tx=0x7f1b7c0c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b94e94640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a21a960 0x56552a21ce00 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 20 realm 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a219e50 con 0x56552a21a960 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a21e010 con 0x56552a21a960 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a21edf0 0x56552a2211e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.637+0000 7f1b94693640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a21edf0 0x56552a2211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.644 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94693640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a21edf0 0x56552a2211e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b96b83980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a2220c0 con 0x56552a21edf0 2024-09-11T11:03:14.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b96b83980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b96b83980 20 searching for the correct realm 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56552a223930 0x56552a225df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a2264c0 con 0x56552a223930 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b93e92640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56552a223930 0x56552a225df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b93e92640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56552a223930 0x56552a225df0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a2264c0 con 0x56552a21edf0 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94693640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1b84078060 0x7f1b84031800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x7f1b84078060 2024-09-11T11:03:14.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94e94640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1b84078060 0x7f1b84031800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94e94640 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1b84078060 0x7f1b84031800 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.641+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a223930 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x7f1b84078060 2024-09-11T11:03:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x7f1b84078060 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a223930 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.645+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a223930 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a223930 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x7f1b84078060 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21a960 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x7f1b84078060 2024-09-11T11:03:14.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a223930 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x7f1b84078060 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.649+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a223930 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56552a221870 con 0x56552a21edf0 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a221d60 con 0x56552a21a960 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a222150 con 0x56552a21edf0 2024-09-11T11:03:14.663 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a222150 con 0x7f1b84078060 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 zone default found 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 4 Realm: () 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 zonegroup default 2024-09-11T11:03:14.664 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a226940 con 0x7f1b84078060 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.653+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a2286c0 con 0x56552a223930 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a228b70 con 0x56552a223930 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 20 started sync module instance, tier type = 2024-09-11T11:03:14.665 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:14.666 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a227b60 con 0x56552a21edf0 2024-09-11T11:03:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923779113088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a227b60 con 0x56552a21edf0 2024-09-11T11:03:14.668 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a2295f0 con 0x56552a21a960 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.657+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923779117376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a229560 con 0x56552a21a960 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22a540 con 0x56552a21edf0 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94923779113088] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94923779117376] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923779119632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22a500 con 0x56552a21edf0 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22a9a0 con 0x7f1b84078060 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923779110576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22a960 con 0x7f1b84078060 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.661+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22b860 con 0x56552a21edf0 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94923779110576] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.669 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94923779119632] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923779121200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22b3b0 con 0x56552a21edf0 2024-09-11T11:03:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22c100 con 0x56552a223930 2024-09-11T11:03:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923779128400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22b3b0 con 0x56552a223930 2024-09-11T11:03:14.670 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22ce40 con 0x56552a223930 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94923779121200] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923779124624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22d710 con 0x56552a223930 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22dfe0 con 0x7f1b84078060 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.665+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94923779128400] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923779130528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22dbc0 con 0x7f1b84078060 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 20 add_watcher() i=0 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 20 add_watcher() i=1 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 20 add_watcher() i=2 2024-09-11T11:03:14.672 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 20 add_watcher() i=3 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 20 add_watcher() i=4 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 20 add_watcher() i=5 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94923779124624] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 20 add_watcher() i=6 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94923779130528] v36'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 20 add_watcher() i=7 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a22da30 con 0x56552a21a960 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.673 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923779134512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22da00 con 0x56552a21a960 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.669+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94923779134512] v36'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1a4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 5 note: GC not initialized 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1a497e2640 20 reqs_thread_entry: start 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 20 Filter name: none 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f19baffd640 20 reqs_thread_entry: start 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-11T11:03:14.675 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.676 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a254660 con 0x56552a21edf0 2024-09-11T11:03:14.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-11T11:03:14.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-11T11:03:14.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-11T11:03:14.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a252e00 con 0x56552a223930 2024-09-11T11:03:14.677 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-11T11:03:14.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-11T11:03:14.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-11T11:03:14.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-11T11:03:14.678 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a2536a0 con 0x56552a21edf0 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v36'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.673+0000 7f1b96b83980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94923779289584 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a257c50 con 0x56552a21edf0 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== watch-notify(notify (1) cookie 94923779119632 notify 154618822709 ret 0) ==== 584+0+0 (crc 0 0 0) 0x56552a2540b0 con 0x56552a21edf0 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1a737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822709 cookie 94923779119632 notifier 4864 bl.length()=542 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(65 notify.2 [notify cookie 94923779289584 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.679 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1a737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-11T11:03:14.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1a737fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-11T11:03:14.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1a737fe640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f1a58003eb0 con 0x56552a21edf0 2024-09-11T11:03:14.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== watch-notify(notify_complete (2) cookie 94923779289584 notify 154618822709 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56552a1fc670 con 0x56552a21edf0 2024-09-11T11:03:14.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.680 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a2536a0 con 0x56552a223930 2024-09-11T11:03:14.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v36'5 uv5 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.681 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b96b83980 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b96b83980 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b96b83980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94923779289584 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56552a257c00 con 0x56552a223930 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== watch-notify(notify (1) cookie 94923779128400 notify 154618822684 ret 0) ==== 217+0+0 (crc 0 0 0) 0x56552a05e610 con 0x56552a223930 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1a737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822684 cookie 94923779128400 notifier 4864 bl.length()=175 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1a737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1a737fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1a737fe640 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f1a58003eb0 con 0x56552a223930 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(68 notify.5 [notify cookie 94923779289584 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.682 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.677+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== watch-notify(notify_complete (2) cookie 94923779289584 notify 154618822684 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1b7c0bf990 con 0x56552a223930 2024-09-11T11:03:14.683 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-11T11:03:14.677413Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:14.677399Z","tags":[],"group_ids":[]} 2024-09-11T11:03:14.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.681+0000 7f1a4a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.683 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.681+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923779134512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a252460 con 0x56552a21a960 2024-09-11T11:03:14.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.681+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94923779134512] v36'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.684 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.681+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923779113088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a252460 con 0x56552a21edf0 2024-09-11T11:03:14.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.685+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94923779113088] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.685+0000 7f1b96b83980 20 remove_watcher() i=0 2024-09-11T11:03:14.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.685+0000 7f1b96b83980 2 removed watcher, disabling cache 2024-09-11T11:03:14.687 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.685+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923779117376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a252460 con 0x56552a21a960 2024-09-11T11:03:14.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.685+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94923779117376] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x56552a21a960 2024-09-11T11:03:14.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.685+0000 7f1b96b83980 20 remove_watcher() i=1 2024-09-11T11:03:14.688 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.685+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923779119632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a252460 con 0x56552a21edf0 2024-09-11T11:03:14.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.689+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94923779119632] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.689+0000 7f1b96b83980 20 remove_watcher() i=2 2024-09-11T11:03:14.690 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.689+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923779110576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a229a10 con 0x7f1b84078060 2024-09-11T11:03:14.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.689+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94923779110576] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.691 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.689+0000 7f1b96b83980 20 remove_watcher() i=3 2024-09-11T11:03:14.692 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.689+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923779121200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a252460 con 0x56552a21edf0 2024-09-11T11:03:14.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b94693640 1 -- 172.21.15.145:0/2573429320 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94923779121200] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b84075030 con 0x56552a21edf0 2024-09-11T11:03:14.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 20 remove_watcher() i=4 2024-09-11T11:03:14.694 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923779128400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a2276b0 con 0x56552a223930 2024-09-11T11:03:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94923779128400] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 20 remove_watcher() i=5 2024-09-11T11:03:14.695 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923779124624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a22a030 con 0x56552a223930 2024-09-11T11:03:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b93e92640 1 -- 172.21.15.145:0/2573429320 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94923779124624] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b7c0aaa80 con 0x56552a223930 2024-09-11T11:03:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 20 remove_watcher() i=6 2024-09-11T11:03:14.696 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923779130528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56552a252460 con 0x7f1b84078060 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94923779130528] v36'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b8c0083f0 con 0x7f1b84078060 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 20 remove_watcher() i=7 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a21edf0 msgr2=0x56552a2211e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a21edf0 0x56552a2211e0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a21a960 msgr2=0x56552a21ce00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a21a960 0x56552a21ce00 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1b84078060 msgr2=0x7f1b84031800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1b84078060 0x7f1b84031800 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56552a223930 msgr2=0x56552a225df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56552a223930 0x56552a225df0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a640347f0 msgr2=0x7f1a64036cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.699 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a640347f0 0x7f1a64036cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0aafd0 tx=0x7f1b7c0c1040 comp rx=0 tx=0).stop 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 msgr2=0x56552a20f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/2573429320 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a2085d0 0x56552a20f860 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f1b84033fb0 tx=0x7f1b8403cee0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 reap_dead start 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b94e94640 1 -- 172.21.15.145:0/2573429320 reap_dead start 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 shutdown_connections 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 >> 172.21.15.145:0/2573429320 conn(0x56552a204a00 msgr2=0x56552a202ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 shutdown_connections 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/2573429320 wait complete. 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/1935823276 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a6c034650 msgr2=0x7f1a6c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1935823276 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a6c034650 0x7f1a6c036b10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x56552a1e2580 tx=0x7f1b7c005ad0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/1935823276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a1fbd10 msgr2=0x56552a1fc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1935823276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a1fbd10 0x56552a1fc130 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f1b840484a0 tx=0x7f1b84005130 comp rx=0 tx=0).stop 2024-09-11T11:03:14.700 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/1935823276 shutdown_connections 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1935823276 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a6c034650 0x7f1a6c036b10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1935823276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a1fbd10 0x56552a1fc130 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/1935823276 >> 172.21.15.145:0/1935823276 conn(0x56552a1f0e60 msgr2=0x56552a1f38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/1935823276 shutdown_connections 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.693+0000 7f1b96b83980 1 -- 172.21.15.145:0/1935823276 wait complete. 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a1e63b0 msgr2=0x56552a1e87a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56552a1e63b0 0x56552a1e87a0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a0efe60 msgr2=0x56552a1e4f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56552a0efe60 0x56552a1e4f80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56552a1eba30 msgr2=0x56552a1ede20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56552a1eba30 0x56552a1ede20 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a7c034650 msgr2=0x7f1a7c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.701 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1a7c034650 0x7f1a7c036b10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0ae000 tx=0x7f1b7c0a6000 comp rx=0 tx=0).stop 2024-09-11T11:03:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 msgr2=0x56552a1ddf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 --2- 172.21.15.145:0/1861751671 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56552a05e230 0x56552a1ddf90 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f1b84006640 tx=0x7f1b84000f50 comp rx=0 tx=0).stop 2024-09-11T11:03:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b94e94640 1 -- 172.21.15.145:0/1861751671 reap_dead start 2024-09-11T11:03:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 shutdown_connections 2024-09-11T11:03:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 >> 172.21.15.145:0/1861751671 conn(0x56552a0e4030 msgr2=0x56552a1d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 shutdown_connections 2024-09-11T11:03:14.702 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.697+0000 7f1b96b83980 1 -- 172.21.15.145:0/1861751671 wait complete. 2024-09-11T11:03:14.707 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-11T11:03:14.677413Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:14.677399Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:14.708 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-11T11:03:14.677413Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:14.677399Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:14.708 ERROR:root:0 2024-09-11T11:03:14.708 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:14.713 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:14.713 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-11T11:03:14.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-11T11:03:14.713 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-11T11:03:14.785 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:14.785 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdeb1f980 1 Processor -- start 2024-09-11T11:03:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdeb1f980 1 -- start start 2024-09-11T11:03:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdeb1f980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56411696fac0 0x564116971eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdeb1f980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641167f3ae0 con 0x5641168e0290 2024-09-11T11:03:14.786 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdeb1f980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x564116817e30 con 0x56411696fac0 2024-09-11T11:03:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdbe2e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56411696fac0 0x564116971eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdbe2e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56411696fac0 0x564116971eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37898/0 (socket says 172.21.15.145:37898) 2024-09-11T11:03:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdc62f640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x5641168e0290 0x56411696e3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52140/0 (socket says 172.21.15.145:52140) 2024-09-11T11:03:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/254095180 learned_addr learned my addr 172.21.15.145:0/254095180 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/254095180 >> v1:172.21.15.102:6789/0 conn(0x5641168e0290 legacy=0x56411696e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/254095180 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641168e0820 con 0x56411696fac0 2024-09-11T11:03:14.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/254095180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56411696fac0 0x564116971eb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000a5c0 tx=0x7f1cd001b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9faae8ca9cbb9c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdb62d640 1 -- 172.21.15.145:0/254095180 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00a6070 con 0x56411696fac0 2024-09-11T11:03:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdb62d640 1 -- 172.21.15.145:0/254095180 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd00af070 con 0x56411696fac0 2024-09-11T11:03:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.785+0000 7f1cdb62d640 1 -- 172.21.15.145:0/254095180 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1cd00aa5c0 con 0x56411696fac0 2024-09-11T11:03:14.790 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.789+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/254095180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56411696fac0 msgr2=0x564116971eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.789+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/254095180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56411696fac0 0x564116971eb0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1cd000a5c0 tx=0x7f1cd001b340 comp rx=0 tx=0).stop 2024-09-11T11:03:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.789+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/254095180 shutdown_connections 2024-09-11T11:03:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.789+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/254095180 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56411696fac0 0x564116971eb0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.789+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/254095180 >> 172.21.15.145:0/254095180 conn(0x564116966090 msgr2=0x5641169684b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.789+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/254095180 shutdown_connections 2024-09-11T11:03:14.791 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.789+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/254095180 wait complete. 2024-09-11T11:03:14.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 Processor -- start 2024-09-11T11:03:14.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 -- start start 2024-09-11T11:03:14.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a56a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564116819200 con 0x5641168e0290 2024-09-11T11:03:14.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a56a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a56a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37908/0 (socket says 172.21.15.145:37908) 2024-09-11T11:03:14.804 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3905141104 learned_addr learned my addr 172.21.15.145:0/3905141104 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3905141104 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564116a56fd0 con 0x5641168e0290 2024-09-11T11:03:14.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/3905141104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a56a00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00b240 tx=0x7f1ccc00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2c8478d8a99912 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1bca60c640 1 -- 172.21.15.145:0/3905141104 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc00e700 con 0x5641168e0290 2024-09-11T11:03:14.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1bca60c640 1 -- 172.21.15.145:0/3905141104 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00e8a0 con 0x5641168e0290 2024-09-11T11:03:14.805 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1bca60c640 1 -- 172.21.15.145:0/3905141104 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc00eb80 con 0x5641168e0290 2024-09-11T11:03:14.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3905141104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 msgr2=0x564116a56a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3905141104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a56a00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00b240 tx=0x7f1ccc00b700 comp rx=0 tx=0).stop 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3905141104 shutdown_connections 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3905141104 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a56a00 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.801+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3905141104 >> 172.21.15.145:0/3905141104 conn(0x564116966090 msgr2=0x564116a52630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3905141104 shutdown_connections 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3905141104 wait complete. 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 Processor -- start 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 -- start start 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a5dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564116972f00 con 0x5641168e0290 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a5dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a5dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37916/0 (socket says 172.21.15.145:37916) 2024-09-11T11:03:14.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3326311606 learned_addr learned my addr 172.21.15.145:0/3326311606 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3326311606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564116a5e290 con 0x5641168e0290 2024-09-11T11:03:14.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a5dd50 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc000c10 tx=0x7f1ccc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1bc8e09640 1 -- 172.21.15.145:0/3326311606 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc00fa90 con 0x5641168e0290 2024-09-11T11:03:14.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564116a5e520 con 0x5641168e0290 2024-09-11T11:03:14.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1bc8e09640 1 -- 172.21.15.145:0/3326311606 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00fc50 con 0x5641168e0290 2024-09-11T11:03:14.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564116a61200 con 0x5641168e0290 2024-09-11T11:03:14.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1bc8e09640 1 -- 172.21.15.145:0/3326311606 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc02c060 con 0x5641168e0290 2024-09-11T11:03:14.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1bc8e09640 1 -- 172.21.15.145:0/3326311606 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ccc017070 con 0x5641168e0290 2024-09-11T11:03:14.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1bc8e09640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bc4034650 0x7f1bc4036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1bc8e09640 1 -- 172.21.15.145:0/3326311606 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1ccc015020 con 0x5641168e0290 2024-09-11T11:03:14.810 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bc4034650 0x7f1bc4036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56411696fac0 0x564116a64d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116a65370 con 0x56411696fac0 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdce30640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56411696fac0 0x564116a64d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bc4034650 0x7f1bc4036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00ae000 tx=0x7f1cd00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.805+0000 7f1cdce30640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56411696fac0 0x564116a64d00 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdce30640 1 -- 172.21.15.145:0/3326311606 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x56411696fac0 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a66160 0x564116a68550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116a68b90 con 0x564116a66160 2024-09-11T11:03:14.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a66160 0x564116a68550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a66160 0x564116a68550 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3326311606 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ccc02e070 con 0x564116a66160 2024-09-11T11:03:14.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116a6a440 con 0x564116a66160 2024-09-11T11:03:14.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3326311606 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ccc02e070 con 0x564116a66160 2024-09-11T11:03:14.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116a69670 con 0x564116a66160 2024-09-11T11:03:14.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3326311606 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ccc02e070 con 0x564116a66160 2024-09-11T11:03:14.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564116a6b7f0 0x564116a6dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116a6e120 con 0x564116a6b7f0 2024-09-11T11:03:14.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564116a6b7f0 0x564116a6dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.809+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564116a6b7f0 0x564116a6dbe0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/3326311606 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116a6b7f0 2024-09-11T11:03:14.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdeb1f980 1 Processor -- start 2024-09-11T11:03:14.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdeb1f980 1 -- start start 2024-09-11T11:03:14.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdeb1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a7bbb0 0x564116a7bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdeb1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564116872800 con 0x564116a7bbb0 2024-09-11T11:03:14.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a7bbb0 0x564116a7bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a7bbb0 0x564116a7bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37926/0 (socket says 172.21.15.145:37926) 2024-09-11T11:03:14.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3089431374 learned_addr learned my addr 172.21.15.145:0/3089431374 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdc62f640 1 -- 172.21.15.145:0/3089431374 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564116a7c510 con 0x564116a7bbb0 2024-09-11T11:03:14.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/3089431374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a7bbb0 0x564116a7bfd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00e870 tx=0x7f1ccc04a3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1bc1ffb640 1 -- 172.21.15.145:0/3089431374 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc01a480 con 0x564116a7bbb0 2024-09-11T11:03:14.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1bc1ffb640 1 -- 172.21.15.145:0/3089431374 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc01a620 con 0x564116a7bbb0 2024-09-11T11:03:14.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3089431374 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564116a7c7a0 con 0x564116a7bbb0 2024-09-11T11:03:14.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1bc1ffb640 1 -- 172.21.15.145:0/3089431374 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc01a900 con 0x564116a7bbb0 2024-09-11T11:03:14.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3089431374 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564116a7c7a0 con 0x564116a7bbb0 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1bc1ffb640 1 -- 172.21.15.145:0/3089431374 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ccc01d7c0 con 0x564116a7bbb0 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1bc1ffb640 1 --2- 172.21.15.145:0/3089431374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bb40346a0 0x7f1bb4036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1bc1ffb640 1 -- 172.21.15.145:0/3089431374 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1ccc038030 con 0x564116a7bbb0 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/3089431374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bb40346a0 0x7f1bb4036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdeb1f980 1 Processor -- start 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdeb1f980 1 -- start start 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.813+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/3089431374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bb40346a0 0x7f1bb4036b60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0017f50 tx=0x7f1cd0005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a88670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564116a57350 con 0x564116a88270 2024-09-11T11:03:14.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a88670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a88670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37934/0 (socket says 172.21.15.145:37934) 2024-09-11T11:03:14.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 -- 172.21.15.145:0/942864853 learned_addr learned my addr 172.21.15.145:0/942864853 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 -- 172.21.15.145:0/942864853 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564116a88c40 con 0x564116a88270 2024-09-11T11:03:14.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/942864853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a88670 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc04a970 tx=0x7f1ccc0306d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a442309b5a38e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1bbb7fe640 1 -- 172.21.15.145:0/942864853 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc05b020 con 0x564116a88270 2024-09-11T11:03:14.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1bbb7fe640 1 -- 172.21.15.145:0/942864853 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc019ac0 con 0x564116a88270 2024-09-11T11:03:14.820 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1bbb7fe640 1 -- 172.21.15.145:0/942864853 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc03fca0 con 0x564116a88270 2024-09-11T11:03:14.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/942864853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 msgr2=0x564116a88670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/942864853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a88670 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc04a970 tx=0x7f1ccc0306d0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/942864853 shutdown_connections 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/942864853 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a88670 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/942864853 >> 172.21.15.145:0/942864853 conn(0x564116a846a0 msgr2=0x564116a827a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/942864853 shutdown_connections 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/942864853 wait complete. 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 Processor -- start 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 -- start start 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a8f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdeb1f980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x564116a89110 con 0x564116a88270 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a8f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a8f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37942/0 (socket says 172.21.15.145:37942) 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 learned_addr learned my addr 172.21.15.145:0/985615832 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:14.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.817+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564116a8f9e0 con 0x564116a88270 2024-09-11T11:03:14.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a8f4a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc042040 tx=0x7f1ccc00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1bb9ffb640 1 -- 172.21.15.145:0/985615832 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc070070 con 0x564116a88270 2024-09-11T11:03:14.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564116a8f9e0 con 0x564116a88270 2024-09-11T11:03:14.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1bb9ffb640 1 -- 172.21.15.145:0/985615832 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ccc01ddf0 con 0x564116a88270 2024-09-11T11:03:14.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1bb9ffb640 1 -- 172.21.15.145:0/985615832 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ccc0471f0 con 0x564116a88270 2024-09-11T11:03:14.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564116a8fe50 con 0x564116a88270 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1bb9ffb640 1 -- 172.21.15.145:0/985615832 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f1ccc073070 con 0x564116a88270 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1bb9ffb640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bac034650 0x7f1bac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1bb9ffb640 1 -- 172.21.15.145:0/985615832 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1ccc067030 con 0x564116a88270 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bac034650 0x7f1bac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564116a9a640 0x564116a9cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116a9d250 con 0x564116a9a640 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdce30640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564116a9a640 0x564116a9cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bac034650 0x7f1bac036b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0000c10 tx=0x7f1cd00c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdce30640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564116a9a640 0x564116a9cb00 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 20 realm 2024-09-11T11:03:14.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116a99a70 con 0x564116a9a640 2024-09-11T11:03:14.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.828 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116a9dce0 con 0x564116a9a640 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a9eac0 0x564116aa0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aa1540 con 0x564116a9eac0 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.821+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a9eac0 0x564116aa0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a9eac0 0x564116aa0eb0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdeb1f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aa1d90 con 0x564116a9eac0 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdeb1f980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdeb1f980 20 searching for the correct realm 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564116aa3b00 0x564116aa5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116aa3b00 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564116aa3b00 0x564116aa5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdbe2e640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564116aa3b00 0x564116aa5ef0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdc62f640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ccc075060 0x7f1ccc06b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x7f1ccc075060 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdce30640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ccc075060 0x7f1ccc06b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdce30640 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ccc075060 0x7f1ccc06b610 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.825+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116aa3b00 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.834 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x7f1ccc075060 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x7f1ccc075060 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116aa3b00 2024-09-11T11:03:14.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.829+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116aa3b00 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116aa3b00 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x7f1ccc075060 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9a640 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x7f1ccc075060 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116aa3b00 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x7f1ccc075060 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.840 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.833+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116aa3b00 2024-09-11T11:03:14.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x564116aa6570 con 0x564116a9eac0 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:14.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aa2710 con 0x564116a9a640 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aa2350 con 0x564116a9eac0 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aa3030 con 0x7f1ccc075060 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:14.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 zone default found 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 4 Realm: () 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 zonegroup default 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aa2c40 con 0x7f1ccc075060 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aa8db0 con 0x564116aa3b00 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.846 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aa9150 con 0x564116aa3b00 2024-09-11T11:03:14.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:14.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 started sync module instance, tier type = 2024-09-11T11:03:14.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:14.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.837+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aa81f0 con 0x564116a9eac0 2024-09-11T11:03:14.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.841+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.841+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94837553137392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aa81f0 con 0x564116a9eac0 2024-09-11T11:03:14.847 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.841+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aa9b10 con 0x564116a9a640 2024-09-11T11:03:14.848 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.841+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.841+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94837553141344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aa9a80 con 0x564116a9a640 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.841+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aaaa50 con 0x564116a9eac0 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94837553137392] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94837553141344] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94837553143552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aaaa10 con 0x564116a9eac0 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aab2f0 con 0x7f1ccc075060 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94837553147456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aaaa10 con 0x7f1ccc075060 2024-09-11T11:03:14.849 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aabd80 con 0x564116a9eac0 2024-09-11T11:03:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.845+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94837553147456] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.850 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94837553143552] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94837553145120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aabd80 con 0x564116a9eac0 2024-09-11T11:03:14.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aac170 con 0x564116aa3b00 2024-09-11T11:03:14.851 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94837553148512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aac9c0 con 0x564116aa3b00 2024-09-11T11:03:14.852 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aad3c0 con 0x564116aa3b00 2024-09-11T11:03:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94837553145120] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94837553150128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aadc60 con 0x564116aa3b00 2024-09-11T11:03:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aae4b0 con 0x7f1ccc075060 2024-09-11T11:03:14.853 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.849+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94837553148512] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94837553150128] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94837553153296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aae3c0 con 0x7f1ccc075060 2024-09-11T11:03:14.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 add_watcher() i=0 2024-09-11T11:03:14.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 add_watcher() i=1 2024-09-11T11:03:14.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 add_watcher() i=2 2024-09-11T11:03:14.854 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 add_watcher() i=3 2024-09-11T11:03:14.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 add_watcher() i=4 2024-09-11T11:03:14.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 add_watcher() i=5 2024-09-11T11:03:14.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 add_watcher() i=6 2024-09-11T11:03:14.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94837553153296] v36'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 add_watcher() i=7 2024-09-11T11:03:14.855 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:14.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116aad840 con 0x564116a9a640 2024-09-11T11:03:14.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.856 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94837553158208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aade70 con 0x564116a9a640 2024-09-11T11:03:14.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94837553158208] v36'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.857 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1b927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:14.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:14.858 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.853+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116ab9d60 con 0x564116a9eac0 2024-09-11T11:03:14.859 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.857+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.857+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116ab9e50 con 0x7f1ccc075060 2024-09-11T11:03:14.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.857+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.861 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.857+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aba580 con 0x564116aa3b00 2024-09-11T11:03:14.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.861+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.863 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.861+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abaa30 con 0x564116a9a640 2024-09-11T11:03:14.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.861+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.861+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116ab7be0 con 0x564116a9eac0 2024-09-11T11:03:14.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.865+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.865+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116ab7b80 con 0x564116aa3b00 2024-09-11T11:03:14.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.865+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.868 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.865+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abb590 con 0x564116a9eac0 2024-09-11T11:03:14.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.869+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.869+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abb590 con 0x564116a9a640 2024-09-11T11:03:14.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.869+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.869+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abba40 con 0x564116a9eac0 2024-09-11T11:03:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.873+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.873+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abba40 con 0x564116a9eac0 2024-09-11T11:03:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.873+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.873+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abba40 con 0x564116a9eac0 2024-09-11T11:03:14.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.873+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.878 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.873+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abba40 con 0x564116aa3b00 2024-09-11T11:03:14.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.877+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.877+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abbca0 con 0x564116a9eac0 2024-09-11T11:03:14.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.877+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.877+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abbca0 con 0x564116a9a640 2024-09-11T11:03:14.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.881+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.882 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.881+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116a9a640 2024-09-11T11:03:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.881+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.881+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116a9eac0 2024-09-11T11:03:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.885+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'74 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.885+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116a9eac0 2024-09-11T11:03:14.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.885+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.888 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.885+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116aa3b00 2024-09-11T11:03:14.889 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.885+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.890 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.885+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116a9eac0 2024-09-11T11:03:14.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.889+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.889+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116a9a640 2024-09-11T11:03:14.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.893+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.893+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116a9eac0 2024-09-11T11:03:14.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.893+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'75 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.896 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.893+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116a9eac0 2024-09-11T11:03:14.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.897+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.897+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116aa3b00 2024-09-11T11:03:14.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.897+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.897+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116a9eac0 2024-09-11T11:03:14.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.897+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.902 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.897+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc150 con 0x564116aa3b00 2024-09-11T11:03:14.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.901+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.901+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc1e0 con 0x564116aa3b00 2024-09-11T11:03:14.904 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.901+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.901+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc1e0 con 0x564116aa3b00 2024-09-11T11:03:14.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.905+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.905+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc1e0 con 0x564116a9eac0 2024-09-11T11:03:14.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.905+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.905+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc1e0 con 0x564116a9a640 2024-09-11T11:03:14.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.909+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.909+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc1e0 con 0x564116a9eac0 2024-09-11T11:03:14.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.909+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'76 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.909+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc1e0 con 0x564116a9a640 2024-09-11T11:03:14.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'61 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.914 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116abc1e0 con 0x7f1ccc075060 2024-09-11T11:03:14.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1b917e2640 20 reqs_thread_entry: start 2024-09-11T11:03:14.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:14.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 20 Filter name: none 2024-09-11T11:03:14.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1b02ffd640 20 reqs_thread_entry: start 2024-09-11T11:03:14.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-11T11:03:14.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 20 rados->read ofs=0 len=0 2024-09-11T11:03:14.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116ad7730 con 0x564116a9eac0 2024-09-11T11:03:14.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 20 rados_obj.operate() r=0 bl.length=363 2024-09-11T11:03:14.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-11T11:03:14.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-11T11:03:14.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:14.917 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116ad9d10 con 0x564116a9eac0 2024-09-11T11:03:14.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 10 removing key index: true_admin_akey 2024-09-11T11:03:14.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.913+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116ad7d20 con 0x564116aa3b00 2024-09-11T11:03:14.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(96 true_admin_akey [delete] v36'6 uv6 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdeb1f980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-11T11:03:14.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94837553330288 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116ad95b0 con 0x564116aa3b00 2024-09-11T11:03:14.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== watch-notify(notify (1) cookie 94837553148512 notify 154618822685 ret 0) ==== 207+0+0 (crc 0 0 0) 0x564116ab7a70 con 0x564116aa3b00 2024-09-11T11:03:14.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1bbb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822685 cookie 94837553148512 notifier 4871 bl.length()=165 2024-09-11T11:03:14.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(97 notify.5 [notify cookie 94837553330288 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1bbb7fe640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f1ba0003d70 con 0x564116aa3b00 2024-09-11T11:03:14.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== watch-notify(notify_complete (2) cookie 94837553330288 notify 154618822685 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564116ab76d0 con 0x564116aa3b00 2024-09-11T11:03:14.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdeb1f980 10 removing email index: 2024-09-11T11:03:14.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdeb1f980 10 removing user buckets index 2024-09-11T11:03:14.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116ad7870 con 0x564116a9eac0 2024-09-11T11:03:14.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(99 a_user.buckets [delete] v36'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdeb1f980 10 removing user index: a_user 2024-09-11T11:03:14.921 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.917+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116ad95b0 con 0x564116a9eac0 2024-09-11T11:03:14.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(100 a_user [call,call,delete] v36'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdeb1f980 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-11T11:03:14.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdeb1f980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-11T11:03:14.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94837553332464 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x564116ad9520 con 0x564116a9eac0 2024-09-11T11:03:14.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== watch-notify(notify (1) cookie 94837553143552 notify 154618822710 ret 0) ==== 197+0+0 (crc 0 0 0) 0x564116abb590 con 0x564116a9eac0 2024-09-11T11:03:14.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(101 notify.2 [notify cookie 94837553332464 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1bbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822710 cookie 94837553143552 notifier 4871 bl.length()=155 2024-09-11T11:03:14.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1bbaffd640 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f1b100032d0 con 0x564116a9eac0 2024-09-11T11:03:14.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== watch-notify(notify_complete (2) cookie 94837553332464 notify 154618822710 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564116a61200 con 0x564116a9eac0 2024-09-11T11:03:14.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1b927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:14.925 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.921+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94837553158208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116ab5dc0 con 0x564116a9a640 2024-09-11T11:03:14.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.925+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94837553158208] v36'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.928 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.925+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94837553137392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aad840 con 0x564116a9eac0 2024-09-11T11:03:14.929 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.925+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94837553137392] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.925+0000 7f1cdeb1f980 20 remove_watcher() i=0 2024-09-11T11:03:14.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.925+0000 7f1cdeb1f980 2 removed watcher, disabling cache 2024-09-11T11:03:14.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.925+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94837553141344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aad840 con 0x564116a9a640 2024-09-11T11:03:14.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.929+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94837553141344] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x564116a9a640 2024-09-11T11:03:14.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.929+0000 7f1cdeb1f980 20 remove_watcher() i=1 2024-09-11T11:03:14.931 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.929+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94837553143552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aa9660 con 0x564116a9eac0 2024-09-11T11:03:14.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.929+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94837553143552] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.929+0000 7f1cdeb1f980 20 remove_watcher() i=2 2024-09-11T11:03:14.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.929+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94837553147456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aad840 con 0x7f1ccc075060 2024-09-11T11:03:14.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94837553147456] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdeb1f980 20 remove_watcher() i=3 2024-09-11T11:03:14.934 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94837553145120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aa9660 con 0x564116a9eac0 2024-09-11T11:03:14.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdc62f640 1 -- 172.21.15.145:0/985615832 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94837553145120] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ccc072030 con 0x564116a9eac0 2024-09-11T11:03:14.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdeb1f980 20 remove_watcher() i=4 2024-09-11T11:03:14.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94837553148512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aaae40 con 0x564116aa3b00 2024-09-11T11:03:14.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94837553148512] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdeb1f980 20 remove_watcher() i=5 2024-09-11T11:03:14.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.933+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94837553150128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aad840 con 0x564116aa3b00 2024-09-11T11:03:14.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdbe2e640 1 -- 172.21.15.145:0/985615832 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94837553150128] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd00aaad0 con 0x564116aa3b00 2024-09-11T11:03:14.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 20 remove_watcher() i=6 2024-09-11T11:03:14.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94837553153296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x564116aaa520 con 0x7f1ccc075060 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94837553153296] v36'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1cd400a4d0 con 0x7f1ccc075060 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 20 remove_watcher() i=7 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a9eac0 msgr2=0x564116aa0eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a9eac0 0x564116aa0eb0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564116a9a640 msgr2=0x564116a9cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x564116a9a640 0x564116a9cb00 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ccc075060 msgr2=0x7f1ccc06b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f1ccc075060 0x7f1ccc06b610 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564116aa3b00 msgr2=0x564116aa5ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x564116aa3b00 0x564116aa5ef0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.942 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bac034650 msgr2=0x7f1bac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bac034650 0x7f1bac036b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0000c10 tx=0x7f1cd00c1040 comp rx=0 tx=0).stop 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdce30640 1 -- 172.21.15.145:0/985615832 reap_dead start 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 msgr2=0x564116a8f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a8f4a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc042040 tx=0x7f1ccc00a4c0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 shutdown_connections 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/985615832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a88270 0x564116a8f4a0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 >> 172.21.15.145:0/985615832 conn(0x564116a846a0 msgr2=0x564116a82770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 shutdown_connections 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/985615832 wait complete. 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3089431374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bb40346a0 msgr2=0x7f1bb4036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3089431374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bb40346a0 0x7f1bb4036b60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0017f50 tx=0x7f1cd0005ad0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3089431374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a7bbb0 msgr2=0x564116a7bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3089431374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a7bbb0 0x564116a7bfd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00e870 tx=0x7f1ccc04a3a0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3089431374 shutdown_connections 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3089431374 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bb40346a0 0x7f1bb4036b60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3089431374 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x564116a7bbb0 0x564116a7bfd0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3089431374 >> 172.21.15.145:0/3089431374 conn(0x564116a70d00 msgr2=0x564116a73780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3089431374 shutdown_connections 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3089431374 wait complete. 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a66160 msgr2=0x564116a68550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x564116a66160 0x564116a68550 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56411696fac0 msgr2=0x564116a64d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56411696fac0 0x564116a64d00 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564116a6b7f0 msgr2=0x564116a6dbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x564116a6b7f0 0x564116a6dbe0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bc4034650 msgr2=0x7f1bc4036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1bc4034650 0x7f1bc4036b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00ae000 tx=0x7f1cd00a6000 comp rx=0 tx=0).stop 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 msgr2=0x564116a5dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 --2- 172.21.15.145:0/3326311606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5641168e0290 0x564116a5dd50 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc000c10 tx=0x7f1ccc000ee0 comp rx=0 tx=0).stop 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdce30640 1 -- 172.21.15.145:0/3326311606 reap_dead start 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 shutdown_connections 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 >> 172.21.15.145:0/3326311606 conn(0x564116966090 msgr2=0x564116a511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 shutdown_connections 2024-09-11T11:03:14.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:14.937+0000 7f1cdeb1f980 1 -- 172.21.15.145:0/3326311606 wait complete. 2024-09-11T11:03:14.950 ERROR:root:None 2024-09-11T11:03:14.950 ERROR:root:0 2024-09-11T11:03:14.950 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-11T11:03:14.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-11T11:03:14.951 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-11T11:03:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:15.030 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb481d7980 1 Processor -- start 2024-09-11T11:03:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb481d7980 1 -- start start 2024-09-11T11:03:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb481d7980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55aff27abb10 0x55aff283a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb481d7980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aff26bfae0 con 0x55aff283a880 2024-09-11T11:03:15.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb481d7980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55aff26e3e30 con 0x55aff27abb10 2024-09-11T11:03:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb45ce7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55aff27abb10 0x55aff283a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb45ce7640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55aff27abb10 0x55aff283a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37948/0 (socket says 172.21.15.145:37948) 2024-09-11T11:03:15.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb45ce7640 1 -- 172.21.15.145:0/1664289808 learned_addr learned my addr 172.21.15.145:0/1664289808 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb454e6640 1 --1- 172.21.15.145:0/1664289808 >> v1:172.21.15.102:6789/0 conn(0x55aff283a880 0x55aff283cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52156/0 (socket says 172.21.15.145:52156) 2024-09-11T11:03:15.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb45ce7640 1 -- 172.21.15.145:0/1664289808 >> v1:172.21.15.102:6789/0 conn(0x55aff283a880 legacy=0x55aff283cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.029+0000 7fcb45ce7640 1 -- 172.21.15.145:0/1664289808 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff283f3a0 con 0x55aff27abb10 2024-09-11T11:03:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/1664289808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff283a340 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800a5c0 tx=0x7fcb3801b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a45ffafea1562aa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb44ce5640 1 -- 172.21.15.145:0/1664289808 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380a6070 con 0x55aff27abb10 2024-09-11T11:03:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb44ce5640 1 -- 172.21.15.145:0/1664289808 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380af070 con 0x55aff27abb10 2024-09-11T11:03:15.035 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb44ce5640 1 -- 172.21.15.145:0/1664289808 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380aa5c0 con 0x55aff27abb10 2024-09-11T11:03:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb481d7980 1 -- 172.21.15.145:0/1664289808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 msgr2=0x55aff283a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb481d7980 1 --2- 172.21.15.145:0/1664289808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff283a340 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fcb3800a5c0 tx=0x7fcb3801b340 comp rx=0 tx=0).stop 2024-09-11T11:03:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb481d7980 1 -- 172.21.15.145:0/1664289808 shutdown_connections 2024-09-11T11:03:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb481d7980 1 --2- 172.21.15.145:0/1664289808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff283a340 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb481d7980 1 -- 172.21.15.145:0/1664289808 >> 172.21.15.145:0/1664289808 conn(0x55aff2832070 msgr2=0x55aff2834490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb481d7980 1 -- 172.21.15.145:0/1664289808 shutdown_connections 2024-09-11T11:03:15.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.033+0000 7fcb481d7980 1 -- 172.21.15.145:0/1664289808 wait complete. 2024-09-11T11:03:15.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.045+0000 7fcb481d7980 1 Processor -- start 2024-09-11T11:03:15.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.045+0000 7fcb481d7980 1 -- start start 2024-09-11T11:03:15.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.045+0000 7fcb481d7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2922a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.045+0000 7fcb481d7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aff26e5200 con 0x55aff27abb10 2024-09-11T11:03:15.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2922a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2922a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37950/0 (socket says 172.21.15.145:37950) 2024-09-11T11:03:15.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 -- 172.21.15.145:0/2814304678 learned_addr learned my addr 172.21.15.145:0/2814304678 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 -- 172.21.15.145:0/2814304678 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff2923050 con 0x55aff27abb10 2024-09-11T11:03:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/2814304678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2922a80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcb380199f0 tx=0x7fcb38003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646b3220e1a4ce24 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fca33e07640 1 -- 172.21.15.145:0/2814304678 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380aaa00 con 0x55aff27abb10 2024-09-11T11:03:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fca33e07640 1 -- 172.21.15.145:0/2814304678 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380aaba0 con 0x55aff27abb10 2024-09-11T11:03:15.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fca33e07640 1 -- 172.21.15.145:0/2814304678 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380bd3f0 con 0x55aff27abb10 2024-09-11T11:03:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 -- 172.21.15.145:0/2814304678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 msgr2=0x55aff2922a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 --2- 172.21.15.145:0/2814304678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2922a80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcb380199f0 tx=0x7fcb38003030 comp rx=0 tx=0).stop 2024-09-11T11:03:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 -- 172.21.15.145:0/2814304678 shutdown_connections 2024-09-11T11:03:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 --2- 172.21.15.145:0/2814304678 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2922a80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 -- 172.21.15.145:0/2814304678 >> 172.21.15.145:0/2814304678 conn(0x55aff2832070 msgr2=0x55aff291e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 -- 172.21.15.145:0/2814304678 shutdown_connections 2024-09-11T11:03:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 -- 172.21.15.145:0/2814304678 wait complete. 2024-09-11T11:03:15.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 Processor -- start 2024-09-11T11:03:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 -- start start 2024-09-11T11:03:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2837c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aff283ee40 con 0x55aff27abb10 2024-09-11T11:03:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2837c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2837c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37958/0 (socket says 172.21.15.145:37958) 2024-09-11T11:03:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3312914204 learned_addr learned my addr 172.21.15.145:0/3312914204 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.054 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3312914204 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff2836360 con 0x55aff27abb10 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2837c40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcb380199f0 tx=0x7fcb380180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fca32604640 1 -- 172.21.15.145:0/3312914204 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380bd7c0 con 0x55aff27abb10 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fca32604640 1 -- 172.21.15.145:0/3312914204 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380bd960 con 0x55aff27abb10 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.049+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aff28365f0 con 0x55aff27abb10 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fca32604640 1 -- 172.21.15.145:0/3312914204 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380bdc40 con 0x55aff27abb10 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff2836ae0 con 0x55aff27abb10 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fca32604640 1 -- 172.21.15.145:0/3312914204 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb380ce020 con 0x55aff27abb10 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fca32604640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca2c034650 0x7fca2c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fca32604640 1 -- 172.21.15.145:0/3312914204 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fcb380cc020 con 0x55aff27abb10 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb454e6640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca2c034650 0x7fca2c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff283a880 0x55aff29330f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff2933630 con 0x55aff283a880 2024-09-11T11:03:15.056 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb464e8640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff283a880 0x55aff29330f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb454e6640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca2c034650 0x7fca2c036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c001e50 tx=0x7fcb3c0013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.057 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb464e8640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff283a880 0x55aff29330f0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb464e8640 1 -- 172.21.15.145:0/3312914204 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff283a880 2024-09-11T11:03:15.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff29340e0 0x55aff29365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff2936d10 con 0x55aff29340e0 2024-09-11T11:03:15.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff29340e0 0x55aff29365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.053+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff29340e0 0x55aff29365a0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3312914204 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff29340e0 2024-09-11T11:03:15.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff29385c0 con 0x55aff29340e0 2024-09-11T11:03:15.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3312914204 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff29340e0 2024-09-11T11:03:15.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff29377f0 con 0x55aff29340e0 2024-09-11T11:03:15.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3312914204 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff29340e0 2024-09-11T11:03:15.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55aff2939970 0x55aff293bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff293c2a0 con 0x55aff2939970 2024-09-11T11:03:15.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb454e6640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55aff2939970 0x55aff293bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb454e6640 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55aff2939970 0x55aff293bd60 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb454e6640 1 -- 172.21.15.145:0/3312914204 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb3c00f700 con 0x55aff2939970 2024-09-11T11:03:15.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb481d7980 1 Processor -- start 2024-09-11T11:03:15.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb481d7980 1 -- start start 2024-09-11T11:03:15.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb481d7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2949c60 0x55aff294a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb481d7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aff273e800 con 0x55aff2949c60 2024-09-11T11:03:15.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2949c60 0x55aff294a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2949c60 0x55aff294a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37964/0 (socket says 172.21.15.145:37964) 2024-09-11T11:03:15.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3262553692 learned_addr learned my addr 172.21.15.145:0/3262553692 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.057+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3262553692 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff294a5c0 con 0x55aff2949c60 2024-09-11T11:03:15.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/3262553692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2949c60 0x55aff294a080 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcb3801b380 tx=0x7fcb380bcc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca2b7fe640 1 -- 172.21.15.145:0/3262553692 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380bcda0 con 0x55aff2949c60 2024-09-11T11:03:15.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb481d7980 1 -- 172.21.15.145:0/3262553692 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aff294a7f0 con 0x55aff2949c60 2024-09-11T11:03:15.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca2b7fe640 1 -- 172.21.15.145:0/3262553692 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380e3130 con 0x55aff2949c60 2024-09-11T11:03:15.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca2b7fe640 1 -- 172.21.15.145:0/3262553692 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380e3410 con 0x55aff2949c60 2024-09-11T11:03:15.063 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb481d7980 1 -- 172.21.15.145:0/3262553692 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff294d470 con 0x55aff2949c60 2024-09-11T11:03:15.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca2b7fe640 1 -- 172.21.15.145:0/3262553692 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb380c53e0 con 0x55aff2949c60 2024-09-11T11:03:15.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca2b7fe640 1 --2- 172.21.15.145:0/3262553692 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca20034650 0x7fca20036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca2b7fe640 1 -- 172.21.15.145:0/3262553692 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fcb380eb070 con 0x55aff2949c60 2024-09-11T11:03:15.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb454e6640 1 --2- 172.21.15.145:0/3262553692 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca20034650 0x7fca20036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb481d7980 1 Processor -- start 2024-09-11T11:03:15.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb481d7980 1 -- start start 2024-09-11T11:03:15.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb481d7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff2956960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.064 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb454e6640 1 --2- 172.21.15.145:0/3262553692 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca20034650 0x7fca20036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55aff2837370 tx=0x7fcb3c00f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb481d7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aff2923310 con 0x55aff2956580 2024-09-11T11:03:15.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff2956960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff2956960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37972/0 (socket says 172.21.15.145:37972) 2024-09-11T11:03:15.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3859911827 learned_addr learned my addr 172.21.15.145:0/3859911827 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb45ce7640 1 -- 172.21.15.145:0/3859911827 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff2956f30 con 0x55aff2956580 2024-09-11T11:03:15.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/3859911827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff2956960 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcb380e09a0 tx=0x7fcb38002550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5b887f8d4ef351a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca297fa640 1 -- 172.21.15.145:0/3859911827 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380e0d50 con 0x55aff2956580 2024-09-11T11:03:15.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca297fa640 1 -- 172.21.15.145:0/3859911827 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb38002ca0 con 0x55aff2956580 2024-09-11T11:03:15.066 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.061+0000 7fca297fa640 1 -- 172.21.15.145:0/3859911827 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb38004290 con 0x55aff2956580 2024-09-11T11:03:15.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- 172.21.15.145:0/3859911827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 msgr2=0x55aff2956960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3859911827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff2956960 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fcb380e09a0 tx=0x7fcb38002550 comp rx=0 tx=0).stop 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- 172.21.15.145:0/3859911827 shutdown_connections 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3859911827 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff2956960 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- 172.21.15.145:0/3859911827 >> 172.21.15.145:0/3859911827 conn(0x55aff2952960 msgr2=0x55aff2950a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- 172.21.15.145:0/3859911827 shutdown_connections 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- 172.21.15.145:0/3859911827 wait complete. 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 Processor -- start 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- start start 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff295d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aff29573d0 con 0x55aff2956580 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff295d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb45ce7640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff295d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37982/0 (socket says 172.21.15.145:37982) 2024-09-11T11:03:15.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 learned_addr learned my addr 172.21.15.145:0/753067802 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aff295dcd0 con 0x55aff2956580 2024-09-11T11:03:15.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff295d790 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcb380cdf10 tx=0x7fcb380a4fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fca177fe640 1 -- 172.21.15.145:0/753067802 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb38116020 con 0x55aff2956580 2024-09-11T11:03:15.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aff295dcd0 con 0x55aff2956580 2024-09-11T11:03:15.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fca177fe640 1 -- 172.21.15.145:0/753067802 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb380c5800 con 0x55aff2956580 2024-09-11T11:03:15.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fca177fe640 1 -- 172.21.15.145:0/753067802 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb380e06e0 con 0x55aff2956580 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aff295dcd0 con 0x55aff2956580 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fca177fe640 1 -- 172.21.15.145:0/753067802 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fcb38119020 con 0x55aff2956580 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fca177fe640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca10034600 0x7fca10036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.065+0000 7fca177fe640 1 -- 172.21.15.145:0/753067802 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fcb3811cc10 con 0x55aff2956580 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb454e6640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca10034600 0x7fca10036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff2968720 0x55aff296abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff296b330 con 0x55aff2968720 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb464e8640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff2968720 0x55aff296abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb454e6640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca10034600 0x7fca10036ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55aff2938510 tx=0x7fcb3c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb464e8640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff2968720 0x55aff296abe0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 realm 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff2967b50 con 0x55aff2968720 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff296bdc0 con 0x55aff2968720 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.073 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff296cba0 0x55aff296ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.074 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff296f620 con 0x55aff296cba0 2024-09-11T11:03:15.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff296cba0 0x55aff296ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff296cba0 0x55aff296ef90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 20 searching for the correct realm 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55aff2971be0 0x55aff2973fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff2974650 con 0x55aff2971be0 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.069+0000 7fcb454e6640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55aff2971be0 0x55aff2973fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb454e6640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55aff2971be0 0x55aff2973fd0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff2974650 con 0x55aff296cba0 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb45ce7640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fcb3811b020 0x7fcb38122910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x7fcb3811b020 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fcb3811b020 0x7fcb38122910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fcb3811b020 0x7fcb38122910 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2971be0 2024-09-11T11:03:15.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.079 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.073+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x7fcb3811b020 2024-09-11T11:03:15.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x7fcb3811b020 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2971be0 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.084 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2971be0 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.077+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2971be0 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x7fcb3811b020 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2968720 2024-09-11T11:03:15.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x7fcb3811b020 2024-09-11T11:03:15.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2971be0 2024-09-11T11:03:15.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x7fcb3811b020 2024-09-11T11:03:15.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff2971be0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.081+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55aff296fe70 con 0x55aff296cba0 2024-09-11T11:03:15.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff29706c0 con 0x55aff2968720 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff2970ab0 con 0x55aff296cba0 2024-09-11T11:03:15.090 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff2970ab0 con 0x7fcb3811b020 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 zone default found 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 4 Realm: () 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 zonegroup default 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.091 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff2974ab0 con 0x7fcb3811b020 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff2970ff0 con 0x55aff2971be0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff2976e60 con 0x55aff2971be0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 started sync module instance, tier type = 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:15.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.085+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2976170 con 0x55aff296cba0 2024-09-11T11:03:15.093 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.089+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.089+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94214177646224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2976170 con 0x55aff296cba0 2024-09-11T11:03:15.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.089+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff29778e0 con 0x55aff2968720 2024-09-11T11:03:15.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.089+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.089+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94214177649712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2977d00 con 0x55aff2968720 2024-09-11T11:03:15.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.089+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2978750 con 0x55aff296cba0 2024-09-11T11:03:15.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.089+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94214177646224] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.089+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94214177649712] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.093+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.093+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94214177653312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2977850 con 0x55aff296cba0 2024-09-11T11:03:15.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.093+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2978ff0 con 0x7fcb3811b020 2024-09-11T11:03:15.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.093+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.093+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94214177655616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2977850 con 0x7fcb3811b020 2024-09-11T11:03:15.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.093+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2979ab0 con 0x55aff296cba0 2024-09-11T11:03:15.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.093+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94214177655616] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.093+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94214177653312] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94214177643712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2979a70 con 0x55aff296cba0 2024-09-11T11:03:15.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2979ea0 con 0x55aff2971be0 2024-09-11T11:03:15.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94214177656672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff297a740 con 0x55aff2971be0 2024-09-11T11:03:15.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff297b100 con 0x55aff2971be0 2024-09-11T11:03:15.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94214177656672] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94214177661584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff297b9a0 con 0x55aff2971be0 2024-09-11T11:03:15.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff297c360 con 0x7fcb3811b020 2024-09-11T11:03:15.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94214177643712] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94214177658240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff297c360 con 0x7fcb3811b020 2024-09-11T11:03:15.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 20 add_watcher() i=0 2024-09-11T11:03:15.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 20 add_watcher() i=1 2024-09-11T11:03:15.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 20 add_watcher() i=2 2024-09-11T11:03:15.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 20 add_watcher() i=3 2024-09-11T11:03:15.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 20 add_watcher() i=4 2024-09-11T11:03:15.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 20 add_watcher() i=5 2024-09-11T11:03:15.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94214177661584] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.097+0000 7fcb481d7980 20 add_watcher() i=6 2024-09-11T11:03:15.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94214177658240] v36'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x7fcb3811b020 2024-09-11T11:03:15.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 20 add_watcher() i=7 2024-09-11T11:03:15.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:15.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff297c360 con 0x55aff2968720 2024-09-11T11:03:15.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94214177668784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff297c2d0 con 0x55aff2968720 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94214177668784] v36'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fc9fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 5 note: GC not initialized 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fc9fafe5640 20 reqs_thread_entry: start 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 20 Filter name: none 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fc9f8fe1640 20 reqs_thread_entry: start 2024-09-11T11:03:15.106 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:15.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.101+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff29a29b0 con 0x55aff2968720 2024-09-11T11:03:15.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fcb4000a4d0 con 0x55aff2968720 2024-09-11T11:03:15.107 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 20 rados_obj.operate() r=0 bl.length=460 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff29a8f20 con 0x55aff2968720 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fcb40039040 con 0x55aff2968720 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:15.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94214177851792 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55aff29a4630 con 0x55aff296cba0 2024-09-11T11:03:15.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94214177643712 notify 154618822711 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55aff294a7f0 con 0x55aff296cba0 2024-09-11T11:03:15.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fca297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822711 cookie 94214177643712 notifier 4878 bl.length()=666 2024-09-11T11:03:15.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fca297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fca297fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fca297fa640 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fca08003eb0 con 0x55aff296cba0 2024-09-11T11:03:15.109 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94214177851792 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.110 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.105+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94214177851792 notify 154618822711 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55aff294a5c0 con 0x55aff296cba0 2024-09-11T11:03:15.110 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:15.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.109+0000 7fc9fbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.109+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94214177668784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff29a07b0 con 0x55aff2968720 2024-09-11T11:03:15.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.109+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94214177668784] v36'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb40039040 con 0x55aff2968720 2024-09-11T11:03:15.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.109+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94214177646224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff29a07b0 con 0x55aff296cba0 2024-09-11T11:03:15.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.113+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94214177646224] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.113+0000 7fcb481d7980 20 remove_watcher() i=0 2024-09-11T11:03:15.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.113+0000 7fcb481d7980 2 removed watcher, disabling cache 2024-09-11T11:03:15.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.113+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94214177649712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff29a07b0 con 0x55aff2968720 2024-09-11T11:03:15.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.113+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94214177649712] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb40039040 con 0x55aff2968720 2024-09-11T11:03:15.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.113+0000 7fcb481d7980 20 remove_watcher() i=1 2024-09-11T11:03:15.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.113+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94214177653312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2977430 con 0x55aff296cba0 2024-09-11T11:03:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94214177653312] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb481d7980 20 remove_watcher() i=2 2024-09-11T11:03:15.118 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94214177655616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff29a07b0 con 0x7fcb3811b020 2024-09-11T11:03:15.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94214177655616] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb40039040 con 0x7fcb3811b020 2024-09-11T11:03:15.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb481d7980 20 remove_watcher() i=3 2024-09-11T11:03:15.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94214177643712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2978240 con 0x55aff296cba0 2024-09-11T11:03:15.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb45ce7640 1 -- 172.21.15.145:0/753067802 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94214177643712] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb380bc3a0 con 0x55aff296cba0 2024-09-11T11:03:15.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb481d7980 20 remove_watcher() i=4 2024-09-11T11:03:15.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.117+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94214177656672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2977430 con 0x55aff2971be0 2024-09-11T11:03:15.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94214177656672] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 20 remove_watcher() i=5 2024-09-11T11:03:15.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94214177661584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff29a07b0 con 0x55aff2971be0 2024-09-11T11:03:15.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb454e6640 1 -- 172.21.15.145:0/753067802 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94214177661584] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c037040 con 0x55aff2971be0 2024-09-11T11:03:15.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 20 remove_watcher() i=6 2024-09-11T11:03:15.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94214177658240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55aff2975cc0 con 0x7fcb3811b020 2024-09-11T11:03:15.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94214177658240] v36'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb40039040 con 0x7fcb3811b020 2024-09-11T11:03:15.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 20 remove_watcher() i=7 2024-09-11T11:03:15.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff296cba0 msgr2=0x55aff296ef90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff296cba0 0x55aff296ef90 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff2968720 msgr2=0x55aff296abe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff2968720 0x55aff296abe0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fcb3811b020 msgr2=0x7fcb38122910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fcb3811b020 0x7fcb38122910 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55aff2971be0 msgr2=0x55aff2973fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55aff2971be0 0x55aff2973fd0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca10034600 msgr2=0x7fca10036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca10034600 0x7fca10036ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55aff2938510 tx=0x7fcb3c010000 comp rx=0 tx=0).stop 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 msgr2=0x55aff295d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb464e8640 1 -- 172.21.15.145:0/753067802 reap_dead start 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff295d790 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcb380cdf10 tx=0x7fcb380a4fd0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 shutdown_connections 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/753067802 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2956580 0x55aff295d790 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 >> 172.21.15.145:0/753067802 conn(0x55aff2952960 msgr2=0x55aff2950a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 shutdown_connections 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/753067802 wait complete. 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3262553692 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca20034650 msgr2=0x7fca20036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3262553692 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca20034650 0x7fca20036b10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x55aff2837370 tx=0x7fcb3c00f000 comp rx=0 tx=0).stop 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3262553692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2949c60 msgr2=0x55aff294a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3262553692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2949c60 0x55aff294a080 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fcb3801b380 tx=0x7fcb380bcc70 comp rx=0 tx=0).stop 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3262553692 shutdown_connections 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3262553692 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca20034650 0x7fca20036b10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3262553692 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff2949c60 0x55aff294a080 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3262553692 >> 172.21.15.145:0/3262553692 conn(0x55aff293edb0 msgr2=0x55aff2941830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3262553692 shutdown_connections 2024-09-11T11:03:15.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3262553692 wait complete. 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff29340e0 msgr2=0x55aff29365a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55aff29340e0 0x55aff29365a0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff283a880 msgr2=0x55aff29330f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55aff283a880 0x55aff29330f0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55aff2939970 msgr2=0x55aff293bd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55aff2939970 0x55aff293bd60 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca2c034650 msgr2=0x7fca2c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fca2c034650 0x7fca2c036b10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c001e50 tx=0x7fcb3c0013b0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 msgr2=0x55aff2837c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 --2- 172.21.15.145:0/3312914204 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aff27abb10 0x55aff2837c40 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcb380199f0 tx=0x7fcb380180e0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb464e8640 1 -- 172.21.15.145:0/3312914204 reap_dead start 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 shutdown_connections 2024-09-11T11:03:15.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 >> 172.21.15.145:0/3312914204 conn(0x55aff2832070 msgr2=0x55aff291d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 shutdown_connections 2024-09-11T11:03:15.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.121+0000 7fcb481d7980 1 -- 172.21.15.145:0/3312914204 wait complete. 2024-09-11T11:03:15.136 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.136 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.136 ERROR:root:0 2024-09-11T11:03:15.136 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:15.141 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:15.141 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-11T11:03:15.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-11T11:03:15.141 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-11T11:03:15.207 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:15.208 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:15.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f327835d980 1 Processor -- start 2024-09-11T11:03:15.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f327835d980 1 -- start start 2024-09-11T11:03:15.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f327835d980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558d694178f0 0x558d69417cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f327835d980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d6929dae0 con 0x558d69418240 2024-09-11T11:03:15.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f327835d980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x558d692c1e30 con 0x558d694178f0 2024-09-11T11:03:15.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f3275e6d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558d694178f0 0x558d69417cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f3275e6d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x558d694178f0 0x558d69417cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:37988/0 (socket says 172.21.15.145:37988) 2024-09-11T11:03:15.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f3275e6d640 1 -- 172.21.15.145:0/2149030391 learned_addr learned my addr 172.21.15.145:0/2149030391 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f327566c640 1 --1- 172.21.15.145:0/2149030391 >> v1:172.21.15.102:6789/0 conn(0x558d69418240 0x558d6941cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52172/0 (socket says 172.21.15.145:52172) 2024-09-11T11:03:15.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f3275e6d640 1 -- 172.21.15.145:0/2149030391 >> v1:172.21.15.102:6789/0 conn(0x558d69418240 legacy=0x558d6941cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.205+0000 7f3275e6d640 1 -- 172.21.15.145:0/2149030391 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d6941f4c0 con 0x558d694178f0 2024-09-11T11:03:15.212 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f3275e6d640 1 --2- 172.21.15.145:0/2149030391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69417cd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f327000a4e0 tx=0x7f327001b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8ecacb3f0d1e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f3274e6b640 1 -- 172.21.15.145:0/2149030391 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700aa540 con 0x558d694178f0 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f3274e6b640 1 -- 172.21.15.145:0/2149030391 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700aa6e0 con 0x558d694178f0 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f3274e6b640 1 -- 172.21.15.145:0/2149030391 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700aaa40 con 0x558d694178f0 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f327835d980 1 -- 172.21.15.145:0/2149030391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 msgr2=0x558d69417cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f327835d980 1 --2- 172.21.15.145:0/2149030391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69417cd0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f327000a4e0 tx=0x7f327001b090 comp rx=0 tx=0).stop 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f327835d980 1 -- 172.21.15.145:0/2149030391 shutdown_connections 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f327835d980 1 --2- 172.21.15.145:0/2149030391 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69417cd0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f327835d980 1 -- 172.21.15.145:0/2149030391 >> 172.21.15.145:0/2149030391 conn(0x558d6938b240 msgr2=0x558d6938b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f327835d980 1 -- 172.21.15.145:0/2149030391 shutdown_connections 2024-09-11T11:03:15.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.209+0000 7f327835d980 1 -- 172.21.15.145:0/2149030391 wait complete. 2024-09-11T11:03:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.221+0000 7f327835d980 1 Processor -- start 2024-09-11T11:03:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- start start 2024-09-11T11:03:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69502c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558d692c3200 con 0x558d694178f0 2024-09-11T11:03:15.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69502c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69502c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38004/0 (socket says 172.21.15.145:38004) 2024-09-11T11:03:15.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3275e6d640 1 -- 172.21.15.145:0/3622406970 learned_addr learned my addr 172.21.15.145:0/3622406970 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3275e6d640 1 -- 172.21.15.145:0/3622406970 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d69503210 con 0x558d694178f0 2024-09-11T11:03:15.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3275e6d640 1 --2- 172.21.15.145:0/3622406970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69502c40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3270017ca0 tx=0x7f32700033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed8cfcd7d04fa71 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3163e07640 1 -- 172.21.15.145:0/3622406970 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700b9070 con 0x558d694178f0 2024-09-11T11:03:15.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3163e07640 1 -- 172.21.15.145:0/3622406970 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700aaa80 con 0x558d694178f0 2024-09-11T11:03:15.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3163e07640 1 -- 172.21.15.145:0/3622406970 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700aad60 con 0x558d694178f0 2024-09-11T11:03:15.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- 172.21.15.145:0/3622406970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 msgr2=0x558d69502c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 --2- 172.21.15.145:0/3622406970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69502c40 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3270017ca0 tx=0x7f32700033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- 172.21.15.145:0/3622406970 shutdown_connections 2024-09-11T11:03:15.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 --2- 172.21.15.145:0/3622406970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69502c40 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- 172.21.15.145:0/3622406970 >> 172.21.15.145:0/3622406970 conn(0x558d6938b240 msgr2=0x558d694fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- 172.21.15.145:0/3622406970 shutdown_connections 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- 172.21.15.145:0/3622406970 wait complete. 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 Processor -- start 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- start start 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69509ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f327835d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558d6941ef00 con 0x558d694178f0 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69509ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69509ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38014/0 (socket says 172.21.15.145:38014) 2024-09-11T11:03:15.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.225+0000 7f3275e6d640 1 -- 172.21.15.145:0/3004644900 learned_addr learned my addr 172.21.15.145:0/3004644900 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f3275e6d640 1 -- 172.21.15.145:0/3004644900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d6950a430 con 0x558d694178f0 2024-09-11T11:03:15.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f3275e6d640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69509ef0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3270018cc0 tx=0x7f3270017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f3162604640 1 -- 172.21.15.145:0/3004644900 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700cc070 con 0x558d694178f0 2024-09-11T11:03:15.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f3162604640 1 -- 172.21.15.145:0/3004644900 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700c7410 con 0x558d694178f0 2024-09-11T11:03:15.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d6950a6c0 con 0x558d694178f0 2024-09-11T11:03:15.231 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f3162604640 1 -- 172.21.15.145:0/3004644900 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700b9070 con 0x558d694178f0 2024-09-11T11:03:15.232 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d6950d3a0 con 0x558d694178f0 2024-09-11T11:03:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f3162604640 1 -- 172.21.15.145:0/3004644900 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32700b3040 con 0x558d694178f0 2024-09-11T11:03:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f3162604640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c0346a0 0x7f315c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f3162604640 1 -- 172.21.15.145:0/3004644900 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f32700c4070 con 0x558d694178f0 2024-09-11T11:03:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327566c640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c0346a0 0x7f315c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327835d980 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d69418240 0x558d69510ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69511570 con 0x558d69418240 2024-09-11T11:03:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327666e640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d69418240 0x558d69510ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327566c640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c0346a0 0x7f315c036b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3260001e50 tx=0x7f32600013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327666e640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d69418240 0x558d69510ff0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.234 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327666e640 1 -- 172.21.15.145:0/3004644900 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d69418240 2024-09-11T11:03:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327835d980 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d69512340 0x558d69514730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.229+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69514d60 con 0x558d69512340 2024-09-11T11:03:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f3275e6d640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d69512340 0x558d69514730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f3275e6d640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d69512340 0x558d69514730 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f3275e6d640 1 -- 172.21.15.145:0/3004644900 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f32700ce310 con 0x558d69512340 2024-09-11T11:03:15.235 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69516610 con 0x558d69512340 2024-09-11T11:03:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f3275e6d640 1 -- 172.21.15.145:0/3004644900 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f32700ce310 con 0x558d69512340 2024-09-11T11:03:15.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69515780 con 0x558d69512340 2024-09-11T11:03:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f3275e6d640 1 -- 172.21.15.145:0/3004644900 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f32700ce310 con 0x558d69512340 2024-09-11T11:03:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f327835d980 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558d695179c0 0x558d69519db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d6951a2f0 con 0x558d695179c0 2024-09-11T11:03:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f327566c640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558d695179c0 0x558d69519db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f327566c640 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558d695179c0 0x558d69519db0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.233+0000 7f327566c640 1 -- 172.21.15.145:0/3004644900 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f326000f700 con 0x558d695179c0 2024-09-11T11:03:15.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 Processor -- start 2024-09-11T11:03:15.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 -- start start 2024-09-11T11:03:15.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d69527ca0 0x558d695280c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558d6931c800 con 0x558d69527ca0 2024-09-11T11:03:15.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d69527ca0 0x558d695280c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d69527ca0 0x558d695280c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38024/0 (socket says 172.21.15.145:38024) 2024-09-11T11:03:15.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f3275e6d640 1 -- 172.21.15.145:0/360109134 learned_addr learned my addr 172.21.15.145:0/360109134 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f3275e6d640 1 -- 172.21.15.145:0/360109134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d69528600 con 0x558d69527ca0 2024-09-11T11:03:15.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f3275e6d640 1 --2- 172.21.15.145:0/360109134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d69527ca0 0x558d695280c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f32700b8000 tx=0x7f32700c6ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f315b7fe640 1 -- 172.21.15.145:0/360109134 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700e4c70 con 0x558d69527ca0 2024-09-11T11:03:15.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 -- 172.21.15.145:0/360109134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d69528890 con 0x558d69527ca0 2024-09-11T11:03:15.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f315b7fe640 1 -- 172.21.15.145:0/360109134 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700e8070 con 0x558d69527ca0 2024-09-11T11:03:15.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f315b7fe640 1 -- 172.21.15.145:0/360109134 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700e4210 con 0x558d69527ca0 2024-09-11T11:03:15.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 -- 172.21.15.145:0/360109134 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d6952b510 con 0x558d69527ca0 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f315b7fe640 1 -- 172.21.15.145:0/360109134 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f32700ea030 con 0x558d69527ca0 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f315b7fe640 1 --2- 172.21.15.145:0/360109134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3150034650 0x7f3150036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f315b7fe640 1 -- 172.21.15.145:0/360109134 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f32700d6040 con 0x558d69527ca0 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327566c640 1 --2- 172.21.15.145:0/360109134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3150034650 0x7f3150036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 Processor -- start 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 -- start start 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327566c640 1 --2- 172.21.15.145:0/360109134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3150034650 0x7f3150036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x558d6950e4e0 tx=0x7f326000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d695348a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f327835d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558d695034d0 con 0x558d695344a0 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.237+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d695348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d695348a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38028/0 (socket says 172.21.15.145:38028) 2024-09-11T11:03:15.242 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 -- 172.21.15.145:0/952232453 learned_addr learned my addr 172.21.15.145:0/952232453 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 -- 172.21.15.145:0/952232453 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d69534e70 con 0x558d695344a0 2024-09-11T11:03:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 --2- 172.21.15.145:0/952232453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d695348a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f32700e1b80 tx=0x7f32700da6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fd9a2a4132b868 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f31597fa640 1 -- 172.21.15.145:0/952232453 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700f1030 con 0x558d695344a0 2024-09-11T11:03:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f31597fa640 1 -- 172.21.15.145:0/952232453 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700bd780 con 0x558d695344a0 2024-09-11T11:03:15.245 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f31597fa640 1 -- 172.21.15.145:0/952232453 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32700e60e0 con 0x558d695344a0 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- 172.21.15.145:0/952232453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 msgr2=0x558d695348a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 --2- 172.21.15.145:0/952232453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d695348a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f32700e1b80 tx=0x7f32700da6d0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- 172.21.15.145:0/952232453 shutdown_connections 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 --2- 172.21.15.145:0/952232453 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d695348a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- 172.21.15.145:0/952232453 >> 172.21.15.145:0/952232453 conn(0x558d69530830 msgr2=0x558d6952e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- 172.21.15.145:0/952232453 shutdown_connections 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- 172.21.15.145:0/952232453 wait complete. 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 Processor -- start 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- start start 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d6953b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558d695353c0 con 0x558d695344a0 2024-09-11T11:03:15.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d6953b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d6953b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38036/0 (socket says 172.21.15.145:38036) 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 learned_addr learned my addr 172.21.15.145:0/4026869700 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d6953bb80 con 0x558d695344a0 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f3275e6d640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d6953b640 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f32700cff50 tx=0x7f32700acea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f31477fe640 1 -- 172.21.15.145:0/4026869700 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3270110070 con 0x558d695344a0 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d6953bb80 con 0x558d695344a0 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f31477fe640 1 -- 172.21.15.145:0/4026869700 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32700e43b0 con 0x558d695344a0 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d6953bff0 con 0x558d695344a0 2024-09-11T11:03:15.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.241+0000 7f31477fe640 1 -- 172.21.15.145:0/4026869700 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f327011a060 con 0x558d695344a0 2024-09-11T11:03:15.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f31477fe640 1 -- 172.21.15.145:0/4026869700 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f3270113070 con 0x558d695344a0 2024-09-11T11:03:15.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f31477fe640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3140034650 0x7f3140036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f31477fe640 1 -- 172.21.15.145:0/4026869700 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f3270108070 con 0x558d695344a0 2024-09-11T11:03:15.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327566c640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3140034650 0x7f3140036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d695465f0 0x558d69548ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69549200 con 0x558d695465f0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327666e640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d695465f0 0x558d69548ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327566c640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3140034650 0x7f3140036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x558d69516550 tx=0x7f3260010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327666e640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d695465f0 0x558d69548ab0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 realm 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69545a70 con 0x558d695465f0 2024-09-11T11:03:15.252 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69549cc0 con 0x558d695465f0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d6954aaa0 0x558d6954ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f3275e6d640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d6954aaa0 0x558d6954ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f3275e6d640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d6954aaa0 0x558d6954ce90 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.253 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.245+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d6954dd70 con 0x558d6954aaa0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327835d980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327835d980 20 searching for the correct realm 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558d6954f5e0 0x558d69551aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d69552170 con 0x558d6954f5e0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327566c640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558d6954f5e0 0x558d69551aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327566c640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558d6954f5e0 0x558d69551aa0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d69552170 con 0x558d6954aaa0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f3275e6d640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3270115060 0x7f32700e65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x7f3270115060 2024-09-11T11:03:15.255 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3270115060 0x7f32700e65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3270115060 0x7f32700e65b0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954f5e0 2024-09-11T11:03:15.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.249+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x7f3270115060 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.261 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x7f3270115060 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954f5e0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954f5e0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.262 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.253+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954f5e0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x7f3270115060 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d695465f0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x7f3270115060 2024-09-11T11:03:15.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954f5e0 2024-09-11T11:03:15.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x7f3270115060 2024-09-11T11:03:15.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.264 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954f5e0 2024-09-11T11:03:15.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.257+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x558d6954d520 con 0x558d6954aaa0 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d6954da10 con 0x558d695465f0 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d6954de00 con 0x558d6954aaa0 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d6954de00 con 0x7f3270115060 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 zone default found 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 4 Realm: () 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:15.270 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 zonegroup default 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d695525f0 con 0x7f3270115060 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d6954e310 con 0x558d6954f5e0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d695548e0 con 0x558d6954f5e0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 started sync module instance, tier type = 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.261+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69553cb0 con 0x558d6954aaa0 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94065845944784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69553cb0 con 0x558d6954aaa0 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69555360 con 0x558d695465f0 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94065845948080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d695552d0 con 0x558d695465f0 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69556280 con 0x558d6954aaa0 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94065845944784] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94065845948080] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94065845950288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69556240 con 0x558d6954aaa0 2024-09-11T11:03:15.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.265+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69556b50 con 0x7f3270115060 2024-09-11T11:03:15.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94065845954208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69556240 con 0x7f3270115060 2024-09-11T11:03:15.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d695575d0 con 0x558d6954aaa0 2024-09-11T11:03:15.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94065845954208] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94065845950288] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94065845951856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d695570e0 con 0x558d6954aaa0 2024-09-11T11:03:15.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69557ea0 con 0x558d6954f5e0 2024-09-11T11:03:15.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94065845959152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d695570e0 con 0x558d6954f5e0 2024-09-11T11:03:15.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.269+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69558d10 con 0x558d6954f5e0 2024-09-11T11:03:15.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94065845951856] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94065845959152] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94065845962848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d695590b0 con 0x558d6954f5e0 2024-09-11T11:03:15.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69559900 con 0x7f3270115060 2024-09-11T11:03:15.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94065845962848] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94065845964976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69559cf0 con 0x7f3270115060 2024-09-11T11:03:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 20 add_watcher() i=0 2024-09-11T11:03:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 20 add_watcher() i=1 2024-09-11T11:03:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 20 add_watcher() i=2 2024-09-11T11:03:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 20 add_watcher() i=3 2024-09-11T11:03:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 20 add_watcher() i=4 2024-09-11T11:03:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 20 add_watcher() i=5 2024-09-11T11:03:15.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 20 add_watcher() i=6 2024-09-11T11:03:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94065845964976] v36'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 20 add_watcher() i=7 2024-09-11T11:03:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.273+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d6955cd20 con 0x558d695465f0 2024-09-11T11:03:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94065845966496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d6955a240 con 0x558d695465f0 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94065845966496] v36'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f31277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 5 note: GC not initialized 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f31267fc640 20 reqs_thread_entry: start 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 20 Filter name: none 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f3097fff640 20 reqs_thread_entry: start 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:15.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69580490 con 0x558d695465f0 2024-09-11T11:03:15.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 20 rados_obj.operate() r=0 bl.length=490 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.277+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69586da0 con 0x558d695465f0 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f327835d980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f327835d980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f327835d980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:15.283 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94065846151184 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x558d69582450 con 0x558d6954aaa0 2024-09-11T11:03:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94065845951856 notify 154618822712 ret 0) ==== 708+0+0 (crc 0 0 0) 0x558d69528600 con 0x558d6954aaa0 2024-09-11T11:03:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f31597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822712 cookie 94065845951856 notifier 4885 bl.length()=666 2024-09-11T11:03:15.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f31597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f31597fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f31597fa640 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f3138003eb0 con 0x558d6954aaa0 2024-09-11T11:03:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94065846151184 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94065846151184 notify 154618822712 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f32700e4040 con 0x558d6954aaa0 2024-09-11T11:03:15.286 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f31277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.281+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94065845966496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d6957e290 con 0x558d695465f0 2024-09-11T11:03:15.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.285+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94065845966496] v36'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.288 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.285+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94065845944784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d6957e290 con 0x558d6954aaa0 2024-09-11T11:03:15.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.285+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94065845944784] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.285+0000 7f327835d980 20 remove_watcher() i=0 2024-09-11T11:03:15.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.285+0000 7f327835d980 2 removed watcher, disabling cache 2024-09-11T11:03:15.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.285+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94065845948080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d6957e290 con 0x558d695465f0 2024-09-11T11:03:15.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.289+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94065845948080] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x558d695465f0 2024-09-11T11:03:15.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.289+0000 7f327835d980 20 remove_watcher() i=1 2024-09-11T11:03:15.291 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.289+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94065845950288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d6957e290 con 0x558d6954aaa0 2024-09-11T11:03:15.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.289+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94065845950288] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.289+0000 7f327835d980 20 remove_watcher() i=2 2024-09-11T11:03:15.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.289+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94065845954208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69555750 con 0x7f3270115060 2024-09-11T11:03:15.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94065845954208] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f327835d980 20 remove_watcher() i=3 2024-09-11T11:03:15.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94065845951856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d6957e290 con 0x558d6954aaa0 2024-09-11T11:03:15.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f3275e6d640 1 -- 172.21.15.145:0/4026869700 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94065845951856] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3270112030 con 0x558d6954aaa0 2024-09-11T11:03:15.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f327835d980 20 remove_watcher() i=4 2024-09-11T11:03:15.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94065845959152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d695566a0 con 0x558d6954f5e0 2024-09-11T11:03:15.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94065845959152] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f327835d980 20 remove_watcher() i=5 2024-09-11T11:03:15.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.293+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94065845962848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d69555750 con 0x558d6954f5e0 2024-09-11T11:03:15.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327566c640 1 -- 172.21.15.145:0/4026869700 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94065845962848] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3260037040 con 0x558d6954f5e0 2024-09-11T11:03:15.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 20 remove_watcher() i=6 2024-09-11T11:03:15.299 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94065845964976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x558d6957e290 con 0x7f3270115060 2024-09-11T11:03:15.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94065845964976] v36'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f32680083f0 con 0x7f3270115060 2024-09-11T11:03:15.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 20 remove_watcher() i=7 2024-09-11T11:03:15.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d6954aaa0 msgr2=0x558d6954ce90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d6954aaa0 0x558d6954ce90 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.302 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d695465f0 msgr2=0x558d69548ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d695465f0 0x558d69548ab0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3270115060 msgr2=0x7f32700e65b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f3270115060 0x7f32700e65b0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558d6954f5e0 msgr2=0x558d69551aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x558d6954f5e0 0x558d69551aa0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3140034650 msgr2=0x7f3140036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3140034650 0x7f3140036b10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x558d69516550 tx=0x7f3260010000 comp rx=0 tx=0).stop 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327666e640 1 -- 172.21.15.145:0/4026869700 reap_dead start 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 msgr2=0x558d6953b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d6953b640 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f32700cff50 tx=0x7f32700acea0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 shutdown_connections 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/4026869700 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d695344a0 0x558d6953b640 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 >> 172.21.15.145:0/4026869700 conn(0x558d69530830 msgr2=0x558d6952e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 shutdown_connections 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/4026869700 wait complete. 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/360109134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3150034650 msgr2=0x7f3150036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/360109134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3150034650 0x7f3150036b10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x558d6950e4e0 tx=0x7f326000f000 comp rx=0 tx=0).stop 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/360109134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d69527ca0 msgr2=0x558d695280c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/360109134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d69527ca0 0x558d695280c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f32700b8000 tx=0x7f32700c6ca0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/360109134 shutdown_connections 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/360109134 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f3150034650 0x7f3150036b10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/360109134 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d69527ca0 0x558d695280c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/360109134 >> 172.21.15.145:0/360109134 conn(0x558d6951cdf0 msgr2=0x558d6951f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/360109134 shutdown_connections 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/360109134 wait complete. 2024-09-11T11:03:15.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d69512340 msgr2=0x558d69514730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x558d69512340 0x558d69514730 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d69418240 msgr2=0x558d69510ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x558d69418240 0x558d69510ff0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558d695179c0 msgr2=0x558d69519db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x558d695179c0 0x558d69519db0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c0346a0 msgr2=0x7f315c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f315c0346a0 0x7f315c036b60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3260001e50 tx=0x7f32600013b0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 msgr2=0x558d69509ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 --2- 172.21.15.145:0/3004644900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558d694178f0 0x558d69509ef0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3270018cc0 tx=0x7f3270017e30 comp rx=0 tx=0).stop 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327666e640 1 -- 172.21.15.145:0/3004644900 reap_dead start 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 shutdown_connections 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 >> 172.21.15.145:0/3004644900 conn(0x558d6938b240 msgr2=0x558d694fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 shutdown_connections 2024-09-11T11:03:15.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.297+0000 7f327835d980 1 -- 172.21.15.145:0/3004644900 wait complete. 2024-09-11T11:03:15.310 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.310 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.311 ERROR:root:0 2024-09-11T11:03:15.311 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:15.315 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:15.315 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-11T11:03:15.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-11T11:03:15.315 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-11T11:03:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:15.389 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.385+0000 7fd3d4e3a980 1 Processor -- start 2024-09-11T11:03:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.385+0000 7fd3d4e3a980 1 -- start start 2024-09-11T11:03:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d4e3a980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55c2ab561c70 0x55c2ab564060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d4e3a980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2ab3e3ae0 con 0x55c2ab55d8f0 2024-09-11T11:03:15.390 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d4e3a980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55c2ab407e30 con 0x55c2ab561c70 2024-09-11T11:03:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d2149640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55c2ab561c70 0x55c2ab564060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d2149640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55c2ab561c70 0x55c2ab564060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38040/0 (socket says 172.21.15.145:38040) 2024-09-11T11:03:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d2149640 1 -- 172.21.15.145:0/1465478226 learned_addr learned my addr 172.21.15.145:0/1465478226 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d2149640 1 -- 172.21.15.145:0/1465478226 >> v1:172.21.15.102:6789/0 conn(0x55c2ab55d8f0 legacy=0x55c2ab55dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.391 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d2149640 1 -- 172.21.15.145:0/1465478226 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ab5655b0 con 0x55c2ab561c70 2024-09-11T11:03:15.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d2149640 1 --2- 172.21.15.145:0/1465478226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab561c70 0x55c2ab564060 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400a5c0 tx=0x7fd3c401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0784d49d2885b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d1948640 1 -- 172.21.15.145:0/1465478226 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c40a6070 con 0x55c2ab561c70 2024-09-11T11:03:15.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d1948640 1 -- 172.21.15.145:0/1465478226 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c40af070 con 0x55c2ab561c70 2024-09-11T11:03:15.393 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.389+0000 7fd3d1948640 1 -- 172.21.15.145:0/1465478226 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c40aa5c0 con 0x55c2ab561c70 2024-09-11T11:03:15.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.393+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/1465478226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab561c70 msgr2=0x55c2ab564060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.393+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/1465478226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab561c70 0x55c2ab564060 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400a5c0 tx=0x7fd3c401b340 comp rx=0 tx=0).stop 2024-09-11T11:03:15.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.393+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/1465478226 shutdown_connections 2024-09-11T11:03:15.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.393+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/1465478226 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab561c70 0x55c2ab564060 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.393+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/1465478226 >> 172.21.15.145:0/1465478226 conn(0x55c2ab4d1240 msgr2=0x55c2ab4d1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.394 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.393+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/1465478226 shutdown_connections 2024-09-11T11:03:15.395 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.393+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/1465478226 wait complete. 2024-09-11T11:03:15.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 Processor -- start 2024-09-11T11:03:15.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 -- start start 2024-09-11T11:03:15.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab648ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.407 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c2ab409200 con 0x55c2ab55d8f0 2024-09-11T11:03:15.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab648ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab648ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38050/0 (socket says 172.21.15.145:38050) 2024-09-11T11:03:15.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d294a640 1 -- 172.21.15.145:0/3420734845 learned_addr learned my addr 172.21.15.145:0/3420734845 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d294a640 1 -- 172.21.15.145:0/3420734845 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ab649270 con 0x55c2ab55d8f0 2024-09-11T11:03:15.408 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d294a640 1 --2- 172.21.15.145:0/3420734845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab648ca0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001ea0 tx=0x7fd3c800b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9cd78ef7a4ae338 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd2c0e09640 1 -- 172.21.15.145:0/3420734845 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c800a040 con 0x55c2ab55d8f0 2024-09-11T11:03:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd2c0e09640 1 -- 172.21.15.145:0/3420734845 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c800f620 con 0x55c2ab55d8f0 2024-09-11T11:03:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd2c0e09640 1 -- 172.21.15.145:0/3420734845 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c800f890 con 0x55c2ab55d8f0 2024-09-11T11:03:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3420734845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 msgr2=0x55c2ab648ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3420734845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab648ca0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001ea0 tx=0x7fd3c800b680 comp rx=0 tx=0).stop 2024-09-11T11:03:15.410 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3420734845 shutdown_connections 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3420734845 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab648ca0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3420734845 >> 172.21.15.145:0/3420734845 conn(0x55c2ab4d1240 msgr2=0x55c2ab6448d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3420734845 shutdown_connections 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3420734845 wait complete. 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.405+0000 7fd3d4e3a980 1 Processor -- start 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d4e3a980 1 -- start start 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d4e3a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab650030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d4e3a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c2ab5650b0 con 0x55c2ab55d8f0 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab650030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab650030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38052/0 (socket says 172.21.15.145:38052) 2024-09-11T11:03:15.411 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d294a640 1 -- 172.21.15.145:0/3506278548 learned_addr learned my addr 172.21.15.145:0/3506278548 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d294a640 1 -- 172.21.15.145:0/3506278548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ab650570 con 0x55c2ab55d8f0 2024-09-11T11:03:15.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d294a640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab650030 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001fd0 tx=0x7fd3c8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd2bf606640 1 -- 172.21.15.145:0/3506278548 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c8001520 con 0x55c2ab55d8f0 2024-09-11T11:03:15.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2ab650800 con 0x55c2ab55d8f0 2024-09-11T11:03:15.413 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd2bf606640 1 -- 172.21.15.145:0/3506278548 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c801ca10 con 0x55c2ab55d8f0 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ab6534e0 con 0x55c2ab55d8f0 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd2bf606640 1 -- 172.21.15.145:0/3506278548 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c802c060 con 0x55c2ab55d8f0 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd2bf606640 1 -- 172.21.15.145:0/3506278548 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3c8017050 con 0x55c2ab55d8f0 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd2bf606640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2b80346a0 0x7fd2b8036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd2bf606640 1 -- 172.21.15.145:0/3506278548 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fd3c8015020 con 0x55c2ab55d8f0 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d2149640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2b80346a0 0x7fd2b8036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab561c70 0x55c2ab657130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab657670 con 0x55c2ab561c70 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d314b640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab561c70 0x55c2ab657130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d2149640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2b80346a0 0x7fd2b8036b60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40ae000 tx=0x7fd3c40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.414 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d314b640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab561c70 0x55c2ab657130 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.415 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.409+0000 7fd3d314b640 1 -- 172.21.15.145:0/3506278548 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab561c70 2024-09-11T11:03:15.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab658420 0x55c2ab65a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab65ae50 con 0x55c2ab658420 2024-09-11T11:03:15.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d294a640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab658420 0x55c2ab65a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d294a640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab658420 0x55c2ab65a810 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d294a640 1 -- 172.21.15.145:0/3506278548 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3c802e070 con 0x55c2ab658420 2024-09-11T11:03:15.416 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab65c700 con 0x55c2ab658420 2024-09-11T11:03:15.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d294a640 1 -- 172.21.15.145:0/3506278548 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd3c802e070 con 0x55c2ab658420 2024-09-11T11:03:15.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab65b930 con 0x55c2ab658420 2024-09-11T11:03:15.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d294a640 1 -- 172.21.15.145:0/3506278548 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3c802e070 con 0x55c2ab658420 2024-09-11T11:03:15.417 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c2ab65dab0 0x55c2ab65fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6603e0 con 0x55c2ab65dab0 2024-09-11T11:03:15.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d2149640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c2ab65dab0 0x55c2ab65fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d2149640 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c2ab65dab0 0x55c2ab65fea0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d2149640 1 -- 172.21.15.145:0/3506278548 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab65dab0 2024-09-11T11:03:15.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d4e3a980 1 Processor -- start 2024-09-11T11:03:15.418 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.413+0000 7fd3d4e3a980 1 -- start start 2024-09-11T11:03:15.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d4e3a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab66dde0 0x55c2ab66e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d4e3a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c2ab462800 con 0x55c2ab66dde0 2024-09-11T11:03:15.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab66dde0 0x55c2ab66e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab66dde0 0x55c2ab66e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38054/0 (socket says 172.21.15.145:38054) 2024-09-11T11:03:15.419 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d294a640 1 -- 172.21.15.145:0/4050457623 learned_addr learned my addr 172.21.15.145:0/4050457623 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d294a640 1 -- 172.21.15.145:0/4050457623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ab66e740 con 0x55c2ab66dde0 2024-09-11T11:03:15.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d294a640 1 --2- 172.21.15.145:0/4050457623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab66dde0 0x55c2ab66e200 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8048550 tx=0x7fd3c800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd2bce01640 1 -- 172.21.15.145:0/4050457623 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c8028e70 con 0x55c2ab66dde0 2024-09-11T11:03:15.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd2bce01640 1 -- 172.21.15.145:0/4050457623 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c802f960 con 0x55c2ab66dde0 2024-09-11T11:03:15.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4050457623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2ab66e9d0 con 0x55c2ab66dde0 2024-09-11T11:03:15.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd2bce01640 1 -- 172.21.15.145:0/4050457623 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c802fc40 con 0x55c2ab66dde0 2024-09-11T11:03:15.420 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4050457623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ab66e9d0 con 0x55c2ab66dde0 2024-09-11T11:03:15.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd2bce01640 1 -- 172.21.15.145:0/4050457623 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3c803d030 con 0x55c2ab66dde0 2024-09-11T11:03:15.421 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd2bce01640 1 --2- 172.21.15.145:0/4050457623 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2ac034650 0x7fd2ac036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd2bce01640 1 -- 172.21.15.145:0/4050457623 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fd3c804c020 con 0x55c2ab66dde0 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d2149640 1 --2- 172.21.15.145:0/4050457623 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2ac034650 0x7fd2ac036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d4e3a980 1 Processor -- start 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d4e3a980 1 -- start start 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d2149640 1 --2- 172.21.15.145:0/4050457623 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2ac034650 0x7fd2ac036b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55c2ab654620 tx=0x7fd3c4005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d4e3a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab67a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d4e3a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c2ab6495f0 con 0x55c2ab67a540 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab67a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab67a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38066/0 (socket says 172.21.15.145:38066) 2024-09-11T11:03:15.422 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.417+0000 7fd3d294a640 1 -- 172.21.15.145:0/4289442817 learned_addr learned my addr 172.21.15.145:0/4289442817 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d294a640 1 -- 172.21.15.145:0/4289442817 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ab67aef0 con 0x55c2ab67a540 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d294a640 1 --2- 172.21.15.145:0/4289442817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab67a920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd3c804a0e0 tx=0x7fd3c8041180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d247b5817c57f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd2b67fc640 1 -- 172.21.15.145:0/4289442817 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c805e030 con 0x55c2ab67a540 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd2b67fc640 1 -- 172.21.15.145:0/4289442817 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c8044960 con 0x55c2ab67a540 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd2b67fc640 1 -- 172.21.15.145:0/4289442817 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c8055070 con 0x55c2ab67a540 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4289442817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 msgr2=0x55c2ab67a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/4289442817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab67a920 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fd3c804a0e0 tx=0x7fd3c8041180 comp rx=0 tx=0).stop 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4289442817 shutdown_connections 2024-09-11T11:03:15.424 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/4289442817 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab67a920 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4289442817 >> 172.21.15.145:0/4289442817 conn(0x55c2ab676920 msgr2=0x55c2ab674a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4289442817 shutdown_connections 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4289442817 wait complete. 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 Processor -- start 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- start start 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab681720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c2ab67b390 con 0x55c2ab67a540 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab681720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d294a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab681720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38072/0 (socket says 172.21.15.145:38072) 2024-09-11T11:03:15.425 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 learned_addr learned my addr 172.21.15.145:0/834136414 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2ab681c60 con 0x55c2ab67a540 2024-09-11T11:03:15.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d294a640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab681720 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80473c0 tx=0x7fd3c8011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd2b4ff9640 1 -- 172.21.15.145:0/834136414 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c80275d0 con 0x55c2ab67a540 2024-09-11T11:03:15.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2ab681c60 con 0x55c2ab67a540 2024-09-11T11:03:15.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2ab681c60 con 0x55c2ab67a540 2024-09-11T11:03:15.428 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd2b4ff9640 1 -- 172.21.15.145:0/834136414 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c8011110 con 0x55c2ab67a540 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.421+0000 7fd2b4ff9640 1 -- 172.21.15.145:0/834136414 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3c805e020 con 0x55c2ab67a540 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd2b4ff9640 1 -- 172.21.15.145:0/834136414 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fd3c8071070 con 0x55c2ab67a540 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd2b4ff9640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd29c0346a0 0x7fd29c036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd2b4ff9640 1 -- 172.21.15.145:0/834136414 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fd3c8062070 con 0x55c2ab67a540 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d2149640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd29c0346a0 0x7fd29c036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab68c8a0 0x55c2ab68ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab68f4b0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d314b640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab68c8a0 0x55c2ab68ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d2149640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd29c0346a0 0x7fd29c036b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4000c10 tx=0x7fd3c40c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d314b640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab68c8a0 0x55c2ab68ed60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.429 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 realm 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab68bd20 con 0x55c2ab68c8a0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab68ff70 con 0x55c2ab68c8a0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.430 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab690d50 0x55c2ab693140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.431 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d294a640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab690d50 0x55c2ab693140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d294a640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab690d50 0x55c2ab693140 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.433 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.425+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab694040 con 0x55c2ab690d50 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d4e3a980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d4e3a980 20 searching for the correct realm 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c2ab6958b0 0x55c2ab697d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab698440 con 0x55c2ab6958b0 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d2149640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c2ab6958b0 0x55c2ab697d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d2149640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c2ab6958b0 0x55c2ab697d70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab698440 con 0x55c2ab690d50 2024-09-11T11:03:15.434 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d294a640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd3c8040070 0x7fd3c8011720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x7fd3c8040070 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd3c8040070 0x7fd3c8011720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd3c8040070 0x7fd3c8011720 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab6958b0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.435 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.429+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.438 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x7fd3c8040070 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x7fd3c8040070 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab6958b0 2024-09-11T11:03:15.439 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.433+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab6958b0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.440 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab6958b0 2024-09-11T11:03:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x7fd3c8040070 2024-09-11T11:03:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x7fd3c8040070 2024-09-11T11:03:15.443 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab6958b0 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x7fd3c8040070 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c807a020 con 0x55c2ab690d50 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab6958b0 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.437+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.444 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6937f0 con 0x55c2ab690d50 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab693ce0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.445 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6940d0 con 0x55c2ab690d50 2024-09-11T11:03:15.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6940d0 con 0x7fd3c8040070 2024-09-11T11:03:15.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.448 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 zone default found 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 4 Realm: () 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 zonegroup default 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6988c0 con 0x7fd3c8040070 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69a6d0 con 0x55c2ab6958b0 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.449 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69ab80 con 0x55c2ab6958b0 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 started sync module instance, tier type = 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.441+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab699ae0 con 0x55c2ab690d50 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.445+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.445+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94294587842560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab699ae0 con 0x55c2ab690d50 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.445+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69b660 con 0x55c2ab68c8a0 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.445+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.450 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.445+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94294587846992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69b620 con 0x55c2ab68c8a0 2024-09-11T11:03:15.451 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.445+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69c560 con 0x55c2ab690d50 2024-09-11T11:03:15.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.445+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94294587842560] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.445+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94294587846992] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.449+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.449+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94294587849296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69c070 con 0x55c2ab690d50 2024-09-11T11:03:15.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.449+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69ce30 con 0x7fd3c8040070 2024-09-11T11:03:15.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.449+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.449+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94294587853184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69c070 con 0x7fd3c8040070 2024-09-11T11:03:15.452 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.449+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69d870 con 0x55c2ab690d50 2024-09-11T11:03:15.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.449+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94294587853184] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.453 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.449+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94294587849296] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94294587840048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69d3c0 con 0x55c2ab690d50 2024-09-11T11:03:15.454 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69e110 con 0x55c2ab6958b0 2024-09-11T11:03:15.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94294587858016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69d3c0 con 0x55c2ab6958b0 2024-09-11T11:03:15.455 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69eeb0 con 0x55c2ab6958b0 2024-09-11T11:03:15.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94294587858016] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.456 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94294587840048] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94294587860144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69f2a0 con 0x55c2ab6958b0 2024-09-11T11:03:15.457 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69faf0 con 0x7fd3c8040070 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94294587864224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69ff80 con 0x7fd3c8040070 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 20 add_watcher() i=0 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 20 add_watcher() i=1 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 20 add_watcher() i=2 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 20 add_watcher() i=3 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 20 add_watcher() i=4 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 20 add_watcher() i=5 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94294587860144] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.458 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.453+0000 7fd3d4e3a980 20 add_watcher() i=6 2024-09-11T11:03:15.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94294587864224] v36'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d4e3a980 20 add_watcher() i=7 2024-09-11T11:03:15.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d4e3a980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:15.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab69e8d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.459 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.460 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94294587861200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6a04d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94294587861200] v36'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd2897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d4e3a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d4e3a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d4e3a980 5 note: GC not initialized 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd203fff640 20 reqs_thread_entry: start 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.457+0000 7fd3d4e3a980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 20 Filter name: none 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd201ffb640 20 reqs_thread_entry: start 2024-09-11T11:03:15.462 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:15.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c6670 con 0x55c2ab68c8a0 2024-09-11T11:03:15.463 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 20 rados_obj.operate() r=0 bl.length=490 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6ccfb0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v36'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:15.464 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94294588049952 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c8680 con 0x55c2ab690d50 2024-09-11T11:03:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94294587840048 notify 154618822713 ret 0) ==== 721+0+0 (crc 0 0 0) 0x55c2ab66e740 con 0x55c2ab690d50 2024-09-11T11:03:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd2b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822713 cookie 94294587840048 notifier 4892 bl.length()=679 2024-09-11T11:03:15.465 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd2b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd2b67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94294588049952 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd2b67fc640 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7fd298003eb0 con 0x55c2ab690d50 2024-09-11T11:03:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.461+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94294588049952 notify 154618822713 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fd3c8037030 con 0x55c2ab690d50 2024-09-11T11:03:15.466 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:15.466 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.465+0000 7fd2897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.467 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.465+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94294587861200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c4470 con 0x55c2ab68c8a0 2024-09-11T11:03:15.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.465+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94294587861200] v36'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.468 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.465+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94294587842560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c4470 con 0x55c2ab690d50 2024-09-11T11:03:15.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.469+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94294587842560] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.469+0000 7fd3d4e3a980 20 remove_watcher() i=0 2024-09-11T11:03:15.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.469+0000 7fd3d4e3a980 2 removed watcher, disabling cache 2024-09-11T11:03:15.470 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.469+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94294587846992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c4470 con 0x55c2ab68c8a0 2024-09-11T11:03:15.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.469+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94294587846992] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x55c2ab68c8a0 2024-09-11T11:03:15.471 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.469+0000 7fd3d4e3a980 20 remove_watcher() i=1 2024-09-11T11:03:15.472 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.469+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94294587849296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c4470 con 0x55c2ab690d50 2024-09-11T11:03:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94294587849296] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d4e3a980 20 remove_watcher() i=2 2024-09-11T11:03:15.474 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94294587853184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c4470 con 0x7fd3c8040070 2024-09-11T11:03:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94294587853184] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d4e3a980 20 remove_watcher() i=3 2024-09-11T11:03:15.475 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94294587840048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c4470 con 0x55c2ab690d50 2024-09-11T11:03:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d294a640 1 -- 172.21.15.145:0/834136414 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94294587840048] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c809b040 con 0x55c2ab690d50 2024-09-11T11:03:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d4e3a980 20 remove_watcher() i=4 2024-09-11T11:03:15.478 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.473+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94294587858016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab699630 con 0x55c2ab6958b0 2024-09-11T11:03:15.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.477+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94294587858016] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.477+0000 7fd3d4e3a980 20 remove_watcher() i=5 2024-09-11T11:03:15.479 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.477+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94294587860144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab6c4470 con 0x55c2ab6958b0 2024-09-11T11:03:15.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.477+0000 7fd3d2149640 1 -- 172.21.15.145:0/834136414 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94294587860144] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3c40aaae0 con 0x55c2ab6958b0 2024-09-11T11:03:15.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.477+0000 7fd3d4e3a980 20 remove_watcher() i=6 2024-09-11T11:03:15.480 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.477+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94294587864224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55c2ab699630 con 0x7fd3c8040070 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94294587864224] v36'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd3cc00a4d0 con 0x7fd3c8040070 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 20 remove_watcher() i=7 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab690d50 msgr2=0x55c2ab693140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab690d50 0x55c2ab693140 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab68c8a0 msgr2=0x55c2ab68ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab68c8a0 0x55c2ab68ed60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd3c8040070 msgr2=0x7fd3c8011720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fd3c8040070 0x7fd3c8011720 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.485 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c2ab6958b0 msgr2=0x55c2ab697d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55c2ab6958b0 0x55c2ab697d70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd29c0346a0 msgr2=0x7fd29c036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd29c0346a0 0x7fd29c036b60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4000c10 tx=0x7fd3c40c1040 comp rx=0 tx=0).stop 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d314b640 1 -- 172.21.15.145:0/834136414 reap_dead start 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 msgr2=0x55c2ab681720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab681720 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80473c0 tx=0x7fd3c8011630 comp rx=0 tx=0).stop 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 shutdown_connections 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/834136414 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab67a540 0x55c2ab681720 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 >> 172.21.15.145:0/834136414 conn(0x55c2ab676920 msgr2=0x55c2ab6749f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 shutdown_connections 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/834136414 wait complete. 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4050457623 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2ac034650 msgr2=0x7fd2ac036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.486 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/4050457623 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2ac034650 0x7fd2ac036b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55c2ab654620 tx=0x7fd3c4005ad0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4050457623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab66dde0 msgr2=0x55c2ab66e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/4050457623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab66dde0 0x55c2ab66e200 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8048550 tx=0x7fd3c800ee90 comp rx=0 tx=0).stop 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4050457623 shutdown_connections 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/4050457623 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2ac034650 0x7fd2ac036b10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/4050457623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab66dde0 0x55c2ab66e200 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4050457623 >> 172.21.15.145:0/4050457623 conn(0x55c2ab662f30 msgr2=0x55c2ab6659b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4050457623 shutdown_connections 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/4050457623 wait complete. 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab658420 msgr2=0x55c2ab65a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55c2ab658420 0x55c2ab65a810 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab561c70 msgr2=0x55c2ab657130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55c2ab561c70 0x55c2ab657130 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.487 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c2ab65dab0 msgr2=0x55c2ab65fea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55c2ab65dab0 0x55c2ab65fea0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2b80346a0 msgr2=0x7fd2b8036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fd2b80346a0 0x7fd2b8036b60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd3c40ae000 tx=0x7fd3c40a6000 comp rx=0 tx=0).stop 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 msgr2=0x55c2ab650030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 --2- 172.21.15.145:0/3506278548 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c2ab55d8f0 0x55c2ab650030 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8001fd0 tx=0x7fd3c8000bd0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d314b640 1 -- 172.21.15.145:0/3506278548 reap_dead start 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 shutdown_connections 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 >> 172.21.15.145:0/3506278548 conn(0x55c2ab4d1240 msgr2=0x55c2ab643450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 shutdown_connections 2024-09-11T11:03:15.488 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.481+0000 7fd3d4e3a980 1 -- 172.21.15.145:0/3506278548 wait complete. 2024-09-11T11:03:15.493 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.493 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.493 ERROR:root:0 2024-09-11T11:03:15.493 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:15.497 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:15.498 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-11T11:03:15.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-11T11:03:15.498 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-11T11:03:15.565 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:15.565 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:15.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6f93e980 1 Processor -- start 2024-09-11T11:03:15.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6f93e980 1 -- start start 2024-09-11T11:03:15.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6f93e980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56307b6cda90 0x56307b6cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6f93e980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56307b551ae0 con 0x56307b63e2e0 2024-09-11T11:03:15.566 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6f93e980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x56307b575e30 con 0x56307b6cda90 2024-09-11T11:03:15.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6cc4d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56307b6cda90 0x56307b6cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6cc4d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x56307b6cda90 0x56307b6cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38080/0 (socket says 172.21.15.145:38080) 2024-09-11T11:03:15.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6cc4d640 1 -- 172.21.15.145:0/731262260 learned_addr learned my addr 172.21.15.145:0/731262260 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6d44e640 1 --1- 172.21.15.145:0/731262260 >> v1:172.21.15.102:6789/0 conn(0x56307b63e2e0 0x56307b6cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52194/0 (socket says 172.21.15.145:52194) 2024-09-11T11:03:15.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6cc4d640 1 -- 172.21.15.145:0/731262260 >> v1:172.21.15.102:6789/0 conn(0x56307b63e2e0 legacy=0x56307b6cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.567 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6cc4d640 1 -- 172.21.15.145:0/731262260 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56307b6d13d0 con 0x56307b6cda90 2024-09-11T11:03:15.569 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/731262260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b6cda90 0x56307b6cfe80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7eff6400a5c0 tx=0x7eff6401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f69f7f5aeb1c11 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff5ffff640 1 -- 172.21.15.145:0/731262260 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff640a6070 con 0x56307b6cda90 2024-09-11T11:03:15.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff5ffff640 1 -- 172.21.15.145:0/731262260 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff640af070 con 0x56307b6cda90 2024-09-11T11:03:15.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.565+0000 7eff5ffff640 1 -- 172.21.15.145:0/731262260 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff640aa5c0 con 0x56307b6cda90 2024-09-11T11:03:15.570 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.569+0000 7eff6f93e980 1 -- 172.21.15.145:0/731262260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b6cda90 msgr2=0x56307b6cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.569+0000 7eff6f93e980 1 --2- 172.21.15.145:0/731262260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b6cda90 0x56307b6cfe80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7eff6400a5c0 tx=0x7eff6401b340 comp rx=0 tx=0).stop 2024-09-11T11:03:15.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.569+0000 7eff6f93e980 1 -- 172.21.15.145:0/731262260 shutdown_connections 2024-09-11T11:03:15.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.569+0000 7eff6f93e980 1 --2- 172.21.15.145:0/731262260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b6cda90 0x56307b6cfe80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.569+0000 7eff6f93e980 1 -- 172.21.15.145:0/731262260 >> 172.21.15.145:0/731262260 conn(0x56307b6c40a0 msgr2=0x56307b6c64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.569+0000 7eff6f93e980 1 -- 172.21.15.145:0/731262260 shutdown_connections 2024-09-11T11:03:15.571 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.569+0000 7eff6f93e980 1 -- 172.21.15.145:0/731262260 wait complete. 2024-09-11T11:03:15.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6f93e980 1 Processor -- start 2024-09-11T11:03:15.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6f93e980 1 -- start start 2024-09-11T11:03:15.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6f93e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.584 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6f93e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56307b577200 con 0x56307b63e2e0 2024-09-11T11:03:15.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38096/0 (socket says 172.21.15.145:38096) 2024-09-11T11:03:15.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6d44e640 1 -- 172.21.15.145:0/2812241924 learned_addr learned my addr 172.21.15.145:0/2812241924 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6d44e640 1 -- 172.21.15.145:0/2812241924 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56307b7b5060 con 0x56307b63e2e0 2024-09-11T11:03:15.585 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7eff6d44e640 1 --2- 172.21.15.145:0/2812241924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7b4a90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7eff680015f0 tx=0x7eff68001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1888c3ce13bb5e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.581+0000 7efe5b606640 1 -- 172.21.15.145:0/2812241924 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68013420 con 0x56307b63e2e0 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7efe5b606640 1 -- 172.21.15.145:0/2812241924 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff680135e0 con 0x56307b63e2e0 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7efe5b606640 1 -- 172.21.15.145:0/2812241924 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68013940 con 0x56307b63e2e0 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- 172.21.15.145:0/2812241924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 msgr2=0x56307b7b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 --2- 172.21.15.145:0/2812241924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7b4a90 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7eff680015f0 tx=0x7eff68001ab0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- 172.21.15.145:0/2812241924 shutdown_connections 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 --2- 172.21.15.145:0/2812241924 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7b4a90 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- 172.21.15.145:0/2812241924 >> 172.21.15.145:0/2812241924 conn(0x56307b6c40a0 msgr2=0x56307b7b06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- 172.21.15.145:0/2812241924 shutdown_connections 2024-09-11T11:03:15.587 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- 172.21.15.145:0/2812241924 wait complete. 2024-09-11T11:03:15.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 Processor -- start 2024-09-11T11:03:15.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- start start 2024-09-11T11:03:15.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.588 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56307b6d0e40 con 0x56307b63e2e0 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7bbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38112/0 (socket says 172.21.15.145:38112) 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6d44e640 1 -- 172.21.15.145:0/3833608129 learned_addr learned my addr 172.21.15.145:0/3833608129 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6d44e640 1 -- 172.21.15.145:0/3833608129 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56307b7bc320 con 0x56307b63e2e0 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6d44e640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7bbde0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7eff68006640 tx=0x7eff68000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7efe59e03640 1 -- 172.21.15.145:0/3833608129 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68022020 con 0x56307b63e2e0 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56307b7bc5b0 con 0x56307b63e2e0 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7efe59e03640 1 -- 172.21.15.145:0/3833608129 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff68006320 con 0x56307b63e2e0 2024-09-11T11:03:15.589 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56307b7bf290 con 0x56307b63e2e0 2024-09-11T11:03:15.590 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7efe59e03640 1 -- 172.21.15.145:0/3833608129 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68004ab0 con 0x56307b63e2e0 2024-09-11T11:03:15.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.585+0000 7efe59e03640 1 -- 172.21.15.145:0/3833608129 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7eff68025020 con 0x56307b63e2e0 2024-09-11T11:03:15.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7efe59e03640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe54034650 0x7efe54036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7efe59e03640 1 -- 172.21.15.145:0/3833608129 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7eff68018030 con 0x56307b63e2e0 2024-09-11T11:03:15.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe54034650 0x7efe54036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.591 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b6cda90 0x56307b7c2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7c3430 con 0x56307b6cda90 2024-09-11T11:03:15.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6dc4f640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b6cda90 0x56307b7c2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe54034650 0x7efe54036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7eff640ae000 tx=0x7eff640a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6dc4f640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b6cda90 0x56307b7c2df0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6dc4f640 1 -- 172.21.15.145:0/3833608129 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b6cda90 2024-09-11T11:03:15.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7c4220 0x56307b7c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7c6c50 con 0x56307b7c4220 2024-09-11T11:03:15.592 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6d44e640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7c4220 0x56307b7c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6d44e640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7c4220 0x56307b7c6610 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6d44e640 1 -- 172.21.15.145:0/3833608129 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff6801b070 con 0x56307b7c4220 2024-09-11T11:03:15.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7c8500 con 0x56307b7c4220 2024-09-11T11:03:15.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6d44e640 1 -- 172.21.15.145:0/3833608129 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff6801b070 con 0x56307b7c4220 2024-09-11T11:03:15.593 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.589+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7c7730 con 0x56307b7c4220 2024-09-11T11:03:15.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6d44e640 1 -- 172.21.15.145:0/3833608129 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff6801b070 con 0x56307b7c4220 2024-09-11T11:03:15.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56307b7c98b0 0x56307b7cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7cc220 con 0x56307b7c98b0 2024-09-11T11:03:15.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56307b7c98b0 0x56307b7cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.594 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56307b7c98b0 0x56307b7cbca0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6cc4d640 1 -- 172.21.15.145:0/3833608129 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b7c98b0 2024-09-11T11:03:15.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6f93e980 1 Processor -- start 2024-09-11T11:03:15.595 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6f93e980 1 -- start start 2024-09-11T11:03:15.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6f93e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7d9c70 0x56307b7da090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6f93e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56307b5d0800 con 0x56307b7d9c70 2024-09-11T11:03:15.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7d9c70 0x56307b7da090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7d9c70 0x56307b7da090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38126/0 (socket says 172.21.15.145:38126) 2024-09-11T11:03:15.596 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6d44e640 1 -- 172.21.15.145:0/4088957027 learned_addr learned my addr 172.21.15.145:0/4088957027 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6d44e640 1 -- 172.21.15.145:0/4088957027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56307b7da5d0 con 0x56307b7d9c70 2024-09-11T11:03:15.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6d44e640 1 --2- 172.21.15.145:0/4088957027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7d9c70 0x56307b7da090 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7eff68004fd0 tx=0x7eff68010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7efe52ffd640 1 -- 172.21.15.145:0/4088957027 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68010490 con 0x56307b7d9c70 2024-09-11T11:03:15.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7efe52ffd640 1 -- 172.21.15.145:0/4088957027 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6801d580 con 0x56307b7d9c70 2024-09-11T11:03:15.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6f93e980 1 -- 172.21.15.145:0/4088957027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56307b7da860 con 0x56307b7d9c70 2024-09-11T11:03:15.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7efe52ffd640 1 -- 172.21.15.145:0/4088957027 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6801d8a0 con 0x56307b7d9c70 2024-09-11T11:03:15.597 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7eff6f93e980 1 -- 172.21.15.145:0/4088957027 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56307b7dd4e0 con 0x56307b7d9c70 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.593+0000 7efe52ffd640 1 -- 172.21.15.145:0/4088957027 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7eff68010070 con 0x56307b7d9c70 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7efe52ffd640 1 --2- 172.21.15.145:0/4088957027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe440346a0 0x7efe44036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7efe52ffd640 1 -- 172.21.15.145:0/4088957027 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7eff680150c0 con 0x56307b7d9c70 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/4088957027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe440346a0 0x7efe44036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 Processor -- start 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- start start 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/4088957027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe440346a0 0x7efe44036b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7eff64000c10 tx=0x7eff64005ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7e6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56307b7b53e0 con 0x56307b7e6570 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7e6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38140/0 (socket says 172.21.15.145:38140) 2024-09-11T11:03:15.599 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6d44e640 1 -- 172.21.15.145:0/3352574620 learned_addr learned my addr 172.21.15.145:0/3352574620 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6d44e640 1 -- 172.21.15.145:0/3352574620 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56307b7e6f40 con 0x56307b7e6570 2024-09-11T11:03:15.601 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6d44e640 1 --2- 172.21.15.145:0/3352574620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7e6970 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7eff68028fd0 tx=0x7eff680306d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee4f443172e8df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7efe50ff9640 1 -- 172.21.15.145:0/3352574620 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68038e70 con 0x56307b7e6570 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7efe50ff9640 1 -- 172.21.15.145:0/3352574620 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff68030400 con 0x56307b7e6570 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7efe50ff9640 1 -- 172.21.15.145:0/3352574620 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68012a20 con 0x56307b7e6570 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- 172.21.15.145:0/3352574620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 msgr2=0x56307b7e6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3352574620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7e6970 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7eff68028fd0 tx=0x7eff680306d0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- 172.21.15.145:0/3352574620 shutdown_connections 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3352574620 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7e6970 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- 172.21.15.145:0/3352574620 >> 172.21.15.145:0/3352574620 conn(0x56307b7e2950 msgr2=0x56307b7e0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- 172.21.15.145:0/3352574620 shutdown_connections 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- 172.21.15.145:0/3352574620 wait complete. 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 Processor -- start 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- start start 2024-09-11T11:03:15.602 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6f93e980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x56307b7e73c0 con 0x56307b7e6570 2024-09-11T11:03:15.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6d44e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38144/0 (socket says 172.21.15.145:38144) 2024-09-11T11:03:15.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.597+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 learned_addr learned my addr 172.21.15.145:0/1944696341 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.603 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56307b7edc40 con 0x56307b7e6570 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6d44e640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7ed700 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7eff680046c0 tx=0x7eff6800bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7efe42ffd640 1 -- 172.21.15.145:0/1944696341 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68049d20 con 0x56307b7e6570 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56307b7edc40 con 0x56307b7e6570 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7efe42ffd640 1 -- 172.21.15.145:0/1944696341 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff680265d0 con 0x56307b7e6570 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56307b7edc40 con 0x56307b7e6570 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7efe42ffd640 1 -- 172.21.15.145:0/1944696341 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6801da40 con 0x56307b7e6570 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7efe42ffd640 1 -- 172.21.15.145:0/1944696341 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7eff68061040 con 0x56307b7e6570 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7efe42ffd640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe38034650 0x7efe38036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7efe42ffd640 1 -- 172.21.15.145:0/1944696341 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7eff6805f020 con 0x56307b7e6570 2024-09-11T11:03:15.606 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe38034650 0x7efe38036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b7f8700 0x56307b7fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7fb310 con 0x56307b7f8700 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6dc4f640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b7f8700 0x56307b7fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe38034650 0x7efe38036b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7eff640aa910 tx=0x7eff640c1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6dc4f640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b7f8700 0x56307b7fabc0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 20 realm 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7f7bb0 con 0x56307b7f8700 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.607 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:15.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7fbdd0 con 0x56307b7f8700 2024-09-11T11:03:15.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7fcbb0 0x56307b7fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7ff630 con 0x56307b7fcbb0 2024-09-11T11:03:15.608 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.601+0000 7eff6d44e640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7fcbb0 0x56307b7fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6d44e640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7fcbb0 0x56307b7fefa0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.611 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6f93e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b7ffe80 con 0x56307b7fcbb0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6f93e980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6f93e980 20 searching for the correct realm 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56307b801bf0 0x56307b803fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56307b804660 con 0x56307b801bf0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56307b801bf0 0x56307b803fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6cc4d640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56307b801bf0 0x56307b803fe0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x56307b804660 con 0x56307b7fcbb0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.612 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6d44e640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7eff68064050 0x7eff68085790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x7eff68064050 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6dc4f640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7eff68064050 0x7eff68085790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6dc4f640 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7eff68064050 0x7eff68085790 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.605+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b801bf0 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.613 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7fcbb0 2024-09-11T11:03:15.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.614 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7fcbb0 2024-09-11T11:03:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x7eff68064050 2024-09-11T11:03:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.618 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x7eff68064050 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.609+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7fcbb0 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b801bf0 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7fcbb0 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b801bf0 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.619 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b801bf0 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x7eff68064050 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7f8700 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x7eff68064050 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.620 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b801bf0 2024-09-11T11:03:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x7eff68064050 2024-09-11T11:03:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.613+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7fcbb0 2024-09-11T11:03:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.621 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7fcbb0 2024-09-11T11:03:15.624 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b801bf0 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7fcbb0 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x7eff680853f0 con 0x56307b7fcbb0 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:15.625 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b8006d0 con 0x56307b7f8700 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b800ac0 con 0x56307b7fcbb0 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b800ac0 con 0x7eff68064050 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:15.626 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 zone default found 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 4 Realm: () 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 zonegroup default 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.617+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b804ac0 con 0x7eff68064050 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b8068d0 con 0x56307b801bf0 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.627 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b806d10 con 0x56307b801bf0 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 20 started sync module instance, tier type = 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b805ce0 con 0x56307b7fcbb0 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94766230430176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b805ce0 con 0x56307b7fcbb0 2024-09-11T11:03:15.628 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.621+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b807800 con 0x56307b7f8700 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94766230434576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b807730 con 0x56307b7f8700 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b808700 con 0x56307b7fcbb0 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94766230430176] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94766230434576] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94766230436848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b808210 con 0x56307b7fcbb0 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b808fd0 con 0x7eff68064050 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.630 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94766230440736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b808210 con 0x7eff68064050 2024-09-11T11:03:15.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b809a10 con 0x56307b7fcbb0 2024-09-11T11:03:15.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94766230436848] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.631 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.625+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94766230440736] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94766230441792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b809560 con 0x56307b7fcbb0 2024-09-11T11:03:15.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b80a2b0 con 0x56307b801bf0 2024-09-11T11:03:15.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94766230445568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b809560 con 0x56307b801bf0 2024-09-11T11:03:15.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b80b120 con 0x56307b801bf0 2024-09-11T11:03:15.632 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94766230441792] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94766230445568] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94766230449264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b80a760 con 0x56307b801bf0 2024-09-11T11:03:15.633 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.629+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b80bb70 con 0x7eff68064050 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94766230449264] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94766230451808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b80bb30 con 0x7eff68064050 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 20 add_watcher() i=0 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 20 add_watcher() i=1 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 20 add_watcher() i=2 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 20 add_watcher() i=3 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 20 add_watcher() i=4 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 20 add_watcher() i=5 2024-09-11T11:03:15.635 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 20 add_watcher() i=6 2024-09-11T11:03:15.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94766230451808] v36'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 20 add_watcher() i=7 2024-09-11T11:03:15.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:15.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b80f080 con 0x56307b7f8700 2024-09-11T11:03:15.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.636 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.633+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94766230427696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b80c5d0 con 0x56307b7f8700 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94766230427696] v36'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7efe237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 5 note: GC not initialized 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7efe227e4640 20 reqs_thread_entry: start 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 20 Filter name: none 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7efd93fff640 20 reqs_thread_entry: start 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.639 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b832720 con 0x56307b7f8700 2024-09-11T11:03:15.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.640 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 20 rados_obj.operate() r=0 bl.length=503 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b8390a0 con 0x56307b7f8700 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:15.641 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94766230637328 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x56307b8347b0 con 0x56307b7fcbb0 2024-09-11T11:03:15.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94766230441792 notify 154618822714 ret 0) ==== 678+0+0 (crc 0 0 0) 0x56307b7da860 con 0x56307b7fcbb0 2024-09-11T11:03:15.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7efe50ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822714 cookie 94766230441792 notifier 4899 bl.length()=636 2024-09-11T11:03:15.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7efe50ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7efe50ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94766230637328 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7efe50ff9640 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7efe30003eb0 con 0x56307b7fcbb0 2024-09-11T11:03:15.642 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.637+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.641+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94766230637328 notify 154618822714 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56307b7da5d0 con 0x56307b7fcbb0 2024-09-11T11:03:15.643 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:15.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.641+0000 7efe237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.643 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.641+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94766230427696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b830510 con 0x56307b7f8700 2024-09-11T11:03:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.641+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94766230427696] v36'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.645 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.641+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94766230430176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b830510 con 0x56307b7fcbb0 2024-09-11T11:03:15.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.645+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94766230430176] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.645+0000 7eff6f93e980 20 remove_watcher() i=0 2024-09-11T11:03:15.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.645+0000 7eff6f93e980 2 removed watcher, disabling cache 2024-09-11T11:03:15.647 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.645+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94766230434576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b8061e0 con 0x56307b7f8700 2024-09-11T11:03:15.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.645+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94766230434576] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x56307b7f8700 2024-09-11T11:03:15.648 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.645+0000 7eff6f93e980 20 remove_watcher() i=1 2024-09-11T11:03:15.649 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.645+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94766230436848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b830510 con 0x56307b7fcbb0 2024-09-11T11:03:15.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94766230436848] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6f93e980 20 remove_watcher() i=2 2024-09-11T11:03:15.650 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94766230440736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b807310 con 0x7eff68064050 2024-09-11T11:03:15.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94766230440736] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6f93e980 20 remove_watcher() i=3 2024-09-11T11:03:15.651 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94766230441792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b8061e0 con 0x56307b7fcbb0 2024-09-11T11:03:15.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6d44e640 1 -- 172.21.15.145:0/1944696341 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94766230441792] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff68074020 con 0x56307b7fcbb0 2024-09-11T11:03:15.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6f93e980 20 remove_watcher() i=4 2024-09-11T11:03:15.653 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.649+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94766230445568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b830510 con 0x56307b801bf0 2024-09-11T11:03:15.654 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94766230445568] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 20 remove_watcher() i=5 2024-09-11T11:03:15.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94766230449264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b807310 con 0x56307b801bf0 2024-09-11T11:03:15.655 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6cc4d640 1 -- 172.21.15.145:0/1944696341 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94766230449264] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff640aaae0 con 0x56307b801bf0 2024-09-11T11:03:15.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 20 remove_watcher() i=6 2024-09-11T11:03:15.656 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94766230451808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x56307b8061e0 con 0x7eff68064050 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94766230451808] v36'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff600083f0 con 0x7eff68064050 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 20 remove_watcher() i=7 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7fcbb0 msgr2=0x56307b7fefa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7fcbb0 0x56307b7fefa0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b7f8700 msgr2=0x56307b7fabc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b7f8700 0x56307b7fabc0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7eff68064050 msgr2=0x7eff68085790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7eff68064050 0x7eff68085790 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.659 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56307b801bf0 msgr2=0x56307b803fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x56307b801bf0 0x56307b803fe0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe38034650 msgr2=0x7efe38036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe38034650 0x7efe38036b10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7eff640aa910 tx=0x7eff640c1040 comp rx=0 tx=0).stop 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 msgr2=0x56307b7ed700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/1944696341 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7e6570 0x56307b7ed700 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7eff680046c0 tx=0x7eff6800bf70 comp rx=0 tx=0).stop 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 reap_dead start 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6dc4f640 1 -- 172.21.15.145:0/1944696341 reap_dead start 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 shutdown_connections 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 >> 172.21.15.145:0/1944696341 conn(0x56307b7e2950 msgr2=0x56307b7e0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 shutdown_connections 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/1944696341 wait complete. 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/4088957027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe440346a0 msgr2=0x7efe44036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.660 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/4088957027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe440346a0 0x7efe44036b60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7eff64000c10 tx=0x7eff64005ad0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/4088957027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7d9c70 msgr2=0x56307b7da090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/4088957027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7d9c70 0x56307b7da090 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7eff68004fd0 tx=0x7eff68010ab0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/4088957027 shutdown_connections 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/4088957027 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe440346a0 0x7efe44036b60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/4088957027 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b7d9c70 0x56307b7da090 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/4088957027 >> 172.21.15.145:0/4088957027 conn(0x56307b7cedc0 msgr2=0x56307b7d1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/4088957027 shutdown_connections 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/4088957027 wait complete. 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7c4220 msgr2=0x56307b7c6610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.653+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x56307b7c4220 0x56307b7c6610 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b6cda90 msgr2=0x56307b7c2df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x56307b6cda90 0x56307b7c2df0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.661 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56307b7c98b0 msgr2=0x56307b7cbca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x56307b7c98b0 0x56307b7cbca0 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe54034650 msgr2=0x7efe54036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7efe54034650 0x7efe54036b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7eff640ae000 tx=0x7eff640a6000 comp rx=0 tx=0).stop 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 msgr2=0x56307b7bbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 --2- 172.21.15.145:0/3833608129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x56307b63e2e0 0x56307b7bbde0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7eff68006640 tx=0x7eff68000f50 comp rx=0 tx=0).stop 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6dc4f640 1 -- 172.21.15.145:0/3833608129 reap_dead start 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 shutdown_connections 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 >> 172.21.15.145:0/3833608129 conn(0x56307b6c40a0 msgr2=0x56307b7af240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 shutdown_connections 2024-09-11T11:03:15.662 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.657+0000 7eff6f93e980 1 -- 172.21.15.145:0/3833608129 wait complete. 2024-09-11T11:03:15.667 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.667 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.668 ERROR:root:0 2024-09-11T11:03:15.668 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-11T11:03:15.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-11T11:03:15.668 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-11T11:03:15.745 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:15.746 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:15.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f27353c8980 1 Processor -- start 2024-09-11T11:03:15.746 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f27353c8980 1 -- start start 2024-09-11T11:03:15.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f27353c8980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562a6ecb1ad0 0x562a6ed40380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f27353c8980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562a6ebc5ae0 con 0x562a6ed408c0 2024-09-11T11:03:15.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f27353c8980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x562a6ebe9e30 con 0x562a6ecb1ad0 2024-09-11T11:03:15.747 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f2732ed8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562a6ecb1ad0 0x562a6ed40380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f2732ed8640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x562a6ecb1ad0 0x562a6ed40380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38158/0 (socket says 172.21.15.145:38158) 2024-09-11T11:03:15.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f2732ed8640 1 -- 172.21.15.145:0/101980834 learned_addr learned my addr 172.21.15.145:0/101980834 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f27326d7640 1 --1- 172.21.15.145:0/101980834 >> v1:172.21.15.102:6789/0 conn(0x562a6ed408c0 0x562a6ed42cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52204/0 (socket says 172.21.15.145:52204) 2024-09-11T11:03:15.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f2732ed8640 1 -- 172.21.15.145:0/101980834 >> v1:172.21.15.102:6789/0 conn(0x562a6ed408c0 legacy=0x562a6ed42cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.748 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.745+0000 7f2732ed8640 1 -- 172.21.15.145:0/101980834 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6ed453e0 con 0x562a6ecb1ad0 2024-09-11T11:03:15.750 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f2732ed8640 1 --2- 172.21.15.145:0/101980834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ed40380 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f272c00a4e0 tx=0x7f272c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e24117dcb88b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f2731ed6640 1 -- 172.21.15.145:0/101980834 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0aa540 con 0x562a6ecb1ad0 2024-09-11T11:03:15.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f2731ed6640 1 -- 172.21.15.145:0/101980834 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c0aa6e0 con 0x562a6ecb1ad0 2024-09-11T11:03:15.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f2731ed6640 1 -- 172.21.15.145:0/101980834 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0aaa40 con 0x562a6ecb1ad0 2024-09-11T11:03:15.751 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f27353c8980 1 -- 172.21.15.145:0/101980834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 msgr2=0x562a6ed40380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f27353c8980 1 --2- 172.21.15.145:0/101980834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ed40380 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f272c00a4e0 tx=0x7f272c01b090 comp rx=0 tx=0).stop 2024-09-11T11:03:15.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f27353c8980 1 -- 172.21.15.145:0/101980834 shutdown_connections 2024-09-11T11:03:15.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f27353c8980 1 --2- 172.21.15.145:0/101980834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ed40380 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f27353c8980 1 -- 172.21.15.145:0/101980834 >> 172.21.15.145:0/101980834 conn(0x562a6ed38070 msgr2=0x562a6ed3a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f27353c8980 1 -- 172.21.15.145:0/101980834 shutdown_connections 2024-09-11T11:03:15.752 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.749+0000 7f27353c8980 1 -- 172.21.15.145:0/101980834 wait complete. 2024-09-11T11:03:15.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.761+0000 7f27353c8980 1 Processor -- start 2024-09-11T11:03:15.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.761+0000 7f27353c8980 1 -- start start 2024-09-11T11:03:15.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.761+0000 7f27353c8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee28a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.765 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.761+0000 7f27353c8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562a6ebeb200 con 0x562a6ecb1ad0 2024-09-11T11:03:15.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.761+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee28a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.761+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee28a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38166/0 (socket says 172.21.15.145:38166) 2024-09-11T11:03:15.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.761+0000 7f2732ed8640 1 -- 172.21.15.145:0/807958470 learned_addr learned my addr 172.21.15.145:0/807958470 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2732ed8640 1 -- 172.21.15.145:0/807958470 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6ee29040 con 0x562a6ecb1ad0 2024-09-11T11:03:15.766 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2732ed8640 1 --2- 172.21.15.145:0/807958470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee28a70 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f272c017ca0 tx=0x7f272c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58837fba6060bccd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2620e09640 1 -- 172.21.15.145:0/807958470 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0b9030 con 0x562a6ecb1ad0 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2620e09640 1 -- 172.21.15.145:0/807958470 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c0aaac0 con 0x562a6ecb1ad0 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2620e09640 1 -- 172.21.15.145:0/807958470 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0aada0 con 0x562a6ecb1ad0 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- 172.21.15.145:0/807958470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 msgr2=0x562a6ee28a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 --2- 172.21.15.145:0/807958470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee28a70 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f272c017ca0 tx=0x7f272c0033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- 172.21.15.145:0/807958470 shutdown_connections 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 --2- 172.21.15.145:0/807958470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee28a70 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- 172.21.15.145:0/807958470 >> 172.21.15.145:0/807958470 conn(0x562a6ed38070 msgr2=0x562a6ee246a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- 172.21.15.145:0/807958470 shutdown_connections 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- 172.21.15.145:0/807958470 wait complete. 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 Processor -- start 2024-09-11T11:03:15.768 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- start start 2024-09-11T11:03:15.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee2fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.769 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562a6ed44e20 con 0x562a6ecb1ad0 2024-09-11T11:03:15.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee2fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee2fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38178/0 (socket says 172.21.15.145:38178) 2024-09-11T11:03:15.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2732ed8640 1 -- 172.21.15.145:0/524218355 learned_addr learned my addr 172.21.15.145:0/524218355 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2732ed8640 1 -- 172.21.15.145:0/524218355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6ee30200 con 0x562a6ecb1ad0 2024-09-11T11:03:15.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f2732ed8640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee2fcc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f272c005cc0 tx=0x7f272c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.770 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f261f606640 1 -- 172.21.15.145:0/524218355 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0b9030 con 0x562a6ecb1ad0 2024-09-11T11:03:15.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a6ee30490 con 0x562a6ecb1ad0 2024-09-11T11:03:15.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f261f606640 1 -- 172.21.15.145:0/524218355 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c0c3070 con 0x562a6ecb1ad0 2024-09-11T11:03:15.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6ee33170 con 0x562a6ecb1ad0 2024-09-11T11:03:15.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.765+0000 7f261f606640 1 -- 172.21.15.145:0/524218355 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0cc060 con 0x562a6ecb1ad0 2024-09-11T11:03:15.771 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f261f606640 1 -- 172.21.15.145:0/524218355 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f272c0c5030 con 0x562a6ecb1ad0 2024-09-11T11:03:15.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f261f606640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2618034650 0x7f2618036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.772 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f261f606640 1 -- 172.21.15.145:0/524218355 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f272c0ba070 con 0x562a6ecb1ad0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27326d7640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2618034650 0x7f2618036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27353c8980 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ed408c0 0x562a6ee36c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee37270 con 0x562a6ed408c0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27336d9640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ed408c0 0x562a6ee36c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27326d7640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2618034650 0x7f2618036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2728001e50 tx=0x7f27280013b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27336d9640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ed408c0 0x562a6ee36c50 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27336d9640 1 -- 172.21.15.145:0/524218355 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ed408c0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27353c8980 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee380b0 0x562a6ee3a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee3ab00 con 0x562a6ee380b0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f2732ed8640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee380b0 0x562a6ee3a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.773 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f2732ed8640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee380b0 0x562a6ee3a4a0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f2732ed8640 1 -- 172.21.15.145:0/524218355 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f272c0c7410 con 0x562a6ee380b0 2024-09-11T11:03:15.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.769+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee3c3b0 con 0x562a6ee380b0 2024-09-11T11:03:15.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f2732ed8640 1 -- 172.21.15.145:0/524218355 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f272c0c7410 con 0x562a6ee380b0 2024-09-11T11:03:15.774 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee3b5e0 con 0x562a6ee380b0 2024-09-11T11:03:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f2732ed8640 1 -- 172.21.15.145:0/524218355 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f272c0c7410 con 0x562a6ee380b0 2024-09-11T11:03:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562a6ee3d760 0x562a6ee3fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.776 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee40090 con 0x562a6ee3d760 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27326d7640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562a6ee3d760 0x562a6ee3fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27326d7640 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562a6ee3d760 0x562a6ee3fb50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27326d7640 1 -- 172.21.15.145:0/524218355 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f272800f700 con 0x562a6ee3d760 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 Processor -- start 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 -- start start 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee4da50 0x562a6ee4de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562a6ec44800 con 0x562a6ee4da50 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee4da50 0x562a6ee4de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee4da50 0x562a6ee4de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38188/0 (socket says 172.21.15.145:38188) 2024-09-11T11:03:15.777 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f2732ed8640 1 -- 172.21.15.145:0/445508637 learned_addr learned my addr 172.21.15.145:0/445508637 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f2732ed8640 1 -- 172.21.15.145:0/445508637 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6ee4e3b0 con 0x562a6ee4da50 2024-09-11T11:03:15.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f2732ed8640 1 --2- 172.21.15.145:0/445508637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee4da50 0x562a6ee4de70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f272c0e5010 tx=0x7f272c0e50b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f261ce01640 1 -- 172.21.15.145:0/445508637 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0e21a0 con 0x562a6ee4da50 2024-09-11T11:03:15.778 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 -- 172.21.15.145:0/445508637 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a6ee4e640 con 0x562a6ee4da50 2024-09-11T11:03:15.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f261ce01640 1 -- 172.21.15.145:0/445508637 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c0e2340 con 0x562a6ee4da50 2024-09-11T11:03:15.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f261ce01640 1 -- 172.21.15.145:0/445508637 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0c6aa0 con 0x562a6ee4da50 2024-09-11T11:03:15.779 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.773+0000 7f27353c8980 1 -- 172.21.15.145:0/445508637 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6ee512c0 con 0x562a6ee4da50 2024-09-11T11:03:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f261ce01640 1 -- 172.21.15.145:0/445508637 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f272c0ec060 con 0x562a6ee4da50 2024-09-11T11:03:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f261ce01640 1 --2- 172.21.15.145:0/445508637 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f260c034600 0x7f260c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f261ce01640 1 -- 172.21.15.145:0/445508637 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f272c0e6db0 con 0x562a6ee4da50 2024-09-11T11:03:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27326d7640 1 --2- 172.21.15.145:0/445508637 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f260c034600 0x7f260c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 Processor -- start 2024-09-11T11:03:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 -- start start 2024-09-11T11:03:15.780 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27326d7640 1 --2- 172.21.15.145:0/445508637 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f260c034600 0x7f260c036ac0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x562a6ee342b0 tx=0x7f272800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ee5a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562a6ee29300 con 0x562a6ee5a420 2024-09-11T11:03:15.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ee5a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ee5a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38196/0 (socket says 172.21.15.145:38196) 2024-09-11T11:03:15.781 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f2732ed8640 1 -- 172.21.15.145:0/3484465299 learned_addr learned my addr 172.21.15.145:0/3484465299 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f2732ed8640 1 -- 172.21.15.145:0/3484465299 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6ee5adf0 con 0x562a6ee5a420 2024-09-11T11:03:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f2732ed8640 1 --2- 172.21.15.145:0/3484465299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ee5a820 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f272c0b7010 tx=0x7f272c0b49b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3f2a77b2fe0c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f26167fc640 1 -- 172.21.15.145:0/3484465299 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0fb020 con 0x562a6ee5a420 2024-09-11T11:03:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f26167fc640 1 -- 172.21.15.145:0/3484465299 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c005150 con 0x562a6ee5a420 2024-09-11T11:03:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f26167fc640 1 -- 172.21.15.145:0/3484465299 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0dd1a0 con 0x562a6ee5a420 2024-09-11T11:03:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 -- 172.21.15.145:0/3484465299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 msgr2=0x562a6ee5a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 --2- 172.21.15.145:0/3484465299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ee5a820 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f272c0b7010 tx=0x7f272c0b49b0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.783 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 -- 172.21.15.145:0/3484465299 shutdown_connections 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 --2- 172.21.15.145:0/3484465299 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ee5a820 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.777+0000 7f27353c8980 1 -- 172.21.15.145:0/3484465299 >> 172.21.15.145:0/3484465299 conn(0x562a6ee567b0 msgr2=0x562a6ee548b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 -- 172.21.15.145:0/3484465299 shutdown_connections 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 -- 172.21.15.145:0/3484465299 wait complete. 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 Processor -- start 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 -- start start 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ed3dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x562a6ee5b340 con 0x562a6ee5a420 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ed3dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2732ed8640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ed3dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38208/0 (socket says 172.21.15.145:38208) 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 learned_addr learned my addr 172.21.15.145:0/3423578483 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.784 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a6ed3c3a0 con 0x562a6ee5a420 2024-09-11T11:03:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2732ed8640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ed3dc80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f272c0c08c0 tx=0x7f272c0daeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2614ff9640 1 -- 172.21.15.145:0/3423578483 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c110070 con 0x562a6ee5a420 2024-09-11T11:03:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562a6ed3c3a0 con 0x562a6ee5a420 2024-09-11T11:03:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a6ed3c3a0 con 0x562a6ee5a420 2024-09-11T11:03:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2614ff9640 1 -- 172.21.15.145:0/3423578483 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f272c0dd070 con 0x562a6ee5a420 2024-09-11T11:03:15.787 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2614ff9640 1 -- 172.21.15.145:0/3423578483 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f272c0c6c40 con 0x562a6ee5a420 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2614ff9640 1 -- 172.21.15.145:0/3423578483 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f272c113070 con 0x562a6ee5a420 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2614ff9640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f25fc0346a0 0x7f25fc036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f2614ff9640 1 -- 172.21.15.145:0/3423578483 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f272c106030 con 0x562a6ee5a420 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27326d7640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f25fc0346a0 0x7f25fc036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ee6e960 0x562a6ee70e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee71550 con 0x562a6ee6e960 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.781+0000 7f27336d9640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ee6e960 0x562a6ee70e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27326d7640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f25fc0346a0 0x7f25fc036b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x562a6ee3c300 tx=0x7f2728010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27336d9640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ee6e960 0x562a6ee70e00 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 realm 2024-09-11T11:03:15.788 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee6de50 con 0x562a6ee6e960 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee72020 con 0x562a6ee6e960 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee72e00 0x562a6ee751f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee75870 con 0x562a6ee72e00 2024-09-11T11:03:15.789 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f2732ed8640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee72e00 0x562a6ee751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f2732ed8640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee72e00 0x562a6ee751f0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.792 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee760c0 con 0x562a6ee72e00 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 20 searching for the correct realm 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562a6ee77e30 0x562a6ee7a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee77e30 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27326d7640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562a6ee77e30 0x562a6ee7a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.785+0000 7f27326d7640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562a6ee77e30 0x562a6ee7a220 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.793 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f2732ed8640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f272c115060 0x7f272c0cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x7f272c115060 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f272c115060 0x7f272c0cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f272c115060 0x7f272c0cc200 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee77e30 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.794 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.795 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.789+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x7f272c115060 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.799 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x7f272c115060 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee77e30 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee77e30 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.800 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.793+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee77e30 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x7f272c115060 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee6e960 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.801 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x7f272c115060 2024-09-11T11:03:15.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee77e30 2024-09-11T11:03:15.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x7f272c115060 2024-09-11T11:03:15.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.802 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee77e30 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.797+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7a8a0 con 0x562a6ee72e00 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.806 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee76a70 con 0x562a6ee6e960 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee77310 con 0x562a6ee72e00 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.807 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee766b0 con 0x7f272c115060 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 zone default found 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 4 Realm: () 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 zonegroup default 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.808 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7b1d0 con 0x7f272c115060 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7cf50 con 0x562a6ee77e30 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7d420 con 0x562a6ee77e30 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 started sync module instance, tier type = 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:15.809 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.801+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7adc0 con 0x562a6ee72e00 2024-09-11T11:03:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94740249297808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7d880 con 0x562a6ee72e00 2024-09-11T11:03:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7e0d0 con 0x562a6ee6e960 2024-09-11T11:03:15.811 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94740249303440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7e380 con 0x562a6ee6e960 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7eea0 con 0x562a6ee72e00 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94740249297808] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94740249303440] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94740249307504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7ee60 con 0x562a6ee72e00 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.805+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7f740 con 0x7f272c115060 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.809+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.809+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94740249309840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7ee60 con 0x7f272c115060 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.809+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee80180 con 0x562a6ee72e00 2024-09-11T11:03:15.812 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.809+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94740249307504] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.809+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94740249309840] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.809+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.809+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94740249310896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7fcd0 con 0x562a6ee72e00 2024-09-11T11:03:15.813 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.809+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee80a20 con 0x562a6ee77e30 2024-09-11T11:03:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94740249314672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7fcd0 con 0x562a6ee77e30 2024-09-11T11:03:15.814 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee81780 con 0x562a6ee77e30 2024-09-11T11:03:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94740249310896] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94740249314672] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.815 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94740249316800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee81b70 con 0x562a6ee77e30 2024-09-11T11:03:15.816 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee82400 con 0x7f272c115060 2024-09-11T11:03:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94740249316800] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94740249317856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee82020 con 0x7f272c115060 2024-09-11T11:03:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 20 add_watcher() i=0 2024-09-11T11:03:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 20 add_watcher() i=1 2024-09-11T11:03:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 20 add_watcher() i=2 2024-09-11T11:03:15.817 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 20 add_watcher() i=3 2024-09-11T11:03:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 20 add_watcher() i=4 2024-09-11T11:03:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 20 add_watcher() i=5 2024-09-11T11:03:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 20 add_watcher() i=6 2024-09-11T11:03:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94740249317856] v36'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.818 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 20 add_watcher() i=7 2024-09-11T11:03:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.813+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee858b0 con 0x562a6ee6e960 2024-09-11T11:03:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.819 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94740249320768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee82d70 con 0x562a6ee6e960 2024-09-11T11:03:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94740249320768] v36'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f25e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 5 note: GC not initialized 2024-09-11T11:03:15.821 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f2563fff640 20 reqs_thread_entry: start 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 20 Filter name: none 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f2561ffb640 20 reqs_thread_entry: start 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6eea8fd0 con 0x562a6ee6e960 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 20 rados_obj.operate() r=0 bl.length=460 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:15.822 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.817+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6eeaf550 con 0x562a6ee6e960 2024-09-11T11:03:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v36'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f27353c8980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f27353c8980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f27353c8980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:15.823 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94740249505728 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x562a6eeaac00 con 0x562a6ee72e00 2024-09-11T11:03:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94740249310896 notify 154618822715 ret 0) ==== 708+0+0 (crc 0 0 0) 0x562a6ee4e640 con 0x562a6ee72e00 2024-09-11T11:03:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94740249505728 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f26167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822715 cookie 94740249310896 notifier 4906 bl.length()=666 2024-09-11T11:03:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f26167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f26167fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f26167fc640 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f25f8003eb0 con 0x562a6ee72e00 2024-09-11T11:03:15.824 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94740249505728 notify 154618822715 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562a6ee4e3b0 con 0x562a6ee72e00 2024-09-11T11:03:15.825 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:15.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f25e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.825 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.821+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94740249320768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6eea6dd0 con 0x562a6ee6e960 2024-09-11T11:03:15.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.825+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94740249320768] v36'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.827 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.825+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94740249297808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6eea6dd0 con 0x562a6ee72e00 2024-09-11T11:03:15.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.825+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94740249297808] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.825+0000 7f27353c8980 20 remove_watcher() i=0 2024-09-11T11:03:15.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.825+0000 7f27353c8980 2 removed watcher, disabling cache 2024-09-11T11:03:15.829 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.825+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94740249303440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6eea6dd0 con 0x562a6ee6e960 2024-09-11T11:03:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94740249303440] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x562a6ee6e960 2024-09-11T11:03:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f27353c8980 20 remove_watcher() i=1 2024-09-11T11:03:15.830 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94740249307504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7d990 con 0x562a6ee72e00 2024-09-11T11:03:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94740249307504] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f27353c8980 20 remove_watcher() i=2 2024-09-11T11:03:15.832 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94740249309840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6eea6dd0 con 0x7f272c115060 2024-09-11T11:03:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94740249309840] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f27353c8980 20 remove_watcher() i=3 2024-09-11T11:03:15.833 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.829+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94740249310896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7e970 con 0x562a6ee72e00 2024-09-11T11:03:15.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f2732ed8640 1 -- 172.21.15.145:0/3423578483 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94740249310896] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f272c112030 con 0x562a6ee72e00 2024-09-11T11:03:15.835 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f27353c8980 20 remove_watcher() i=4 2024-09-11T11:03:15.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94740249314672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6eea6dd0 con 0x562a6ee77e30 2024-09-11T11:03:15.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94740249314672] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f27353c8980 20 remove_watcher() i=5 2024-09-11T11:03:15.836 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94740249316800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee7e970 con 0x562a6ee77e30 2024-09-11T11:03:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f27326d7640 1 -- 172.21.15.145:0/3423578483 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94740249316800] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2728037040 con 0x562a6ee77e30 2024-09-11T11:03:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f27353c8980 20 remove_watcher() i=6 2024-09-11T11:03:15.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.833+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94740249317856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x562a6ee80570 con 0x7f272c115060 2024-09-11T11:03:15.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94740249317856] v36'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f27240083f0 con 0x7f272c115060 2024-09-11T11:03:15.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 20 remove_watcher() i=7 2024-09-11T11:03:15.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee72e00 msgr2=0x562a6ee751f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee72e00 0x562a6ee751f0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ee6e960 msgr2=0x562a6ee70e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ee6e960 0x562a6ee70e00 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f272c115060 msgr2=0x7f272c0cc200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f272c115060 0x7f272c0cc200 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562a6ee77e30 msgr2=0x562a6ee7a220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x562a6ee77e30 0x562a6ee7a220 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f25fc0346a0 msgr2=0x7f25fc036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f25fc0346a0 0x7f25fc036b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x562a6ee3c300 tx=0x7f2728010000 comp rx=0 tx=0).stop 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 msgr2=0x562a6ed3dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27336d9640 1 -- 172.21.15.145:0/3423578483 reap_dead start 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ed3dc80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f272c0c08c0 tx=0x7f272c0daeb0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 shutdown_connections 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/3423578483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee5a420 0x562a6ed3dc80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 >> 172.21.15.145:0/3423578483 conn(0x562a6ee567b0 msgr2=0x562a6ee54880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 shutdown_connections 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/3423578483 wait complete. 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/445508637 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f260c034600 msgr2=0x7f260c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/445508637 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f260c034600 0x7f260c036ac0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x562a6ee342b0 tx=0x7f272800f000 comp rx=0 tx=0).stop 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/445508637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee4da50 msgr2=0x562a6ee4de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/445508637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee4da50 0x562a6ee4de70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f272c0e5010 tx=0x7f272c0e50b0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/445508637 shutdown_connections 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/445508637 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f260c034600 0x7f260c036ac0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/445508637 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ee4da50 0x562a6ee4de70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/445508637 >> 172.21.15.145:0/445508637 conn(0x562a6ee42ba0 msgr2=0x562a6ee45620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/445508637 shutdown_connections 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/445508637 wait complete. 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee380b0 msgr2=0x562a6ee3a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x562a6ee380b0 0x562a6ee3a4a0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ed408c0 msgr2=0x562a6ee36c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x562a6ed408c0 0x562a6ee36c50 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562a6ee3d760 msgr2=0x562a6ee3fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x562a6ee3d760 0x562a6ee3fb50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2618034650 msgr2=0x7f2618036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f2618034650 0x7f2618036b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2728001e50 tx=0x7f27280013b0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 msgr2=0x562a6ee2fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 --2- 172.21.15.145:0/524218355 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x562a6ecb1ad0 0x562a6ee2fcc0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f272c005cc0 tx=0x7f272c017e30 comp rx=0 tx=0).stop 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27336d9640 1 -- 172.21.15.145:0/524218355 reap_dead start 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 shutdown_connections 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 >> 172.21.15.145:0/524218355 conn(0x562a6ed38070 msgr2=0x562a6ee23220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.844 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 shutdown_connections 2024-09-11T11:03:15.845 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.837+0000 7f27353c8980 1 -- 172.21.15.145:0/524218355 wait complete. 2024-09-11T11:03:15.849 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.849 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:15.849 ERROR:root:0 2024-09-11T11:03:15.849 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:15.853 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx00000491e5f20ad76727d-0066e178f3-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:03:15.854 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-11T11:03:15.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-11T11:03:15.854 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-11T11:03:15.917 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:15.918 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:15.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9754963980 1 Processor -- start 2024-09-11T11:03:15.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9754963980 1 -- start start 2024-09-11T11:03:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9754963980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55610780c2a0 0x55610789a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9754963980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55610771fae0 con 0x55610789a8f0 2024-09-11T11:03:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9754963980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x556107743e30 con 0x55610780c2a0 2024-09-11T11:03:15.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9752473640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55610780c2a0 0x55610789a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9752473640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55610780c2a0 0x55610789a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38214/0 (socket says 172.21.15.145:38214) 2024-09-11T11:03:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9751c72640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55610789a8f0 0x55610789cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52208/0 (socket says 172.21.15.145:52208) 2024-09-11T11:03:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9752473640 1 -- 172.21.15.145:0/1761955958 learned_addr learned my addr 172.21.15.145:0/1761955958 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9752473640 1 -- 172.21.15.145:0/1761955958 >> v1:172.21.15.102:6789/0 conn(0x55610789a8f0 legacy=0x55610789cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9752473640 1 -- 172.21.15.145:0/1761955958 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610780c830 con 0x55610780c2a0 2024-09-11T11:03:15.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.917+0000 7f9752473640 1 --2- 172.21.15.145:0/1761955958 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610780c2a0 0x55610789a3b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f974400a4e0 tx=0x7f974401b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70964c7274926c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9751471640 1 -- 172.21.15.145:0/1761955958 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440aa540 con 0x55610780c2a0 2024-09-11T11:03:15.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9751471640 1 -- 172.21.15.145:0/1761955958 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97440aa6e0 con 0x55610780c2a0 2024-09-11T11:03:15.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9751471640 1 -- 172.21.15.145:0/1761955958 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440aaa40 con 0x55610780c2a0 2024-09-11T11:03:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9754963980 1 -- 172.21.15.145:0/1761955958 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610780c2a0 msgr2=0x55610789a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9754963980 1 --2- 172.21.15.145:0/1761955958 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610780c2a0 0x55610789a3b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f974400a4e0 tx=0x7f974401b090 comp rx=0 tx=0).stop 2024-09-11T11:03:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9754963980 1 -- 172.21.15.145:0/1761955958 shutdown_connections 2024-09-11T11:03:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9754963980 1 --2- 172.21.15.145:0/1761955958 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610780c2a0 0x55610789a3b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9754963980 1 -- 172.21.15.145:0/1761955958 >> 172.21.15.145:0/1761955958 conn(0x5561078920a0 msgr2=0x5561078944c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9754963980 1 -- 172.21.15.145:0/1761955958 shutdown_connections 2024-09-11T11:03:15.923 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.921+0000 7f9754963980 1 -- 172.21.15.145:0/1761955958 wait complete. 2024-09-11T11:03:15.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9754963980 1 Processor -- start 2024-09-11T11:03:15.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9754963980 1 -- start start 2024-09-11T11:03:15.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9754963980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107982bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9754963980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556107745200 con 0x55610789a8f0 2024-09-11T11:03:15.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107982bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.936 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107982bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38222/0 (socket says 172.21.15.145:38222) 2024-09-11T11:03:15.937 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9752473640 1 -- 172.21.15.145:0/2252304858 learned_addr learned my addr 172.21.15.145:0/2252304858 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9752473640 1 -- 172.21.15.145:0/2252304858 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561079831a0 con 0x55610789a8f0 2024-09-11T11:03:15.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9752473640 1 --2- 172.21.15.145:0/2252304858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107982bd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9744019740 tx=0x7f97440033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ec459a35eb9934 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9640608640 1 -- 172.21.15.145:0/2252304858 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440b9070 con 0x55610789a8f0 2024-09-11T11:03:15.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9640608640 1 -- 172.21.15.145:0/2252304858 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97440aa990 con 0x55610789a8f0 2024-09-11T11:03:15.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.933+0000 7f9640608640 1 -- 172.21.15.145:0/2252304858 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440aac70 con 0x55610789a8f0 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- 172.21.15.145:0/2252304858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 msgr2=0x556107982bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 --2- 172.21.15.145:0/2252304858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107982bd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f9744019740 tx=0x7f97440033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- 172.21.15.145:0/2252304858 shutdown_connections 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 --2- 172.21.15.145:0/2252304858 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107982bd0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- 172.21.15.145:0/2252304858 >> 172.21.15.145:0/2252304858 conn(0x5561078920a0 msgr2=0x55610797e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- 172.21.15.145:0/2252304858 shutdown_connections 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- 172.21.15.145:0/2252304858 wait complete. 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 Processor -- start 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- start start 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107989df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.939 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55610789ef10 con 0x55610789a8f0 2024-09-11T11:03:15.940 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107989df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107989df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38236/0 (socket says 172.21.15.145:38236) 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9752473640 1 -- 172.21.15.145:0/809379360 learned_addr learned my addr 172.21.15.145:0/809379360 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9752473640 1 -- 172.21.15.145:0/809379360 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610798a330 con 0x55610789a8f0 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9752473640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107989df0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9744019740 tx=0x7f9744017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f963ee05640 1 -- 172.21.15.145:0/809379360 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440b9070 con 0x55610789a8f0 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55610798a5c0 con 0x55610789a8f0 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f963ee05640 1 -- 172.21.15.145:0/809379360 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97440b58c0 con 0x55610789a8f0 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610798d2a0 con 0x55610789a8f0 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f963ee05640 1 -- 172.21.15.145:0/809379360 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440b5ba0 con 0x55610789a8f0 2024-09-11T11:03:15.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f963ee05640 1 -- 172.21.15.145:0/809379360 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f97440b3040 con 0x55610789a8f0 2024-09-11T11:03:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f963ee05640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9638034650 0x7f9638036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f963ee05640 1 -- 172.21.15.145:0/809379360 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f97440c4030 con 0x55610789a8f0 2024-09-11T11:03:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9751c72640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9638034650 0x7f9638036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55610798eee0 0x5561079912d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556107991860 con 0x55610798eee0 2024-09-11T11:03:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9752c74640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55610798eee0 0x5561079912d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9751c72640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9638034650 0x7f9638036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9748000f70 tx=0x7f9748001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.937+0000 7f9752c74640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55610798eee0 0x5561079912d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9752c74640 1 -- 172.21.15.145:0/809379360 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x55610798eee0 2024-09-11T11:03:15.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9754963980 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556107992650 0x556107994a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556107995080 con 0x556107992650 2024-09-11T11:03:15.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9752473640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556107992650 0x556107994a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.944 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9752473640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556107992650 0x556107994a40 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9752473640 1 -- 172.21.15.145:0/809379360 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97440b5d40 con 0x556107992650 2024-09-11T11:03:15.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556107996930 con 0x556107992650 2024-09-11T11:03:15.945 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9752473640 1 -- 172.21.15.145:0/809379360 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f97440b5d40 con 0x556107992650 2024-09-11T11:03:15.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556107995b60 con 0x556107992650 2024-09-11T11:03:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9752473640 1 -- 172.21.15.145:0/809379360 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97440b5d40 con 0x556107992650 2024-09-11T11:03:15.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9754963980 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556107997ce0 0x55610799a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55610799a610 con 0x556107997ce0 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9751c72640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556107997ce0 0x55610799a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.941+0000 7f9751c72640 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556107997ce0 0x55610799a0d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9751c72640 1 -- 172.21.15.145:0/809379360 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f974800f6a0 con 0x556107997ce0 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9754963980 1 Processor -- start 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9754963980 1 -- start start 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9754963980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079a80a0 0x5561079a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9754963980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55610779e800 con 0x5561079a80a0 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079a80a0 0x5561079a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079a80a0 0x5561079a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38252/0 (socket says 172.21.15.145:38252) 2024-09-11T11:03:15.948 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9752473640 1 -- 172.21.15.145:0/1404714198 learned_addr learned my addr 172.21.15.145:0/1404714198 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9752473640 1 -- 172.21.15.145:0/1404714198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561079a8a00 con 0x5561079a80a0 2024-09-11T11:03:15.949 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9752473640 1 --2- 172.21.15.145:0/1404714198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079a80a0 0x5561079a84c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f97440e3030 tx=0x7f97440d0e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9637fff640 1 -- 172.21.15.145:0/1404714198 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440cfd80 con 0x5561079a80a0 2024-09-11T11:03:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9637fff640 1 -- 172.21.15.145:0/1404714198 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97440c8420 con 0x5561079a80a0 2024-09-11T11:03:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9754963980 1 -- 172.21.15.145:0/1404714198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561079a8c90 con 0x5561079a80a0 2024-09-11T11:03:15.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9637fff640 1 -- 172.21.15.145:0/1404714198 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440c8720 con 0x5561079a80a0 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9754963980 1 -- 172.21.15.145:0/1404714198 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561079ab910 con 0x5561079a80a0 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9637fff640 1 -- 172.21.15.145:0/1404714198 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f97440e43d0 con 0x5561079a80a0 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9637fff640 1 --2- 172.21.15.145:0/1404714198 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f962c034650 0x7f962c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9637fff640 1 -- 172.21.15.145:0/1404714198 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f97440eec90 con 0x5561079a80a0 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.945+0000 7f9751c72640 1 --2- 172.21.15.145:0/1404714198 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f962c034650 0x7f962c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 Processor -- start 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- start start 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9751c72640 1 --2- 172.21.15.145:0/1404714198 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f962c034650 0x7f962c036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55610799aa10 tx=0x7f974800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x556107983460 con 0x5561079b4a40 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38258/0 (socket says 172.21.15.145:38258) 2024-09-11T11:03:15.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 -- 172.21.15.145:0/1895133798 learned_addr learned my addr 172.21.15.145:0/1895133798 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 -- 172.21.15.145:0/1895133798 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561079b53f0 con 0x5561079b4a40 2024-09-11T11:03:15.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 --2- 172.21.15.145:0/1895133798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079b4e20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f97440e1930 tx=0x7f97440e1470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132d19089ed8eb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9635ffb640 1 -- 172.21.15.145:0/1895133798 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440fb030 con 0x5561079b4a40 2024-09-11T11:03:15.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9635ffb640 1 -- 172.21.15.145:0/1895133798 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97440a9970 con 0x5561079b4a40 2024-09-11T11:03:15.953 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9635ffb640 1 -- 172.21.15.145:0/1895133798 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440e47f0 con 0x5561079b4a40 2024-09-11T11:03:15.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- 172.21.15.145:0/1895133798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 msgr2=0x5561079b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:15.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 --2- 172.21.15.145:0/1895133798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079b4e20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f97440e1930 tx=0x7f97440e1470 comp rx=0 tx=0).stop 2024-09-11T11:03:15.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- 172.21.15.145:0/1895133798 shutdown_connections 2024-09-11T11:03:15.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 --2- 172.21.15.145:0/1895133798 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079b4e20 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:15.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- 172.21.15.145:0/1895133798 >> 172.21.15.145:0/1895133798 conn(0x5561079b0d70 msgr2=0x5561079aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:15.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- 172.21.15.145:0/1895133798 shutdown_connections 2024-09-11T11:03:15.955 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- 172.21.15.145:0/1895133798 wait complete. 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 Processor -- start 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- start start 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079bb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9754963980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5561079b53f0 con 0x5561079b4a40 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079bb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079bb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38274/0 (socket says 172.21.15.145:38274) 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 learned_addr learned my addr 172.21.15.145:0/332788800 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561079bbf30 con 0x5561079b4a40 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.949+0000 7f9752473640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079bb9f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f97440bd570 tx=0x7f97440ddf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9623fff640 1 -- 172.21.15.145:0/332788800 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440d17b0 con 0x5561079b4a40 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561079bbf30 con 0x5561079b4a40 2024-09-11T11:03:15.956 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9623fff640 1 -- 172.21.15.145:0/332788800 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97440d1950 con 0x5561079b4a40 2024-09-11T11:03:15.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9623fff640 1 -- 172.21.15.145:0/332788800 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f97440b49a0 con 0x5561079b4a40 2024-09-11T11:03:15.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561079bc3a0 con 0x5561079b4a40 2024-09-11T11:03:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9623fff640 1 -- 172.21.15.145:0/332788800 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9744113030 con 0x5561079b4a40 2024-09-11T11:03:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9623fff640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f961c034650 0x7f961c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9623fff640 1 -- 172.21.15.145:0/332788800 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f9744111070 con 0x5561079b4a40 2024-09-11T11:03:15.960 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9751c72640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f961c034650 0x7f961c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5561079c6990 0x5561079c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079c9580 con 0x5561079c6990 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9752c74640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5561079c6990 0x5561079c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9751c72640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f961c034650 0x7f961c036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f974800c010 tx=0x7f9748010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9752c74640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5561079c6990 0x5561079c8e30 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 20 realm 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079c5e80 con 0x5561079c6990 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079ca050 con 0x5561079c6990 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5561079cae30 0x5561079cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079cd8a0 con 0x5561079cae30 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.953+0000 7f9752473640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5561079cae30 0x5561079cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752473640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5561079cae30 0x5561079cd220 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9754963980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.962 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079ce0f0 con 0x5561079cae30 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9754963980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9754963980 20 searching for the correct realm 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5561079cfe60 0x5561079d2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cfe60 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9751c72640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5561079cfe60 0x5561079d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9751c72640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5561079cfe60 0x5561079d2250 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.968 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752473640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55610780c2a0 0x7f9744102890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x55610780c2a0 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752c74640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55610780c2a0 0x7f9744102890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752c74640 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55610780c2a0 0x7f9744102890 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.957+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cfe60 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x55610780c2a0 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x55610780c2a0 2024-09-11T11:03:15.970 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cfe60 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.961+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cfe60 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.971 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cfe60 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x55610780c2a0 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079c6990 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x55610780c2a0 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cfe60 2024-09-11T11:03:15.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x55610780c2a0 2024-09-11T11:03:15.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.965+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cfe60 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5561079d28d0 con 0x5561079cae30 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:15.977 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079ceaa0 con 0x5561079c6990 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079ce6e0 con 0x5561079cae30 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:15.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079cf440 con 0x55610780c2a0 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 zone default found 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 4 Realm: () 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 zonegroup default 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079d3220 con 0x55610780c2a0 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079d54f0 con 0x5561079cfe60 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.969+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079d5890 con 0x5561079cfe60 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9754963980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9754963980 20 started sync module instance, tier type = 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9754963980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d4980 con 0x5561079cae30 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.980 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93875227938512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d4980 con 0x5561079cae30 2024-09-11T11:03:15.981 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d62e0 con 0x5561079c6990 2024-09-11T11:03:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93875227942448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d6700 con 0x5561079c6990 2024-09-11T11:03:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.973+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d7180 con 0x5561079cae30 2024-09-11T11:03:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 93875227938512] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93875227942448] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93875227946096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d6250 con 0x5561079cae30 2024-09-11T11:03:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d7a20 con 0x55610780c2a0 2024-09-11T11:03:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93875227948400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d6250 con 0x55610780c2a0 2024-09-11T11:03:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d84c0 con 0x5561079cae30 2024-09-11T11:03:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 93875227946096] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.983 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.977+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93875227948400] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93875227949456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d8480 con 0x5561079cae30 2024-09-11T11:03:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d88b0 con 0x5561079cfe60 2024-09-11T11:03:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93875227935952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d9150 con 0x5561079cfe60 2024-09-11T11:03:15.984 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d9b10 con 0x5561079cfe60 2024-09-11T11:03:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 93875227935952] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93875227949456] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93875227956832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d9f00 con 0x5561079cfe60 2024-09-11T11:03:15.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.981+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079da750 con 0x55610780c2a0 2024-09-11T11:03:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 93875227956832] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93875227959040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079da7d0 con 0x55610780c2a0 2024-09-11T11:03:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 add_watcher() i=0 2024-09-11T11:03:15.986 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 add_watcher() i=1 2024-09-11T11:03:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 add_watcher() i=2 2024-09-11T11:03:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 add_watcher() i=3 2024-09-11T11:03:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 add_watcher() i=4 2024-09-11T11:03:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 add_watcher() i=5 2024-09-11T11:03:15.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 add_watcher() i=6 2024-09-11T11:03:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 93875227959040] v36'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 add_watcher() i=7 2024-09-11T11:03:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5561079ddac0 con 0x5561079c6990 2024-09-11T11:03:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.988 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93875227960464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079dad60 con 0x5561079c6990 2024-09-11T11:03:15.990 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93875227960464] v36'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9608fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f9754963980 5 note: GC not initialized 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.985+0000 7f95837fe640 20 reqs_thread_entry: start 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 20 Filter name: none 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f95817fa640 20 reqs_thread_entry: start 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 20 rados->read ofs=0 len=0 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556107a01260 con 0x5561079c6990 2024-09-11T11:03:15.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 20 rados_obj.operate() r=0 bl.length=490 2024-09-11T11:03:15.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:15.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:15.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x556107a07b20 con 0x5561079c6990 2024-09-11T11:03:15.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v36'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:15.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93875228145040 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x556107a031d0 con 0x5561079cae30 2024-09-11T11:03:15.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 93875227949456 notify 154618822716 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5561079a8c90 con 0x5561079cae30 2024-09-11T11:03:15.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9635ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822716 cookie 93875227949456 notifier 4913 bl.length()=636 2024-09-11T11:03:15.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9635ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9635ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9635ffb640 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9618003eb0 con 0x5561079cae30 2024-09-11T11:03:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 93875228145040 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.989+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.993+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 93875228145040 notify 154618822716 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5561079a8a00 con 0x5561079cae30 2024-09-11T11:03:15.995 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.993+0000 7f9608fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:15.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.993+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93875227960464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079ff060 con 0x5561079c6990 2024-09-11T11:03:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.993+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93875227960464] v36'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:15.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.993+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93875227938512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079ff060 con 0x5561079cae30 2024-09-11T11:03:15.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.997+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93875227938512] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:15.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.997+0000 7f9754963980 20 remove_watcher() i=0 2024-09-11T11:03:15.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.997+0000 7f9754963980 2 removed watcher, disabling cache 2024-09-11T11:03:15.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.997+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93875227942448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079ff060 con 0x5561079c6990 2024-09-11T11:03:16.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.997+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93875227942448] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x5561079c6990 2024-09-11T11:03:16.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.997+0000 7f9754963980 20 remove_watcher() i=1 2024-09-11T11:03:16.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:15.997+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93875227946096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079ff060 con 0x5561079cae30 2024-09-11T11:03:16.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.001+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93875227946096] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:16.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.001+0000 7f9754963980 20 remove_watcher() i=2 2024-09-11T11:03:16.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.001+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93875227948400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079ff060 con 0x55610780c2a0 2024-09-11T11:03:16.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.001+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93875227948400] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:16.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.001+0000 7f9754963980 20 remove_watcher() i=3 2024-09-11T11:03:16.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.001+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93875227949456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d7570 con 0x5561079cae30 2024-09-11T11:03:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9752473640 1 -- 172.21.15.145:0/332788800 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93875227949456] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f97440b5d40 con 0x5561079cae30 2024-09-11T11:03:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 20 remove_watcher() i=4 2024-09-11T11:03:16.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93875227935952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d7a20 con 0x5561079cfe60 2024-09-11T11:03:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93875227935952] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 20 remove_watcher() i=5 2024-09-11T11:03:16.007 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93875227956832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079d79f0 con 0x5561079cfe60 2024-09-11T11:03:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9751c72640 1 -- 172.21.15.145:0/332788800 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93875227956832] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9748037040 con 0x5561079cfe60 2024-09-11T11:03:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 20 remove_watcher() i=6 2024-09-11T11:03:16.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93875227959040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5561079ff060 con 0x55610780c2a0 2024-09-11T11:03:16.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93875227959040] v36'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f974c0083f0 con 0x55610780c2a0 2024-09-11T11:03:16.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 20 remove_watcher() i=7 2024-09-11T11:03:16.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5561079cae30 msgr2=0x5561079cd220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5561079cae30 0x5561079cd220 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5561079c6990 msgr2=0x5561079c8e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5561079c6990 0x5561079c8e30 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55610780c2a0 msgr2=0x7f9744102890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55610780c2a0 0x7f9744102890 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5561079cfe60 msgr2=0x5561079d2250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5561079cfe60 0x5561079d2250 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f961c034650 msgr2=0x7f961c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f961c034650 0x7f961c036b10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f974800c010 tx=0x7f9748010000 comp rx=0 tx=0).stop 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 msgr2=0x5561079bb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9752c74640 1 -- 172.21.15.145:0/332788800 reap_dead start 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079bb9f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f97440bd570 tx=0x7f97440ddf90 comp rx=0 tx=0).stop 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 shutdown_connections 2024-09-11T11:03:16.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 --2- 172.21.15.145:0/332788800 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079b4a40 0x5561079bb9f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 >> 172.21.15.145:0/332788800 conn(0x5561079b0d70 msgr2=0x5561079aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 shutdown_connections 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.005+0000 7f9754963980 1 -- 172.21.15.145:0/332788800 wait complete. 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/1404714198 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f962c034650 msgr2=0x7f962c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/1404714198 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f962c034650 0x7f962c036b10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55610799aa10 tx=0x7f974800f000 comp rx=0 tx=0).stop 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/1404714198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079a80a0 msgr2=0x5561079a84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/1404714198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079a80a0 0x5561079a84c0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f97440e3030 tx=0x7f97440d0e40 comp rx=0 tx=0).stop 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/1404714198 shutdown_connections 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/1404714198 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f962c034650 0x7f962c036b10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/1404714198 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5561079a80a0 0x5561079a84c0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/1404714198 >> 172.21.15.145:0/1404714198 conn(0x55610799d1f0 msgr2=0x55610799fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.013 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/1404714198 shutdown_connections 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/1404714198 wait complete. 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556107992650 msgr2=0x556107994a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x556107992650 0x556107994a40 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55610798eee0 msgr2=0x5561079912d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55610798eee0 0x5561079912d0 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556107997ce0 msgr2=0x55610799a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x556107997ce0 0x55610799a0d0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9638034650 msgr2=0x7f9638036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9638034650 0x7f9638036b10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9748000f70 tx=0x7f9748001380 comp rx=0 tx=0).stop 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 msgr2=0x556107989df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 --2- 172.21.15.145:0/809379360 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55610789a8f0 0x556107989df0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f9744019740 tx=0x7f9744017e30 comp rx=0 tx=0).stop 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9752c74640 1 -- 172.21.15.145:0/809379360 reap_dead start 2024-09-11T11:03:16.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 shutdown_connections 2024-09-11T11:03:16.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 >> 172.21.15.145:0/809379360 conn(0x5561078920a0 msgr2=0x55610797d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 shutdown_connections 2024-09-11T11:03:16.015 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.009+0000 7f9754963980 1 -- 172.21.15.145:0/809379360 wait complete. 2024-09-11T11:03:16.020 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:16.020 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:16.020 ERROR:root:0 2024-09-11T11:03:16.020 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-11T11:03:16.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-11T11:03:16.020 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-11T11:03:16.097 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:16.098 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:16.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa093b61980 1 Processor -- start 2024-09-11T11:03:16.098 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa093b61980 1 -- start start 2024-09-11T11:03:16.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa093b61980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5615aebb68a0 0x5615aebb6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa093b61980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5615aea40ae0 con 0x5615aebb72b0 2024-09-11T11:03:16.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa093b61980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5615aea64e30 con 0x5615aebb68a0 2024-09-11T11:03:16.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa091671640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5615aebb68a0 0x5615aebb6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa091671640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5615aebb68a0 0x5615aebb6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38276/0 (socket says 172.21.15.145:38276) 2024-09-11T11:03:16.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa091671640 1 -- 172.21.15.145:0/3332229607 learned_addr learned my addr 172.21.15.145:0/3332229607 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa090e70640 1 --1- 172.21.15.145:0/3332229607 >> v1:172.21.15.102:6789/0 conn(0x5615aebb72b0 0x5615aebbdbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52220/0 (socket says 172.21.15.145:52220) 2024-09-11T11:03:16.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa091671640 1 -- 172.21.15.145:0/3332229607 >> v1:172.21.15.102:6789/0 conn(0x5615aebb72b0 legacy=0x5615aebbdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.100 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa091671640 1 -- 172.21.15.145:0/3332229607 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615aebc0310 con 0x5615aebb68a0 2024-09-11T11:03:16.101 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.097+0000 7fa091671640 1 --2- 172.21.15.145:0/3332229607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aebb6c80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00a4e0 tx=0x7fa08c01b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9854c5ff69d7f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa083fff640 1 -- 172.21.15.145:0/3332229607 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0aa540 con 0x5615aebb68a0 2024-09-11T11:03:16.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa083fff640 1 -- 172.21.15.145:0/3332229607 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c0aa6e0 con 0x5615aebb68a0 2024-09-11T11:03:16.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa083fff640 1 -- 172.21.15.145:0/3332229607 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0aaa40 con 0x5615aebb68a0 2024-09-11T11:03:16.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa093b61980 1 -- 172.21.15.145:0/3332229607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 msgr2=0x5615aebb6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa093b61980 1 --2- 172.21.15.145:0/3332229607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aebb6c80 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00a4e0 tx=0x7fa08c01b090 comp rx=0 tx=0).stop 2024-09-11T11:03:16.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa093b61980 1 -- 172.21.15.145:0/3332229607 shutdown_connections 2024-09-11T11:03:16.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa093b61980 1 --2- 172.21.15.145:0/3332229607 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aebb6c80 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa093b61980 1 -- 172.21.15.145:0/3332229607 >> 172.21.15.145:0/3332229607 conn(0x5615aebb27b0 msgr2=0x5615aebb4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa093b61980 1 -- 172.21.15.145:0/3332229607 shutdown_connections 2024-09-11T11:03:16.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.101+0000 7fa093b61980 1 -- 172.21.15.145:0/3332229607 wait complete. 2024-09-11T11:03:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa093b61980 1 Processor -- start 2024-09-11T11:03:16.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa093b61980 1 -- start start 2024-09-11T11:03:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa093b61980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aeca39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa093b61980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5615aea66200 con 0x5615aebb68a0 2024-09-11T11:03:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aeca39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aeca39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38290/0 (socket says 172.21.15.145:38290) 2024-09-11T11:03:16.117 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa091671640 1 -- 172.21.15.145:0/3038813227 learned_addr learned my addr 172.21.15.145:0/3038813227 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa091671640 1 -- 172.21.15.145:0/3038813227 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615aeca3fb0 con 0x5615aebb68a0 2024-09-11T11:03:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7fa091671640 1 --2- 172.21.15.145:0/3038813227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aeca39e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0ac040 tx=0x7fa08c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d86839a3e3c353a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7f9f7f606640 1 -- 172.21.15.145:0/3038813227 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0b9030 con 0x5615aebb68a0 2024-09-11T11:03:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7f9f7f606640 1 -- 172.21.15.145:0/3038813227 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c0aab10 con 0x5615aebb68a0 2024-09-11T11:03:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.113+0000 7f9f7f606640 1 -- 172.21.15.145:0/3038813227 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0aae30 con 0x5615aebb68a0 2024-09-11T11:03:16.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- 172.21.15.145:0/3038813227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 msgr2=0x5615aeca39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 --2- 172.21.15.145:0/3038813227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aeca39e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0ac040 tx=0x7fa08c0033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- 172.21.15.145:0/3038813227 shutdown_connections 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 --2- 172.21.15.145:0/3038813227 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aeca39e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- 172.21.15.145:0/3038813227 >> 172.21.15.145:0/3038813227 conn(0x5615aebb27b0 msgr2=0x5615aec9f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- 172.21.15.145:0/3038813227 shutdown_connections 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- 172.21.15.145:0/3038813227 wait complete. 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 Processor -- start 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- start start 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aecaacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5615aebbfe10 con 0x5615aebb68a0 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aecaacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.120 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aecaacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38298/0 (socket says 172.21.15.145:38298) 2024-09-11T11:03:16.121 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa091671640 1 -- 172.21.15.145:0/4175205810 learned_addr learned my addr 172.21.15.145:0/4175205810 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa091671640 1 -- 172.21.15.145:0/4175205810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615aecab1f0 con 0x5615aebb68a0 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa091671640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aecaacb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa08c01aec0 tx=0x7fa08c017e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7f9f7de03640 1 -- 172.21.15.145:0/4175205810 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0b9070 con 0x5615aebb68a0 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615aecab480 con 0x5615aebb68a0 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615aecae160 con 0x5615aebb68a0 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7f9f7de03640 1 -- 172.21.15.145:0/4175205810 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c0c2070 con 0x5615aebb68a0 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7f9f7de03640 1 -- 172.21.15.145:0/4175205810 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0be610 con 0x5615aebb68a0 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7f9f7de03640 1 -- 172.21.15.145:0/4175205810 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa08c0b3040 con 0x5615aebb68a0 2024-09-11T11:03:16.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7f9f7de03640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f78034650 0x7f9f78036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7f9f7de03640 1 -- 172.21.15.145:0/4175205810 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fa08c0ba070 con 0x5615aebb68a0 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa090e70640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f78034650 0x7f9f78036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aebb72b0 0x5615aecb1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.117+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecb22f0 con 0x5615aebb72b0 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa091e72640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aebb72b0 0x5615aecb1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa090e70640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f78034650 0x7f9f78036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa088000f70 tx=0x7fa088001380 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa091e72640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aebb72b0 0x5615aecb1db0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa091e72640 1 -- 172.21.15.145:0/4175205810 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aebb72b0 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa093b61980 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecb3130 0x5615aecb5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecb5b60 con 0x5615aecb3130 2024-09-11T11:03:16.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa091671640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecb3130 0x5615aecb5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa091671640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecb3130 0x5615aecb5520 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa091671640 1 -- 172.21.15.145:0/4175205810 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa08c0c6430 con 0x5615aecb3130 2024-09-11T11:03:16.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecb7410 con 0x5615aecb3130 2024-09-11T11:03:16.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa091671640 1 -- 172.21.15.145:0/4175205810 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa08c0c6430 con 0x5615aecb3130 2024-09-11T11:03:16.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecb6640 con 0x5615aecb3130 2024-09-11T11:03:16.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa091671640 1 -- 172.21.15.145:0/4175205810 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa08c0c6430 con 0x5615aecb3130 2024-09-11T11:03:16.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa093b61980 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5615aecb87c0 0x5615aecbabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecbb0f0 con 0x5615aecb87c0 2024-09-11T11:03:16.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.121+0000 7fa090e70640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5615aecb87c0 0x5615aecbabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa090e70640 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5615aecb87c0 0x5615aecbabb0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.128 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa090e70640 1 -- 172.21.15.145:0/4175205810 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa08800f6a0 con 0x5615aecb87c0 2024-09-11T11:03:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa093b61980 1 Processor -- start 2024-09-11T11:03:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa093b61980 1 -- start start 2024-09-11T11:03:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa093b61980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb9530 0x5615aebb7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa093b61980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5615aeabf800 con 0x5615aebb9530 2024-09-11T11:03:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb9530 0x5615aebb7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb9530 0x5615aebb7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38306/0 (socket says 172.21.15.145:38306) 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa091671640 1 -- 172.21.15.145:0/2734183483 learned_addr learned my addr 172.21.15.145:0/2734183483 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa091671640 1 -- 172.21.15.145:0/2734183483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615aebb9950 con 0x5615aebb9530 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa091671640 1 --2- 172.21.15.145:0/2734183483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb9530 0x5615aebb7bb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0e3800 tx=0x7fa08c0bce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7f9f76ffd640 1 -- 172.21.15.145:0/2734183483 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0ea070 con 0x5615aebb9530 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa093b61980 1 -- 172.21.15.145:0/2734183483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615aebb8150 con 0x5615aebb9530 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa093b61980 1 -- 172.21.15.145:0/2734183483 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615aebb8150 con 0x5615aebb9530 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7f9f76ffd640 1 -- 172.21.15.145:0/2734183483 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c0b5e50 con 0x5615aebb9530 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7f9f76ffd640 1 -- 172.21.15.145:0/2734183483 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0b43a0 con 0x5615aebb9530 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7f9f76ffd640 1 -- 172.21.15.145:0/2734183483 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa08c0ed070 con 0x5615aebb9530 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7f9f76ffd640 1 --2- 172.21.15.145:0/2734183483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f68034650 0x7f9f68036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7f9f76ffd640 1 -- 172.21.15.145:0/2734183483 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fa08c0f0c50 con 0x5615aebb9530 2024-09-11T11:03:16.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa090e70640 1 --2- 172.21.15.145:0/2734183483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f68034650 0x7f9f68036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.125+0000 7fa093b61980 1 Processor -- start 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- start start 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa090e70640 1 --2- 172.21.15.145:0/2734183483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f68034650 0x7f9f68036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0bcb30 tx=0x7fa08800f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecd79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5615aeca4270 con 0x5615aecd75f0 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecd79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecd79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38316/0 (socket says 172.21.15.145:38316) 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 -- 172.21.15.145:0/73183335 learned_addr learned my addr 172.21.15.145:0/73183335 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 -- 172.21.15.145:0/73183335 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615aecd7fc0 con 0x5615aecd75f0 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 --2- 172.21.15.145:0/73183335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecd79f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0b0fd0 tx=0x7fa08c0b4910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694f562a8a085c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7f9f74ff9640 1 -- 172.21.15.145:0/73183335 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0bd740 con 0x5615aecd75f0 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7f9f74ff9640 1 -- 172.21.15.145:0/73183335 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c0cbe10 con 0x5615aecd75f0 2024-09-11T11:03:16.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7f9f74ff9640 1 -- 172.21.15.145:0/73183335 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c0d86d0 con 0x5615aecd75f0 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- 172.21.15.145:0/73183335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 msgr2=0x5615aecd79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 --2- 172.21.15.145:0/73183335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecd79f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0b0fd0 tx=0x7fa08c0b4910 comp rx=0 tx=0).stop 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- 172.21.15.145:0/73183335 shutdown_connections 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 --2- 172.21.15.145:0/73183335 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecd79f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- 172.21.15.145:0/73183335 >> 172.21.15.145:0/73183335 conn(0x5615aecd3970 msgr2=0x5615aecd1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- 172.21.15.145:0/73183335 shutdown_connections 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- 172.21.15.145:0/73183335 wait complete. 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 Processor -- start 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- start start 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecde730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa093b61980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5615aecd8380 con 0x5615aecd75f0 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecde730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecde730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38324/0 (socket says 172.21.15.145:38324) 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 learned_addr learned my addr 172.21.15.145:0/1382883793 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615aecdec70 con 0x5615aecd75f0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.129+0000 7fa091671640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecde730 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0e2620 tx=0x7fa08c0a7f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7f9f66ffd640 1 -- 172.21.15.145:0/1382883793 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c10c070 con 0x5615aecd75f0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5615aecdec70 con 0x5615aecd75f0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7f9f66ffd640 1 -- 172.21.15.145:0/1382883793 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c007b50 con 0x5615aecd75f0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7f9f66ffd640 1 -- 172.21.15.145:0/1382883793 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c004b20 con 0x5615aecd75f0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615aecdf0e0 con 0x5615aecd75f0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7f9f66ffd640 1 -- 172.21.15.145:0/1382883793 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fa08c105040 con 0x5615aecd75f0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7f9f66ffd640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f5c034600 0x7f9f5c036ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7f9f66ffd640 1 -- 172.21.15.145:0/1382883793 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fa08c0fa070 con 0x5615aecd75f0 2024-09-11T11:03:16.165 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa090e70640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f5c034600 0x7f9f5c036ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aece98c0 0x5615aecebd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecec4d0 con 0x5615aece98c0 2024-09-11T11:03:16.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa091e72640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aece98c0 0x5615aecebd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa090e70640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f5c034600 0x7f9f5c036ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa08800ffd0 tx=0x7fa088010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa091e72640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aece98c0 0x5615aecebd80 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.166 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 20 realm 2024-09-11T11:03:16.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aece8d30 con 0x5615aece98c0 2024-09-11T11:03:16.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:16.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aececfa0 con 0x5615aece98c0 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecedd80 0x5615aecf0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf07f0 con 0x5615aecedd80 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.133+0000 7fa091671640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecedd80 0x5615aecf0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091671640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecedd80 0x5615aecf0170 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa093b61980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf1040 con 0x5615aecedd80 2024-09-11T11:03:16.168 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa093b61980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa093b61980 20 searching for the correct realm 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5615aecf2db0 0x5615aecf51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecf2db0 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa090e70640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5615aecf2db0 0x5615aecf51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa090e70640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5615aecf2db0 0x5615aecf51a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091671640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa08c108040 0x7fa08c0b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x7fa08c108040 2024-09-11T11:03:16.169 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091e72640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa08c108040 0x7fa08c0b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091e72640 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa08c108040 0x7fa08c0b9210 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.137+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecf2db0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.170 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x7fa08c108040 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x7fa08c108040 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecf2db0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.141+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecf2db0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecf2db0 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x7fa08c108040 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aece98c0 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x7fa08c108040 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecf2db0 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x7fa08c108040 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.145+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecf2db0 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf5820 con 0x5615aecedd80 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:16.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf19c0 con 0x5615aece98c0 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf2260 con 0x5615aecedd80 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.149+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf1600 con 0x7fa08c108040 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 zone default found 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 4 Realm: () 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 zonegroup default 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf2220 con 0x7fa08c108040 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.176 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf8030 con 0x5615aecf2db0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf83d0 con 0x5615aecf2db0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 started sync module instance, tier type = 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf74c0 con 0x5615aecedd80 2024-09-11T11:03:16.177 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94651127134656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf74c0 con 0x5615aecedd80 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.153+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf8de0 con 0x5615aece98c0 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.157+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.157+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94651127138608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf8d50 con 0x5615aece98c0 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.157+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf9d40 con 0x5615aecedd80 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.157+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94651127134656] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.157+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94651127138608] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.157+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.157+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94651127140816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf9d40 con 0x5615aecedd80 2024-09-11T11:03:16.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.157+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfa190 con 0x7fa08c108040 2024-09-11T11:03:16.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94651127142432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfa150 con 0x7fa08c108040 2024-09-11T11:03:16.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfb050 con 0x5615aecedd80 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94651127142432] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94651127140816] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94651127132176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfaba0 con 0x5615aecedd80 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfb3f0 con 0x5615aecf2db0 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94651127147728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfbc90 con 0x5615aecf2db0 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.161+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfc650 con 0x5615aecf2db0 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94651127132176] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(56 notify.6 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94651127145856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfcef0 con 0x5615aecf2db0 2024-09-11T11:03:16.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfd740 con 0x7fa08c108040 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94651127147728] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94651127156464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfdb30 con 0x7fa08c108040 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94651127145856] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 20 add_watcher() i=0 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 20 add_watcher() i=1 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 20 add_watcher() i=2 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 20 add_watcher() i=3 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 20 add_watcher() i=4 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 20 add_watcher() i=5 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 20 add_watcher() i=6 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94651127156464] v36'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 20 add_watcher() i=7 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aed00b60 con 0x5615aece98c0 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.165+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94651127157520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecfdbe0 con 0x5615aece98c0 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94651127157520] v36'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7f9f47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 5 note: GC not initialized 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7f9f46fe5640 20 reqs_thread_entry: start 2024-09-11T11:03:16.186 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:16.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 20 Filter name: none 2024-09-11T11:03:16.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7f9f44fe1640 20 reqs_thread_entry: start 2024-09-11T11:03:16.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:16.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aed23cf0 con 0x5615aece98c0 2024-09-11T11:03:16.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 20 rados_obj.operate() r=0 bl.length=460 2024-09-11T11:03:16.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:16.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:16.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:16.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aed2a2d0 con 0x5615aece98c0 2024-09-11T11:03:16.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:16.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:16.188 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94651127340352 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5615aed25960 con 0x5615aecedd80 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94651127132176 notify 154618822717 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5615aebb9950 con 0x5615aecedd80 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7f9f74ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822717 cookie 94651127132176 notifier 4920 bl.length()=649 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7f9f74ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7f9f74ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.169+0000 7f9f74ff9640 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f9f54003eb0 con 0x5615aecedd80 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.173+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94651127340352 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.173+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.189 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.173+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94651127340352 notify 154618822717 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa08c0d6040 con 0x5615aecedd80 2024-09-11T11:03:16.190 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:16.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.173+0000 7f9f47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.173+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94651127157520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aed295e0 con 0x5615aece98c0 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94651127157520] v36'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94651127134656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aed295e0 con 0x5615aecedd80 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94651127134656] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa093b61980 20 remove_watcher() i=0 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa093b61980 2 removed watcher, disabling cache 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94651127138608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aed295e0 con 0x5615aece98c0 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94651127138608] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x5615aece98c0 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa093b61980 20 remove_watcher() i=1 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.177+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94651127140816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aed295e0 con 0x5615aecedd80 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.181+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94651127140816] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.195 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.181+0000 7fa093b61980 20 remove_watcher() i=2 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.181+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94651127142432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aed295e0 con 0x7fa08c108040 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.181+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94651127142432] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.181+0000 7fa093b61980 20 remove_watcher() i=3 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.181+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94651127132176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf79c0 con 0x5615aecedd80 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa091671640 1 -- 172.21.15.145:0/1382883793 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94651127132176] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c0ec030 con 0x5615aecedd80 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa093b61980 20 remove_watcher() i=4 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94651127147728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf8930 con 0x5615aecf2db0 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94651127147728] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa093b61980 20 remove_watcher() i=5 2024-09-11T11:03:16.196 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94651127145856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf9820 con 0x5615aecf2db0 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa090e70640 1 -- 172.21.15.145:0/1382883793 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94651127145856] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa088037040 con 0x5615aecf2db0 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa093b61980 20 remove_watcher() i=6 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94651127156464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5615aecf79c0 con 0x7fa08c108040 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94651127156464] v36'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa0840083f0 con 0x7fa08c108040 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.185+0000 7fa093b61980 20 remove_watcher() i=7 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecedd80 msgr2=0x5615aecf0170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecedd80 0x5615aecf0170 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aece98c0 msgr2=0x5615aecebd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aece98c0 0x5615aecebd80 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa08c108040 msgr2=0x7fa08c0b9210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fa08c108040 0x7fa08c0b9210 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5615aecf2db0 msgr2=0x5615aecf51a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5615aecf2db0 0x5615aecf51a0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f5c034600 msgr2=0x7f9f5c036ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f5c034600 0x7f9f5c036ac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa08800ffd0 tx=0x7fa088010000 comp rx=0 tx=0).stop 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 msgr2=0x5615aecde730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/1382883793 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aecd75f0 0x5615aecde730 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0e2620 tx=0x7fa08c0a7f00 comp rx=0 tx=0).stop 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 reap_dead start 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa091e72640 1 -- 172.21.15.145:0/1382883793 reap_dead start 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 shutdown_connections 2024-09-11T11:03:16.198 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 >> 172.21.15.145:0/1382883793 conn(0x5615aecd3970 msgr2=0x5615aecd1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 shutdown_connections 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/1382883793 wait complete. 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/2734183483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f68034650 msgr2=0x7f9f68036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/2734183483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f68034650 0x7f9f68036b10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0bcb30 tx=0x7fa08800f000 comp rx=0 tx=0).stop 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/2734183483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb9530 msgr2=0x5615aebb7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/2734183483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb9530 0x5615aebb7bb0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0e3800 tx=0x7fa08c0bce90 comp rx=0 tx=0).stop 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/2734183483 shutdown_connections 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/2734183483 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f68034650 0x7f9f68036b10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/2734183483 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb9530 0x5615aebb7bb0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.199 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/2734183483 >> 172.21.15.145:0/2734183483 conn(0x5615aecbdcf0 msgr2=0x5615aecc0770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/2734183483 shutdown_connections 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/2734183483 wait complete. 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecb3130 msgr2=0x5615aecb5520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5615aecb3130 0x5615aecb5520 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aebb72b0 msgr2=0x5615aecb1db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5615aebb72b0 0x5615aecb1db0 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5615aecb87c0 msgr2=0x5615aecbabb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5615aecb87c0 0x5615aecbabb0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f78034650 msgr2=0x7f9f78036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9f78034650 0x7f9f78036b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa088000f70 tx=0x7fa088001380 comp rx=0 tx=0).stop 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 msgr2=0x5615aecaacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 --2- 172.21.15.145:0/4175205810 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5615aebb68a0 0x5615aecaacb0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa08c01aec0 tx=0x7fa08c017e30 comp rx=0 tx=0).stop 2024-09-11T11:03:16.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa091e72640 1 -- 172.21.15.145:0/4175205810 reap_dead start 2024-09-11T11:03:16.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 shutdown_connections 2024-09-11T11:03:16.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 >> 172.21.15.145:0/4175205810 conn(0x5615aebb27b0 msgr2=0x5615aec9e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 shutdown_connections 2024-09-11T11:03:16.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.189+0000 7fa093b61980 1 -- 172.21.15.145:0/4175205810 wait complete. 2024-09-11T11:03:16.202 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:16.202 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:16.202 ERROR:root:0 2024-09-11T11:03:16.202 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-11T11:03:16.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-11T11:03:16.203 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-11T11:03:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:03:16.274 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:03:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4709128980 1 Processor -- start 2024-09-11T11:03:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4709128980 1 -- start start 2024-09-11T11:03:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4709128980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ac07e64550 0x55ac07e64930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4709128980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ac07cedae0 con 0x55ac07e64ea0 2024-09-11T11:03:16.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4709128980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x55ac07d11e30 con 0x55ac07e64550 2024-09-11T11:03:16.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4706c38640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x55ac07e64550 0x55ac07e64930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4706437640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x55ac07e64ea0 0x55ac07e69920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.145:52234/0 (socket says 172.21.15.145:52234) 2024-09-11T11:03:16.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4706437640 1 -- 172.21.15.145:0/2876397631 learned_addr learned my addr 172.21.15.145:0/2876397631 (peer_addr_for_me v1:172.21.15.145:0/0) 2024-09-11T11:03:16.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4706c38640 1 -- 172.21.15.145:0/2876397631 >> v1:172.21.15.102:6789/0 conn(0x55ac07e64ea0 legacy=0x55ac07e69920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.273+0000 7f4706c38640 1 -- 172.21.15.145:0/2876397631 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac07e6c170 con 0x55ac07e64550 2024-09-11T11:03:16.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4706c38640 1 --2- 172.21.15.145:0/2876397631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07e64930 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f470000a420 tx=0x7f470001afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b528d494429e1d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4705c36640 1 -- 172.21.15.145:0/2876397631 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000af070 con 0x55ac07e64550 2024-09-11T11:03:16.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4705c36640 1 -- 172.21.15.145:0/2876397631 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47000aa530 con 0x55ac07e64550 2024-09-11T11:03:16.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4705c36640 1 -- 172.21.15.145:0/2876397631 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000aa850 con 0x55ac07e64550 2024-09-11T11:03:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4709128980 1 -- 172.21.15.145:0/2876397631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 msgr2=0x55ac07e64930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4709128980 1 --2- 172.21.15.145:0/2876397631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07e64930 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f470000a420 tx=0x7f470001afd0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4709128980 1 -- 172.21.15.145:0/2876397631 shutdown_connections 2024-09-11T11:03:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4709128980 1 --2- 172.21.15.145:0/2876397631 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07e64930 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4709128980 1 -- 172.21.15.145:0/2876397631 >> 172.21.15.145:0/2876397631 conn(0x55ac07e60070 msgr2=0x55ac07e62490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4709128980 1 -- 172.21.15.145:0/2876397631 shutdown_connections 2024-09-11T11:03:16.280 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.277+0000 7f4709128980 1 -- 172.21.15.145:0/2876397631 wait complete. 2024-09-11T11:03:16.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4709128980 1 Processor -- start 2024-09-11T11:03:16.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4709128980 1 -- start start 2024-09-11T11:03:16.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4709128980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07dd93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.293 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4709128980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac07d13200 con 0x55ac07e64550 2024-09-11T11:03:16.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07dd93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07dd93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38340/0 (socket says 172.21.15.145:38340) 2024-09-11T11:03:16.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4706c38640 1 -- 172.21.15.145:0/1000661525 learned_addr learned my addr 172.21.15.145:0/1000661525 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4706c38640 1 -- 172.21.15.145:0/1000661525 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac07dd99c0 con 0x55ac07e64550 2024-09-11T11:03:16.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.289+0000 7f4706c38640 1 --2- 172.21.15.145:0/1000661525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07dd93f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f470000a420 tx=0x7f47000033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63efe9d3a8028064 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f45f4e09640 1 -- 172.21.15.145:0/1000661525 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000af050 con 0x55ac07e64550 2024-09-11T11:03:16.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f45f4e09640 1 -- 172.21.15.145:0/1000661525 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47000b0040 con 0x55ac07e64550 2024-09-11T11:03:16.294 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f45f4e09640 1 -- 172.21.15.145:0/1000661525 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000aac60 con 0x55ac07e64550 2024-09-11T11:03:16.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- 172.21.15.145:0/1000661525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 msgr2=0x55ac07dd93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 --2- 172.21.15.145:0/1000661525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07dd93f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f470000a420 tx=0x7f47000033b0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.296 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- 172.21.15.145:0/1000661525 shutdown_connections 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 --2- 172.21.15.145:0/1000661525 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07dd93f0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- 172.21.15.145:0/1000661525 >> 172.21.15.145:0/1000661525 conn(0x55ac07e60070 msgr2=0x55ac07f4b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- 172.21.15.145:0/1000661525 shutdown_connections 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- 172.21.15.145:0/1000661525 wait complete. 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 Processor -- start 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- start start 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07f511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac07e6bbb0 con 0x55ac07e64550 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07f511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07f511d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38346/0 (socket says 172.21.15.145:38346) 2024-09-11T11:03:16.297 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4706c38640 1 -- 172.21.15.145:0/392837274 learned_addr learned my addr 172.21.15.145:0/392837274 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4706c38640 1 -- 172.21.15.145:0/392837274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac07f51710 con 0x55ac07e64550 2024-09-11T11:03:16.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4706c38640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07f511d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f470001b870 tx=0x7f4700019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f45f3606640 1 -- 172.21.15.145:0/392837274 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000c5020 con 0x55ac07e64550 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac07f4f8f0 con 0x55ac07e64550 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f45f3606640 1 -- 172.21.15.145:0/392837274 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47000c1480 con 0x55ac07e64550 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac07f4fe40 con 0x55ac07e64550 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.293+0000 7f45f3606640 1 -- 172.21.15.145:0/392837274 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000c1760 con 0x55ac07e64550 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f45f3606640 1 -- 172.21.15.145:0/392837274 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f47000ca440 con 0x55ac07e64550 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f45f3606640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45ec034650 0x7f45ec036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f45f3606640 1 -- 172.21.15.145:0/392837274 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f47000bb070 con 0x55ac07e64550 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4706437640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45ec034650 0x7f45ec036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4709128980 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07e64ea0 0x55ac07f61160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f616a0 con 0x55ac07e64ea0 2024-09-11T11:03:16.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4707439640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07e64ea0 0x55ac07f61160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4706437640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45ec034650 0x7f45ec036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f46f0000f70 tx=0x7f46f00012c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4707439640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07e64ea0 0x55ac07f61160 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4707439640 1 -- 172.21.15.145:0/392837274 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07e64ea0 2024-09-11T11:03:16.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4709128980 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f62150 0x55ac07f645e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f64d50 con 0x55ac07f62150 2024-09-11T11:03:16.301 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4706c38640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f62150 0x55ac07f645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4706c38640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f62150 0x55ac07f645e0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4706c38640 1 -- 172.21.15.145:0/392837274 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47000c7070 con 0x55ac07f62150 2024-09-11T11:03:16.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.297+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f66600 con 0x55ac07f62150 2024-09-11T11:03:16.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706c38640 1 -- 172.21.15.145:0/392837274 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47000c7070 con 0x55ac07f62150 2024-09-11T11:03:16.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f65830 con 0x55ac07f62150 2024-09-11T11:03:16.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706c38640 1 -- 172.21.15.145:0/392837274 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47000c7070 con 0x55ac07f62150 2024-09-11T11:03:16.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac07f679b0 0x55ac07f69da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f6a2e0 con 0x55ac07f679b0 2024-09-11T11:03:16.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706437640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac07f679b0 0x55ac07f69da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.304 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706437640 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac07f679b0 0x55ac07f69da0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706437640 1 -- 172.21.15.145:0/392837274 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f679b0 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 Processor -- start 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 -- start start 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f77ca0 0x55ac07f780c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac07d6c800 con 0x55ac07f77ca0 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f77ca0 0x55ac07f780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f77ca0 0x55ac07f780c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38362/0 (socket says 172.21.15.145:38362) 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706c38640 1 -- 172.21.15.145:0/2200964472 learned_addr learned my addr 172.21.15.145:0/2200964472 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706c38640 1 -- 172.21.15.145:0/2200964472 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac07f78600 con 0x55ac07f77ca0 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4706c38640 1 --2- 172.21.15.145:0/2200964472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f77ca0 0x55ac07f780c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f47000e3040 tx=0x7f47000a9700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f45f0e01640 1 -- 172.21.15.145:0/2200964472 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000dc0c0 con 0x55ac07f77ca0 2024-09-11T11:03:16.306 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 -- 172.21.15.145:0/2200964472 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac07f78890 con 0x55ac07f77ca0 2024-09-11T11:03:16.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f45f0e01640 1 -- 172.21.15.145:0/2200964472 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47000dc260 con 0x55ac07f77ca0 2024-09-11T11:03:16.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f45f0e01640 1 -- 172.21.15.145:0/2200964472 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000c93e0 con 0x55ac07f77ca0 2024-09-11T11:03:16.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.301+0000 7f4709128980 1 -- 172.21.15.145:0/2200964472 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac07f7b510 con 0x55ac07f77ca0 2024-09-11T11:03:16.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f45f0e01640 1 -- 172.21.15.145:0/2200964472 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f47000eb060 con 0x55ac07f77ca0 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f45f0e01640 1 --2- 172.21.15.145:0/2200964472 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45e0034650 0x7f45e0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f45f0e01640 1 -- 172.21.15.145:0/2200964472 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f47000dce00 con 0x55ac07f77ca0 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4706437640 1 --2- 172.21.15.145:0/2200964472 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45e0034650 0x7f45e0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 Processor -- start 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- start start 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4706437640 1 --2- 172.21.15.145:0/2200964472 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45e0034650 0x7f45e0036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f46f000bf60 tx=0x7f46f000f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f84a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac07dd9c80 con 0x55ac07f84650 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f84a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f84a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38376/0 (socket says 172.21.15.145:38376) 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4706c38640 1 -- 172.21.15.145:0/1537907399 learned_addr learned my addr 172.21.15.145:0/1537907399 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.309 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4706c38640 1 -- 172.21.15.145:0/1537907399 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac07f85020 con 0x55ac07f84650 2024-09-11T11:03:16.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4706c38640 1 --2- 172.21.15.145:0/1537907399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f84a50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f47000bffd0 tx=0x7f47000da4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f892fe4d92a2fc03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f45ea7fc640 1 -- 172.21.15.145:0/1537907399 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000fc020 con 0x55ac07f84650 2024-09-11T11:03:16.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f45ea7fc640 1 -- 172.21.15.145:0/1537907399 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47000bf370 con 0x55ac07f84650 2024-09-11T11:03:16.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f45ea7fc640 1 -- 172.21.15.145:0/1537907399 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000f3040 con 0x55ac07f84650 2024-09-11T11:03:16.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- 172.21.15.145:0/1537907399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 msgr2=0x55ac07f84a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 --2- 172.21.15.145:0/1537907399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f84a50 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f47000bffd0 tx=0x7f47000da4d0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- 172.21.15.145:0/1537907399 shutdown_connections 2024-09-11T11:03:16.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 --2- 172.21.15.145:0/1537907399 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f84a50 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- 172.21.15.145:0/1537907399 >> 172.21.15.145:0/1537907399 conn(0x55ac07f809e0 msgr2=0x55ac07f7eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- 172.21.15.145:0/1537907399 shutdown_connections 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- 172.21.15.145:0/1537907399 wait complete. 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 Processor -- start 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- start start 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f8b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.305+0000 7f4709128980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55ac07f853f0 con 0x55ac07f84650 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f8b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4706c38640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f8b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:38386/0 (socket says 172.21.15.145:38386) 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 learned_addr learned my addr 172.21.15.145:0/844907450 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac07f8bbc0 con 0x55ac07f84650 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4706c38640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f8b680 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f47000e1e90 tx=0x7f47000ccf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f45e8ff9640 1 -- 172.21.15.145:0/844907450 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f470010a070 con 0x55ac07f84650 2024-09-11T11:03:16.313 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ac07f8bbc0 con 0x55ac07f84650 2024-09-11T11:03:16.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f45e8ff9640 1 -- 172.21.15.145:0/844907450 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47000d4df0 con 0x55ac07f84650 2024-09-11T11:03:16.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f45e8ff9640 1 -- 172.21.15.145:0/844907450 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47000c8480 con 0x55ac07f84650 2024-09-11T11:03:16.314 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac07f8c030 con 0x55ac07f84650 2024-09-11T11:03:16.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f45e8ff9640 1 -- 172.21.15.145:0/844907450 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f470010d070 con 0x55ac07f84650 2024-09-11T11:03:16.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f45e8ff9640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 0x7f45d0036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f45e8ff9640 1 -- 172.21.15.145:0/844907450 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f4700110c60 con 0x55ac07f84650 2024-09-11T11:03:16.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4706437640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 0x7f45d0036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07f966a0 0x55ac07f98b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f99290 con 0x55ac07f966a0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4707439640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07f966a0 0x55ac07f98b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4706437640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 0x7f45d0036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55ac07f508b0 tx=0x7f46f0010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4707439640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07f966a0 0x55ac07f98b40 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 20 realm 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.309+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f95b90 con 0x55ac07f966a0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:03:16.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f99d60 con 0x55ac07f966a0 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f9ab40 0x55ac07f9cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4706c38640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f9ab40 0x55ac07f9cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4706c38640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f9ab40 0x55ac07f9cf30 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9de00 con 0x55ac07f9ab40 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 20 searching for the correct realm 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac07f9f6a0 0x55ac07fa1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa2230 con 0x55ac07f9f6a0 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4706437640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac07f9f6a0 0x55ac07fa1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4706437640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac07f9f6a0 0x55ac07fa1b60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.313+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa2230 con 0x55ac07f9ab40 2024-09-11T11:03:16.321 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706c38640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f470010f070 0x7f4700102430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:03:16.322 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x7f470010f070 2024-09-11T11:03:16.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f470010f070 0x7f4700102430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:03:16.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f470010f070 0x7f4700102430 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:03:16.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.332 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.317+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x7f470010f070 2024-09-11T11:03:16.333 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x7f470010f070 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.334 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.335 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.336 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x7f470010f070 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.321+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f966a0 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x7f470010f070 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.337 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x7f470010f070 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9d5b0 con 0x55ac07f9ab40 2024-09-11T11:03:16.338 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9dad0 con 0x55ac07f966a0 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.325+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9dec0 con 0x55ac07f9ab40 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.339 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07f9dec0 con 0x7f470010f070 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 zone default found 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 4 Realm: () 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 zonegroup default 2024-09-11T11:03:16.340 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa26b0 con 0x7f470010f070 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa44c0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa4a00 con 0x55ac07f9f6a0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.341 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:03:16.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 started sync module instance, tier type = 2024-09-11T11:03:16.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:03:16.342 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa38d0 con 0x55ac07f9ab40 2024-09-11T11:03:16.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94197356576240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa38d0 con 0x55ac07f9ab40 2024-09-11T11:03:16.346 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.329+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa5480 con 0x55ac07f966a0 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.333+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.333+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94197356580816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa53f0 con 0x55ac07f966a0 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.333+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa6400 con 0x55ac07f9ab40 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.333+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94197356576240] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.333+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94197356580816] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.333+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.333+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94197356584688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa63c0 con 0x55ac07f9ab40 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.333+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa6ca0 con 0x7f470010f070 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.337+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.337+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94197356586992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa63c0 con 0x7f470010f070 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.337+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa7780 con 0x55ac07f9ab40 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.337+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94197356584688] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.347 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.337+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94197356586992] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.337+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.337+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94197356588048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa63c0 con 0x55ac07f9ab40 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.337+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa7ba0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94197356589664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa83f0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa8db0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94197356588048] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94197356589664] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.348 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94197356595456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa9150 con 0x55ac07f9f6a0 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa99a0 con 0x7f470010f070 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94197356595456] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94197356597584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa9d90 con 0x7f470010f070 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 20 add_watcher() i=0 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 20 add_watcher() i=1 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 20 add_watcher() i=2 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 20 add_watcher() i=3 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 20 add_watcher() i=4 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 20 add_watcher() i=5 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.341+0000 7f4709128980 20 add_watcher() i=6 2024-09-11T11:03:16.349 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94197356597584] v36'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 20 add_watcher() i=7 2024-09-11T11:03:16.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 2 all 8 watchers are set, enabling cache 2024-09-11T11:03:16.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07facdf0 con 0x55ac07f966a0 2024-09-11T11:03:16.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.350 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94197356599104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07faa1a0 con 0x55ac07f966a0 2024-09-11T11:03:16.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94197356599104] v36'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f45bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:16.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:03:16.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:03:16.353 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 5 note: GC not initialized 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4537fff640 20 reqs_thread_entry: start 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 20 init_complete bucket index max shards: 11 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 20 Filter name: none 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4535ffb640 20 reqs_thread_entry: start 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 20 rados->read ofs=0 len=0 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fd04f0 con 0x55ac07f966a0 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.354 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 20 rados_obj.operate() r=0 bl.length=473 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.345+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fd6db0 con 0x55ac07f966a0 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v36'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4709128980 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4709128980 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4709128980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94197356783648 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fd2480 con 0x55ac07f9ab40 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== watch-notify(notify (1) cookie 94197356588048 notify 154618822718 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55ac07f78890 con 0x55ac07f9ab40 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f45e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 154618822718 cookie 94197356588048 notifier 4927 bl.length()=649 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f45e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-11T11:03:16.355 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f45e9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-11T11:03:16.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f45e9ffb640 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x7f453c003410 con 0x55ac07f9ab40 2024-09-11T11:03:16.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(64 notify.4 [notify cookie 94197356783648 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.356 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== watch-notify(notify_complete (2) cookie 94197356783648 notify 154618822718 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ac07f78600 con 0x55ac07f9ab40 2024-09-11T11:03:16.356 INFO:teuthology.orchestra.run.smithi145.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-11T11:03:13.825132Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-11T11:03:13.825118Z","tags":[],"group_ids":[]} 2024-09-11T11:03:16.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f45bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:03:16.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.349+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94197356599104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fd60c0 con 0x55ac07f966a0 2024-09-11T11:03:16.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.353+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94197356599104] v36'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.357 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.353+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94197356576240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fce2f0 con 0x55ac07f9ab40 2024-09-11T11:03:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.353+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94197356576240] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.353+0000 7f4709128980 20 remove_watcher() i=0 2024-09-11T11:03:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.353+0000 7f4709128980 2 removed watcher, disabling cache 2024-09-11T11:03:16.358 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.353+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94197356580816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fce2f0 con 0x55ac07f966a0 2024-09-11T11:03:16.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.357+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94197356580816] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x55ac07f966a0 2024-09-11T11:03:16.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.357+0000 7f4709128980 20 remove_watcher() i=1 2024-09-11T11:03:16.359 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.357+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94197356584688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fce2f0 con 0x55ac07f9ab40 2024-09-11T11:03:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.357+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94197356584688] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.357+0000 7f4709128980 20 remove_watcher() i=2 2024-09-11T11:03:16.361 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.357+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94197356586992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa5ef0 con 0x7f470010f070 2024-09-11T11:03:16.363 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94197356586992] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4709128980 20 remove_watcher() i=3 2024-09-11T11:03:16.364 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94197356588048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fce2f0 con 0x55ac07f9ab40 2024-09-11T11:03:16.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4706c38640 1 -- 172.21.15.145:0/844907450 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94197356588048] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4700116070 con 0x55ac07f9ab40 2024-09-11T11:03:16.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4709128980 20 remove_watcher() i=4 2024-09-11T11:03:16.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94197356589664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa5ef0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.365 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94197356589664] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4709128980 20 remove_watcher() i=5 2024-09-11T11:03:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.361+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94197356595456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fce2f0 con 0x55ac07f9f6a0 2024-09-11T11:03:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4706437640 1 -- 172.21.15.145:0/844907450 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94197356595456] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f000e620 con 0x55ac07f9f6a0 2024-09-11T11:03:16.366 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 20 remove_watcher() i=6 2024-09-11T11:03:16.367 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94197356597584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x55ac07fa7260 con 0x7f470010f070 2024-09-11T11:03:16.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94197356597584] v36'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46f80083f0 con 0x7f470010f070 2024-09-11T11:03:16.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 20 remove_watcher() i=7 2024-09-11T11:03:16.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f9ab40 msgr2=0x55ac07f9cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f9ab40 0x55ac07f9cf30 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07f966a0 msgr2=0x55ac07f98b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.370 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07f966a0 0x55ac07f98b40 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f470010f070 msgr2=0x7f4700102430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f470010f070 0x7f4700102430 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac07f9f6a0 msgr2=0x55ac07fa1b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x55ac07f9f6a0 0x55ac07fa1b60 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 msgr2=0x7f45d0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45d0034650 0x7f45d0036b10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55ac07f508b0 tx=0x7f46f0010000 comp rx=0 tx=0).stop 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 msgr2=0x55ac07f8b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/844907450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f84650 0x55ac07f8b680 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f47000e1e90 tx=0x7f47000ccf20 comp rx=0 tx=0).stop 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4707439640 1 -- 172.21.15.145:0/844907450 reap_dead start 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 shutdown_connections 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 >> 172.21.15.145:0/844907450 conn(0x55ac07f809e0 msgr2=0x55ac07f7eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 shutdown_connections 2024-09-11T11:03:16.371 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/844907450 wait complete. 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/2200964472 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45e0034650 msgr2=0x7f45e0036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/2200964472 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45e0034650 0x7f45e0036b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f46f000bf60 tx=0x7f46f000f000 comp rx=0 tx=0).stop 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/2200964472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f77ca0 msgr2=0x55ac07f780c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/2200964472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f77ca0 0x55ac07f780c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f47000e3040 tx=0x7f47000a9700 comp rx=0 tx=0).stop 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/2200964472 shutdown_connections 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/2200964472 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45e0034650 0x7f45e0036b10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/2200964472 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07f77ca0 0x55ac07f780c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/2200964472 >> 172.21.15.145:0/2200964472 conn(0x55ac07f6cdf0 msgr2=0x55ac07f6f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/2200964472 shutdown_connections 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/2200964472 wait complete. 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f62150 msgr2=0x55ac07f645e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.372 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x55ac07f62150 0x55ac07f645e0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07e64ea0 msgr2=0x55ac07f61160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x55ac07e64ea0 0x55ac07f61160 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac07f679b0 msgr2=0x55ac07f69da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x55ac07f679b0 0x55ac07f69da0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45ec034650 msgr2=0x7f45ec036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f45ec034650 0x7f45ec036b10 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f46f0000f70 tx=0x7f46f00012c0 comp rx=0 tx=0).stop 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 msgr2=0x55ac07f511d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 --2- 172.21.15.145:0/392837274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55ac07e64550 0x55ac07f511d0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f470001b870 tx=0x7f4700019810 comp rx=0 tx=0).stop 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4707439640 1 -- 172.21.15.145:0/392837274 reap_dead start 2024-09-11T11:03:16.373 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 shutdown_connections 2024-09-11T11:03:16.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 >> 172.21.15.145:0/392837274 conn(0x55ac07e60070 msgr2=0x55ac07f4a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:03:16.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 shutdown_connections 2024-09-11T11:03:16.374 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:03:16.365+0000 7f4709128980 1 -- 172.21.15.145:0/392837274 wait complete. 2024-09-11T11:03:16.378 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:16.378 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-11T11:03:13.825132Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-11T11:03:13.825118Z', 'tags': [], 'group_ids': []} 2024-09-11T11:03:16.378 ERROR:root:0 2024-09-11T11:03:16.378 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-11T11:03:16.387 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.388 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.393 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.393 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-11T11:03:16.401 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.401 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.405 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.405 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-11T11:03:16.415 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-11T11:03:16.415 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.419 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.419 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-11T11:03:16.429 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.429 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.433 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.433 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-11T11:03:16.443 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-11T11:03:16.443 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.448 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.448 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-11T11:03:16.458 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-11T11:03:16.458 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.462 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.463 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-11T11:03:16.472 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.472 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.476 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.477 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-11T11:03:16.485 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.485 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.489 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.489 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-11T11:03:16.499 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.499 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.504 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.505 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.510 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-11T11:03:16.511 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-11T11:03:16.516 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-11T11:03:16.529 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-11T11:03:16.534 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-11T11:03:16.534 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-11T11:03:16.539 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-11T11:03:16.525995Z', 'creation_time': '2024-09-11T11:03:16.522174Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-11T11:03:16.539 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-11T11:03:16.545 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-11T11:03:16.525995Z', 'creation_time': '2024-09-11T11:03:16.522174Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-09-11T11:03:16.551 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-11T11:03:16.557 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-11T11:03:16.525995Z', 'creation_time': '2024-09-11T11:03:16.522174Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-11T11:03:16.558 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-11T11:03:16.563 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx000002f98745ec59ef494-0066e178f4-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:03:16.569 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-11T11:03:16.577 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.578 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-11T11:03:16.588 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:03:16.642 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11'} 2024-09-11T11:03:16.661 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.665 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11'} 2024-09-11T11:03:16.684 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.684 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-11T11:03:16.703 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.714 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-11T11:03:16.726 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:03:16.726 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-11T11:03:16.733 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '2267e615-29e0-4503-94c5-a003ba7e8ee3', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11', 'marker': '27698d38-fc40-410e-96d8-191ffc71147c.4235.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-11T11:03:16.674386Z', 'creation_time': '2024-09-11T11:03:16.522174Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-09-11T11:04:16.844 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-11T11:04:16.877 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-09-11T11:04:16.878 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-11T11:04:16.908 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-09-11T11:04:16.908 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-11T11:04:16.914 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-09-11T11:04:16.914 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-11T11:04:16.919 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-09-11T11:04:16.920 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-11T11:04:16.925 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-09-11T11:04:16.926 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-11T11:04:16.930 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-09-11T11:04:16.931 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-11T11:04:16.936 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-09-11T11:00:00.000000Z', 'epoch': 1726052400, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-09-11T11:04:16.936 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-11T11:04:16.946 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:04:16.946 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-11T11:04:16.951 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-11T11:04:16.952 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-11T11:04:16.967 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:04:16.972 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-11T11:04:16.988 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:04:17.360 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-11T11:04:17.366 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx000004fe02c714d8c45d6-0066e17931-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:17.543 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-11T11:04:17.549 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-11T11:04:17.558 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-11T11:04:17.563 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-11T11:04:17.709 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-11T11:04:17.794 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:04:17.794 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-11T11:04:17.804 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-11T11:04:17.805 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-11T11:04:17.814 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-11T11:04:17.838 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-11T11:04:17.843 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000eaae1f96f0832981-0066e17931-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:17.887 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-11T11:04:17.962 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:04:17.962 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-11T11:04:17.967 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000f54e2236e41bd6a7-0066e17931-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:17.968 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-11T11:04:17.972 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '2f203b3f-97d8-4a3b-bc37-33833403bb89'}]}} 2024-09-11T11:04:17.972 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-11T11:04:17.993 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-11T11:04:17.994 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-11T11:04:17.998 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-11T11:04:17.999 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-11T11:04:18.003 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b3d6ef2ef888f63e-0066e17932-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:18.004 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-11T11:04:18.008 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000003c43179cc07aeb7e-0066e17932-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:18.034 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-11T11:04:18.039 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-11T11:04:18.040 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-11T11:04:18.044 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000cb9305bb1471ba5b-0066e17932-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:18.045 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-11T11:04:18.049 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000791e6d1e94a3eacb-0066e17932-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:18.049 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-11T11:04:18.054 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-11T11:04:18.054 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-11T11:04:18.058 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000004a07fd97fd156878-0066e17932-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:18.058 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-11T11:04:18.062 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000096c83a690bc7038e-0066e17932-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:18.062 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-11T11:04:18.068 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000002dc53e77a9fbe749-0066e17932-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:18.068 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-11T11:04:18.072 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000a4443cb7e6ce2939-0066e17932-4235-default', 'HostId': '4235-default-default'} 2024-09-11T11:04:18.072 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-11T11:04:18.091 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:04:18.092 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-11T11:04:18.096 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-11T11:04:18.096 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-11T11:04:18.106 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:04:18.106 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-11T11:04:18.110 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-11T11:04:18.111 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-11T11:04:18.119 INFO:tasks.radosgw_admin_rest: empty result 2024-09-11T11:04:18.124 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-11T11:04:18.133 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-11T11:04:18.133 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T11:04:18.134 INFO:tasks.rgw.client.0.smithi145.stdout:2024-09-11T11:04:18.133+0000 7f9a75910640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 29056) UID: 0 2024-09-11T11:04:18.134 INFO:tasks.rgw.client.0.smithi145.stdout:2024-09-11T11:04:18.133+0000 7f9a79158a40 -1 shutting down 2024-09-11T11:04:48.640 INFO:tasks.rgw.client.0:Stopped 2024-09-11T11:04:48.641 DEBUG:teuthology.orchestra.run.smithi145:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-11T11:04:48.647 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /etc/ceph/vault-root-token 2024-09-11T11:04:48.701 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-11T11:04:48.756 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-11T11:04:48.756 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-11T11:04:48.756 DEBUG:teuthology.orchestra.run.smithi145:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-11T11:04:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setuser ceph since I am not root 2024-09-11T11:04:48.836 INFO:teuthology.orchestra.run.smithi145.stderr:ignoring --setgroup ceph since I am not root 2024-09-11T11:04:48.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe365796980 1 Processor -- start 2024-09-11T11:04:48.837 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe365796980 1 -- start start 2024-09-11T11:04:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe365796980 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5601b6dccac0 0x5601b6e5d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe365796980 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5601b6ce0ae0 con 0x5601b6e5dcb0 2024-09-11T11:04:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe365796980 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x5601b6d04e30 con 0x5601b6dccac0 2024-09-11T11:04:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe3632a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5601b6dccac0 0x5601b6e5d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe3632a6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x5601b6dccac0 0x5601b6e5d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:51766/0 (socket says 172.21.15.145:51766) 2024-09-11T11:04:48.838 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe3632a6640 1 -- 172.21.15.145:0/4107113067 learned_addr learned my addr 172.21.15.145:0/4107113067 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:04:48.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe3632a6640 1 -- 172.21.15.145:0/4107113067 >> v1:172.21.15.102:6789/0 conn(0x5601b6e5dcb0 legacy=0x5601b6e600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:48.839 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.837+0000 7fe3632a6640 1 -- 172.21.15.145:0/4107113067 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b6dccea0 con 0x5601b6dccac0 2024-09-11T11:04:48.841 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe3632a6640 1 --2- 172.21.15.145:0/4107113067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6e5d770 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe35400a5c0 tx=0x7fe35401b340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc117ddc909dd1f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe3622a4640 1 -- 172.21.15.145:0/4107113067 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540a6070 con 0x5601b6dccac0 2024-09-11T11:04:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe3622a4640 1 -- 172.21.15.145:0/4107113067 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540af070 con 0x5601b6dccac0 2024-09-11T11:04:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe3622a4640 1 -- 172.21.15.145:0/4107113067 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540aa5c0 con 0x5601b6dccac0 2024-09-11T11:04:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe365796980 1 -- 172.21.15.145:0/4107113067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 msgr2=0x5601b6e5d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe365796980 1 --2- 172.21.15.145:0/4107113067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6e5d770 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe35400a5c0 tx=0x7fe35401b340 comp rx=0 tx=0).stop 2024-09-11T11:04:48.842 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe365796980 1 -- 172.21.15.145:0/4107113067 shutdown_connections 2024-09-11T11:04:48.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe365796980 1 --2- 172.21.15.145:0/4107113067 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6e5d770 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:48.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe365796980 1 -- 172.21.15.145:0/4107113067 >> 172.21.15.145:0/4107113067 conn(0x5601b6e53060 msgr2=0x5601b6e55480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:48.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe365796980 1 -- 172.21.15.145:0/4107113067 shutdown_connections 2024-09-11T11:04:48.843 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.841+0000 7fe365796980 1 -- 172.21.15.145:0/4107113067 wait complete. 2024-09-11T11:04:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.857+0000 7fe365796980 1 Processor -- start 2024-09-11T11:04:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.857+0000 7fe365796980 1 -- start start 2024-09-11T11:04:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.857+0000 7fe365796980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f45c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.857+0000 7fe365796980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601b6d06200 con 0x5601b6dccac0 2024-09-11T11:04:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.857+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f45c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.857+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f45c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:51770/0 (socket says 172.21.15.145:51770) 2024-09-11T11:04:48.860 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.857+0000 7fe3632a6640 1 -- 172.21.15.145:0/2083719598 learned_addr learned my addr 172.21.15.145:0/2083719598 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:04:48.864 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.857+0000 7fe3632a6640 1 -- 172.21.15.145:0/2083719598 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b6f461f0 con 0x5601b6dccac0 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe3632a6640 1 --2- 172.21.15.145:0/2083719598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f45c20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe354018f70 tx=0x7fe354003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58383bce46dd14b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe25160a640 1 -- 172.21.15.145:0/2083719598 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540aaa00 con 0x5601b6dccac0 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe25160a640 1 -- 172.21.15.145:0/2083719598 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540aaba0 con 0x5601b6dccac0 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe25160a640 1 -- 172.21.15.145:0/2083719598 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540bd3f0 con 0x5601b6dccac0 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- 172.21.15.145:0/2083719598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 msgr2=0x5601b6f45c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 --2- 172.21.15.145:0/2083719598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f45c20 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe354018f70 tx=0x7fe354003030 comp rx=0 tx=0).stop 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- 172.21.15.145:0/2083719598 shutdown_connections 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 --2- 172.21.15.145:0/2083719598 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f45c20 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:48.865 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- 172.21.15.145:0/2083719598 >> 172.21.15.145:0/2083719598 conn(0x5601b6e53060 msgr2=0x5601b6f41850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- 172.21.15.145:0/2083719598 shutdown_connections 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- 172.21.15.145:0/2083719598 wait complete. 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 Processor -- start 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- start start 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f4ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601b6e64250 con 0x5601b6dccac0 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f4ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f4ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:51776/0 (socket says 172.21.15.145:51776) 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe3632a6640 1 -- 172.21.15.145:0/1931095839 learned_addr learned my addr 172.21.15.145:0/1931095839 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe3632a6640 1 -- 172.21.15.145:0/1931095839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b6f4d3a0 con 0x5601b6dccac0 2024-09-11T11:04:48.866 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe3632a6640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f4ce60 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe35401b170 tx=0x7fe3540180e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe24fe07640 1 -- 172.21.15.145:0/1931095839 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540bd790 con 0x5601b6dccac0 2024-09-11T11:04:48.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601b6f4d630 con 0x5601b6dccac0 2024-09-11T11:04:48.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe24fe07640 1 -- 172.21.15.145:0/1931095839 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540bd930 con 0x5601b6dccac0 2024-09-11T11:04:48.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe24fe07640 1 -- 172.21.15.145:0/1931095839 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540bdc10 con 0x5601b6dccac0 2024-09-11T11:04:48.867 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.861+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601b6f50310 con 0x5601b6dccac0 2024-09-11T11:04:48.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe24fe07640 1 -- 172.21.15.145:0/1931095839 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe3540ce030 con 0x5601b6dccac0 2024-09-11T11:04:48.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe24fe07640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe2480346a0 0x7fe248036b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.869 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe24fe07640 1 -- 172.21.15.145:0/1931095839 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fe3540cc020 con 0x5601b6dccac0 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe362aa5640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe2480346a0 0x7fe248036b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe365796980 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6e5dcb0 0x5601b6f53e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f54490 con 0x5601b6e5dcb0 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe363aa7640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6e5dcb0 0x5601b6f53e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe362aa5640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe2480346a0 0x7fe248036b60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe358001e20 tx=0x7fe3580013a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe363aa7640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6e5dcb0 0x5601b6f53e50 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe363aa7640 1 -- 172.21.15.145:0/1931095839 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6e5dcb0 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe365796980 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f55260 0x5601b6f57650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f57cb0 con 0x5601b6f55260 2024-09-11T11:04:48.870 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe3632a6640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f55260 0x5601b6f57650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.865+0000 7fe3632a6640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f55260 0x5601b6f57650 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe3632a6640 1 -- 172.21.15.145:0/1931095839 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3540c6d20 con 0x5601b6f55260 2024-09-11T11:04:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:3 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f59560 con 0x5601b6f55260 2024-09-11T11:04:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe3632a6640 1 -- 172.21.15.145:0/1931095839 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(3 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe3540c6d20 con 0x5601b6f55260 2024-09-11T11:04:48.871 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f58790 con 0x5601b6f55260 2024-09-11T11:04:48.872 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe3632a6640 1 -- 172.21.15.145:0/1931095839 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3540c6d20 con 0x5601b6f55260 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe365796980 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5601b6f5a910 0x5601b6f5cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:5 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f5d240 con 0x5601b6f5a910 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe362aa5640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5601b6f5a910 0x5601b6f5cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe362aa5640 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5601b6f5a910 0x5601b6f5cd00 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe362aa5640 1 -- 172.21.15.145:0/1931095839 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(5 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe35800d040 con 0x5601b6f5a910 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe365796980 1 Processor -- start 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe365796980 1 -- start start 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe365796980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f6ac00 0x5601b6f6b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.873 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe365796980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601b6d5f800 con 0x5601b6f6ac00 2024-09-11T11:04:48.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f6ac00 0x5601b6f6b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f6ac00 0x5601b6f6b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:51786/0 (socket says 172.21.15.145:51786) 2024-09-11T11:04:48.874 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.869+0000 7fe3632a6640 1 -- 172.21.15.145:0/655894055 learned_addr learned my addr 172.21.15.145:0/655894055 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe3632a6640 1 -- 172.21.15.145:0/655894055 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b6f6b560 con 0x5601b6f6ac00 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe3632a6640 1 --2- 172.21.15.145:0/655894055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f6ac00 0x5601b6f6b020 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe3540e3730 tx=0x7fe3540c5e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe24d602640 1 -- 172.21.15.145:0/655894055 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540e3270 con 0x5601b6f6ac00 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe24d602640 1 -- 172.21.15.145:0/655894055 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540e3410 con 0x5601b6f6ac00 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe365796980 1 -- 172.21.15.145:0/655894055 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601b6f6b7f0 con 0x5601b6f6ac00 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe24d602640 1 -- 172.21.15.145:0/655894055 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540cfb40 con 0x5601b6f6ac00 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe365796980 1 -- 172.21.15.145:0/655894055 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601b6f6e470 con 0x5601b6f6ac00 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe24d602640 1 -- 172.21.15.145:0/655894055 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe3540cfce0 con 0x5601b6f6ac00 2024-09-11T11:04:48.876 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe24d602640 1 --2- 172.21.15.145:0/655894055 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe23c034650 0x7fe23c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe24d602640 1 -- 172.21.15.145:0/655894055 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fe3540f2c40 con 0x5601b6f6ac00 2024-09-11T11:04:48.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe362aa5640 1 --2- 172.21.15.145:0/655894055 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe23c034650 0x7fe23c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe365796980 1 Processor -- start 2024-09-11T11:04:48.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe365796980 1 -- start start 2024-09-11T11:04:48.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe362aa5640 1 --2- 172.21.15.145:0/655894055 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe23c034650 0x7fe23c036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5601b6f51450 tx=0x7fe358006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe365796980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f77950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.877 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe365796980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601b6f464b0 con 0x5601b6f77550 2024-09-11T11:04:48.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f77950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f77950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:51794/0 (socket says 172.21.15.145:51794) 2024-09-11T11:04:48.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.873+0000 7fe3632a6640 1 -- 172.21.15.145:0/3265918799 learned_addr learned my addr 172.21.15.145:0/3265918799 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:04:48.879 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe3632a6640 1 -- 172.21.15.145:0/3265918799 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b6f77f20 con 0x5601b6f77550 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe3632a6640 1 --2- 172.21.15.145:0/3265918799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f77950 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe3540c6fd0 tx=0x7fe3540e3e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0459a3e92105a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe246ffd640 1 -- 172.21.15.145:0/3265918799 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe354009550 con 0x5601b6f77550 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe246ffd640 1 -- 172.21.15.145:0/3265918799 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540c67b0 con 0x5601b6f77550 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe246ffd640 1 -- 172.21.15.145:0/3265918799 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540b39c0 con 0x5601b6f77550 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- 172.21.15.145:0/3265918799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 msgr2=0x5601b6f77950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 --2- 172.21.15.145:0/3265918799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f77950 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fe3540c6fd0 tx=0x7fe3540e3e40 comp rx=0 tx=0).stop 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- 172.21.15.145:0/3265918799 shutdown_connections 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 --2- 172.21.15.145:0/3265918799 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f77950 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- 172.21.15.145:0/3265918799 >> 172.21.15.145:0/3265918799 conn(0x5601b6f73980 msgr2=0x5601b6f71a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- 172.21.15.145:0/3265918799 shutdown_connections 2024-09-11T11:04:48.880 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- 172.21.15.145:0/3265918799 wait complete. 2024-09-11T11:04:48.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 Processor -- start 2024-09-11T11:04:48.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- start start 2024-09-11T11:04:48.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f7e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5601b6f783f0 con 0x5601b6f77550 2024-09-11T11:04:48.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f7e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe3632a6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f7e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.145:51810/0 (socket says 172.21.15.145:51810) 2024-09-11T11:04:48.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 learned_addr learned my addr 172.21.15.145:0/2341111719 (peer_addr_for_me v2:172.21.15.145:0/0) 2024-09-11T11:04:48.881 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601b6f7ecf0 con 0x5601b6f77550 2024-09-11T11:04:48.884 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe3632a6640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f7e7b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe3540f3000 tx=0x7fe3540c5a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe2457fa640 1 -- 172.21.15.145:0/2341111719 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540e3790 con 0x5601b6f77550 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe2457fa640 1 -- 172.21.15.145:0/2341111719 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3540e3930 con 0x5601b6f77550 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5601b6f7ecf0 con 0x5601b6f77550 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe2457fa640 1 -- 172.21.15.145:0/2341111719 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe3540df930 con 0x5601b6f77550 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.877+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601b6f7ecf0 con 0x5601b6f77550 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe2457fa640 1 -- 172.21.15.145:0/2341111719 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fe3540dfad0 con 0x5601b6f77550 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe2457fa640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe22c034650 0x7fe22c036b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe2457fa640 1 -- 172.21.15.145:0/2341111719 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fe354102030 con 0x5601b6f77550 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe362aa5640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe22c034650 0x7fe22c036b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.885 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6f89730 0x5601b6f8bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f8c340 con 0x5601b6f89730 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe363aa7640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6f89730 0x5601b6f8bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe362aa5640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe22c034650 0x7fe22c036b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5601b6f594b0 tx=0x7fe358011000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe363aa7640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6f89730 0x5601b6f8bbf0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 20 realm 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.886 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f88b60 con 0x5601b6f89730 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f8ce00 con 0x5601b6f89730 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f8dbe0 0x5601b6f8ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f90680 con 0x5601b6f8dbe0 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.881+0000 7fe3632a6640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f8dbe0 0x5601b6f8ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.887 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe3632a6640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f8dbe0 0x5601b6f8ffd0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe365796980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:5 5.10 5:0bf2982c:::zone_info.27698d38-fc40-410e-96d8-191ffc71147c:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f90ed0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== osd_op_reply(5 zone_info.27698d38-fc40-410e-96d8-191ffc71147c [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe365796980 20 rados_obj.operate() r=0 bl.length=993 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe365796980 20 searching for the correct realm 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5601b6f92c40 0x5601b6f95030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.891 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f92c40 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe362aa5640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5601b6f92c40 0x5601b6f95030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe362aa5640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5601b6f92c40 0x5601b6f95030 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== osd_op_reply(6 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 3 ==== osd_op_reply(7 [pgnls start_epoch 36 out=107b] v36'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe3632a6640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe354009040 0x7fe3540c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x7fe354009040 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe363aa7640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe354009040 0x7fe3540c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe363aa7640 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe354009040 0x7fe3540c7590 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== osd_op_reply(8 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.892 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.885+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 4 ==== osd_op_reply(9 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 5 ==== osd_op_reply(10 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f92c40 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== osd_op_reply(11 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 6 ==== osd_op_reply(12 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 4 ==== osd_op_reply(13 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.893 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 5 ==== osd_op_reply(14 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.894 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 7 ==== osd_op_reply(15 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x7fe354009040 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== osd_op_reply(16 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 8 ==== osd_op_reply(17 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x7fe354009040 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 3 ==== osd_op_reply(18 [pgnls start_epoch 36 out=142b] v25'2 uv2 ondisk = 1) ==== 144+0+142 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.889+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 6 ==== osd_op_reply(19 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.898 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f92c40 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 3 ==== osd_op_reply(20 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 9 ==== osd_op_reply(21 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 7 ==== osd_op_reply(22 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f92c40 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 4 ==== osd_op_reply(23 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 10 ==== osd_op_reply(24 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.899 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 11 ==== osd_op_reply(25 [pgnls start_epoch 36 out=74b] v36'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 12 ==== osd_op_reply(26 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f92c40 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 5 ==== osd_op_reply(27 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x7fe354009040 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 4 ==== osd_op_reply(28 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.893+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f89730 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 13 ==== osd_op_reply(29 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x7fe354009040 2024-09-11T11:04:48.900 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 5 ==== osd_op_reply(30 [pgnls start_epoch 36 out=82b] v36'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f92c40 2024-09-11T11:04:48.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 6 ==== osd_op_reply(31 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x7fe354009040 2024-09-11T11:04:48.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 6 ==== osd_op_reply(32 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.901 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 8 ==== osd_op_reply(33 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 9 ==== osd_op_reply(34 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f92c40 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 7 ==== osd_op_reply(35 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 10 ==== osd_op_reply(36 [pgnls start_epoch 36 out=115b] v36'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.897+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 36 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f956b0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.905 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 11 ==== osd_op_reply(37 [pgnls start_epoch 36 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 RGWRados::pool_iterate: got zone_info.27698d38-fc40-410e-96d8-191ffc71147c 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 RGWRados::pool_iterate: got zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 RGWRados::pool_iterate: got default.zone. 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 RGWRados::pool_iterate: got period_config.default 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 RGWRados::pool_iterate: got zone_names.default 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f91880 con 0x5601b6f89730 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 14 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.906 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f914c0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 12 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados_obj.operate() r=0 bl.length=46 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:40 5.6 5:650353c4:::zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f92220 con 0x7fe354009040 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 7 ==== osd_op_reply(40 zonegroup_info.2267e615-29e0-4503-94c5-a003ba7e8ee3 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados_obj.operate() r=0 bl.length=436 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 zone default found 2024-09-11T11:04:48.907 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 4 Realm: () 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 4 ZoneGroup: default (2267e615-29e0-4503-94c5-a003ba7e8ee3) 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 4 Zone: default (27698d38-fc40-410e-96d8-191ffc71147c) 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 zonegroup default 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f95fc0 con 0x7fe354009040 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 8 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados_obj.operate() r=0 bl.length=187 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f98270 con 0x5601b6f92c40 2024-09-11T11:04:48.908 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 8 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:04:48.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados->read ofs=0 len=0 2024-09-11T11:04:48.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f986d0 con 0x5601b6f92c40 2024-09-11T11:04:48.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 9 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 rados_obj.operate() r=-2 bl.length=0 2024-09-11T11:04:48.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 started sync module instance, tier type = 2024-09-11T11:04:48.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 20 started zone id=27698d38-fc40-410e-96d8-191ffc71147c (name=default) with tier type = 2024-09-11T11:04:48.909 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.901+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f97700 con 0x5601b6f8dbe0 2024-09-11T11:04:48.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.905+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 13 ==== osd_op_reply(44 notify.0 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.905+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94565364759552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f97700 con 0x5601b6f8dbe0 2024-09-11T11:04:48.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.905+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f991b0 con 0x5601b6f89730 2024-09-11T11:04:48.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.905+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 15 ==== osd_op_reply(46 notify.1 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.911 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.905+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94565364763808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f99170 con 0x5601b6f89730 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.905+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9a0d0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.905+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 14 ==== osd_op_reply(45 notify.0 [watch watch cookie 94565364759552] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94565364763808] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 15 ==== osd_op_reply(48 notify.2 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94565364766112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9a090 con 0x5601b6f8dbe0 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9a520 con 0x7fe354009040 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 9 ==== osd_op_reply(50 notify.3 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94565364757072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9a4e0 con 0x7fe354009040 2024-09-11T11:04:48.912 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9b420 con 0x5601b6f8dbe0 2024-09-11T11:04:48.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 16 ==== osd_op_reply(49 notify.2 [watch watch cookie 94565364766112] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.909+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94565364757072] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 17 ==== osd_op_reply(52 notify.4 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94565364771088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9b420 con 0x5601b6f8dbe0 2024-09-11T11:04:48.913 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9b810 con 0x5601b6f92c40 2024-09-11T11:04:48.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 10 ==== osd_op_reply(54 notify.5 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94565364767680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9c060 con 0x5601b6f92c40 2024-09-11T11:04:48.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9ca60 con 0x5601b6f92c40 2024-09-11T11:04:48.915 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94565364771088] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 11 ==== osd_op_reply(55 notify.5 [watch watch cookie 94565364767680] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 12 ==== osd_op_reply(56 notify.6 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94565364772656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9bbb0 con 0x5601b6f92c40 2024-09-11T11:04:48.916 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.913+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9d300 con 0x7fe354009040 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 13 ==== osd_op_reply(57 notify.6 [watch watch cookie 94565364772656] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 11 ==== osd_op_reply(58 notify.7 [create] v36'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94565364778352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9bbb0 con 0x7fe354009040 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 20 add_watcher() i=0 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 20 add_watcher() i=1 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 20 add_watcher() i=2 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 20 add_watcher() i=3 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 20 add_watcher() i=4 2024-09-11T11:04:48.918 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 20 add_watcher() i=5 2024-09-11T11:04:48.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 20 add_watcher() i=6 2024-09-11T11:04:48.919 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 12 ==== osd_op_reply(59 notify.7 [watch watch cookie 94565364778352] v36'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 20 add_watcher() i=7 2024-09-11T11:04:48.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 2 all 8 watchers are set, enabling cache 2024-09-11T11:04:48.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa03c0 con 0x5601b6f89730 2024-09-11T11:04:48.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 17 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.920 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.917+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94565364780624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9d880 con 0x5601b6f89730 2024-09-11T11:04:48.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.921+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 18 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94565364780624] v36'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.921+0000 7fe219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:04:48.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.921+0000 7fe365796980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-11T11:04:48.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.921+0000 7fe365796980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-11T11:04:48.922 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.921+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa8be0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.921+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 19 ==== osd_op_reply(62 gc.0 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.924 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.921+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa8cf0 con 0x7fe354009040 2024-09-11T11:04:48.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.925+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 13 ==== osd_op_reply(63 gc.1 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.926 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.925+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa9400 con 0x5601b6f92c40 2024-09-11T11:04:48.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.925+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v36'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.927 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.925+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa98b0 con 0x5601b6f89730 2024-09-11T11:04:48.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.929+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 19 ==== osd_op_reply(65 gc.3 [create,call,call,call] v36'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.930 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.929+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa6a40 con 0x5601b6f8dbe0 2024-09-11T11:04:48.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.929+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 20 ==== osd_op_reply(66 gc.4 [create,call,call,call] v36'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.932 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.929+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa6a40 con 0x5601b6f92c40 2024-09-11T11:04:48.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.933+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v36'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.933 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.933+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa6a40 con 0x5601b6f8dbe0 2024-09-11T11:04:48.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.933+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 21 ==== osd_op_reply(68 gc.6 [create,call,call,call] v36'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.935 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.933+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa6a40 con 0x5601b6f89730 2024-09-11T11:04:48.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.937+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 20 ==== osd_op_reply(69 gc.7 [create,call,call,call] v36'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.938 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.937+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6faa600 con 0x5601b6f8dbe0 2024-09-11T11:04:48.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.941+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 22 ==== osd_op_reply(70 gc.8 [create,call,call,call] v36'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.941 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.941+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6faa690 con 0x5601b6f8dbe0 2024-09-11T11:04:48.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.941+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 23 ==== osd_op_reply(71 gc.9 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.943 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.941+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6faa690 con 0x5601b6f8dbe0 2024-09-11T11:04:48.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.945+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 24 ==== osd_op_reply(72 gc.10 [create,call,call,call] v36'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.946 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.945+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6faa690 con 0x5601b6f92c40 2024-09-11T11:04:48.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.945+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 16 ==== osd_op_reply(73 gc.11 [create,call,call,call] v36'42 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.947 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.945+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6faac80 con 0x5601b6f8dbe0 2024-09-11T11:04:48.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.949+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 25 ==== osd_op_reply(74 gc.12 [create,call,call,call] v36'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.950 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.949+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6faac80 con 0x5601b6f89730 2024-09-11T11:04:48.951 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.949+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v36'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.952 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.949+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0c0 con 0x5601b6f89730 2024-09-11T11:04:48.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.953+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 22 ==== osd_op_reply(76 gc.14 [create,call,call,call] v36'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.954 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.953+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0a0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.957+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 26 ==== osd_op_reply(77 gc.15 [create,call,call,call] v36'77 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.957 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.957+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0a0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.957+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 27 ==== osd_op_reply(78 gc.16 [create,call,call,call] v36'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.959 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.957+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0a0 con 0x5601b6f92c40 2024-09-11T11:04:48.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.961+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v36'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.961 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.961+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0a0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.963 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.961+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 28 ==== osd_op_reply(80 gc.18 [create,call,call,call] v36'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.964 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.961+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0a0 con 0x5601b6f89730 2024-09-11T11:04:48.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.965+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 23 ==== osd_op_reply(81 gc.19 [create,call,call,call] v36'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.966 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.965+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0a0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.969+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 29 ==== osd_op_reply(82 gc.20 [create,call,call,call] v36'78 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.969 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.969+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0a0 con 0x5601b6f8dbe0 2024-09-11T11:04:48.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.969+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 30 ==== osd_op_reply(83 gc.21 [create,call,call,call] v36'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.972 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.969+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab0a0 con 0x5601b6f92c40 2024-09-11T11:04:48.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.973+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 18 ==== osd_op_reply(84 gc.22 [create,call,call,call] v36'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.973 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.973+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x5601b6f8dbe0 2024-09-11T11:04:48.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.973+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 31 ==== osd_op_reply(85 gc.23 [create,call,call,call] v36'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.976 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.973+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x5601b6f92c40 2024-09-11T11:04:48.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.977+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 19 ==== osd_op_reply(86 gc.24 [create,call,call,call] v36'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.978 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.977+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x5601b6f92c40 2024-09-11T11:04:48.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.977+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 20 ==== osd_op_reply(87 gc.25 [create,call,call,call] v36'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.979 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.977+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x5601b6f92c40 2024-09-11T11:04:48.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.981+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v36'35 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.982 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.981+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x5601b6f8dbe0 2024-09-11T11:04:48.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.985+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 32 ==== osd_op_reply(89 gc.27 [create,call,call,call] v36'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.985 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.985+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x5601b6f89730 2024-09-11T11:04:48.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.985+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 24 ==== osd_op_reply(90 gc.28 [create,call,call,call] v36'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.987 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.985+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x5601b6f8dbe0 2024-09-11T11:04:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.989+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 33 ==== osd_op_reply(91 gc.29 [create,call,call,call] v36'79 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:48.989 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.989+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x5601b6f89730 2024-09-11T11:04:48.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.989+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 25 ==== osd_op_reply(92 gc.30 [create,call,call,call] v36'64 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:48.991 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.989+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fab460 con 0x7fe354009040 2024-09-11T11:04:48.992 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.989+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 14 ==== osd_op_reply(93 gc.31 [create,call,call,call] v36'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x7fe354009040 2024-09-11T11:04:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe218fe1640 20 reqs_thread_entry: start 2024-09-11T11:04:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe365796980 20 init_complete bucket index max shards: 11 2024-09-11T11:04:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe365796980 20 Filter name: none 2024-09-11T11:04:48.993 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe1927fc640 20 reqs_thread_entry: start 2024-09-11T11:04:48.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-11T11:04:48.994 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:94 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f92c40 2024-09-11T11:04:48.995 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 22 ==== osd_op_reply(94 gc.2 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.996 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:95 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f92c40 2024-09-11T11:04:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 23 ==== osd_op_reply(95 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:96 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f92c40 2024-09-11T11:04:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 24 ==== osd_op_reply(96 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.997 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.993+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:97 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f92c40 2024-09-11T11:04:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 25 ==== osd_op_reply(97 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:98 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f92c40 2024-09-11T11:04:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 26 ==== osd_op_reply(98 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:48.998 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:99 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f92c40 2024-09-11T11:04:48.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 27 ==== osd_op_reply(99 gc.2 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:48.999 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-11T11:04:49.000 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:48.997+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:100 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f89730 2024-09-11T11:04:49.001 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 26 ==== osd_op_reply(100 gc.3 [call] v36'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.002 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:101 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f89730 2024-09-11T11:04:49.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 27 ==== osd_op_reply(101 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:102 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f89730 2024-09-11T11:04:49.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 28 ==== osd_op_reply(102 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f89730 2024-09-11T11:04:49.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 29 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.003 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f89730 2024-09-11T11:04:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 30 ==== osd_op_reply(104 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.004 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.001+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fc74a0 con 0x5601b6f89730 2024-09-11T11:04:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.005+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 31 ==== osd_op_reply(105 gc.3 [call] v36'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.005+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-11T11:04:49.006 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.005+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.005+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 34 ==== osd_op_reply(106 gc.4 [call] v36'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.008 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.005+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 35 ==== osd_op_reply(107 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.009 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 36 ==== osd_op_reply(108 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.010 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:109 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 37 ==== osd_op_reply(109 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.011 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:110 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 38 ==== osd_op_reply(110 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.012 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.009+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:111 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.013+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 39 ==== osd_op_reply(111 gc.4 [call] v36'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.013+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-11T11:04:49.014 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.013+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:112 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f92c40 2024-09-11T11:04:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.013+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 28 ==== osd_op_reply(112 gc.5 [call] v36'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.016 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.013+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:113 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f92c40 2024-09-11T11:04:49.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.013+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 29 ==== osd_op_reply(113 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.017 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.013+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.013+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:114 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f92c40 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 30 ==== osd_op_reply(114 gc.5 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:115 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f92c40 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 31 ==== osd_op_reply(115 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:116 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f92c40 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 32 ==== osd_op_reply(116 gc.5 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.018 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:117 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f92c40 2024-09-11T11:04:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 33 ==== osd_op_reply(117 gc.5 [call] v36'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-11T11:04:49.019 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.017+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:118 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.021 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 40 ==== osd_op_reply(118 gc.6 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:119 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 41 ==== osd_op_reply(119 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.022 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:120 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 42 ==== osd_op_reply(120 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.023 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:121 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 43 ==== osd_op_reply(121 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.024 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.021+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:122 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.025 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.025+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 44 ==== osd_op_reply(122 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.025+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.028 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.025+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:123 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f8dbe0 2024-09-11T11:04:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.025+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 45 ==== osd_op_reply(123 gc.6 [call] v36'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.025+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-11T11:04:49.029 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.025+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:124 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5410 con 0x5601b6f89730 2024-09-11T11:04:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 32 ==== osd_op_reply(124 gc.7 [call] v36'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.030 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:125 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa53c0 con 0x5601b6f89730 2024-09-11T11:04:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 33 ==== osd_op_reply(125 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.031 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:126 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f89730 2024-09-11T11:04:49.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 34 ==== osd_op_reply(126 gc.7 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.032 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:127 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f89730 2024-09-11T11:04:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 35 ==== osd_op_reply(127 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.029+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:128 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f89730 2024-09-11T11:04:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.033+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 36 ==== osd_op_reply(128 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c00a4d0 con 0x5601b6f89730 2024-09-11T11:04:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.033+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.033 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.033+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:129 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f89730 2024-09-11T11:04:49.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.033+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 37 ==== osd_op_reply(129 gc.7 [call] v36'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.033+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-11T11:04:49.036 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.033+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:130 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.037+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 46 ==== osd_op_reply(130 gc.8 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.037+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:131 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.039 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.037+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 47 ==== osd_op_reply(131 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.037+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.037+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:132 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.037+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 48 ==== osd_op_reply(132 gc.8 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.040 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.041+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:133 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.041 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.041+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 49 ==== osd_op_reply(133 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.041+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.041+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:134 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.041+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 50 ==== osd_op_reply(134 gc.8 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.042 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.041+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.043 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.041+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:135 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.045+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 51 ==== osd_op_reply(135 gc.8 [call] v36'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.045+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-11T11:04:49.045 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.045+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:136 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.048 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 52 ==== osd_op_reply(136 gc.9 [call] v36'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:137 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.049 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 53 ==== osd_op_reply(137 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:138 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 54 ==== osd_op_reply(138 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.050 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:139 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 55 ==== osd_op_reply(139 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.051 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:140 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 56 ==== osd_op_reply(140 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.052 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.053 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.049+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:141 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.053+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 57 ==== osd_op_reply(141 gc.9 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.053+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-11T11:04:49.055 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.053+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:142 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.057+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 58 ==== osd_op_reply(142 gc.10 [call] v36'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.057+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:143 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.058 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.057+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 59 ==== osd_op_reply(143 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.057+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.059 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.057+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:144 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.057+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 60 ==== osd_op_reply(144 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.057+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:145 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.060 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.057+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 61 ==== osd_op_reply(145 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.061+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.061+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:146 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.061 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.061+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 62 ==== osd_op_reply(146 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.061+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.062 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.061+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:147 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f8dbe0 2024-09-11T11:04:49.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 63 ==== osd_op_reply(147 gc.10 [call] v36'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-11T11:04:49.065 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:148 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f92c40 2024-09-11T11:04:49.067 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 34 ==== osd_op_reply(148 gc.11 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:149 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f92c40 2024-09-11T11:04:49.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 35 ==== osd_op_reply(149 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.068 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:150 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f92c40 2024-09-11T11:04:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 36 ==== osd_op_reply(150 gc.11 [call out=24b] v0'0 uv43 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.065+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:151 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f92c40 2024-09-11T11:04:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 37 ==== osd_op_reply(151 gc.11 [call out=15b] v0'0 uv43 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.069 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:152 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5370 con 0x5601b6f92c40 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 38 ==== osd_op_reply(152 gc.11 [call out=1715b] v0'0 uv43 ondisk = 0) ==== 149+0+1715 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 20 garbage collection: RGWGC::process iterating over entry tag='27698d38-fc40-410e-96d8-191ffc71147c.4235.8186926313393037718', time=2024-09-11T11:04:32.359176+0000, chain.objs.size()=7 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_1 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:153 3.26 3:66ae38f4:::27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5cb0 con 0x7fe354009040 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_2 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:154 3.10 3:0a118d0b:::27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fca980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_3 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:155 3.6 3:63d5d316:::27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fca980 con 0x5601b6f89730 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_4 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:156 3.32 3:4f714903:::27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fcf880 con 0x5601b6f92c40 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_5 2024-09-11T11:04:49.071 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:157 3.10 3:0a83b5c2:::27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd21f0 con 0x5601b6f8dbe0 2024-09-11T11:04:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_6 2024-09-11T11:04:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:158 3.19 3:9bec48a4:::27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd4a60 con 0x5601b6f89730 2024-09-11T11:04:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_7 2024-09-11T11:04:49.072 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.069+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:159 3.32 3:4fd99f19:::27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd72d0 con 0x5601b6f92c40 2024-09-11T11:04:49.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.073+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 38 ==== osd_op_reply(158 27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_6 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.075 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.073+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 39 ==== osd_op_reply(156 27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_4 [call] v36'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.076 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.073+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 15 ==== osd_op_reply(153 27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_1 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.077 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.077+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 39 ==== osd_op_reply(155 27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_3 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.077+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 64 ==== osd_op_reply(154 27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_2 [call] v36'5 uv5 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.077+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 40 ==== osd_op_reply(159 27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_7 [call] v36'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.077+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 65 ==== osd_op_reply(157 27698d38-fc40-410e-96d8-191ffc71147c.4235.11__shadow_.myDX6-FzssS9t2rHvMPXCoMq73JU84F_5 [call] v36'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.077+0000 7fe365796980 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-11T11:04:49.078 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.077+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:160 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5800 con 0x5601b6f92c40 2024-09-11T11:04:49.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.077+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 41 ==== osd_op_reply(160 gc.11 [call] v36'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.080 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.077+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:161 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5790 con 0x5601b6f92c40 2024-09-11T11:04:49.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.081+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 42 ==== osd_op_reply(161 gc.11 [call] v36'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.081+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-11T11:04:49.083 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.081+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:162 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5790 con 0x5601b6f8dbe0 2024-09-11T11:04:49.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 66 ==== osd_op_reply(162 gc.12 [call] v36'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.085 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:163 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5790 con 0x5601b6f8dbe0 2024-09-11T11:04:49.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 67 ==== osd_op_reply(163 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.086 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:164 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd0d30 con 0x5601b6f8dbe0 2024-09-11T11:04:49.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 68 ==== osd_op_reply(164 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.087 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:165 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5760 con 0x5601b6f8dbe0 2024-09-11T11:04:49.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 69 ==== osd_op_reply(165 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.088 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.085+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:166 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.089+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 70 ==== osd_op_reply(166 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.089+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.089 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.089+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:167 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.089+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 71 ==== osd_op_reply(167 gc.12 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.089+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-11T11:04:49.092 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.089+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:168 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 40 ==== osd_op_reply(168 gc.13 [call] v36'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.094 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:169 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 41 ==== osd_op_reply(169 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.095 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:170 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 42 ==== osd_op_reply(170 gc.13 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:171 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 43 ==== osd_op_reply(171 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.096 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.093+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:172 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.097+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 44 ==== osd_op_reply(172 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.097+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.097 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.097+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:173 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.097+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 45 ==== osd_op_reply(173 gc.13 [call] v36'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.097+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-11T11:04:49.099 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.097+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:174 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 46 ==== osd_op_reply(174 gc.14 [call] v36'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.102 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:175 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 47 ==== osd_op_reply(175 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:176 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.103 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 48 ==== osd_op_reply(176 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:177 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 49 ==== osd_op_reply(177 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.104 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.101+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:178 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.105+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 50 ==== osd_op_reply(178 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.105+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.105 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.105+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:179 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.105+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 51 ==== osd_op_reply(179 gc.14 [call] v36'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.105+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-11T11:04:49.108 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.105+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:180 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.109+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 72 ==== osd_op_reply(180 gc.15 [call] v36'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.111 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.109+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:181 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.109+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 73 ==== osd_op_reply(181 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.109+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.112 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.109+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:182 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.113+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 74 ==== osd_op_reply(182 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.113 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.113+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:183 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.113+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 75 ==== osd_op_reply(183 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.114 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.113+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.115 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.113+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:184 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.113+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 76 ==== osd_op_reply(184 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.113+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.116 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.113+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:185 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.117+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 77 ==== osd_op_reply(185 gc.15 [call] v36'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.117+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-11T11:04:49.119 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.117+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:186 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.121+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 78 ==== osd_op_reply(186 gc.16 [call] v36'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.122 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.121+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:187 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.121+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 79 ==== osd_op_reply(187 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.121+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.123 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.121+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:188 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.121+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 80 ==== osd_op_reply(188 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.124 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.121+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:189 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.125+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 81 ==== osd_op_reply(189 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.125+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.125 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.125+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:190 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.125+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 82 ==== osd_op_reply(190 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.126 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.125+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.127 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.125+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:191 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.129+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 83 ==== osd_op_reply(191 gc.16 [call] v36'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.129 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.129+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-11T11:04:49.130 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.129+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:192 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.132 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.129+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 43 ==== osd_op_reply(192 gc.17 [call] v36'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:193 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 44 ==== osd_op_reply(193 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.133 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:194 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 45 ==== osd_op_reply(194 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.134 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:195 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 46 ==== osd_op_reply(195 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:196 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 47 ==== osd_op_reply(196 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.135 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.133+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:197 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.137 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.137+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 48 ==== osd_op_reply(197 gc.17 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.137+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-11T11:04:49.138 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.137+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:198 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.137+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 84 ==== osd_op_reply(198 gc.18 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.140 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.137+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:199 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 85 ==== osd_op_reply(199 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.141 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:200 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 86 ==== osd_op_reply(200 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.142 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:201 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 87 ==== osd_op_reply(201 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.143 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:202 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 88 ==== osd_op_reply(202 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.144 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.141+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:203 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.145+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 89 ==== osd_op_reply(203 gc.18 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.145+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-11T11:04:49.147 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.145+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:204 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 52 ==== osd_op_reply(204 gc.19 [call] v36'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.150 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:205 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 53 ==== osd_op_reply(205 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:206 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 54 ==== osd_op_reply(206 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.151 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:207 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 55 ==== osd_op_reply(207 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.152 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.149+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:208 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.153+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 56 ==== osd_op_reply(208 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.153+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.153 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.153+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:209 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.155 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.153+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 57 ==== osd_op_reply(209 gc.19 [call] v36'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.153+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-11T11:04:49.156 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.153+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:210 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.157+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 90 ==== osd_op_reply(210 gc.20 [call] v36'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.159 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.157+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:211 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.157+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 91 ==== osd_op_reply(211 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.157+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.160 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.157+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:212 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.161+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 92 ==== osd_op_reply(212 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.161 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.161+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:213 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.161+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 93 ==== osd_op_reply(213 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.162 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.161+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.161+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:214 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.163 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.161+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 94 ==== osd_op_reply(214 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.161+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.164 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.161+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:215 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.165+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 95 ==== osd_op_reply(215 gc.20 [call] v36'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.165+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-11T11:04:49.167 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.165+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:216 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.169+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 96 ==== osd_op_reply(216 gc.21 [call] v36'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.171 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.169+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:217 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.169+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 97 ==== osd_op_reply(217 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.169+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.172 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.169+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:218 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.173+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 98 ==== osd_op_reply(218 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.173 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.173+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:219 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.173+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 99 ==== osd_op_reply(219 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.173+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.174 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.173+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:220 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.173+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 100 ==== osd_op_reply(220 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.173+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.175 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.173+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:221 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.178 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.177+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 101 ==== osd_op_reply(221 gc.21 [call] v36'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.177+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-11T11:04:49.179 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.177+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:222 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.181 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 49 ==== osd_op_reply(222 gc.22 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:223 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 50 ==== osd_op_reply(223 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.182 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:224 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 51 ==== osd_op_reply(224 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.183 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:225 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 52 ==== osd_op_reply(225 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:226 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.184 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 53 ==== osd_op_reply(226 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.185 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.181+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:227 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.185+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 54 ==== osd_op_reply(227 gc.22 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.185+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-11T11:04:49.187 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.185+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:228 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.189+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 102 ==== osd_op_reply(228 gc.23 [call] v36'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.189+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:229 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.190 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.189+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 103 ==== osd_op_reply(229 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.189+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.189+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:230 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.189+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 104 ==== osd_op_reply(230 gc.23 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.191 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.189+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:231 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.189+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 105 ==== osd_op_reply(231 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.193+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.193 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.193+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:232 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.193+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 106 ==== osd_op_reply(232 gc.23 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.193+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.194 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.193+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:233 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.197+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 107 ==== osd_op_reply(233 gc.23 [call] v36'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.197+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-11T11:04:49.197 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.197+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:234 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.197+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 55 ==== osd_op_reply(234 gc.24 [call] v36'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.200 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.197+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:235 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 56 ==== osd_op_reply(235 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:236 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 57 ==== osd_op_reply(236 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.201 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:237 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 58 ==== osd_op_reply(237 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.202 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:238 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 59 ==== osd_op_reply(238 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.203 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.201+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:239 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.205 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.205+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 60 ==== osd_op_reply(239 gc.24 [call] v36'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.205+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-11T11:04:49.206 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.205+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:240 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.205+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 61 ==== osd_op_reply(240 gc.25 [call] v36'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.208 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.205+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:241 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 62 ==== osd_op_reply(241 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.209 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:242 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 63 ==== osd_op_reply(242 gc.25 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:243 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 64 ==== osd_op_reply(243 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.210 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:244 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 65 ==== osd_op_reply(244 gc.25 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.211 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.209+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:245 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.213+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 66 ==== osd_op_reply(245 gc.25 [call] v36'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.213+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-11T11:04:49.213 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.213+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:246 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.213+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 67 ==== osd_op_reply(246 gc.26 [call] v36'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.216 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.213+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:247 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 68 ==== osd_op_reply(247 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.217 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:248 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 69 ==== osd_op_reply(248 gc.26 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:249 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.218 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 70 ==== osd_op_reply(249 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:250 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 71 ==== osd_op_reply(250 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.219 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.217+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:251 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f92c40 2024-09-11T11:04:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.221+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 72 ==== osd_op_reply(251 gc.26 [call] v36'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.221+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-11T11:04:49.222 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.221+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:252 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 108 ==== osd_op_reply(252 gc.27 [call] v36'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.225 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:253 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 109 ==== osd_op_reply(253 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.226 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:254 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 110 ==== osd_op_reply(254 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.227 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:255 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 111 ==== osd_op_reply(255 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.228 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.225+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:256 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.229 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.229+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 112 ==== osd_op_reply(256 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.229+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.230 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.229+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:257 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f8dbe0 2024-09-11T11:04:49.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.233+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 113 ==== osd_op_reply(257 gc.27 [call] v36'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.233+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-11T11:04:49.233 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.233+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:258 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fa5600 con 0x5601b6f89730 2024-09-11T11:04:49.236 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.233+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 58 ==== osd_op_reply(258 gc.28 [call] v36'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:259 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.237 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 59 ==== osd_op_reply(259 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:260 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1db0 con 0x5601b6f89730 2024-09-11T11:04:49.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 60 ==== osd_op_reply(260 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.238 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:261 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 61 ==== osd_op_reply(261 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.239 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:262 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 62 ==== osd_op_reply(262 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.240 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.237+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:263 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.241+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 63 ==== osd_op_reply(263 gc.28 [call] v36'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.241+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-11T11:04:49.243 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.241+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:264 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.245+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 114 ==== osd_op_reply(264 gc.29 [call] v36'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.246 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.245+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:265 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.245+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 115 ==== osd_op_reply(265 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.245+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.247 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.245+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:266 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1d70 con 0x5601b6f8dbe0 2024-09-11T11:04:49.248 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.245+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 116 ==== osd_op_reply(266 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.249 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.249+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:267 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.249+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 117 ==== osd_op_reply(267 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.249+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.250 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.249+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:268 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.249+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 118 ==== osd_op_reply(268 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.249+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.251 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.249+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:269 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.253+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 119 ==== osd_op_reply(269 gc.29 [call] v36'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.253+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-11T11:04:49.254 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.253+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:270 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 64 ==== osd_op_reply(270 gc.30 [call] v36'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.257 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:271 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 65 ==== osd_op_reply(271 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.258 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:272 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1dd0 con 0x5601b6f89730 2024-09-11T11:04:49.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 66 ==== osd_op_reply(272 gc.30 [call out=24b] v0'0 uv67 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:273 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 67 ==== osd_op_reply(273 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.259 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:274 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 68 ==== osd_op_reply(274 gc.30 [call out=15b] v0'0 uv67 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.260 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.257+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:275 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f89730 2024-09-11T11:04:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.261+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 69 ==== osd_op_reply(275 gc.30 [call] v36'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.261+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-11T11:04:49.263 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.261+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:276 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.265 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 16 ==== osd_op_reply(276 gc.31 [call] v36'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:277 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 17 ==== osd_op_reply(277 gc.31 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.266 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:278 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1dd0 con 0x7fe354009040 2024-09-11T11:04:49.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 18 ==== osd_op_reply(278 gc.31 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.267 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:279 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 19 ==== osd_op_reply(279 gc.31 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.268 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.265+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:280 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.269+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 20 ==== osd_op_reply(280 gc.31 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.269+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.269 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.269+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:281 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.271 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.269+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 21 ==== osd_op_reply(281 gc.31 [call] v36'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.269+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-11T11:04:49.272 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.269+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:282 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.273+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 120 ==== osd_op_reply(282 gc.0 [call] v36'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.274 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.273+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:283 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.273+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 121 ==== osd_op_reply(283 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.275 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.273+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.273+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:284 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1d80 con 0x5601b6f8dbe0 2024-09-11T11:04:49.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.273+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 122 ==== osd_op_reply(284 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.276 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.273+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:285 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.277+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 123 ==== osd_op_reply(285 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.277 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.277+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.277+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:286 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.277+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 124 ==== osd_op_reply(286 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.278 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.277+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.279 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.277+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:287 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x5601b6f8dbe0 2024-09-11T11:04:49.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.281+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 125 ==== osd_op_reply(287 gc.0 [call] v36'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.281 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.281+0000 7fe365796980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-11T11:04:49.282 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.281+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:288 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.281+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 22 ==== osd_op_reply(288 gc.1 [call] v36'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.284 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.281+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:289 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 23 ==== osd_op_reply(289 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.285 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:290 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1d70 con 0x7fe354009040 2024-09-11T11:04:49.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 24 ==== osd_op_reply(290 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:291 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 25 ==== osd_op_reply(291 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.286 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-11T11:04:49.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:292 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 26 ==== osd_op_reply(292 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe365796980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-11T11:04:49.287 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.285+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:293 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1980 con 0x7fe354009040 2024-09-11T11:04:49.290 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.289+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 27 ==== osd_op_reply(293 gc.1 [call] v36'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.289+0000 7fe219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-11T11:04:49.292 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.289+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94565364780624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6fd1d70 con 0x5601b6f89730 2024-09-11T11:04:49.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.293+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 70 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94565364780624] v36'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.295 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.293+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94565364759552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9ce50 con 0x5601b6f8dbe0 2024-09-11T11:04:49.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.297+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 126 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94565364759552] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.297+0000 7fe365796980 20 remove_watcher() i=0 2024-09-11T11:04:49.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.297+0000 7fe365796980 2 removed watcher, disabling cache 2024-09-11T11:04:49.298 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.297+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94565364763808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9ce50 con 0x5601b6f89730 2024-09-11T11:04:49.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.297+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.1 v2:172.21.15.145:6808/1879781812 71 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94565364763808] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x5601b6f89730 2024-09-11T11:04:49.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.297+0000 7fe365796980 20 remove_watcher() i=1 2024-09-11T11:04:49.300 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.297+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94565364766112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9ce50 con 0x5601b6f8dbe0 2024-09-11T11:04:49.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.301+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 127 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94565364766112] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.301+0000 7fe365796980 20 remove_watcher() i=2 2024-09-11T11:04:49.303 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.301+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94565364757072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f995a0 con 0x7fe354009040 2024-09-11T11:04:49.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.305+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 28 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94565364757072] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.305+0000 7fe365796980 20 remove_watcher() i=3 2024-09-11T11:04:49.305 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.305+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94565364771088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9ce50 con 0x5601b6f8dbe0 2024-09-11T11:04:49.307 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.305+0000 7fe3632a6640 1 -- 172.21.15.145:0/2341111719 <== osd.0 v2:172.21.15.102:6800/3035634142 128 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94565364771088] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe3540f8070 con 0x5601b6f8dbe0 2024-09-11T11:04:49.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.305+0000 7fe365796980 20 remove_watcher() i=4 2024-09-11T11:04:49.308 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.305+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94565364767680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f995a0 con 0x5601b6f92c40 2024-09-11T11:04:49.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.309+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 73 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94565364767680] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.309+0000 7fe365796980 20 remove_watcher() i=5 2024-09-11T11:04:49.310 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.309+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94565364772656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9a910 con 0x5601b6f92c40 2024-09-11T11:04:49.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.309+0000 7fe362aa5640 1 -- 172.21.15.145:0/2341111719 <== osd.3 v2:172.21.15.145:6800/493661776 74 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94565364772656] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe358036040 con 0x5601b6f92c40 2024-09-11T11:04:49.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.309+0000 7fe365796980 20 remove_watcher() i=6 2024-09-11T11:04:49.312 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.309+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94565364778352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36) -- 0x5601b6f9ce50 con 0x7fe354009040 2024-09-11T11:04:49.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 <== osd.2 v2:172.21.15.145:6816/446921044 29 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94565364778352] v36'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe35c045040 con 0x7fe354009040 2024-09-11T11:04:49.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 20 remove_watcher() i=7 2024-09-11T11:04:49.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f8dbe0 msgr2=0x5601b6f8ffd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f8dbe0 0x5601b6f8ffd0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6f89730 msgr2=0x5601b6f8bbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6f89730 0x5601b6f8bbf0 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.315 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe354009040 msgr2=0x7fe3540c7590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7fe354009040 0x7fe3540c7590 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5601b6f92c40 msgr2=0x5601b6f95030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x5601b6f92c40 0x5601b6f95030 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe22c034650 msgr2=0x7fe22c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe22c034650 0x7fe22c036b10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x5601b6f594b0 tx=0x7fe358011000 comp rx=0 tx=0).stop 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 msgr2=0x5601b6f7e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/2341111719 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f77550 0x5601b6f7e7b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fe3540f3000 tx=0x7fe3540c5a80 comp rx=0 tx=0).stop 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe363aa7640 1 -- 172.21.15.145:0/2341111719 reap_dead start 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 shutdown_connections 2024-09-11T11:04:49.316 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 >> 172.21.15.145:0/2341111719 conn(0x5601b6f73980 msgr2=0x5601b6f71a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:49.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 shutdown_connections 2024-09-11T11:04:49.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/2341111719 wait complete. 2024-09-11T11:04:49.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/655894055 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe23c034650 msgr2=0x7fe23c036b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/655894055 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe23c034650 0x7fe23c036b10 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x5601b6f51450 tx=0x7fe358006000 comp rx=0 tx=0).stop 2024-09-11T11:04:49.318 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/655894055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f6ac00 msgr2=0x5601b6f6b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/655894055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f6ac00 0x5601b6f6b020 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe3540e3730 tx=0x7fe3540c5e20 comp rx=0 tx=0).stop 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/655894055 shutdown_connections 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/655894055 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe23c034650 0x7fe23c036b10 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 --2- 172.21.15.145:0/655894055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6f6ac00 0x5601b6f6b020 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/655894055 >> 172.21.15.145:0/655894055 conn(0x5601b6f5fd50 msgr2=0x5601b6f627d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/655894055 shutdown_connections 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.313+0000 7fe365796980 1 -- 172.21.15.145:0/655894055 wait complete. 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f55260 msgr2=0x5601b6f57650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x5601b6f55260 0x5601b6f57650 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6e5dcb0 msgr2=0x5601b6f53e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x5601b6e5dcb0 0x5601b6f53e50 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5601b6f5a910 msgr2=0x5601b6f5cd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.319 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x5601b6f5a910 0x5601b6f5cd00 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe2480346a0 msgr2=0x7fe248036b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fe2480346a0 0x7fe248036b60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe358001e20 tx=0x7fe3580013a0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 msgr2=0x5601b6f4ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 --2- 172.21.15.145:0/1931095839 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5601b6dccac0 0x5601b6f4ce60 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe35401b170 tx=0x7fe3540180e0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe363aa7640 1 -- 172.21.15.145:0/1931095839 reap_dead start 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 shutdown_connections 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 >> 172.21.15.145:0/1931095839 conn(0x5601b6e53060 msgr2=0x5601b6f403d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 shutdown_connections 2024-09-11T11:04:49.320 INFO:teuthology.orchestra.run.smithi145.stderr:2024-09-11T11:04:49.317+0000 7fe365796980 1 -- 172.21.15.145:0/1931095839 wait complete. 2024-09-11T11:04:49.333 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T11:04:49.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T11:04:49.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:04:49.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf9ba00640 1 Processor -- start 2024-09-11T11:04:49.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf9ba00640 1 -- start start 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf9ba00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdf9406d0e0 0x7fdf9406d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf9ba00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf94071c10 con 0x7fdf9406da00 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf9ba00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdf94072230 con 0x7fdf9406d0e0 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf9979c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdf9406d0e0 0x7fdf9406d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf98f9b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fdf9406da00 0x7fdf9412ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50584/0 (socket says 172.21.15.102:50584) 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf98f9b640 1 -- 172.21.15.102:0/1349026903 learned_addr learned my addr 172.21.15.102:0/1349026903 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf9979c640 1 -- 172.21.15.102:0/1349026903 >> v1:172.21.15.102:6789/0 conn(0x7fdf9406da00 legacy=0x7fdf9412ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf9979c640 1 -- 172.21.15.102:0/1349026903 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf940709e0 con 0x7fdf9406d0e0 2024-09-11T11:04:49.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.475+0000 7fdf8bfff640 1 -- 172.21.15.102:0/1349026903 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282823017 0 0) 0x7fdf94071c10 con 0x7fdf9406da00 2024-09-11T11:04:49.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9979c640 1 --2- 172.21.15.102:0/1349026903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf9406d4c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009740 tx=0x7fdf8c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79b6dc49c1c11d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:49.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf8bfff640 1 -- 172.21.15.102:0/1349026903 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8c0b0070 con 0x7fdf9406d0e0 2024-09-11T11:04:49.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf8bfff640 1 -- 172.21.15.102:0/1349026903 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0ab530 con 0x7fdf9406d0e0 2024-09-11T11:04:49.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf8bfff640 1 -- 172.21.15.102:0/1349026903 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8c0ab830 con 0x7fdf9406d0e0 2024-09-11T11:04:49.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 -- 172.21.15.102:0/1349026903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 msgr2=0x7fdf9406d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 --2- 172.21.15.102:0/1349026903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf9406d4c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009740 tx=0x7fdf8c01c370 comp rx=0 tx=0).stop 2024-09-11T11:04:49.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 -- 172.21.15.102:0/1349026903 shutdown_connections 2024-09-11T11:04:49.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 --2- 172.21.15.102:0/1349026903 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf9406d4c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 -- 172.21.15.102:0/1349026903 >> 172.21.15.102:0/1349026903 conn(0x7fdf94099a50 msgr2=0x7fdf940972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:49.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 -- 172.21.15.102:0/1349026903 shutdown_connections 2024-09-11T11:04:49.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 -- 172.21.15.102:0/1349026903 wait complete. 2024-09-11T11:04:49.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 Processor -- start 2024-09-11T11:04:49.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 -- start start 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf94127980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9ba00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdf94134e80 con 0x7fdf9406d0e0 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9979c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf94127980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9979c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf94127980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48558/0 (socket says 172.21.15.102:48558) 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9979c640 1 -- 172.21.15.102:0/814807473 learned_addr learned my addr 172.21.15.102:0/814807473 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9979c640 1 -- 172.21.15.102:0/814807473 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf94072710 con 0x7fdf9406d0e0 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.479+0000 7fdf9979c640 1 --2- 172.21.15.102:0/814807473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf94127980 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c019fa0 tx=0x7fdf8c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf89ffb640 1 -- 172.21.15.102:0/814807473 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8c0b0050 con 0x7fdf9406d0e0 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf89ffb640 1 -- 172.21.15.102:0/814807473 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0b1040 con 0x7fdf9406d0e0 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf94129ed0 con 0x7fdf9406d0e0 2024-09-11T11:04:49.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf89ffb640 1 -- 172.21.15.102:0/814807473 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8c0b5740 con 0x7fdf9406d0e0 2024-09-11T11:04:49.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf9412a560 con 0x7fdf9406d0e0 2024-09-11T11:04:49.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf89ffb640 1 -- 172.21.15.102:0/814807473 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fdf8c0be030 con 0x7fdf9406d0e0 2024-09-11T11:04:49.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf9406d4c0 con 0x7fdf9406d0e0 2024-09-11T11:04:49.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf89ffb640 1 --2- 172.21.15.102:0/814807473 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf80035db0 0x7fdf80038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:49.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf89ffb640 1 -- 172.21.15.102:0/814807473 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fdf8c0bc070 con 0x7fdf9406d0e0 2024-09-11T11:04:49.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf98f9b640 1 --2- 172.21.15.102:0/814807473 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf80035db0 0x7fdf80038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:49.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.483+0000 7fdf98f9b640 1 --2- 172.21.15.102:0/814807473 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf80035db0 0x7fdf80038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdf90000f90 tx=0x7fdf900016c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:49.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.487+0000 7fdf89ffb640 1 -- 172.21.15.102:0/814807473 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdf8c0c5020 con 0x7fdf9406d0e0 2024-09-11T11:04:49.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.643+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdf94129260 con 0x7fdf80035db0 2024-09-11T11:04:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.779+0000 7fdf89ffb640 1 -- 172.21.15.102:0/814807473 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665564 (secure 0 0 0) 0x7fdf94129260 con 0x7fdf80035db0 2024-09-11T11:04:49.788 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:04:49.794 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:04:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf80035db0 msgr2=0x7fdf80038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 --2- 172.21.15.102:0/814807473 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf80035db0 0x7fdf80038270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdf90000f90 tx=0x7fdf900016c0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 msgr2=0x7fdf94127980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 --2- 172.21.15.102:0/814807473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf94127980 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c019fa0 tx=0x7fdf8c01abb0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 shutdown_connections 2024-09-11T11:04:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 --2- 172.21.15.102:0/814807473 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fdf80035db0 0x7fdf80038270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 --2- 172.21.15.102:0/814807473 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdf9406d0e0 0x7fdf94127980 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 >> 172.21.15.102:0/814807473 conn(0x7fdf94099a50 msgr2=0x7fdf94131c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 shutdown_connections 2024-09-11T11:04:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.787+0000 7fdf9ba00640 1 -- 172.21.15.102:0/814807473 wait complete. 2024-09-11T11:04:49.813 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-11T11:04:49.048110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412808,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4874,"num_read_kb":4455,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":207248,"kb_used_data":53392,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377280112,"statfs":{"total":386547056640,"available":386334834688,"internally_reserved":0,"allocated":54673408,"data_stored":53417624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006488"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129252+0000","last_change":"2024-09-11T11:01:03.337877+0000","last_active":"2024-09-11T11:02:42.129252+0000","last_peered":"2024-09-11T11:02:42.129252+0000","last_clean":"2024-09-11T11:02:42.129252+0000","last_became_active":"2024-09-11T11:01:03.336333+0000","last_became_peered":"2024-09-11T11:01:03.336333+0000","last_unstale":"2024-09-11T11:02:42.129252+0000","last_undegraded":"2024-09-11T11:02:42.129252+0000","last_fullsized":"2024-09-11T11:02:42.129252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:39.536350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573739+0000","last_change":"2024-09-11T11:01:05.334117+0000","last_active":"2024-09-11T11:04:17.573739+0000","last_peered":"2024-09-11T11:04:17.573739+0000","last_clean":"2024-09-11T11:04:17.573739+0000","last_became_active":"2024-09-11T11:01:05.332897+0000","last_became_peered":"2024-09-11T11:01:05.332897+0000","last_unstale":"2024-09-11T11:04:17.573739+0000","last_undegraded":"2024-09-11T11:04:17.573739+0000","last_fullsized":"2024-09-11T11:04:17.573739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:30.170950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845264+0000","last_change":"2024-09-11T11:01:03.346417+0000","last_active":"2024-09-11T11:02:42.845264+0000","last_peered":"2024-09-11T11:02:42.845264+0000","last_clean":"2024-09-11T11:02:42.845264+0000","last_became_active":"2024-09-11T11:01:03.346113+0000","last_became_peered":"2024-09-11T11:01:03.346113+0000","last_unstale":"2024-09-11T11:02:42.845264+0000","last_undegraded":"2024-09-11T11:02:42.845264+0000","last_fullsized":"2024-09-11T11:02:42.845264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:42.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836745+0000","last_change":"2024-09-11T11:01:05.333693+0000","last_active":"2024-09-11T11:03:16.836745+0000","last_peered":"2024-09-11T11:03:16.836745+0000","last_clean":"2024-09-11T11:03:16.836745+0000","last_became_active":"2024-09-11T11:01:05.330885+0000","last_became_peered":"2024-09-11T11:01:05.330885+0000","last_unstale":"2024-09-11T11:03:16.836745+0000","last_undegraded":"2024-09-11T11:03:16.836745+0000","last_fullsized":"2024-09-11T11:03:16.836745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:17:27.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112814+0000","last_change":"2024-09-11T11:01:03.346111+0000","last_active":"2024-09-11T11:02:42.112814+0000","last_peered":"2024-09-11T11:02:42.112814+0000","last_clean":"2024-09-11T11:02:42.112814+0000","last_became_active":"2024-09-11T11:01:03.345673+0000","last_became_peered":"2024-09-11T11:01:03.345673+0000","last_unstale":"2024-09-11T11:02:42.112814+0000","last_undegraded":"2024-09-11T11:02:42.112814+0000","last_fullsized":"2024-09-11T11:02:42.112814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:11.883100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.436815+0000","last_change":"2024-09-11T11:01:05.331041+0000","last_active":"2024-09-11T11:04:17.436815+0000","last_peered":"2024-09-11T11:04:17.436815+0000","last_clean":"2024-09-11T11:04:17.436815+0000","last_became_active":"2024-09-11T11:01:05.330639+0000","last_became_peered":"2024-09-11T11:01:05.330639+0000","last_unstale":"2024-09-11T11:04:17.436815+0000","last_undegraded":"2024-09-11T11:04:17.436815+0000","last_fullsized":"2024-09-11T11:04:17.436815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:51.046871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.721051+0000","last_change":"2024-09-11T11:01:03.335434+0000","last_active":"2024-09-11T11:03:16.721051+0000","last_peered":"2024-09-11T11:03:16.721051+0000","last_clean":"2024-09-11T11:03:16.721051+0000","last_became_active":"2024-09-11T11:01:03.335132+0000","last_became_peered":"2024-09-11T11:01:03.335132+0000","last_unstale":"2024-09-11T11:03:16.721051+0000","last_undegraded":"2024-09-11T11:03:16.721051+0000","last_fullsized":"2024-09-11T11:03:16.721051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:27.769400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573787+0000","last_change":"2024-09-11T11:01:05.344140+0000","last_active":"2024-09-11T11:04:17.573787+0000","last_peered":"2024-09-11T11:04:17.573787+0000","last_clean":"2024-09-11T11:04:17.573787+0000","last_became_active":"2024-09-11T11:01:05.339018+0000","last_became_peered":"2024-09-11T11:01:05.339018+0000","last_unstale":"2024-09-11T11:04:17.573787+0000","last_undegraded":"2024-09-11T11:04:17.573787+0000","last_fullsized":"2024-09-11T11:04:17.573787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:03.791497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124006+0000","last_change":"2024-09-11T11:01:03.324287+0000","last_active":"2024-09-11T11:02:42.124006+0000","last_peered":"2024-09-11T11:02:42.124006+0000","last_clean":"2024-09-11T11:02:42.124006+0000","last_became_active":"2024-09-11T11:01:03.322877+0000","last_became_peered":"2024-09-11T11:01:03.322877+0000","last_unstale":"2024-09-11T11:02:42.124006+0000","last_undegraded":"2024-09-11T11:02:42.124006+0000","last_fullsized":"2024-09-11T11:02:42.124006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:03.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'7","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.837597+0000","last_change":"2024-09-11T11:01:05.354323+0000","last_active":"2024-09-11T11:03:16.837597+0000","last_peered":"2024-09-11T11:03:16.837597+0000","last_clean":"2024-09-11T11:03:16.837597+0000","last_became_active":"2024-09-11T11:01:05.353908+0000","last_became_peered":"2024-09-11T11:01:05.353908+0000","last_unstale":"2024-09-11T11:03:16.837597+0000","last_undegraded":"2024-09-11T11:03:16.837597+0000","last_fullsized":"2024-09-11T11:03:16.837597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:11:14.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124871+0000","last_change":"2024-09-11T11:01:03.346652+0000","last_active":"2024-09-11T11:02:42.124871+0000","last_peered":"2024-09-11T11:02:42.124871+0000","last_clean":"2024-09-11T11:02:42.124871+0000","last_became_active":"2024-09-11T11:01:03.345964+0000","last_became_peered":"2024-09-11T11:01:03.345964+0000","last_unstale":"2024-09-11T11:02:42.124871+0000","last_undegraded":"2024-09-11T11:02:42.124871+0000","last_fullsized":"2024-09-11T11:02:42.124871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:12.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'14","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921127+0000","last_change":"2024-09-11T11:01:05.346892+0000","last_active":"2024-09-11T11:04:17.921127+0000","last_peered":"2024-09-11T11:04:17.921127+0000","last_clean":"2024-09-11T11:04:17.921127+0000","last_became_active":"2024-09-11T11:01:05.345664+0000","last_became_peered":"2024-09-11T11:01:05.345664+0000","last_unstale":"2024-09-11T11:04:17.921127+0000","last_undegraded":"2024-09-11T11:04:17.921127+0000","last_fullsized":"2024-09-11T11:04:17.921127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:15.826673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110283+0000","last_change":"2024-09-11T11:01:03.349146+0000","last_active":"2024-09-11T11:02:42.110283+0000","last_peered":"2024-09-11T11:02:42.110283+0000","last_clean":"2024-09-11T11:02:42.110283+0000","last_became_active":"2024-09-11T11:01:03.348822+0000","last_became_peered":"2024-09-11T11:01:03.348822+0000","last_unstale":"2024-09-11T11:02:42.110283+0000","last_undegraded":"2024-09-11T11:02:42.110283+0000","last_fullsized":"2024-09-11T11:02:42.110283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:25.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127393+0000","last_change":"2024-09-11T11:01:05.347306+0000","last_active":"2024-09-11T11:02:42.127393+0000","last_peered":"2024-09-11T11:02:42.127393+0000","last_clean":"2024-09-11T11:02:42.127393+0000","last_became_active":"2024-09-11T11:01:05.345698+0000","last_became_peered":"2024-09-11T11:01:05.345698+0000","last_unstale":"2024-09-11T11:02:42.127393+0000","last_undegraded":"2024-09-11T11:02:42.127393+0000","last_fullsized":"2024-09-11T11:02:42.127393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:41:08.367843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.750645+0000","last_change":"2024-09-11T11:01:03.336343+0000","last_active":"2024-09-11T11:03:12.750645+0000","last_peered":"2024-09-11T11:03:12.750645+0000","last_clean":"2024-09-11T11:03:12.750645+0000","last_became_active":"2024-09-11T11:01:03.335830+0000","last_became_peered":"2024-09-11T11:01:03.335830+0000","last_unstale":"2024-09-11T11:03:12.750645+0000","last_undegraded":"2024-09-11T11:03:12.750645+0000","last_fullsized":"2024-09-11T11:03:12.750645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:12:21.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.021931+0000","last_change":"2024-09-11T11:01:05.344202+0000","last_active":"2024-09-11T11:04:18.021931+0000","last_peered":"2024-09-11T11:04:18.021931+0000","last_clean":"2024-09-11T11:04:18.021931+0000","last_became_active":"2024-09-11T11:01:05.343805+0000","last_became_peered":"2024-09-11T11:01:05.343805+0000","last_unstale":"2024-09-11T11:04:18.021931+0000","last_undegraded":"2024-09-11T11:04:18.021931+0000","last_fullsized":"2024-09-11T11:04:18.021931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:37:30.179996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122512+0000","last_change":"2024-09-11T11:01:05.333623+0000","last_active":"2024-09-11T11:02:42.122512+0000","last_peered":"2024-09-11T11:02:42.122512+0000","last_clean":"2024-09-11T11:02:42.122512+0000","last_became_active":"2024-09-11T11:01:05.332915+0000","last_became_peered":"2024-09-11T11:01:05.332915+0000","last_unstale":"2024-09-11T11:02:42.122512+0000","last_undegraded":"2024-09-11T11:02:42.122512+0000","last_fullsized":"2024-09-11T11:02:42.122512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:37.428238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847796+0000","last_change":"2024-09-11T11:01:03.347195+0000","last_active":"2024-09-11T11:02:42.847796+0000","last_peered":"2024-09-11T11:02:42.847796+0000","last_clean":"2024-09-11T11:02:42.847796+0000","last_became_active":"2024-09-11T11:01:03.346878+0000","last_became_peered":"2024-09-11T11:01:03.346878+0000","last_unstale":"2024-09-11T11:02:42.847796+0000","last_undegraded":"2024-09-11T11:02:42.847796+0000","last_fullsized":"2024-09-11T11:02:42.847796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:23.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.837531+0000","last_change":"2024-09-11T11:01:42.051383+0000","last_active":"2024-09-11T11:03:16.837531+0000","last_peered":"2024-09-11T11:03:16.837531+0000","last_clean":"2024-09-11T11:03:16.837531+0000","last_became_active":"2024-09-11T11:01:42.050609+0000","last_became_peered":"2024-09-11T11:01:42.050609+0000","last_unstale":"2024-09-11T11:03:16.837531+0000","last_undegraded":"2024-09-11T11:03:16.837531+0000","last_fullsized":"2024-09-11T11:03:16.837531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:02:47.432629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500359+0000","last_change":"2024-09-11T11:01:03.335675+0000","last_active":"2024-09-11T11:02:42.500359+0000","last_peered":"2024-09-11T11:02:42.500359+0000","last_clean":"2024-09-11T11:02:42.500359+0000","last_became_active":"2024-09-11T11:01:03.335121+0000","last_became_peered":"2024-09-11T11:01:03.335121+0000","last_unstale":"2024-09-11T11:02:42.500359+0000","last_undegraded":"2024-09-11T11:02:42.500359+0000","last_fullsized":"2024-09-11T11:02:42.500359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:09:08.817967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124476+0000","last_change":"2024-09-11T11:01:05.332966+0000","last_active":"2024-09-11T11:02:42.124476+0000","last_peered":"2024-09-11T11:02:42.124476+0000","last_clean":"2024-09-11T11:02:42.124476+0000","last_became_active":"2024-09-11T11:01:05.332299+0000","last_became_peered":"2024-09-11T11:01:05.332299+0000","last_unstale":"2024-09-11T11:02:42.124476+0000","last_undegraded":"2024-09-11T11:02:42.124476+0000","last_fullsized":"2024-09-11T11:02:42.124476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:16:36.575022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.128827+0000","last_change":"2024-09-11T11:01:03.346356+0000","last_active":"2024-09-11T11:02:42.128827+0000","last_peered":"2024-09-11T11:02:42.128827+0000","last_clean":"2024-09-11T11:02:42.128827+0000","last_became_active":"2024-09-11T11:01:03.345528+0000","last_became_peered":"2024-09-11T11:01:03.345528+0000","last_unstale":"2024-09-11T11:02:42.128827+0000","last_undegraded":"2024-09-11T11:02:42.128827+0000","last_fullsized":"2024-09-11T11:02:42.128827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:22.337303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855579+0000","last_change":"2024-09-11T11:01:05.353141+0000","last_active":"2024-09-11T11:04:17.855579+0000","last_peered":"2024-09-11T11:04:17.855579+0000","last_clean":"2024-09-11T11:04:17.855579+0000","last_became_active":"2024-09-11T11:01:05.352754+0000","last_became_peered":"2024-09-11T11:01:05.352754+0000","last_unstale":"2024-09-11T11:04:17.855579+0000","last_undegraded":"2024-09-11T11:04:17.855579+0000","last_fullsized":"2024-09-11T11:04:17.855579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:13.106892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.125934+0000","last_change":"2024-09-11T11:01:03.323543+0000","last_active":"2024-09-11T11:02:42.125934+0000","last_peered":"2024-09-11T11:02:42.125934+0000","last_clean":"2024-09-11T11:02:42.125934+0000","last_became_active":"2024-09-11T11:01:03.321411+0000","last_became_peered":"2024-09-11T11:01:03.321411+0000","last_unstale":"2024-09-11T11:02:42.125934+0000","last_undegraded":"2024-09-11T11:02:42.125934+0000","last_fullsized":"2024-09-11T11:02:42.125934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:47:39.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'32","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.854585+0000","last_change":"2024-09-11T11:01:05.337548+0000","last_active":"2024-09-11T11:04:17.854585+0000","last_peered":"2024-09-11T11:04:17.854585+0000","last_clean":"2024-09-11T11:04:17.854585+0000","last_became_active":"2024-09-11T11:01:05.337040+0000","last_became_peered":"2024-09-11T11:01:05.337040+0000","last_unstale":"2024-09-11T11:04:17.854585+0000","last_undegraded":"2024-09-11T11:04:17.854585+0000","last_fullsized":"2024-09-11T11:04:17.854585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:06.158539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.757156+0000","last_change":"2024-09-11T11:01:03.334314+0000","last_active":"2024-09-11T11:04:17.757156+0000","last_peered":"2024-09-11T11:04:17.757156+0000","last_clean":"2024-09-11T11:04:17.757156+0000","last_became_active":"2024-09-11T11:01:03.333820+0000","last_became_peered":"2024-09-11T11:01:03.333820+0000","last_unstale":"2024-09-11T11:04:17.757156+0000","last_undegraded":"2024-09-11T11:04:17.757156+0000","last_fullsized":"2024-09-11T11:04:17.757156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:32:19.168897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.574261+0000","last_change":"2024-09-11T11:01:05.342829+0000","last_active":"2024-09-11T11:04:17.574261+0000","last_peered":"2024-09-11T11:04:17.574261+0000","last_clean":"2024-09-11T11:04:17.574261+0000","last_became_active":"2024-09-11T11:01:05.342461+0000","last_became_peered":"2024-09-11T11:01:05.342461+0000","last_unstale":"2024-09-11T11:04:17.574261+0000","last_undegraded":"2024-09-11T11:04:17.574261+0000","last_fullsized":"2024-09-11T11:04:17.574261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:01:49.773250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.267054+0000","last_change":"2024-09-11T11:01:03.346138+0000","last_active":"2024-09-11T11:04:17.267054+0000","last_peered":"2024-09-11T11:04:17.267054+0000","last_clean":"2024-09-11T11:04:17.267054+0000","last_became_active":"2024-09-11T11:01:03.345866+0000","last_became_peered":"2024-09-11T11:01:03.345866+0000","last_unstale":"2024-09-11T11:04:17.267054+0000","last_undegraded":"2024-09-11T11:04:17.267054+0000","last_fullsized":"2024-09-11T11:04:17.267054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:08.559205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4834176,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.814618+0000","last_change":"2024-09-11T11:01:13.415583+0000","last_active":"2024-09-11T11:04:17.814618+0000","last_peered":"2024-09-11T11:04:17.814618+0000","last_clean":"2024-09-11T11:04:17.814618+0000","last_became_active":"2024-09-11T11:01:13.410232+0000","last_became_peered":"2024-09-11T11:01:13.410232+0000","last_unstale":"2024-09-11T11:04:17.814618+0000","last_undegraded":"2024-09-11T11:04:17.814618+0000","last_fullsized":"2024-09-11T11:04:17.814618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:58.102633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'14","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.435955+0000","last_change":"2024-09-11T11:01:05.347684+0000","last_active":"2024-09-11T11:04:17.435955+0000","last_peered":"2024-09-11T11:04:17.435955+0000","last_clean":"2024-09-11T11:04:17.435955+0000","last_became_active":"2024-09-11T11:01:05.347254+0000","last_became_peered":"2024-09-11T11:01:05.347254+0000","last_unstale":"2024-09-11T11:04:17.435955+0000","last_undegraded":"2024-09-11T11:04:17.435955+0000","last_fullsized":"2024-09-11T11:04:17.435955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:37.428238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.729046+0000","last_change":"2024-09-11T11:01:03.341239+0000","last_active":"2024-09-11T11:04:17.729046+0000","last_peered":"2024-09-11T11:04:17.729046+0000","last_clean":"2024-09-11T11:04:17.729046+0000","last_became_active":"2024-09-11T11:01:03.340851+0000","last_became_peered":"2024-09-11T11:01:03.340851+0000","last_unstale":"2024-09-11T11:04:17.729046+0000","last_undegraded":"2024-09-11T11:04:17.729046+0000","last_fullsized":"2024-09-11T11:04:17.729046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:47:39.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113676+0000","last_change":"2024-09-11T11:01:07.364976+0000","last_active":"2024-09-11T11:02:42.113676+0000","last_peered":"2024-09-11T11:02:42.113676+0000","last_clean":"2024-09-11T11:02:42.113676+0000","last_became_active":"2024-09-11T11:01:07.363392+0000","last_became_peered":"2024-09-11T11:01:07.363392+0000","last_unstale":"2024-09-11T11:02:42.113676+0000","last_undegraded":"2024-09-11T11:02:42.113676+0000","last_fullsized":"2024-09-11T11:02:42.113676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:33.505775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.891552+0000","last_change":"2024-09-11T11:01:09.392616+0000","last_active":"2024-09-11T11:03:14.891552+0000","last_peered":"2024-09-11T11:03:14.891552+0000","last_clean":"2024-09-11T11:03:14.891552+0000","last_became_active":"2024-09-11T11:01:09.392044+0000","last_became_peered":"2024-09-11T11:01:09.392044+0000","last_unstale":"2024-09-11T11:03:14.891552+0000","last_undegraded":"2024-09-11T11:03:14.891552+0000","last_fullsized":"2024-09-11T11:03:14.891552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:06.838378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129542+0000","last_change":"2024-09-11T11:01:11.400422+0000","last_active":"2024-09-11T11:02:42.129542+0000","last_peered":"2024-09-11T11:02:42.129542+0000","last_clean":"2024-09-11T11:02:42.129542+0000","last_became_active":"2024-09-11T11:01:11.399820+0000","last_became_peered":"2024-09-11T11:01:11.399820+0000","last_unstale":"2024-09-11T11:02:42.129542+0000","last_undegraded":"2024-09-11T11:02:42.129542+0000","last_fullsized":"2024-09-11T11:02:42.129542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:20.584480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121749+0000","last_change":"2024-09-11T11:01:13.421600+0000","last_active":"2024-09-11T11:02:42.121749+0000","last_peered":"2024-09-11T11:02:42.121749+0000","last_clean":"2024-09-11T11:02:42.121749+0000","last_became_active":"2024-09-11T11:01:13.420843+0000","last_became_peered":"2024-09-11T11:01:13.420843+0000","last_unstale":"2024-09-11T11:02:42.121749+0000","last_undegraded":"2024-09-11T11:02:42.121749+0000","last_fullsized":"2024-09-11T11:02:42.121749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:32:51.362925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'17","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.870018+0000","last_change":"2024-09-11T11:01:05.335422+0000","last_active":"2024-09-11T11:04:17.870018+0000","last_peered":"2024-09-11T11:04:17.870018+0000","last_clean":"2024-09-11T11:04:17.870018+0000","last_became_active":"2024-09-11T11:01:05.334085+0000","last_became_peered":"2024-09-11T11:01:05.334085+0000","last_unstale":"2024-09-11T11:04:17.870018+0000","last_undegraded":"2024-09-11T11:04:17.870018+0000","last_fullsized":"2024-09-11T11:04:17.870018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:14.677319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.775271+0000","last_change":"2024-09-11T11:01:03.335761+0000","last_active":"2024-09-11T11:03:16.775271+0000","last_peered":"2024-09-11T11:03:16.775271+0000","last_clean":"2024-09-11T11:03:16.775271+0000","last_became_active":"2024-09-11T11:01:03.335439+0000","last_became_peered":"2024-09-11T11:01:03.335439+0000","last_unstale":"2024-09-11T11:03:16.775271+0000","last_undegraded":"2024-09-11T11:03:16.775271+0000","last_fullsized":"2024-09-11T11:03:16.775271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:15:21.556672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113629+0000","last_change":"2024-09-11T11:01:07.354963+0000","last_active":"2024-09-11T11:02:42.113629+0000","last_peered":"2024-09-11T11:02:42.113629+0000","last_clean":"2024-09-11T11:02:42.113629+0000","last_became_active":"2024-09-11T11:01:07.350851+0000","last_became_peered":"2024-09-11T11:01:07.350851+0000","last_unstale":"2024-09-11T11:02:42.113629+0000","last_undegraded":"2024-09-11T11:02:42.113629+0000","last_fullsized":"2024-09-11T11:02:42.113629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:35:29.768861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845742+0000","last_change":"2024-09-11T11:01:09.383885+0000","last_active":"2024-09-11T11:02:42.845742+0000","last_peered":"2024-09-11T11:02:42.845742+0000","last_clean":"2024-09-11T11:02:42.845742+0000","last_became_active":"2024-09-11T11:01:09.382890+0000","last_became_peered":"2024-09-11T11:01:09.382890+0000","last_unstale":"2024-09-11T11:02:42.845742+0000","last_undegraded":"2024-09-11T11:02:42.845742+0000","last_fullsized":"2024-09-11T11:02:42.845742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:07.186578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126516+0000","last_change":"2024-09-11T11:01:11.401654+0000","last_active":"2024-09-11T11:02:42.126516+0000","last_peered":"2024-09-11T11:02:42.126516+0000","last_clean":"2024-09-11T11:02:42.126516+0000","last_became_active":"2024-09-11T11:01:11.400881+0000","last_became_peered":"2024-09-11T11:01:11.400881+0000","last_unstale":"2024-09-11T11:02:42.126516+0000","last_undegraded":"2024-09-11T11:02:42.126516+0000","last_fullsized":"2024-09-11T11:02:42.126516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:35:07.181778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110054+0000","last_change":"2024-09-11T11:01:13.423960+0000","last_active":"2024-09-11T11:02:42.110054+0000","last_peered":"2024-09-11T11:02:42.110054+0000","last_clean":"2024-09-11T11:02:42.110054+0000","last_became_active":"2024-09-11T11:01:13.422439+0000","last_became_peered":"2024-09-11T11:01:13.422439+0000","last_unstale":"2024-09-11T11:02:42.110054+0000","last_undegraded":"2024-09-11T11:02:42.110054+0000","last_fullsized":"2024-09-11T11:02:42.110054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:51.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113671+0000","last_change":"2024-09-11T11:01:05.343880+0000","last_active":"2024-09-11T11:02:42.113671+0000","last_peered":"2024-09-11T11:02:42.113671+0000","last_clean":"2024-09-11T11:02:42.113671+0000","last_became_active":"2024-09-11T11:01:05.343489+0000","last_became_peered":"2024-09-11T11:01:05.343489+0000","last_unstale":"2024-09-11T11:02:42.113671+0000","last_undegraded":"2024-09-11T11:02:42.113671+0000","last_fullsized":"2024-09-11T11:02:42.113671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:27:12.077223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121664+0000","last_change":"2024-09-11T11:01:03.338861+0000","last_active":"2024-09-11T11:02:42.121664+0000","last_peered":"2024-09-11T11:02:42.121664+0000","last_clean":"2024-09-11T11:02:42.121664+0000","last_became_active":"2024-09-11T11:01:03.337993+0000","last_became_peered":"2024-09-11T11:01:03.337993+0000","last_unstale":"2024-09-11T11:02:42.121664+0000","last_undegraded":"2024-09-11T11:02:42.121664+0000","last_fullsized":"2024-09-11T11:02:42.121664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:02.814616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116892+0000","last_change":"2024-09-11T11:01:07.364400+0000","last_active":"2024-09-11T11:02:42.116892+0000","last_peered":"2024-09-11T11:02:42.116892+0000","last_clean":"2024-09-11T11:02:42.116892+0000","last_became_active":"2024-09-11T11:01:07.363656+0000","last_became_peered":"2024-09-11T11:01:07.363656+0000","last_unstale":"2024-09-11T11:02:42.116892+0000","last_undegraded":"2024-09-11T11:02:42.116892+0000","last_fullsized":"2024-09-11T11:02:42.116892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:51.467819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.772825+0000","last_change":"2024-09-11T11:01:09.365976+0000","last_active":"2024-09-11T11:03:12.772825+0000","last_peered":"2024-09-11T11:03:12.772825+0000","last_clean":"2024-09-11T11:03:12.772825+0000","last_became_active":"2024-09-11T11:01:09.365291+0000","last_became_peered":"2024-09-11T11:01:09.365291+0000","last_unstale":"2024-09-11T11:03:12.772825+0000","last_undegraded":"2024-09-11T11:03:12.772825+0000","last_fullsized":"2024-09-11T11:03:12.772825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:26.467645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":386,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597318+0000","last_change":"2024-09-11T11:01:11.385545+0000","last_active":"2024-09-11T11:04:17.597318+0000","last_peered":"2024-09-11T11:04:17.597318+0000","last_clean":"2024-09-11T11:04:17.597318+0000","last_became_active":"2024-09-11T11:01:11.384635+0000","last_became_peered":"2024-09-11T11:01:11.384635+0000","last_unstale":"2024-09-11T11:04:17.597318+0000","last_undegraded":"2024-09-11T11:04:17.597318+0000","last_fullsized":"2024-09-11T11:04:17.597318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:41.366917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498281+0000","last_change":"2024-09-11T11:01:13.420839+0000","last_active":"2024-09-11T11:02:42.498281+0000","last_peered":"2024-09-11T11:02:42.498281+0000","last_clean":"2024-09-11T11:02:42.498281+0000","last_became_active":"2024-09-11T11:01:13.413465+0000","last_became_peered":"2024-09-11T11:01:13.413465+0000","last_unstale":"2024-09-11T11:02:42.498281+0000","last_undegraded":"2024-09-11T11:02:42.498281+0000","last_fullsized":"2024-09-11T11:02:42.498281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:12.707001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'18","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770490+0000","last_change":"2024-09-11T11:01:05.347779+0000","last_active":"2024-09-11T11:04:17.770490+0000","last_peered":"2024-09-11T11:04:17.770490+0000","last_clean":"2024-09-11T11:04:17.770490+0000","last_became_active":"2024-09-11T11:01:05.347434+0000","last_became_peered":"2024-09-11T11:01:05.347434+0000","last_unstale":"2024-09-11T11:04:17.770490+0000","last_undegraded":"2024-09-11T11:04:17.770490+0000","last_fullsized":"2024-09-11T11:04:17.770490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:14.471785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.216896+0000","last_change":"2024-09-11T11:01:03.322006+0000","last_active":"2024-09-11T11:04:17.216896+0000","last_peered":"2024-09-11T11:04:17.216896+0000","last_clean":"2024-09-11T11:04:17.216896+0000","last_became_active":"2024-09-11T11:01:03.320684+0000","last_became_peered":"2024-09-11T11:01:03.320684+0000","last_unstale":"2024-09-11T11:04:17.216896+0000","last_undegraded":"2024-09-11T11:04:17.216896+0000","last_fullsized":"2024-09-11T11:04:17.216896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:11.801971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127569+0000","last_change":"2024-09-11T11:01:07.343287+0000","last_active":"2024-09-11T11:02:42.127569+0000","last_peered":"2024-09-11T11:02:42.127569+0000","last_clean":"2024-09-11T11:02:42.127569+0000","last_became_active":"2024-09-11T11:01:07.342607+0000","last_became_peered":"2024-09-11T11:01:07.342607+0000","last_unstale":"2024-09-11T11:02:42.127569+0000","last_undegraded":"2024-09-11T11:02:42.127569+0000","last_fullsized":"2024-09-11T11:02:42.127569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:33:47.987384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.883742+0000","last_change":"2024-09-11T11:01:09.367726+0000","last_active":"2024-09-11T11:03:14.883742+0000","last_peered":"2024-09-11T11:03:14.883742+0000","last_clean":"2024-09-11T11:03:14.883742+0000","last_became_active":"2024-09-11T11:01:09.366811+0000","last_became_peered":"2024-09-11T11:01:09.366811+0000","last_unstale":"2024-09-11T11:03:14.883742+0000","last_undegraded":"2024-09-11T11:03:14.883742+0000","last_fullsized":"2024-09-11T11:03:14.883742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:56:57.446929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.928557+0000","last_change":"2024-09-11T11:01:11.399976+0000","last_active":"2024-09-11T11:04:17.928557+0000","last_peered":"2024-09-11T11:04:17.928557+0000","last_clean":"2024-09-11T11:04:17.928557+0000","last_became_active":"2024-09-11T11:01:11.399213+0000","last_became_peered":"2024-09-11T11:01:11.399213+0000","last_unstale":"2024-09-11T11:04:17.928557+0000","last_undegraded":"2024-09-11T11:04:17.928557+0000","last_fullsized":"2024-09-11T11:04:17.928557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:38.273109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573835+0000","last_change":"2024-09-11T11:01:05.330488+0000","last_active":"2024-09-11T11:04:17.573835+0000","last_peered":"2024-09-11T11:04:17.573835+0000","last_clean":"2024-09-11T11:04:17.573835+0000","last_became_active":"2024-09-11T11:01:05.330091+0000","last_became_peered":"2024-09-11T11:01:05.330091+0000","last_unstale":"2024-09-11T11:04:17.573835+0000","last_undegraded":"2024-09-11T11:04:17.573835+0000","last_fullsized":"2024-09-11T11:04:17.573835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:03.072232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127186+0000","last_change":"2024-09-11T11:01:03.338267+0000","last_active":"2024-09-11T11:02:42.127186+0000","last_peered":"2024-09-11T11:02:42.127186+0000","last_clean":"2024-09-11T11:02:42.127186+0000","last_became_active":"2024-09-11T11:01:03.337496+0000","last_became_peered":"2024-09-11T11:01:03.337496+0000","last_unstale":"2024-09-11T11:02:42.127186+0000","last_undegraded":"2024-09-11T11:02:42.127186+0000","last_fullsized":"2024-09-11T11:02:42.127186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:32:02.436613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843554+0000","last_change":"2024-09-11T11:01:07.366981+0000","last_active":"2024-09-11T11:02:42.843554+0000","last_peered":"2024-09-11T11:02:42.843554+0000","last_clean":"2024-09-11T11:02:42.843554+0000","last_became_active":"2024-09-11T11:01:07.366115+0000","last_became_peered":"2024-09-11T11:01:07.366115+0000","last_unstale":"2024-09-11T11:02:42.843554+0000","last_undegraded":"2024-09-11T11:02:42.843554+0000","last_fullsized":"2024-09-11T11:02:42.843554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:28:41.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.901157+0000","last_change":"2024-09-11T11:01:09.377146+0000","last_active":"2024-09-11T11:03:14.901157+0000","last_peered":"2024-09-11T11:03:14.901157+0000","last_clean":"2024-09-11T11:03:14.901157+0000","last_became_active":"2024-09-11T11:01:09.376242+0000","last_became_peered":"2024-09-11T11:01:09.376242+0000","last_unstale":"2024-09-11T11:03:14.901157+0000","last_undegraded":"2024-09-11T11:03:14.901157+0000","last_fullsized":"2024-09-11T11:03:14.901157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:27.367457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842086+0000","last_change":"2024-09-11T11:01:11.378387+0000","last_active":"2024-09-11T11:02:42.842086+0000","last_peered":"2024-09-11T11:02:42.842086+0000","last_clean":"2024-09-11T11:02:42.842086+0000","last_became_active":"2024-09-11T11:01:11.377655+0000","last_became_peered":"2024-09-11T11:01:11.377655+0000","last_unstale":"2024-09-11T11:02:42.842086+0000","last_undegraded":"2024-09-11T11:02:42.842086+0000","last_fullsized":"2024-09-11T11:02:42.842086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:45.529658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499873+0000","last_change":"2024-09-11T11:01:13.421261+0000","last_active":"2024-09-11T11:02:42.499873+0000","last_peered":"2024-09-11T11:02:42.499873+0000","last_clean":"2024-09-11T11:02:42.499873+0000","last_became_active":"2024-09-11T11:01:13.420299+0000","last_became_peered":"2024-09-11T11:01:13.420299+0000","last_unstale":"2024-09-11T11:02:42.499873+0000","last_undegraded":"2024-09-11T11:02:42.499873+0000","last_fullsized":"2024-09-11T11:02:42.499873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:06:26.945332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842409+0000","last_change":"2024-09-11T11:01:05.355473+0000","last_active":"2024-09-11T11:02:42.842409+0000","last_peered":"2024-09-11T11:02:42.842409+0000","last_clean":"2024-09-11T11:02:42.842409+0000","last_became_active":"2024-09-11T11:01:05.355135+0000","last_became_peered":"2024-09-11T11:01:05.355135+0000","last_unstale":"2024-09-11T11:02:42.842409+0000","last_undegraded":"2024-09-11T11:02:42.842409+0000","last_fullsized":"2024-09-11T11:02:42.842409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:47.491766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126834+0000","last_change":"2024-09-11T11:01:03.322857+0000","last_active":"2024-09-11T11:02:42.126834+0000","last_peered":"2024-09-11T11:02:42.126834+0000","last_clean":"2024-09-11T11:02:42.126834+0000","last_became_active":"2024-09-11T11:01:03.320605+0000","last_became_peered":"2024-09-11T11:01:03.320605+0000","last_unstale":"2024-09-11T11:02:42.126834+0000","last_undegraded":"2024-09-11T11:02:42.126834+0000","last_fullsized":"2024-09-11T11:02:42.126834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:02.081735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497680+0000","last_change":"2024-09-11T11:01:07.349262+0000","last_active":"2024-09-11T11:02:42.497680+0000","last_peered":"2024-09-11T11:02:42.497680+0000","last_clean":"2024-09-11T11:02:42.497680+0000","last_became_active":"2024-09-11T11:01:07.348627+0000","last_became_peered":"2024-09-11T11:01:07.348627+0000","last_unstale":"2024-09-11T11:02:42.497680+0000","last_undegraded":"2024-09-11T11:02:42.497680+0000","last_fullsized":"2024-09-11T11:02:42.497680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:14:29.786650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.841432+0000","last_change":"2024-09-11T11:01:09.385906+0000","last_active":"2024-09-11T11:03:16.841432+0000","last_peered":"2024-09-11T11:03:16.841432+0000","last_clean":"2024-09-11T11:03:16.841432+0000","last_became_active":"2024-09-11T11:01:09.384478+0000","last_became_peered":"2024-09-11T11:01:09.384478+0000","last_unstale":"2024-09-11T11:03:16.841432+0000","last_undegraded":"2024-09-11T11:03:16.841432+0000","last_fullsized":"2024-09-11T11:03:16.841432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:10.751059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112388+0000","last_change":"2024-09-11T11:01:11.402062+0000","last_active":"2024-09-11T11:02:42.112388+0000","last_peered":"2024-09-11T11:02:42.112388+0000","last_clean":"2024-09-11T11:02:42.112388+0000","last_became_active":"2024-09-11T11:01:11.401382+0000","last_became_peered":"2024-09-11T11:01:11.401382+0000","last_unstale":"2024-09-11T11:02:42.112388+0000","last_undegraded":"2024-09-11T11:02:42.112388+0000","last_fullsized":"2024-09-11T11:02:42.112388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:09.834093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844778+0000","last_change":"2024-09-11T11:01:13.419597+0000","last_active":"2024-09-11T11:02:42.844778+0000","last_peered":"2024-09-11T11:02:42.844778+0000","last_clean":"2024-09-11T11:02:42.844778+0000","last_became_active":"2024-09-11T11:01:13.415041+0000","last_became_peered":"2024-09-11T11:01:13.415041+0000","last_unstale":"2024-09-11T11:02:42.844778+0000","last_undegraded":"2024-09-11T11:02:42.844778+0000","last_fullsized":"2024-09-11T11:02:42.844778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:25.378088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'8","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921023+0000","last_change":"2024-09-11T11:01:05.347855+0000","last_active":"2024-09-11T11:04:17.921023+0000","last_peered":"2024-09-11T11:04:17.921023+0000","last_clean":"2024-09-11T11:04:17.921023+0000","last_became_active":"2024-09-11T11:01:05.347137+0000","last_became_peered":"2024-09-11T11:01:05.347137+0000","last_unstale":"2024-09-11T11:04:17.921023+0000","last_undegraded":"2024-09-11T11:04:17.921023+0000","last_fullsized":"2024-09-11T11:04:17.921023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:31:24.806914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127018+0000","last_change":"2024-09-11T11:01:42.098396+0000","last_active":"2024-09-11T11:02:42.127018+0000","last_peered":"2024-09-11T11:02:42.127018+0000","last_clean":"2024-09-11T11:02:42.127018+0000","last_became_active":"2024-09-11T11:01:42.065732+0000","last_became_peered":"2024-09-11T11:01:42.065732+0000","last_unstale":"2024-09-11T11:02:42.127018+0000","last_undegraded":"2024-09-11T11:02:42.127018+0000","last_fullsized":"2024-09-11T11:02:42.127018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:11:20.458955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498082+0000","last_change":"2024-09-11T11:01:42.064065+0000","last_active":"2024-09-11T11:02:42.498082+0000","last_peered":"2024-09-11T11:02:42.498082+0000","last_clean":"2024-09-11T11:02:42.498082+0000","last_became_active":"2024-09-11T11:01:42.062781+0000","last_became_peered":"2024-09-11T11:01:42.062781+0000","last_unstale":"2024-09-11T11:02:42.498082+0000","last_undegraded":"2024-09-11T11:02:42.498082+0000","last_fullsized":"2024-09-11T11:02:42.498082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:38:04.790112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.904313+0000","last_change":"2024-09-11T11:01:09.362905+0000","last_active":"2024-09-11T11:03:14.904313+0000","last_peered":"2024-09-11T11:03:14.904313+0000","last_clean":"2024-09-11T11:03:14.904313+0000","last_became_active":"2024-09-11T11:01:09.362260+0000","last_became_peered":"2024-09-11T11:01:09.362260+0000","last_unstale":"2024-09-11T11:03:14.904313+0000","last_undegraded":"2024-09-11T11:03:14.904313+0000","last_fullsized":"2024-09-11T11:03:14.904313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:49:20.880526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":380,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.121670+0000","last_change":"2024-09-11T11:01:11.392542+0000","last_active":"2024-09-11T11:04:18.121670+0000","last_peered":"2024-09-11T11:04:18.121670+0000","last_clean":"2024-09-11T11:04:18.121670+0000","last_became_active":"2024-09-11T11:01:11.391826+0000","last_became_peered":"2024-09-11T11:01:11.391826+0000","last_unstale":"2024-09-11T11:04:18.121670+0000","last_undegraded":"2024-09-11T11:04:18.121670+0000","last_fullsized":"2024-09-11T11:04:18.121670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:38:29.310699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844769+0000","last_change":"2024-09-11T11:01:13.429296+0000","last_active":"2024-09-11T11:02:42.844769+0000","last_peered":"2024-09-11T11:02:42.844769+0000","last_clean":"2024-09-11T11:02:42.844769+0000","last_became_active":"2024-09-11T11:01:13.428914+0000","last_became_peered":"2024-09-11T11:01:13.428914+0000","last_unstale":"2024-09-11T11:02:42.844769+0000","last_undegraded":"2024-09-11T11:02:42.844769+0000","last_fullsized":"2024-09-11T11:02:42.844769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:03.330930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921462+0000","last_change":"2024-09-11T11:01:05.340468+0000","last_active":"2024-09-11T11:04:17.921462+0000","last_peered":"2024-09-11T11:04:17.921462+0000","last_clean":"2024-09-11T11:04:17.921462+0000","last_became_active":"2024-09-11T11:01:05.340069+0000","last_became_peered":"2024-09-11T11:01:05.340069+0000","last_unstale":"2024-09-11T11:04:17.921462+0000","last_undegraded":"2024-09-11T11:04:17.921462+0000","last_fullsized":"2024-09-11T11:04:17.921462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:10.394106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.390386+0000","last_change":"2024-09-11T11:01:03.334480+0000","last_active":"2024-09-11T11:04:17.390386+0000","last_peered":"2024-09-11T11:04:17.390386+0000","last_clean":"2024-09-11T11:04:17.390386+0000","last_became_active":"2024-09-11T11:01:03.333740+0000","last_became_peered":"2024-09-11T11:01:03.333740+0000","last_unstale":"2024-09-11T11:04:17.390386+0000","last_undegraded":"2024-09-11T11:04:17.390386+0000","last_fullsized":"2024-09-11T11:04:17.390386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:50:26.785068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498170+0000","last_change":"2024-09-11T11:01:07.355314+0000","last_active":"2024-09-11T11:02:42.498170+0000","last_peered":"2024-09-11T11:02:42.498170+0000","last_clean":"2024-09-11T11:02:42.498170+0000","last_became_active":"2024-09-11T11:01:07.354827+0000","last_became_peered":"2024-09-11T11:01:07.354827+0000","last_unstale":"2024-09-11T11:02:42.498170+0000","last_undegraded":"2024-09-11T11:02:42.498170+0000","last_fullsized":"2024-09-11T11:02:42.498170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:19:54.907620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'54","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.906396+0000","last_change":"2024-09-11T11:01:09.378757+0000","last_active":"2024-09-11T11:03:14.906396+0000","last_peered":"2024-09-11T11:03:14.906396+0000","last_clean":"2024-09-11T11:03:14.906396+0000","last_became_active":"2024-09-11T11:01:09.374320+0000","last_became_peered":"2024-09-11T11:01:09.374320+0000","last_unstale":"2024-09-11T11:03:14.906396+0000","last_undegraded":"2024-09-11T11:03:14.906396+0000","last_fullsized":"2024-09-11T11:03:14.906396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:24:56.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497933+0000","last_change":"2024-09-11T11:01:11.399906+0000","last_active":"2024-09-11T11:02:42.497933+0000","last_peered":"2024-09-11T11:02:42.497933+0000","last_clean":"2024-09-11T11:02:42.497933+0000","last_became_active":"2024-09-11T11:01:11.399118+0000","last_became_peered":"2024-09-11T11:01:11.399118+0000","last_unstale":"2024-09-11T11:02:42.497933+0000","last_undegraded":"2024-09-11T11:02:42.497933+0000","last_fullsized":"2024-09-11T11:02:42.497933+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:55:10.905238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.082661+0000","last_change":"2024-09-11T11:01:13.419418+0000","last_active":"2024-09-11T11:04:18.082661+0000","last_peered":"2024-09-11T11:04:18.082661+0000","last_clean":"2024-09-11T11:04:18.082661+0000","last_became_active":"2024-09-11T11:01:13.415242+0000","last_became_peered":"2024-09-11T11:01:13.415242+0000","last_unstale":"2024-09-11T11:04:18.082661+0000","last_undegraded":"2024-09-11T11:04:18.082661+0000","last_fullsized":"2024-09-11T11:04:18.082661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:11.846013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845729+0000","last_change":"2024-09-11T11:01:05.348021+0000","last_active":"2024-09-11T11:02:42.845729+0000","last_peered":"2024-09-11T11:02:42.845729+0000","last_clean":"2024-09-11T11:02:42.845729+0000","last_became_active":"2024-09-11T11:01:05.347367+0000","last_became_peered":"2024-09-11T11:01:05.347367+0000","last_unstale":"2024-09-11T11:02:42.845729+0000","last_undegraded":"2024-09-11T11:02:42.845729+0000","last_fullsized":"2024-09-11T11:02:42.845729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:39:58.017666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113078+0000","last_change":"2024-09-11T11:01:03.349349+0000","last_active":"2024-09-11T11:02:42.113078+0000","last_peered":"2024-09-11T11:02:42.113078+0000","last_clean":"2024-09-11T11:02:42.113078+0000","last_became_active":"2024-09-11T11:01:03.349051+0000","last_became_peered":"2024-09-11T11:01:03.349051+0000","last_unstale":"2024-09-11T11:02:42.113078+0000","last_undegraded":"2024-09-11T11:02:42.113078+0000","last_fullsized":"2024-09-11T11:02:42.113078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:55.170368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499811+0000","last_change":"2024-09-11T11:01:07.345118+0000","last_active":"2024-09-11T11:02:42.499811+0000","last_peered":"2024-09-11T11:02:42.499811+0000","last_clean":"2024-09-11T11:02:42.499811+0000","last_became_active":"2024-09-11T11:01:07.344509+0000","last_became_peered":"2024-09-11T11:01:07.344509+0000","last_unstale":"2024-09-11T11:02:42.499811+0000","last_undegraded":"2024-09-11T11:02:42.499811+0000","last_fullsized":"2024-09-11T11:02:42.499811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:59:57.440549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.872442+0000","last_change":"2024-09-11T11:01:09.377401+0000","last_active":"2024-09-11T11:03:14.872442+0000","last_peered":"2024-09-11T11:03:14.872442+0000","last_clean":"2024-09-11T11:03:14.872442+0000","last_became_active":"2024-09-11T11:01:09.376576+0000","last_became_peered":"2024-09-11T11:01:09.376576+0000","last_unstale":"2024-09-11T11:03:14.872442+0000","last_undegraded":"2024-09-11T11:03:14.872442+0000","last_fullsized":"2024-09-11T11:03:14.872442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:35.979322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114062+0000","last_change":"2024-09-11T11:01:11.394988+0000","last_active":"2024-09-11T11:02:42.114062+0000","last_peered":"2024-09-11T11:02:42.114062+0000","last_clean":"2024-09-11T11:02:42.114062+0000","last_became_active":"2024-09-11T11:01:11.394215+0000","last_became_peered":"2024-09-11T11:01:11.394215+0000","last_unstale":"2024-09-11T11:02:42.114062+0000","last_undegraded":"2024-09-11T11:02:42.114062+0000","last_fullsized":"2024-09-11T11:02:42.114062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:01.319010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.482720+0000","last_change":"2024-09-11T11:01:13.391142+0000","last_active":"2024-09-11T11:03:14.482720+0000","last_peered":"2024-09-11T11:03:14.482720+0000","last_clean":"2024-09-11T11:03:14.482720+0000","last_became_active":"2024-09-11T11:01:13.390538+0000","last_became_peered":"2024-09-11T11:01:13.390538+0000","last_unstale":"2024-09-11T11:03:14.482720+0000","last_undegraded":"2024-09-11T11:03:14.482720+0000","last_fullsized":"2024-09-11T11:03:14.482720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:22.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836912+0000","last_change":"2024-09-11T11:01:05.332887+0000","last_active":"2024-09-11T11:03:16.836912+0000","last_peered":"2024-09-11T11:03:16.836912+0000","last_clean":"2024-09-11T11:03:16.836912+0000","last_became_active":"2024-09-11T11:01:05.332138+0000","last_became_peered":"2024-09-11T11:01:05.332138+0000","last_unstale":"2024-09-11T11:03:16.836912+0000","last_undegraded":"2024-09-11T11:03:16.836912+0000","last_fullsized":"2024-09-11T11:03:16.836912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:58.679274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123858+0000","last_change":"2024-09-11T11:01:03.321735+0000","last_active":"2024-09-11T11:02:42.123858+0000","last_peered":"2024-09-11T11:02:42.123858+0000","last_clean":"2024-09-11T11:02:42.123858+0000","last_became_active":"2024-09-11T11:01:03.320906+0000","last_became_peered":"2024-09-11T11:01:03.320906+0000","last_unstale":"2024-09-11T11:02:42.123858+0000","last_undegraded":"2024-09-11T11:02:42.123858+0000","last_fullsized":"2024-09-11T11:02:42.123858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:36.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843009+0000","last_change":"2024-09-11T11:01:07.367900+0000","last_active":"2024-09-11T11:02:42.843009+0000","last_peered":"2024-09-11T11:02:42.843009+0000","last_clean":"2024-09-11T11:02:42.843009+0000","last_became_active":"2024-09-11T11:01:07.367554+0000","last_became_peered":"2024-09-11T11:01:07.367554+0000","last_unstale":"2024-09-11T11:02:42.843009+0000","last_undegraded":"2024-09-11T11:02:42.843009+0000","last_fullsized":"2024-09-11T11:02:42.843009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:52.335084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'38","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.916885+0000","last_change":"2024-09-11T11:01:09.367972+0000","last_active":"2024-09-11T11:03:14.916885+0000","last_peered":"2024-09-11T11:03:14.916885+0000","last_clean":"2024-09-11T11:03:14.916885+0000","last_became_active":"2024-09-11T11:01:09.367246+0000","last_became_peered":"2024-09-11T11:01:09.367246+0000","last_unstale":"2024-09-11T11:03:14.916885+0000","last_undegraded":"2024-09-11T11:03:14.916885+0000","last_fullsized":"2024-09-11T11:03:14.916885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:32.334281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":414,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.093944+0000","last_change":"2024-09-11T11:01:11.393113+0000","last_active":"2024-09-11T11:04:18.093944+0000","last_peered":"2024-09-11T11:04:18.093944+0000","last_clean":"2024-09-11T11:04:18.093944+0000","last_became_active":"2024-09-11T11:01:11.392359+0000","last_became_peered":"2024-09-11T11:01:11.392359+0000","last_unstale":"2024-09-11T11:04:18.093944+0000","last_undegraded":"2024-09-11T11:04:18.093944+0000","last_fullsized":"2024-09-11T11:04:18.093944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:39.923836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'16","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.875398+0000","last_change":"2024-09-11T11:01:13.418955+0000","last_active":"2024-09-11T11:04:17.875398+0000","last_peered":"2024-09-11T11:04:17.875398+0000","last_clean":"2024-09-11T11:04:17.875398+0000","last_became_active":"2024-09-11T11:01:13.415115+0000","last_became_peered":"2024-09-11T11:01:13.415115+0000","last_unstale":"2024-09-11T11:04:17.875398+0000","last_undegraded":"2024-09-11T11:04:17.875398+0000","last_fullsized":"2024-09-11T11:04:17.875398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:40.005800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770486+0000","last_change":"2024-09-11T11:01:05.337583+0000","last_active":"2024-09-11T11:04:17.770486+0000","last_peered":"2024-09-11T11:04:17.770486+0000","last_clean":"2024-09-11T11:04:17.770486+0000","last_became_active":"2024-09-11T11:01:05.337055+0000","last_became_peered":"2024-09-11T11:01:05.337055+0000","last_unstale":"2024-09-11T11:04:17.770486+0000","last_undegraded":"2024-09-11T11:04:17.770486+0000","last_fullsized":"2024-09-11T11:04:17.770486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:52.604892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.743722+0000","last_change":"2024-09-11T11:01:03.336594+0000","last_active":"2024-09-11T11:04:17.743722+0000","last_peered":"2024-09-11T11:04:17.743722+0000","last_clean":"2024-09-11T11:04:17.743722+0000","last_became_active":"2024-09-11T11:01:03.334392+0000","last_became_peered":"2024-09-11T11:01:03.334392+0000","last_unstale":"2024-09-11T11:04:17.743722+0000","last_undegraded":"2024-09-11T11:04:17.743722+0000","last_fullsized":"2024-09-11T11:04:17.743722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:14.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.333038+0000","last_change":"2024-09-11T11:01:07.360933+0000","last_active":"2024-09-11T11:03:16.333038+0000","last_peered":"2024-09-11T11:03:16.333038+0000","last_clean":"2024-09-11T11:03:16.333038+0000","last_became_active":"2024-09-11T11:01:07.360348+0000","last_became_peered":"2024-09-11T11:01:07.360348+0000","last_unstale":"2024-09-11T11:03:16.333038+0000","last_undegraded":"2024-09-11T11:03:16.333038+0000","last_fullsized":"2024-09-11T11:03:16.333038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:05.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.519176+0000","last_change":"2024-09-11T11:02:42.518145+0000","last_active":"2024-09-11T11:02:42.519176+0000","last_peered":"2024-09-11T11:02:42.519176+0000","last_clean":"2024-09-11T11:02:42.519176+0000","last_became_active":"2024-09-11T11:02:42.501712+0000","last_became_peered":"2024-09-11T11:02:42.501712+0000","last_unstale":"2024-09-11T11:02:42.519176+0000","last_undegraded":"2024-09-11T11:02:42.519176+0000","last_fullsized":"2024-09-11T11:02:42.519176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:53.342864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.034092+0000","last_change":"2024-09-11T11:01:11.386158+0000","last_active":"2024-09-11T11:04:18.034092+0000","last_peered":"2024-09-11T11:04:18.034092+0000","last_clean":"2024-09-11T11:04:18.034092+0000","last_became_active":"2024-09-11T11:01:11.384776+0000","last_became_peered":"2024-09-11T11:01:11.384776+0000","last_unstale":"2024-09-11T11:04:18.034092+0000","last_undegraded":"2024-09-11T11:04:18.034092+0000","last_fullsized":"2024-09-11T11:04:18.034092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:00.643395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.829302+0000","last_change":"2024-09-11T11:01:13.419039+0000","last_active":"2024-09-11T11:03:16.829302+0000","last_peered":"2024-09-11T11:03:16.829302+0000","last_clean":"2024-09-11T11:03:16.829302+0000","last_became_active":"2024-09-11T11:01:13.418296+0000","last_became_peered":"2024-09-11T11:01:13.418296+0000","last_unstale":"2024-09-11T11:03:16.829302+0000","last_undegraded":"2024-09-11T11:03:16.829302+0000","last_fullsized":"2024-09-11T11:03:16.829302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:38:59.936533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.920553+0000","last_change":"2024-09-11T11:01:05.348048+0000","last_active":"2024-09-11T11:04:17.920553+0000","last_peered":"2024-09-11T11:04:17.920553+0000","last_clean":"2024-09-11T11:04:17.920553+0000","last_became_active":"2024-09-11T11:01:05.347644+0000","last_became_peered":"2024-09-11T11:01:05.347644+0000","last_unstale":"2024-09-11T11:04:17.920553+0000","last_undegraded":"2024-09-11T11:04:17.920553+0000","last_fullsized":"2024-09-11T11:04:17.920553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:28.667270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109195+0000","last_change":"2024-09-11T11:01:03.349954+0000","last_active":"2024-09-11T11:02:42.109195+0000","last_peered":"2024-09-11T11:02:42.109195+0000","last_clean":"2024-09-11T11:02:42.109195+0000","last_became_active":"2024-09-11T11:01:03.349605+0000","last_became_peered":"2024-09-11T11:01:03.349605+0000","last_unstale":"2024-09-11T11:02:42.109195+0000","last_undegraded":"2024-09-11T11:02:42.109195+0000","last_fullsized":"2024-09-11T11:02:42.109195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:42.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113995+0000","last_change":"2024-09-11T11:01:07.355413+0000","last_active":"2024-09-11T11:02:42.113995+0000","last_peered":"2024-09-11T11:02:42.113995+0000","last_clean":"2024-09-11T11:02:42.113995+0000","last_became_active":"2024-09-11T11:01:07.351403+0000","last_became_peered":"2024-09-11T11:01:07.351403+0000","last_unstale":"2024-09-11T11:02:42.113995+0000","last_undegraded":"2024-09-11T11:02:42.113995+0000","last_fullsized":"2024-09-11T11:02:42.113995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:36:28.171191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'38","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.894816+0000","last_change":"2024-09-11T11:01:09.377243+0000","last_active":"2024-09-11T11:03:14.894816+0000","last_peered":"2024-09-11T11:03:14.894816+0000","last_clean":"2024-09-11T11:03:14.894816+0000","last_became_active":"2024-09-11T11:01:09.376340+0000","last_became_peered":"2024-09-11T11:01:09.376340+0000","last_unstale":"2024-09-11T11:03:14.894816+0000","last_undegraded":"2024-09-11T11:03:14.894816+0000","last_fullsized":"2024-09-11T11:03:14.894816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:34:10.669607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126520+0000","last_change":"2024-09-11T11:01:11.386915+0000","last_active":"2024-09-11T11:02:42.126520+0000","last_peered":"2024-09-11T11:02:42.126520+0000","last_clean":"2024-09-11T11:02:42.126520+0000","last_became_active":"2024-09-11T11:01:11.385523+0000","last_became_peered":"2024-09-11T11:01:11.385523+0000","last_unstale":"2024-09-11T11:02:42.126520+0000","last_undegraded":"2024-09-11T11:02:42.126520+0000","last_fullsized":"2024-09-11T11:02:42.126520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:46:58.221514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'6","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.989822+0000","last_change":"2024-09-11T11:01:13.408216+0000","last_active":"2024-09-11T11:04:17.989822+0000","last_peered":"2024-09-11T11:04:17.989822+0000","last_clean":"2024-09-11T11:04:17.989822+0000","last_became_active":"2024-09-11T11:01:13.403125+0000","last_became_peered":"2024-09-11T11:01:13.403125+0000","last_unstale":"2024-09-11T11:04:17.989822+0000","last_undegraded":"2024-09-11T11:04:17.989822+0000","last_fullsized":"2024-09-11T11:04:17.989822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:20.557182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'22","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.856373+0000","last_change":"2024-09-11T11:01:05.346169+0000","last_active":"2024-09-11T11:04:17.856373+0000","last_peered":"2024-09-11T11:04:17.856373+0000","last_clean":"2024-09-11T11:04:17.856373+0000","last_became_active":"2024-09-11T11:01:05.345474+0000","last_became_peered":"2024-09-11T11:01:05.345474+0000","last_unstale":"2024-09-11T11:04:17.856373+0000","last_undegraded":"2024-09-11T11:04:17.856373+0000","last_fullsized":"2024-09-11T11:04:17.856373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:50.321614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":206,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.841643+0000","last_change":"2024-09-11T11:00:51.371382+0000","last_active":"2024-09-11T11:02:42.841643+0000","last_peered":"2024-09-11T11:02:42.841643+0000","last_clean":"2024-09-11T11:02:42.841643+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:02:42.841643+0000","last_undegraded":"2024-09-11T11:02:42.841643+0000","last_fullsized":"2024-09-11T11:02:42.841643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_clean_scrub_stamp":"2024-09-11T11:00:49.442581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:56.798705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124201+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:02:42.124201+0000","last_peered":"2024-09-11T11:02:42.124201+0000","last_clean":"2024-09-11T11:02:42.124201+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:02:42.124201+0000","last_undegraded":"2024-09-11T11:02:42.124201+0000","last_fullsized":"2024-09-11T11:02:42.124201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:29.398076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110553+0000","last_change":"2024-09-11T11:01:03.345152+0000","last_active":"2024-09-11T11:02:42.110553+0000","last_peered":"2024-09-11T11:02:42.110553+0000","last_clean":"2024-09-11T11:02:42.110553+0000","last_became_active":"2024-09-11T11:01:03.334611+0000","last_became_peered":"2024-09-11T11:01:03.334611+0000","last_unstale":"2024-09-11T11:02:42.110553+0000","last_undegraded":"2024-09-11T11:02:42.110553+0000","last_fullsized":"2024-09-11T11:02:42.110553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:26:54.046187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843252+0000","last_change":"2024-09-11T11:01:07.352085+0000","last_active":"2024-09-11T11:02:42.843252+0000","last_peered":"2024-09-11T11:02:42.843252+0000","last_clean":"2024-09-11T11:02:42.843252+0000","last_became_active":"2024-09-11T11:01:07.348530+0000","last_became_peered":"2024-09-11T11:01:07.348530+0000","last_unstale":"2024-09-11T11:02:42.843252+0000","last_undegraded":"2024-09-11T11:02:42.843252+0000","last_fullsized":"2024-09-11T11:02:42.843252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:05.458479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.915190+0000","last_change":"2024-09-11T11:01:09.370703+0000","last_active":"2024-09-11T11:03:14.915190+0000","last_peered":"2024-09-11T11:03:14.915190+0000","last_clean":"2024-09-11T11:03:14.915190+0000","last_became_active":"2024-09-11T11:01:09.369066+0000","last_became_peered":"2024-09-11T11:01:09.369066+0000","last_unstale":"2024-09-11T11:03:14.915190+0000","last_undegraded":"2024-09-11T11:03:14.915190+0000","last_fullsized":"2024-09-11T11:03:14.915190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:36.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113047+0000","last_change":"2024-09-11T11:01:11.396326+0000","last_active":"2024-09-11T11:02:42.113047+0000","last_peered":"2024-09-11T11:02:42.113047+0000","last_clean":"2024-09-11T11:02:42.113047+0000","last_became_active":"2024-09-11T11:01:11.394277+0000","last_became_peered":"2024-09-11T11:01:11.394277+0000","last_unstale":"2024-09-11T11:02:42.113047+0000","last_undegraded":"2024-09-11T11:02:42.113047+0000","last_fullsized":"2024-09-11T11:02:42.113047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:23.366168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.947140+0000","last_change":"2024-09-11T11:01:13.413493+0000","last_active":"2024-09-11T11:04:17.947140+0000","last_peered":"2024-09-11T11:04:17.947140+0000","last_clean":"2024-09-11T11:04:17.947140+0000","last_became_active":"2024-09-11T11:01:13.412615+0000","last_became_peered":"2024-09-11T11:01:13.412615+0000","last_unstale":"2024-09-11T11:04:17.947140+0000","last_undegraded":"2024-09-11T11:04:17.947140+0000","last_fullsized":"2024-09-11T11:04:17.947140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:01.417923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.856351+0000","last_change":"2024-09-11T11:01:05.348037+0000","last_active":"2024-09-11T11:04:17.856351+0000","last_peered":"2024-09-11T11:04:17.856351+0000","last_clean":"2024-09-11T11:04:17.856351+0000","last_became_active":"2024-09-11T11:01:05.346710+0000","last_became_peered":"2024-09-11T11:01:05.346710+0000","last_unstale":"2024-09-11T11:04:17.856351+0000","last_undegraded":"2024-09-11T11:04:17.856351+0000","last_fullsized":"2024-09-11T11:04:17.856351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:08.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122859+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:02:42.122859+0000","last_peered":"2024-09-11T11:02:42.122859+0000","last_clean":"2024-09-11T11:02:42.122859+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:02:42.122859+0000","last_undegraded":"2024-09-11T11:02:42.122859+0000","last_fullsized":"2024-09-11T11:02:42.122859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:31:53.046144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844373+0000","last_change":"2024-09-11T11:01:03.326592+0000","last_active":"2024-09-11T11:02:42.844373+0000","last_peered":"2024-09-11T11:02:42.844373+0000","last_clean":"2024-09-11T11:02:42.844373+0000","last_became_active":"2024-09-11T11:01:03.325795+0000","last_became_peered":"2024-09-11T11:01:03.325795+0000","last_unstale":"2024-09-11T11:02:42.844373+0000","last_undegraded":"2024-09-11T11:02:42.844373+0000","last_fullsized":"2024-09-11T11:02:42.844373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:12:21.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129384+0000","last_change":"2024-09-11T11:01:07.361191+0000","last_active":"2024-09-11T11:02:42.129384+0000","last_peered":"2024-09-11T11:02:42.129384+0000","last_clean":"2024-09-11T11:02:42.129384+0000","last_became_active":"2024-09-11T11:01:07.360718+0000","last_became_peered":"2024-09-11T11:01:07.360718+0000","last_unstale":"2024-09-11T11:02:42.129384+0000","last_undegraded":"2024-09-11T11:02:42.129384+0000","last_fullsized":"2024-09-11T11:02:42.129384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:36:44.262635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'273","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597426+0000","last_change":"2024-09-11T11:01:09.377670+0000","last_active":"2024-09-11T11:04:17.597426+0000","last_peered":"2024-09-11T11:04:17.597426+0000","last_clean":"2024-09-11T11:04:17.597426+0000","last_became_active":"2024-09-11T11:01:09.376555+0000","last_became_peered":"2024-09-11T11:01:09.376555+0000","last_unstale":"2024-09-11T11:04:17.597426+0000","last_undegraded":"2024-09-11T11:04:17.597426+0000","last_fullsized":"2024-09-11T11:04:17.597426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:13.150085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112535+0000","last_change":"2024-09-11T11:01:11.400937+0000","last_active":"2024-09-11T11:02:42.112535+0000","last_peered":"2024-09-11T11:02:42.112535+0000","last_clean":"2024-09-11T11:02:42.112535+0000","last_became_active":"2024-09-11T11:01:11.400253+0000","last_became_peered":"2024-09-11T11:01:11.400253+0000","last_unstale":"2024-09-11T11:02:42.112535+0000","last_undegraded":"2024-09-11T11:02:42.112535+0000","last_fullsized":"2024-09-11T11:02:42.112535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:56.090713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'11","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843512+0000","last_change":"2024-09-11T11:01:13.422211+0000","last_active":"2024-09-11T11:02:42.843512+0000","last_peered":"2024-09-11T11:02:42.843512+0000","last_clean":"2024-09-11T11:02:42.843512+0000","last_became_active":"2024-09-11T11:01:13.421491+0000","last_became_peered":"2024-09-11T11:01:13.421491+0000","last_unstale":"2024-09-11T11:02:42.843512+0000","last_undegraded":"2024-09-11T11:02:42.843512+0000","last_fullsized":"2024-09-11T11:02:42.843512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:09:11.421051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.442243+0000","last_change":"2024-09-11T11:01:05.347801+0000","last_active":"2024-09-11T11:04:17.442243+0000","last_peered":"2024-09-11T11:04:17.442243+0000","last_clean":"2024-09-11T11:04:17.442243+0000","last_became_active":"2024-09-11T11:01:05.347359+0000","last_became_peered":"2024-09-11T11:01:05.347359+0000","last_unstale":"2024-09-11T11:04:17.442243+0000","last_undegraded":"2024-09-11T11:04:17.442243+0000","last_fullsized":"2024-09-11T11:04:17.442243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:17:27.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.496965+0000","last_change":"2024-09-11T11:00:56.127438+0000","last_active":"2024-09-11T11:02:42.496965+0000","last_peered":"2024-09-11T11:02:42.496965+0000","last_clean":"2024-09-11T11:02:42.496965+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:02:42.496965+0000","last_undegraded":"2024-09-11T11:02:42.496965+0000","last_fullsized":"2024-09-11T11:02:42.496965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:21.503625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842035+0000","last_change":"2024-09-11T11:01:03.325786+0000","last_active":"2024-09-11T11:02:42.842035+0000","last_peered":"2024-09-11T11:02:42.842035+0000","last_clean":"2024-09-11T11:02:42.842035+0000","last_became_active":"2024-09-11T11:01:03.325168+0000","last_became_peered":"2024-09-11T11:01:03.325168+0000","last_unstale":"2024-09-11T11:02:42.842035+0000","last_undegraded":"2024-09-11T11:02:42.842035+0000","last_fullsized":"2024-09-11T11:02:42.842035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:26.401311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":223,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.332529+0000","last_change":"2024-09-11T11:01:07.348097+0000","last_active":"2024-09-11T11:03:16.332529+0000","last_peered":"2024-09-11T11:03:16.332529+0000","last_clean":"2024-09-11T11:03:16.332529+0000","last_became_active":"2024-09-11T11:01:07.345998+0000","last_became_peered":"2024-09-11T11:01:07.345998+0000","last_unstale":"2024-09-11T11:03:16.332529+0000","last_undegraded":"2024-09-11T11:03:16.332529+0000","last_fullsized":"2024-09-11T11:03:16.332529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:01:22.783881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'17","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.944373+0000","last_change":"2024-09-11T11:01:09.372579+0000","last_active":"2024-09-11T11:04:17.944373+0000","last_peered":"2024-09-11T11:04:17.944373+0000","last_clean":"2024-09-11T11:04:17.944373+0000","last_became_active":"2024-09-11T11:01:09.371816+0000","last_became_peered":"2024-09-11T11:01:09.371816+0000","last_unstale":"2024-09-11T11:04:17.944373+0000","last_undegraded":"2024-09-11T11:04:17.944373+0000","last_fullsized":"2024-09-11T11:04:17.944373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:35.245802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843529+0000","last_change":"2024-09-11T11:01:11.392823+0000","last_active":"2024-09-11T11:02:42.843529+0000","last_peered":"2024-09-11T11:02:42.843529+0000","last_clean":"2024-09-11T11:02:42.843529+0000","last_became_active":"2024-09-11T11:01:11.392208+0000","last_became_peered":"2024-09-11T11:01:11.392208+0000","last_unstale":"2024-09-11T11:02:42.843529+0000","last_undegraded":"2024-09-11T11:02:42.843529+0000","last_fullsized":"2024-09-11T11:02:42.843529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:42:29.363507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114046+0000","last_change":"2024-09-11T11:01:13.408511+0000","last_active":"2024-09-11T11:02:42.114046+0000","last_peered":"2024-09-11T11:02:42.114046+0000","last_clean":"2024-09-11T11:02:42.114046+0000","last_became_active":"2024-09-11T11:01:13.406863+0000","last_became_peered":"2024-09-11T11:01:13.406863+0000","last_unstale":"2024-09-11T11:02:42.114046+0000","last_undegraded":"2024-09-11T11:02:42.114046+0000","last_fullsized":"2024-09-11T11:02:42.114046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:54.284696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845057+0000","last_change":"2024-09-11T11:01:05.333748+0000","last_active":"2024-09-11T11:02:42.845057+0000","last_peered":"2024-09-11T11:02:42.845057+0000","last_clean":"2024-09-11T11:02:42.845057+0000","last_became_active":"2024-09-11T11:01:05.332361+0000","last_became_peered":"2024-09-11T11:01:05.332361+0000","last_unstale":"2024-09-11T11:02:42.845057+0000","last_undegraded":"2024-09-11T11:02:42.845057+0000","last_fullsized":"2024-09-11T11:02:42.845057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:40:25.995301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123553+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:02:42.123553+0000","last_peered":"2024-09-11T11:02:42.123553+0000","last_clean":"2024-09-11T11:02:42.123553+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:02:42.123553+0000","last_undegraded":"2024-09-11T11:02:42.123553+0000","last_fullsized":"2024-09-11T11:02:42.123553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:00.420708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123842+0000","last_change":"2024-09-11T11:01:03.328169+0000","last_active":"2024-09-11T11:02:42.123842+0000","last_peered":"2024-09-11T11:02:42.123842+0000","last_clean":"2024-09-11T11:02:42.123842+0000","last_became_active":"2024-09-11T11:01:03.327456+0000","last_became_peered":"2024-09-11T11:01:03.327456+0000","last_unstale":"2024-09-11T11:02:42.123842+0000","last_undegraded":"2024-09-11T11:02:42.123842+0000","last_fullsized":"2024-09-11T11:02:42.123842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:11.883100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845875+0000","last_change":"2024-09-11T11:01:07.369393+0000","last_active":"2024-09-11T11:02:42.845875+0000","last_peered":"2024-09-11T11:02:42.845875+0000","last_clean":"2024-09-11T11:02:42.845875+0000","last_became_active":"2024-09-11T11:01:07.367962+0000","last_became_peered":"2024-09-11T11:01:07.367962+0000","last_unstale":"2024-09-11T11:02:42.845875+0000","last_undegraded":"2024-09-11T11:02:42.845875+0000","last_fullsized":"2024-09-11T11:02:42.845875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:35:29.768861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.859766+0000","last_change":"2024-09-11T11:01:09.390513+0000","last_active":"2024-09-11T11:04:16.859766+0000","last_peered":"2024-09-11T11:04:16.859766+0000","last_clean":"2024-09-11T11:04:16.859766+0000","last_became_active":"2024-09-11T11:01:09.389732+0000","last_became_peered":"2024-09-11T11:01:09.389732+0000","last_unstale":"2024-09-11T11:04:16.859766+0000","last_undegraded":"2024-09-11T11:04:16.859766+0000","last_fullsized":"2024-09-11T11:04:16.859766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:21.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116921+0000","last_change":"2024-09-11T11:01:11.398218+0000","last_active":"2024-09-11T11:02:42.116921+0000","last_peered":"2024-09-11T11:02:42.116921+0000","last_clean":"2024-09-11T11:02:42.116921+0000","last_became_active":"2024-09-11T11:01:11.397467+0000","last_became_peered":"2024-09-11T11:01:11.397467+0000","last_unstale":"2024-09-11T11:02:42.116921+0000","last_undegraded":"2024-09-11T11:02:42.116921+0000","last_fullsized":"2024-09-11T11:02:42.116921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:09:09.409131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.026023+0000","last_change":"2024-09-11T11:01:13.418703+0000","last_active":"2024-09-11T11:04:18.026023+0000","last_peered":"2024-09-11T11:04:18.026023+0000","last_clean":"2024-09-11T11:04:18.026023+0000","last_became_active":"2024-09-11T11:01:13.414898+0000","last_became_peered":"2024-09-11T11:01:13.414898+0000","last_unstale":"2024-09-11T11:04:18.026023+0000","last_undegraded":"2024-09-11T11:04:18.026023+0000","last_fullsized":"2024-09-11T11:04:18.026023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:40.285029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.769897+0000","last_change":"2024-09-11T11:01:05.343143+0000","last_active":"2024-09-11T11:04:17.769897+0000","last_peered":"2024-09-11T11:04:17.769897+0000","last_clean":"2024-09-11T11:04:17.769897+0000","last_became_active":"2024-09-11T11:01:05.342651+0000","last_became_peered":"2024-09-11T11:01:05.342651+0000","last_unstale":"2024-09-11T11:04:17.769897+0000","last_undegraded":"2024-09-11T11:04:17.769897+0000","last_fullsized":"2024-09-11T11:04:17.769897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:48:14.974986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126841+0000","last_change":"2024-09-11T11:01:03.338569+0000","last_active":"2024-09-11T11:02:42.126841+0000","last_peered":"2024-09-11T11:02:42.126841+0000","last_clean":"2024-09-11T11:02:42.126841+0000","last_became_active":"2024-09-11T11:01:03.336412+0000","last_became_peered":"2024-09-11T11:01:03.336412+0000","last_unstale":"2024-09-11T11:02:42.126841+0000","last_undegraded":"2024-09-11T11:02:42.126841+0000","last_fullsized":"2024-09-11T11:02:42.126841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:54:35.346732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843492+0000","last_change":"2024-09-11T11:00:55.878837+0000","last_active":"2024-09-11T11:02:42.843492+0000","last_peered":"2024-09-11T11:02:42.843492+0000","last_clean":"2024-09-11T11:02:42.843492+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:02:42.843492+0000","last_undegraded":"2024-09-11T11:02:42.843492+0000","last_fullsized":"2024-09-11T11:02:42.843492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.033101+0000","last_change":"2024-09-11T11:01:07.359762+0000","last_active":"2024-09-11T11:03:13.033101+0000","last_peered":"2024-09-11T11:03:13.033101+0000","last_clean":"2024-09-11T11:03:13.033101+0000","last_became_active":"2024-09-11T11:01:07.359228+0000","last_became_peered":"2024-09-11T11:01:07.359228+0000","last_unstale":"2024-09-11T11:03:13.033101+0000","last_undegraded":"2024-09-11T11:03:13.033101+0000","last_fullsized":"2024-09-11T11:03:13.033101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:33:49.649502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'62","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.915603+0000","last_change":"2024-09-11T11:01:09.361376+0000","last_active":"2024-09-11T11:03:14.915603+0000","last_peered":"2024-09-11T11:03:14.915603+0000","last_clean":"2024-09-11T11:03:14.915603+0000","last_became_active":"2024-09-11T11:01:09.360676+0000","last_became_peered":"2024-09-11T11:01:09.360676+0000","last_unstale":"2024-09-11T11:03:14.915603+0000","last_undegraded":"2024-09-11T11:03:14.915603+0000","last_fullsized":"2024-09-11T11:03:14.915603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:50.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123302+0000","last_change":"2024-09-11T11:01:11.386663+0000","last_active":"2024-09-11T11:02:42.123302+0000","last_peered":"2024-09-11T11:02:42.123302+0000","last_clean":"2024-09-11T11:02:42.123302+0000","last_became_active":"2024-09-11T11:01:11.384826+0000","last_became_peered":"2024-09-11T11:01:11.384826+0000","last_unstale":"2024-09-11T11:02:42.123302+0000","last_undegraded":"2024-09-11T11:02:42.123302+0000","last_fullsized":"2024-09-11T11:02:42.123302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:19.464704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.703110+0000","last_change":"2024-09-11T11:01:13.422273+0000","last_active":"2024-09-11T11:03:16.703110+0000","last_peered":"2024-09-11T11:03:16.703110+0000","last_clean":"2024-09-11T11:03:16.703110+0000","last_became_active":"2024-09-11T11:01:13.421181+0000","last_became_peered":"2024-09-11T11:01:13.421181+0000","last_unstale":"2024-09-11T11:03:16.703110+0000","last_undegraded":"2024-09-11T11:03:16.703110+0000","last_fullsized":"2024-09-11T11:03:16.703110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:34.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855771+0000","last_change":"2024-09-11T11:01:05.354294+0000","last_active":"2024-09-11T11:04:17.855771+0000","last_peered":"2024-09-11T11:04:17.855771+0000","last_clean":"2024-09-11T11:04:17.855771+0000","last_became_active":"2024-09-11T11:01:05.353896+0000","last_became_peered":"2024-09-11T11:01:05.353896+0000","last_unstale":"2024-09-11T11:04:17.855771+0000","last_undegraded":"2024-09-11T11:04:17.855771+0000","last_fullsized":"2024-09-11T11:04:17.855771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:59.773137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843845+0000","last_change":"2024-09-11T11:01:03.325763+0000","last_active":"2024-09-11T11:02:42.843845+0000","last_peered":"2024-09-11T11:02:42.843845+0000","last_clean":"2024-09-11T11:02:42.843845+0000","last_became_active":"2024-09-11T11:01:03.324923+0000","last_became_peered":"2024-09-11T11:01:03.324923+0000","last_unstale":"2024-09-11T11:02:42.843845+0000","last_undegraded":"2024-09-11T11:02:42.843845+0000","last_fullsized":"2024-09-11T11:02:42.843845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:14.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126572+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:02:42.126572+0000","last_peered":"2024-09-11T11:02:42.126572+0000","last_clean":"2024-09-11T11:02:42.126572+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:02:42.126572+0000","last_undegraded":"2024-09-11T11:02:42.126572+0000","last_fullsized":"2024-09-11T11:02:42.126572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122843+0000","last_change":"2024-09-11T11:01:07.360915+0000","last_active":"2024-09-11T11:02:42.122843+0000","last_peered":"2024-09-11T11:02:42.122843+0000","last_clean":"2024-09-11T11:02:42.122843+0000","last_became_active":"2024-09-11T11:01:07.360208+0000","last_became_peered":"2024-09-11T11:01:07.360208+0000","last_unstale":"2024-09-11T11:02:42.122843+0000","last_undegraded":"2024-09-11T11:02:42.122843+0000","last_fullsized":"2024-09-11T11:02:42.122843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:39.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843864+0000","last_change":"2024-09-11T11:01:09.383166+0000","last_active":"2024-09-11T11:02:42.843864+0000","last_peered":"2024-09-11T11:02:42.843864+0000","last_clean":"2024-09-11T11:02:42.843864+0000","last_became_active":"2024-09-11T11:01:09.382364+0000","last_became_peered":"2024-09-11T11:01:09.382364+0000","last_unstale":"2024-09-11T11:02:42.843864+0000","last_undegraded":"2024-09-11T11:02:42.843864+0000","last_fullsized":"2024-09-11T11:02:42.843864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:41.311952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":351,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.596675+0000","last_change":"2024-09-11T11:01:11.395761+0000","last_active":"2024-09-11T11:04:17.596675+0000","last_peered":"2024-09-11T11:04:17.596675+0000","last_clean":"2024-09-11T11:04:17.596675+0000","last_became_active":"2024-09-11T11:01:11.395016+0000","last_became_peered":"2024-09-11T11:01:11.395016+0000","last_unstale":"2024-09-11T11:04:17.596675+0000","last_undegraded":"2024-09-11T11:04:17.596675+0000","last_fullsized":"2024-09-11T11:04:17.596675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:12.765617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.831484+0000","last_change":"2024-09-11T11:01:13.423655+0000","last_active":"2024-09-11T11:04:17.831484+0000","last_peered":"2024-09-11T11:04:17.831484+0000","last_clean":"2024-09-11T11:04:17.831484+0000","last_became_active":"2024-09-11T11:01:13.422825+0000","last_became_peered":"2024-09-11T11:01:13.422825+0000","last_unstale":"2024-09-11T11:04:17.831484+0000","last_undegraded":"2024-09-11T11:04:17.831484+0000","last_fullsized":"2024-09-11T11:04:17.831484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:56.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'12","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.767965+0000","last_change":"2024-09-11T11:01:42.069205+0000","last_active":"2024-09-11T11:03:12.767965+0000","last_peered":"2024-09-11T11:03:12.767965+0000","last_clean":"2024-09-11T11:03:12.767965+0000","last_became_active":"2024-09-11T11:01:42.049256+0000","last_became_peered":"2024-09-11T11:01:42.049256+0000","last_unstale":"2024-09-11T11:03:12.767965+0000","last_undegraded":"2024-09-11T11:03:12.767965+0000","last_fullsized":"2024-09-11T11:03:12.767965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:18:53.891454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.750448+0000","last_change":"2024-09-11T11:01:03.351057+0000","last_active":"2024-09-11T11:04:17.750448+0000","last_peered":"2024-09-11T11:04:17.750448+0000","last_clean":"2024-09-11T11:04:17.750448+0000","last_became_active":"2024-09-11T11:01:03.349487+0000","last_became_peered":"2024-09-11T11:01:03.349487+0000","last_unstale":"2024-09-11T11:04:17.750448+0000","last_undegraded":"2024-09-11T11:04:17.750448+0000","last_fullsized":"2024-09-11T11:04:17.750448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:03.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845075+0000","last_change":"2024-09-11T11:00:55.878899+0000","last_active":"2024-09-11T11:02:42.845075+0000","last_peered":"2024-09-11T11:02:42.845075+0000","last_clean":"2024-09-11T11:02:42.845075+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:02:42.845075+0000","last_undegraded":"2024-09-11T11:02:42.845075+0000","last_fullsized":"2024-09-11T11:02:42.845075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:24.156776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122524+0000","last_change":"2024-09-11T11:01:07.344789+0000","last_active":"2024-09-11T11:02:42.122524+0000","last_peered":"2024-09-11T11:02:42.122524+0000","last_clean":"2024-09-11T11:02:42.122524+0000","last_became_active":"2024-09-11T11:01:07.344021+0000","last_became_peered":"2024-09-11T11:01:07.344021+0000","last_unstale":"2024-09-11T11:02:42.122524+0000","last_undegraded":"2024-09-11T11:02:42.122524+0000","last_fullsized":"2024-09-11T11:02:42.122524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:48:47.594716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111150+0000","last_change":"2024-09-11T11:01:09.380595+0000","last_active":"2024-09-11T11:02:42.111150+0000","last_peered":"2024-09-11T11:02:42.111150+0000","last_clean":"2024-09-11T11:02:42.111150+0000","last_became_active":"2024-09-11T11:01:09.379372+0000","last_became_peered":"2024-09-11T11:01:09.379372+0000","last_unstale":"2024-09-11T11:02:42.111150+0000","last_undegraded":"2024-09-11T11:02:42.111150+0000","last_fullsized":"2024-09-11T11:02:42.111150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:43.515100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.084413+0000","last_change":"2024-09-11T11:01:11.404411+0000","last_active":"2024-09-11T11:04:18.084413+0000","last_peered":"2024-09-11T11:04:18.084413+0000","last_clean":"2024-09-11T11:04:18.084413+0000","last_became_active":"2024-09-11T11:01:11.403355+0000","last_became_peered":"2024-09-11T11:01:11.403355+0000","last_unstale":"2024-09-11T11:04:18.084413+0000","last_undegraded":"2024-09-11T11:04:18.084413+0000","last_fullsized":"2024-09-11T11:04:18.084413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:37.993880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843018+0000","last_change":"2024-09-11T11:01:13.420938+0000","last_active":"2024-09-11T11:02:42.843018+0000","last_peered":"2024-09-11T11:02:42.843018+0000","last_clean":"2024-09-11T11:02:42.843018+0000","last_became_active":"2024-09-11T11:01:13.415413+0000","last_became_peered":"2024-09-11T11:01:13.415413+0000","last_unstale":"2024-09-11T11:02:42.843018+0000","last_undegraded":"2024-09-11T11:02:42.843018+0000","last_fullsized":"2024-09-11T11:02:42.843018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:06:12.988613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'13","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938421+0000","last_change":"2024-09-11T11:01:05.339012+0000","last_active":"2024-09-11T11:04:17.938421+0000","last_peered":"2024-09-11T11:04:17.938421+0000","last_clean":"2024-09-11T11:04:17.938421+0000","last_became_active":"2024-09-11T11:01:05.338465+0000","last_became_peered":"2024-09-11T11:01:05.338465+0000","last_unstale":"2024-09-11T11:04:17.938421+0000","last_undegraded":"2024-09-11T11:04:17.938421+0000","last_fullsized":"2024-09-11T11:04:17.938421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:07:59.232948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.736226+0000","last_change":"2024-09-11T11:01:03.327083+0000","last_active":"2024-09-11T11:04:17.736226+0000","last_peered":"2024-09-11T11:04:17.736226+0000","last_clean":"2024-09-11T11:04:17.736226+0000","last_became_active":"2024-09-11T11:01:03.325009+0000","last_became_peered":"2024-09-11T11:01:03.325009+0000","last_unstale":"2024-09-11T11:04:17.736226+0000","last_undegraded":"2024-09-11T11:04:17.736226+0000","last_fullsized":"2024-09-11T11:04:17.736226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:07.534323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127143+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:02:42.127143+0000","last_peered":"2024-09-11T11:02:42.127143+0000","last_clean":"2024-09-11T11:02:42.127143+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:02:42.127143+0000","last_undegraded":"2024-09-11T11:02:42.127143+0000","last_fullsized":"2024-09-11T11:02:42.127143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:52:42.400043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110145+0000","last_change":"2024-09-11T11:01:07.364237+0000","last_active":"2024-09-11T11:02:42.110145+0000","last_peered":"2024-09-11T11:02:42.110145+0000","last_clean":"2024-09-11T11:02:42.110145+0000","last_became_active":"2024-09-11T11:01:07.363499+0000","last_became_peered":"2024-09-11T11:01:07.363499+0000","last_unstale":"2024-09-11T11:02:42.110145+0000","last_undegraded":"2024-09-11T11:02:42.110145+0000","last_fullsized":"2024-09-11T11:02:42.110145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:05.458479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'82","reported_seq":158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.890359+0000","last_change":"2024-09-11T11:01:09.372054+0000","last_active":"2024-09-11T11:03:14.890359+0000","last_peered":"2024-09-11T11:03:14.890359+0000","last_clean":"2024-09-11T11:03:14.890359+0000","last_became_active":"2024-09-11T11:01:09.371312+0000","last_became_peered":"2024-09-11T11:01:09.371312+0000","last_unstale":"2024-09-11T11:03:14.890359+0000","last_undegraded":"2024-09-11T11:03:14.890359+0000","last_fullsized":"2024-09-11T11:03:14.890359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:16.530704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111457+0000","last_change":"2024-09-11T11:01:11.384314+0000","last_active":"2024-09-11T11:02:42.111457+0000","last_peered":"2024-09-11T11:02:42.111457+0000","last_clean":"2024-09-11T11:02:42.111457+0000","last_became_active":"2024-09-11T11:01:11.383342+0000","last_became_peered":"2024-09-11T11:01:11.383342+0000","last_unstale":"2024-09-11T11:02:42.111457+0000","last_undegraded":"2024-09-11T11:02:42.111457+0000","last_fullsized":"2024-09-11T11:02:42.111457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:19.950700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500048+0000","last_change":"2024-09-11T11:01:13.418374+0000","last_active":"2024-09-11T11:02:42.500048+0000","last_peered":"2024-09-11T11:02:42.500048+0000","last_clean":"2024-09-11T11:02:42.500048+0000","last_became_active":"2024-09-11T11:01:13.413156+0000","last_became_peered":"2024-09-11T11:01:13.413156+0000","last_unstale":"2024-09-11T11:02:42.500048+0000","last_undegraded":"2024-09-11T11:02:42.500048+0000","last_fullsized":"2024-09-11T11:02:42.500048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:07:28.142970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500143+0000","last_change":"2024-09-11T11:01:13.418594+0000","last_active":"2024-09-11T11:02:42.500143+0000","last_peered":"2024-09-11T11:02:42.500143+0000","last_clean":"2024-09-11T11:02:42.500143+0000","last_became_active":"2024-09-11T11:01:13.413535+0000","last_became_peered":"2024-09-11T11:01:13.413535+0000","last_unstale":"2024-09-11T11:02:42.500143+0000","last_undegraded":"2024-09-11T11:02:42.500143+0000","last_fullsized":"2024-09-11T11:02:42.500143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:31:24.015178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'9","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036251+0000","last_change":"2024-09-11T11:01:05.338098+0000","last_active":"2024-09-11T11:03:28.036251+0000","last_peered":"2024-09-11T11:03:28.036251+0000","last_clean":"2024-09-11T11:03:28.036251+0000","last_became_active":"2024-09-11T11:01:05.337509+0000","last_became_peered":"2024-09-11T11:01:05.337509+0000","last_unstale":"2024-09-11T11:03:28.036251+0000","last_undegraded":"2024-09-11T11:03:28.036251+0000","last_fullsized":"2024-09-11T11:03:28.036251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:26.300276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124980+0000","last_change":"2024-09-11T11:01:03.321762+0000","last_active":"2024-09-11T11:02:42.124980+0000","last_peered":"2024-09-11T11:02:42.124980+0000","last_clean":"2024-09-11T11:02:42.124980+0000","last_became_active":"2024-09-11T11:01:03.320981+0000","last_became_peered":"2024-09-11T11:01:03.320981+0000","last_unstale":"2024-09-11T11:02:42.124980+0000","last_undegraded":"2024-09-11T11:02:42.124980+0000","last_fullsized":"2024-09-11T11:02:42.124980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:03.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842801+0000","last_change":"2024-09-11T11:01:07.369265+0000","last_active":"2024-09-11T11:02:42.842801+0000","last_peered":"2024-09-11T11:02:42.842801+0000","last_clean":"2024-09-11T11:02:42.842801+0000","last_became_active":"2024-09-11T11:01:07.367778+0000","last_became_peered":"2024-09-11T11:01:07.367778+0000","last_unstale":"2024-09-11T11:02:42.842801+0000","last_undegraded":"2024-09-11T11:02:42.842801+0000","last_fullsized":"2024-09-11T11:02:42.842801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:13.316958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.901680+0000","last_change":"2024-09-11T11:01:09.372426+0000","last_active":"2024-09-11T11:03:14.901680+0000","last_peered":"2024-09-11T11:03:14.901680+0000","last_clean":"2024-09-11T11:03:14.901680+0000","last_became_active":"2024-09-11T11:01:09.369318+0000","last_became_peered":"2024-09-11T11:01:09.369318+0000","last_unstale":"2024-09-11T11:03:14.901680+0000","last_undegraded":"2024-09-11T11:03:14.901680+0000","last_fullsized":"2024-09-11T11:03:14.901680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:11.108714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111320+0000","last_change":"2024-09-11T11:01:11.397868+0000","last_active":"2024-09-11T11:02:42.111320+0000","last_peered":"2024-09-11T11:02:42.111320+0000","last_clean":"2024-09-11T11:02:42.111320+0000","last_became_active":"2024-09-11T11:01:11.396833+0000","last_became_peered":"2024-09-11T11:01:11.396833+0000","last_unstale":"2024-09-11T11:02:42.111320+0000","last_undegraded":"2024-09-11T11:02:42.111320+0000","last_fullsized":"2024-09-11T11:02:42.111320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:06:10.976693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.485342+0000","last_change":"2024-09-11T11:01:13.408361+0000","last_active":"2024-09-11T11:03:14.485342+0000","last_peered":"2024-09-11T11:03:14.485342+0000","last_clean":"2024-09-11T11:03:14.485342+0000","last_became_active":"2024-09-11T11:01:13.407663+0000","last_became_peered":"2024-09-11T11:01:13.407663+0000","last_unstale":"2024-09-11T11:03:14.485342+0000","last_undegraded":"2024-09-11T11:03:14.485342+0000","last_fullsized":"2024-09-11T11:03:14.485342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:55:13.024275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.572787+0000","last_change":"2024-09-11T11:01:05.340874+0000","last_active":"2024-09-11T11:04:17.572787+0000","last_peered":"2024-09-11T11:04:17.572787+0000","last_clean":"2024-09-11T11:04:17.572787+0000","last_became_active":"2024-09-11T11:01:05.340457+0000","last_became_peered":"2024-09-11T11:01:05.340457+0000","last_unstale":"2024-09-11T11:04:17.572787+0000","last_undegraded":"2024-09-11T11:04:17.572787+0000","last_fullsized":"2024-09-11T11:04:17.572787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:13:20.748246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498765+0000","last_change":"2024-09-11T11:01:03.336186+0000","last_active":"2024-09-11T11:02:42.498765+0000","last_peered":"2024-09-11T11:02:42.498765+0000","last_clean":"2024-09-11T11:02:42.498765+0000","last_became_active":"2024-09-11T11:01:03.335235+0000","last_became_peered":"2024-09-11T11:01:03.335235+0000","last_unstale":"2024-09-11T11:02:42.498765+0000","last_undegraded":"2024-09-11T11:02:42.498765+0000","last_fullsized":"2024-09-11T11:02:42.498765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:32:59.574503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.504244+0000","last_change":"2024-09-11T11:02:42.502850+0000","last_active":"2024-09-11T11:02:42.504244+0000","last_peered":"2024-09-11T11:02:42.504244+0000","last_clean":"2024-09-11T11:02:42.504244+0000","last_became_active":"2024-09-11T11:02:42.501867+0000","last_became_peered":"2024-09-11T11:02:42.501867+0000","last_unstale":"2024-09-11T11:02:42.504244+0000","last_undegraded":"2024-09-11T11:02:42.504244+0000","last_fullsized":"2024-09-11T11:02:42.504244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:44:22.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.868748+0000","last_change":"2024-09-11T11:01:09.363815+0000","last_active":"2024-09-11T11:04:16.868748+0000","last_peered":"2024-09-11T11:04:16.868748+0000","last_clean":"2024-09-11T11:04:16.868748+0000","last_became_active":"2024-09-11T11:01:09.362975+0000","last_became_peered":"2024-09-11T11:01:09.362975+0000","last_unstale":"2024-09-11T11:04:16.868748+0000","last_undegraded":"2024-09-11T11:04:16.868748+0000","last_fullsized":"2024-09-11T11:04:16.868748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:48:49.614061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497830+0000","last_change":"2024-09-11T11:01:11.393863+0000","last_active":"2024-09-11T11:02:42.497830+0000","last_peered":"2024-09-11T11:02:42.497830+0000","last_clean":"2024-09-11T11:02:42.497830+0000","last_became_active":"2024-09-11T11:01:11.393181+0000","last_became_peered":"2024-09-11T11:01:11.393181+0000","last_unstale":"2024-09-11T11:02:42.497830+0000","last_undegraded":"2024-09-11T11:02:42.497830+0000","last_fullsized":"2024-09-11T11:02:42.497830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:48.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.983086+0000","last_change":"2024-09-11T11:01:13.419907+0000","last_active":"2024-09-11T11:04:16.983086+0000","last_peered":"2024-09-11T11:04:16.983086+0000","last_clean":"2024-09-11T11:04:16.983086+0000","last_became_active":"2024-09-11T11:01:13.419238+0000","last_became_peered":"2024-09-11T11:01:13.419238+0000","last_unstale":"2024-09-11T11:04:16.983086+0000","last_undegraded":"2024-09-11T11:04:16.983086+0000","last_fullsized":"2024-09-11T11:04:16.983086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:21.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921392+0000","last_change":"2024-09-11T11:01:42.073807+0000","last_active":"2024-09-11T11:04:17.921392+0000","last_peered":"2024-09-11T11:04:17.921392+0000","last_clean":"2024-09-11T11:04:17.921392+0000","last_became_active":"2024-09-11T11:01:42.058258+0000","last_became_peered":"2024-09-11T11:01:42.058258+0000","last_unstale":"2024-09-11T11:04:17.921392+0000","last_undegraded":"2024-09-11T11:04:17.921392+0000","last_fullsized":"2024-09-11T11:04:17.921392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:23:48.191355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127148+0000","last_change":"2024-09-11T11:01:03.339928+0000","last_active":"2024-09-11T11:02:42.127148+0000","last_peered":"2024-09-11T11:02:42.127148+0000","last_clean":"2024-09-11T11:02:42.127148+0000","last_became_active":"2024-09-11T11:01:03.337144+0000","last_became_peered":"2024-09-11T11:01:03.337144+0000","last_unstale":"2024-09-11T11:02:42.127148+0000","last_undegraded":"2024-09-11T11:02:42.127148+0000","last_fullsized":"2024-09-11T11:02:42.127148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:53:40.334818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"36'4","reported_seq":230,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.319107+0000","last_change":"2024-09-11T11:01:07.358746+0000","last_active":"2024-09-11T11:03:16.319107+0000","last_peered":"2024-09-11T11:03:16.319107+0000","last_clean":"2024-09-11T11:03:16.319107+0000","last_became_active":"2024-09-11T11:01:07.358156+0000","last_became_peered":"2024-09-11T11:01:07.358156+0000","last_unstale":"2024-09-11T11:03:16.319107+0000","last_undegraded":"2024-09-11T11:03:16.319107+0000","last_fullsized":"2024-09-11T11:03:16.319107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:14.921699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'41","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.362531+0000","last_change":"2024-09-11T11:01:09.385303+0000","last_active":"2024-09-11T11:04:17.362531+0000","last_peered":"2024-09-11T11:04:17.362531+0000","last_clean":"2024-09-11T11:04:17.362531+0000","last_became_active":"2024-09-11T11:01:09.380595+0000","last_became_peered":"2024-09-11T11:01:09.380595+0000","last_unstale":"2024-09-11T11:04:17.362531+0000","last_undegraded":"2024-09-11T11:04:17.362531+0000","last_fullsized":"2024-09-11T11:04:17.362531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:12:15.180214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":63,"num_read_kb":66,"num_write":48,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.841780+0000","last_change":"2024-09-11T11:01:11.402562+0000","last_active":"2024-09-11T11:02:42.841780+0000","last_peered":"2024-09-11T11:02:42.841780+0000","last_clean":"2024-09-11T11:02:42.841780+0000","last_became_active":"2024-09-11T11:01:11.401847+0000","last_became_peered":"2024-09-11T11:01:11.401847+0000","last_unstale":"2024-09-11T11:02:42.841780+0000","last_undegraded":"2024-09-11T11:02:42.841780+0000","last_fullsized":"2024-09-11T11:02:42.841780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:24:37.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110992+0000","last_change":"2024-09-11T11:01:13.397280+0000","last_active":"2024-09-11T11:02:42.110992+0000","last_peered":"2024-09-11T11:02:42.110992+0000","last_clean":"2024-09-11T11:02:42.110992+0000","last_became_active":"2024-09-11T11:01:13.395231+0000","last_became_peered":"2024-09-11T11:01:13.395231+0000","last_unstale":"2024-09-11T11:02:42.110992+0000","last_undegraded":"2024-09-11T11:02:42.110992+0000","last_fullsized":"2024-09-11T11:02:42.110992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:00:32.324647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.940026+0000","last_change":"2024-09-11T11:01:05.348465+0000","last_active":"2024-09-11T11:04:17.940026+0000","last_peered":"2024-09-11T11:04:17.940026+0000","last_clean":"2024-09-11T11:04:17.940026+0000","last_became_active":"2024-09-11T11:01:05.348002+0000","last_became_peered":"2024-09-11T11:01:05.348002+0000","last_unstale":"2024-09-11T11:04:17.940026+0000","last_undegraded":"2024-09-11T11:04:17.940026+0000","last_fullsized":"2024-09-11T11:04:17.940026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:27:41.532168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847625+0000","last_change":"2024-09-11T11:01:03.338184+0000","last_active":"2024-09-11T11:02:42.847625+0000","last_peered":"2024-09-11T11:02:42.847625+0000","last_clean":"2024-09-11T11:02:42.847625+0000","last_became_active":"2024-09-11T11:01:03.330782+0000","last_became_peered":"2024-09-11T11:01:03.330782+0000","last_unstale":"2024-09-11T11:02:42.847625+0000","last_undegraded":"2024-09-11T11:02:42.847625+0000","last_fullsized":"2024-09-11T11:02:42.847625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:42.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111231+0000","last_change":"2024-09-11T11:01:07.351359+0000","last_active":"2024-09-11T11:02:42.111231+0000","last_peered":"2024-09-11T11:02:42.111231+0000","last_clean":"2024-09-11T11:02:42.111231+0000","last_became_active":"2024-09-11T11:01:07.350685+0000","last_became_peered":"2024-09-11T11:01:07.350685+0000","last_unstale":"2024-09-11T11:02:42.111231+0000","last_undegraded":"2024-09-11T11:02:42.111231+0000","last_fullsized":"2024-09-11T11:02:42.111231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:39.784471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.876511+0000","last_change":"2024-09-11T11:01:09.363365+0000","last_active":"2024-09-11T11:03:14.876511+0000","last_peered":"2024-09-11T11:03:14.876511+0000","last_clean":"2024-09-11T11:03:14.876511+0000","last_became_active":"2024-09-11T11:01:09.362483+0000","last_became_peered":"2024-09-11T11:01:09.362483+0000","last_unstale":"2024-09-11T11:03:14.876511+0000","last_undegraded":"2024-09-11T11:03:14.876511+0000","last_fullsized":"2024-09-11T11:03:14.876511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:30.250968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500588+0000","last_change":"2024-09-11T11:01:11.399469+0000","last_active":"2024-09-11T11:02:42.500588+0000","last_peered":"2024-09-11T11:02:42.500588+0000","last_clean":"2024-09-11T11:02:42.500588+0000","last_became_active":"2024-09-11T11:01:11.398843+0000","last_became_peered":"2024-09-11T11:01:11.398843+0000","last_unstale":"2024-09-11T11:02:42.500588+0000","last_undegraded":"2024-09-11T11:02:42.500588+0000","last_fullsized":"2024-09-11T11:02:42.500588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:44:43.419308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770552+0000","last_change":"2024-09-11T11:01:05.348376+0000","last_active":"2024-09-11T11:04:17.770552+0000","last_peered":"2024-09-11T11:04:17.770552+0000","last_clean":"2024-09-11T11:04:17.770552+0000","last_became_active":"2024-09-11T11:01:05.347496+0000","last_became_peered":"2024-09-11T11:01:05.347496+0000","last_unstale":"2024-09-11T11:04:17.770552+0000","last_undegraded":"2024-09-11T11:04:17.770552+0000","last_fullsized":"2024-09-11T11:04:17.770552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:32.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109337+0000","last_change":"2024-09-11T11:01:03.349185+0000","last_active":"2024-09-11T11:02:42.109337+0000","last_peered":"2024-09-11T11:02:42.109337+0000","last_clean":"2024-09-11T11:02:42.109337+0000","last_became_active":"2024-09-11T11:01:03.348849+0000","last_became_peered":"2024-09-11T11:01:03.348849+0000","last_unstale":"2024-09-11T11:02:42.109337+0000","last_undegraded":"2024-09-11T11:02:42.109337+0000","last_fullsized":"2024-09-11T11:02:42.109337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:33.180623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847481+0000","last_change":"2024-09-11T11:01:07.366791+0000","last_active":"2024-09-11T11:02:42.847481+0000","last_peered":"2024-09-11T11:02:42.847481+0000","last_clean":"2024-09-11T11:02:42.847481+0000","last_became_active":"2024-09-11T11:01:07.365953+0000","last_became_peered":"2024-09-11T11:01:07.365953+0000","last_unstale":"2024-09-11T11:02:42.847481+0000","last_undegraded":"2024-09-11T11:02:42.847481+0000","last_fullsized":"2024-09-11T11:02:42.847481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:09:50.935366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.912449+0000","last_change":"2024-09-11T11:01:09.375348+0000","last_active":"2024-09-11T11:03:14.912449+0000","last_peered":"2024-09-11T11:03:14.912449+0000","last_clean":"2024-09-11T11:03:14.912449+0000","last_became_active":"2024-09-11T11:01:09.374937+0000","last_became_peered":"2024-09-11T11:01:09.374937+0000","last_unstale":"2024-09-11T11:03:14.912449+0000","last_undegraded":"2024-09-11T11:03:14.912449+0000","last_fullsized":"2024-09-11T11:03:14.912449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:33:50.006729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499366+0000","last_change":"2024-09-11T11:01:11.395444+0000","last_active":"2024-09-11T11:02:42.499366+0000","last_peered":"2024-09-11T11:02:42.499366+0000","last_clean":"2024-09-11T11:02:42.499366+0000","last_became_active":"2024-09-11T11:01:11.394849+0000","last_became_peered":"2024-09-11T11:01:11.394849+0000","last_unstale":"2024-09-11T11:02:42.499366+0000","last_undegraded":"2024-09-11T11:02:42.499366+0000","last_fullsized":"2024-09-11T11:02:42.499366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:14:10.559226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.693746+0000","last_change":"2024-09-11T11:01:13.416940+0000","last_active":"2024-09-11T11:03:16.693746+0000","last_peered":"2024-09-11T11:03:16.693746+0000","last_clean":"2024-09-11T11:03:16.693746+0000","last_became_active":"2024-09-11T11:01:13.416414+0000","last_became_peered":"2024-09-11T11:01:13.416414+0000","last_unstale":"2024-09-11T11:03:16.693746+0000","last_undegraded":"2024-09-11T11:03:16.693746+0000","last_fullsized":"2024-09-11T11:03:16.693746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:02:37.102253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845863+0000","last_change":"2024-09-11T11:01:05.340233+0000","last_active":"2024-09-11T11:02:42.845863+0000","last_peered":"2024-09-11T11:02:42.845863+0000","last_clean":"2024-09-11T11:02:42.845863+0000","last_became_active":"2024-09-11T11:01:05.339898+0000","last_became_peered":"2024-09-11T11:01:05.339898+0000","last_unstale":"2024-09-11T11:02:42.845863+0000","last_undegraded":"2024-09-11T11:02:42.845863+0000","last_fullsized":"2024-09-11T11:02:42.845863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:51.046871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'3","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.039656+0000","last_change":"2024-09-11T11:01:42.094568+0000","last_active":"2024-09-11T11:03:28.039656+0000","last_peered":"2024-09-11T11:03:28.039656+0000","last_clean":"2024-09-11T11:03:28.039656+0000","last_became_active":"2024-09-11T11:01:42.058648+0000","last_became_peered":"2024-09-11T11:01:42.058648+0000","last_unstale":"2024-09-11T11:03:28.039656+0000","last_undegraded":"2024-09-11T11:03:28.039656+0000","last_fullsized":"2024-09-11T11:03:28.039656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:41.034099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129527+0000","last_change":"2024-09-11T11:01:07.340610+0000","last_active":"2024-09-11T11:02:42.129527+0000","last_peered":"2024-09-11T11:02:42.129527+0000","last_clean":"2024-09-11T11:02:42.129527+0000","last_became_active":"2024-09-11T11:01:07.340147+0000","last_became_peered":"2024-09-11T11:01:07.340147+0000","last_unstale":"2024-09-11T11:02:42.129527+0000","last_undegraded":"2024-09-11T11:02:42.129527+0000","last_fullsized":"2024-09-11T11:02:42.129527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:59:55.768264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.878428+0000","last_change":"2024-09-11T11:01:09.372272+0000","last_active":"2024-09-11T11:03:14.878428+0000","last_peered":"2024-09-11T11:03:14.878428+0000","last_clean":"2024-09-11T11:03:14.878428+0000","last_became_active":"2024-09-11T11:01:09.371522+0000","last_became_peered":"2024-09-11T11:01:09.371522+0000","last_unstale":"2024-09-11T11:03:14.878428+0000","last_undegraded":"2024-09-11T11:03:14.878428+0000","last_fullsized":"2024-09-11T11:03:14.878428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:58:05.506059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847450+0000","last_change":"2024-09-11T11:01:11.393543+0000","last_active":"2024-09-11T11:02:42.847450+0000","last_peered":"2024-09-11T11:02:42.847450+0000","last_clean":"2024-09-11T11:02:42.847450+0000","last_became_active":"2024-09-11T11:01:11.392489+0000","last_became_peered":"2024-09-11T11:01:11.392489+0000","last_unstale":"2024-09-11T11:02:42.847450+0000","last_undegraded":"2024-09-11T11:02:42.847450+0000","last_fullsized":"2024-09-11T11:02:42.847450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:57.060008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121990+0000","last_change":"2024-09-11T11:01:13.405032+0000","last_active":"2024-09-11T11:02:42.121990+0000","last_peered":"2024-09-11T11:02:42.121990+0000","last_clean":"2024-09-11T11:02:42.121990+0000","last_became_active":"2024-09-11T11:01:13.404341+0000","last_became_peered":"2024-09-11T11:01:13.404341+0000","last_unstale":"2024-09-11T11:02:42.121990+0000","last_undegraded":"2024-09-11T11:02:42.121990+0000","last_fullsized":"2024-09-11T11:02:42.121990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:41:29.058689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'18","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836712+0000","last_change":"2024-09-11T11:01:05.348158+0000","last_active":"2024-09-11T11:03:16.836712+0000","last_peered":"2024-09-11T11:03:16.836712+0000","last_clean":"2024-09-11T11:03:16.836712+0000","last_became_active":"2024-09-11T11:01:05.347745+0000","last_became_peered":"2024-09-11T11:01:05.347745+0000","last_unstale":"2024-09-11T11:03:16.836712+0000","last_undegraded":"2024-09-11T11:03:16.836712+0000","last_fullsized":"2024-09-11T11:03:16.836712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:16:36.575022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124170+0000","last_change":"2024-09-11T11:01:03.322039+0000","last_active":"2024-09-11T11:02:42.124170+0000","last_peered":"2024-09-11T11:02:42.124170+0000","last_clean":"2024-09-11T11:02:42.124170+0000","last_became_active":"2024-09-11T11:01:03.321106+0000","last_became_peered":"2024-09-11T11:01:03.321106+0000","last_unstale":"2024-09-11T11:02:42.124170+0000","last_undegraded":"2024-09-11T11:02:42.124170+0000","last_fullsized":"2024-09-11T11:02:42.124170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.482692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124610+0000","last_change":"2024-09-11T11:01:07.343664+0000","last_active":"2024-09-11T11:02:42.124610+0000","last_peered":"2024-09-11T11:02:42.124610+0000","last_clean":"2024-09-11T11:02:42.124610+0000","last_became_active":"2024-09-11T11:01:07.342760+0000","last_became_peered":"2024-09-11T11:01:07.342760+0000","last_unstale":"2024-09-11T11:02:42.124610+0000","last_undegraded":"2024-09-11T11:02:42.124610+0000","last_fullsized":"2024-09-11T11:02:42.124610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:48.492230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'34","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.465133+0000","last_change":"2024-09-11T11:01:09.390274+0000","last_active":"2024-09-11T11:04:17.465133+0000","last_peered":"2024-09-11T11:04:17.465133+0000","last_clean":"2024-09-11T11:04:17.465133+0000","last_became_active":"2024-09-11T11:01:09.389548+0000","last_became_peered":"2024-09-11T11:01:09.389548+0000","last_unstale":"2024-09-11T11:04:17.465133+0000","last_undegraded":"2024-09-11T11:04:17.465133+0000","last_fullsized":"2024-09-11T11:04:17.465133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:55.045450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847493+0000","last_change":"2024-09-11T11:01:11.391754+0000","last_active":"2024-09-11T11:02:42.847493+0000","last_peered":"2024-09-11T11:02:42.847493+0000","last_clean":"2024-09-11T11:02:42.847493+0000","last_became_active":"2024-09-11T11:01:11.391080+0000","last_became_peered":"2024-09-11T11:01:11.391080+0000","last_unstale":"2024-09-11T11:02:42.847493+0000","last_undegraded":"2024-09-11T11:02:42.847493+0000","last_fullsized":"2024-09-11T11:02:42.847493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:23.746419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.825662+0000","last_change":"2024-09-11T11:01:13.421751+0000","last_active":"2024-09-11T11:03:16.825662+0000","last_peered":"2024-09-11T11:03:16.825662+0000","last_clean":"2024-09-11T11:03:16.825662+0000","last_became_active":"2024-09-11T11:01:13.420844+0000","last_became_peered":"2024-09-11T11:01:13.420844+0000","last_unstale":"2024-09-11T11:03:16.825662+0000","last_undegraded":"2024-09-11T11:03:16.825662+0000","last_fullsized":"2024-09-11T11:03:16.825662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:01:42.372122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.443118+0000","last_change":"2024-09-11T11:01:05.339320+0000","last_active":"2024-09-11T11:04:17.443118+0000","last_peered":"2024-09-11T11:04:17.443118+0000","last_clean":"2024-09-11T11:04:17.443118+0000","last_became_active":"2024-09-11T11:01:05.338036+0000","last_became_peered":"2024-09-11T11:01:05.338036+0000","last_unstale":"2024-09-11T11:04:17.443118+0000","last_undegraded":"2024-09-11T11:04:17.443118+0000","last_fullsized":"2024-09-11T11:04:17.443118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:32.889486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.908157+0000","last_change":"2024-09-11T11:01:03.336252+0000","last_active":"2024-09-11T11:04:17.908157+0000","last_peered":"2024-09-11T11:04:17.908157+0000","last_clean":"2024-09-11T11:04:17.908157+0000","last_became_active":"2024-09-11T11:01:03.335959+0000","last_became_peered":"2024-09-11T11:01:03.335959+0000","last_unstale":"2024-09-11T11:04:17.908157+0000","last_undegraded":"2024-09-11T11:04:17.908157+0000","last_fullsized":"2024-09-11T11:04:17.908157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:07.534323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847461+0000","last_change":"2024-09-11T11:01:07.370087+0000","last_active":"2024-09-11T11:02:42.847461+0000","last_peered":"2024-09-11T11:02:42.847461+0000","last_clean":"2024-09-11T11:02:42.847461+0000","last_became_active":"2024-09-11T11:01:07.368853+0000","last_became_peered":"2024-09-11T11:01:07.368853+0000","last_unstale":"2024-09-11T11:02:42.847461+0000","last_undegraded":"2024-09-11T11:02:42.847461+0000","last_fullsized":"2024-09-11T11:02:42.847461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:39.784471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115820+0000","last_change":"2024-09-11T11:01:09.391884+0000","last_active":"2024-09-11T11:02:42.115820+0000","last_peered":"2024-09-11T11:02:42.115820+0000","last_clean":"2024-09-11T11:02:42.115820+0000","last_became_active":"2024-09-11T11:01:09.391249+0000","last_became_peered":"2024-09-11T11:01:09.391249+0000","last_unstale":"2024-09-11T11:02:42.115820+0000","last_undegraded":"2024-09-11T11:02:42.115820+0000","last_fullsized":"2024-09-11T11:02:42.115820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:42:27.348949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":371,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597039+0000","last_change":"2024-09-11T11:01:11.403073+0000","last_active":"2024-09-11T11:04:17.597039+0000","last_peered":"2024-09-11T11:04:17.597039+0000","last_clean":"2024-09-11T11:04:17.597039+0000","last_became_active":"2024-09-11T11:01:11.401400+0000","last_became_peered":"2024-09-11T11:01:11.401400+0000","last_unstale":"2024-09-11T11:04:17.597039+0000","last_undegraded":"2024-09-11T11:04:17.597039+0000","last_fullsized":"2024-09-11T11:04:17.597039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:49.090546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121310+0000","last_change":"2024-09-11T11:01:13.403086+0000","last_active":"2024-09-11T11:02:42.121310+0000","last_peered":"2024-09-11T11:02:42.121310+0000","last_clean":"2024-09-11T11:02:42.121310+0000","last_became_active":"2024-09-11T11:01:13.402406+0000","last_became_peered":"2024-09-11T11:01:13.402406+0000","last_unstale":"2024-09-11T11:02:42.121310+0000","last_undegraded":"2024-09-11T11:02:42.121310+0000","last_fullsized":"2024-09-11T11:02:42.121310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:56.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'5","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.038763+0000","last_change":"2024-09-11T11:01:05.353823+0000","last_active":"2024-09-11T11:03:38.038763+0000","last_peered":"2024-09-11T11:03:38.038763+0000","last_clean":"2024-09-11T11:03:38.038763+0000","last_became_active":"2024-09-11T11:01:05.353214+0000","last_became_peered":"2024-09-11T11:01:05.353214+0000","last_unstale":"2024-09-11T11:03:38.038763+0000","last_undegraded":"2024-09-11T11:03:38.038763+0000","last_fullsized":"2024-09-11T11:03:38.038763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:59:11.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844327+0000","last_change":"2024-09-11T11:01:03.346782+0000","last_active":"2024-09-11T11:02:42.844327+0000","last_peered":"2024-09-11T11:02:42.844327+0000","last_clean":"2024-09-11T11:02:42.844327+0000","last_became_active":"2024-09-11T11:01:03.346318+0000","last_became_peered":"2024-09-11T11:01:03.346318+0000","last_unstale":"2024-09-11T11:02:42.844327+0000","last_undegraded":"2024-09-11T11:02:42.844327+0000","last_fullsized":"2024-09-11T11:02:42.844327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:08.559205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843531+0000","last_change":"2024-09-11T11:01:07.369704+0000","last_active":"2024-09-11T11:02:42.843531+0000","last_peered":"2024-09-11T11:02:42.843531+0000","last_clean":"2024-09-11T11:02:42.843531+0000","last_became_active":"2024-09-11T11:01:07.368713+0000","last_became_peered":"2024-09-11T11:01:07.368713+0000","last_unstale":"2024-09-11T11:02:42.843531+0000","last_undegraded":"2024-09-11T11:02:42.843531+0000","last_fullsized":"2024-09-11T11:02:42.843531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:00:00.692745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.862353+0000","last_change":"2024-09-11T11:01:09.364363+0000","last_active":"2024-09-11T11:03:14.862353+0000","last_peered":"2024-09-11T11:03:14.862353+0000","last_clean":"2024-09-11T11:03:14.862353+0000","last_became_active":"2024-09-11T11:01:09.363530+0000","last_became_peered":"2024-09-11T11:01:09.363530+0000","last_unstale":"2024-09-11T11:03:14.862353+0000","last_undegraded":"2024-09-11T11:03:14.862353+0000","last_fullsized":"2024-09-11T11:03:14.862353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:20:25.511602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109273+0000","last_change":"2024-09-11T11:01:11.373298+0000","last_active":"2024-09-11T11:02:42.109273+0000","last_peered":"2024-09-11T11:02:42.109273+0000","last_clean":"2024-09-11T11:02:42.109273+0000","last_became_active":"2024-09-11T11:01:11.371526+0000","last_became_peered":"2024-09-11T11:01:11.371526+0000","last_unstale":"2024-09-11T11:02:42.109273+0000","last_undegraded":"2024-09-11T11:02:42.109273+0000","last_fullsized":"2024-09-11T11:02:42.109273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:18.545262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129245+0000","last_change":"2024-09-11T11:01:13.421954+0000","last_active":"2024-09-11T11:02:42.129245+0000","last_peered":"2024-09-11T11:02:42.129245+0000","last_clean":"2024-09-11T11:02:42.129245+0000","last_became_active":"2024-09-11T11:01:13.421220+0000","last_became_peered":"2024-09-11T11:01:13.421220+0000","last_unstale":"2024-09-11T11:02:42.129245+0000","last_undegraded":"2024-09-11T11:02:42.129245+0000","last_fullsized":"2024-09-11T11:02:42.129245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:37.260215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.769226+0000","last_change":"2024-09-11T11:01:05.348922+0000","last_active":"2024-09-11T11:03:12.769226+0000","last_peered":"2024-09-11T11:03:12.769226+0000","last_clean":"2024-09-11T11:03:12.769226+0000","last_became_active":"2024-09-11T11:01:05.348256+0000","last_became_peered":"2024-09-11T11:01:05.348256+0000","last_unstale":"2024-09-11T11:03:12.769226+0000","last_undegraded":"2024-09-11T11:03:12.769226+0000","last_fullsized":"2024-09-11T11:03:12.769226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:10:09.634465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127285+0000","last_change":"2024-09-11T11:01:03.323843+0000","last_active":"2024-09-11T11:02:42.127285+0000","last_peered":"2024-09-11T11:02:42.127285+0000","last_clean":"2024-09-11T11:02:42.127285+0000","last_became_active":"2024-09-11T11:01:03.323106+0000","last_became_peered":"2024-09-11T11:01:03.323106+0000","last_unstale":"2024-09-11T11:02:42.127285+0000","last_undegraded":"2024-09-11T11:02:42.127285+0000","last_fullsized":"2024-09-11T11:02:42.127285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:24:10.573016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124332+0000","last_change":"2024-09-11T11:01:07.347165+0000","last_active":"2024-09-11T11:02:42.124332+0000","last_peered":"2024-09-11T11:02:42.124332+0000","last_clean":"2024-09-11T11:02:42.124332+0000","last_became_active":"2024-09-11T11:01:07.346507+0000","last_became_peered":"2024-09-11T11:01:07.346507+0000","last_unstale":"2024-09-11T11:02:42.124332+0000","last_undegraded":"2024-09-11T11:02:42.124332+0000","last_fullsized":"2024-09-11T11:02:42.124332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:11.130739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.862649+0000","last_change":"2024-09-11T11:01:09.370064+0000","last_active":"2024-09-11T11:03:14.862649+0000","last_peered":"2024-09-11T11:03:14.862649+0000","last_clean":"2024-09-11T11:03:14.862649+0000","last_became_active":"2024-09-11T11:01:09.367104+0000","last_became_peered":"2024-09-11T11:01:09.367104+0000","last_unstale":"2024-09-11T11:03:14.862649+0000","last_undegraded":"2024-09-11T11:03:14.862649+0000","last_fullsized":"2024-09-11T11:03:14.862649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:42.885042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122669+0000","last_change":"2024-09-11T11:01:11.400983+0000","last_active":"2024-09-11T11:02:42.122669+0000","last_peered":"2024-09-11T11:02:42.122669+0000","last_clean":"2024-09-11T11:02:42.122669+0000","last_became_active":"2024-09-11T11:01:11.400269+0000","last_became_peered":"2024-09-11T11:01:11.400269+0000","last_unstale":"2024-09-11T11:02:42.122669+0000","last_undegraded":"2024-09-11T11:02:42.122669+0000","last_fullsized":"2024-09-11T11:02:42.122669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:48.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112745+0000","last_change":"2024-09-11T11:01:13.424386+0000","last_active":"2024-09-11T11:02:42.112745+0000","last_peered":"2024-09-11T11:02:42.112745+0000","last_clean":"2024-09-11T11:02:42.112745+0000","last_became_active":"2024-09-11T11:01:13.423466+0000","last_became_peered":"2024-09-11T11:01:13.423466+0000","last_unstale":"2024-09-11T11:02:42.112745+0000","last_undegraded":"2024-09-11T11:02:42.112745+0000","last_fullsized":"2024-09-11T11:02:42.112745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:51:02.142046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.574272+0000","last_change":"2024-09-11T11:01:05.334600+0000","last_active":"2024-09-11T11:04:17.574272+0000","last_peered":"2024-09-11T11:04:17.574272+0000","last_clean":"2024-09-11T11:04:17.574272+0000","last_became_active":"2024-09-11T11:01:05.334141+0000","last_became_peered":"2024-09-11T11:01:05.334141+0000","last_unstale":"2024-09-11T11:04:17.574272+0000","last_undegraded":"2024-09-11T11:04:17.574272+0000","last_fullsized":"2024-09-11T11:04:17.574272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:40:25.995301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115947+0000","last_change":"2024-09-11T11:01:03.340441+0000","last_active":"2024-09-11T11:02:42.115947+0000","last_peered":"2024-09-11T11:02:42.115947+0000","last_clean":"2024-09-11T11:02:42.115947+0000","last_became_active":"2024-09-11T11:01:03.337584+0000","last_became_peered":"2024-09-11T11:01:03.337584+0000","last_unstale":"2024-09-11T11:02:42.115947+0000","last_undegraded":"2024-09-11T11:02:42.115947+0000","last_fullsized":"2024-09-11T11:02:42.115947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:11.801971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842557+0000","last_change":"2024-09-11T11:01:07.366290+0000","last_active":"2024-09-11T11:02:42.842557+0000","last_peered":"2024-09-11T11:02:42.842557+0000","last_clean":"2024-09-11T11:02:42.842557+0000","last_became_active":"2024-09-11T11:01:07.365791+0000","last_became_peered":"2024-09-11T11:01:07.365791+0000","last_unstale":"2024-09-11T11:02:42.842557+0000","last_undegraded":"2024-09-11T11:02:42.842557+0000","last_fullsized":"2024-09-11T11:02:42.842557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:31:26.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.905215+0000","last_change":"2024-09-11T11:01:09.385201+0000","last_active":"2024-09-11T11:03:14.905215+0000","last_peered":"2024-09-11T11:03:14.905215+0000","last_clean":"2024-09-11T11:03:14.905215+0000","last_became_active":"2024-09-11T11:01:09.380531+0000","last_became_peered":"2024-09-11T11:01:09.380531+0000","last_unstale":"2024-09-11T11:03:14.905215+0000","last_undegraded":"2024-09-11T11:03:14.905215+0000","last_fullsized":"2024-09-11T11:03:14.905215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:30.066289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123409+0000","last_change":"2024-09-11T11:01:11.387269+0000","last_active":"2024-09-11T11:02:42.123409+0000","last_peered":"2024-09-11T11:02:42.123409+0000","last_clean":"2024-09-11T11:02:42.123409+0000","last_became_active":"2024-09-11T11:01:11.386302+0000","last_became_peered":"2024-09-11T11:01:11.386302+0000","last_unstale":"2024-09-11T11:02:42.123409+0000","last_undegraded":"2024-09-11T11:02:42.123409+0000","last_fullsized":"2024-09-11T11:02:42.123409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:54:54.650646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.580984+0000","last_change":"2024-09-11T11:01:13.423002+0000","last_active":"2024-09-11T11:04:17.580984+0000","last_peered":"2024-09-11T11:04:17.580984+0000","last_clean":"2024-09-11T11:04:17.580984+0000","last_became_active":"2024-09-11T11:01:13.422285+0000","last_became_peered":"2024-09-11T11:01:13.422285+0000","last_unstale":"2024-09-11T11:04:17.580984+0000","last_undegraded":"2024-09-11T11:04:17.580984+0000","last_fullsized":"2024-09-11T11:04:17.580984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:03:35.147747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.440090+0000","last_change":"2024-09-11T11:01:05.337161+0000","last_active":"2024-09-11T11:04:17.440090+0000","last_peered":"2024-09-11T11:04:17.440090+0000","last_clean":"2024-09-11T11:04:17.440090+0000","last_became_active":"2024-09-11T11:01:05.336680+0000","last_became_peered":"2024-09-11T11:01:05.336680+0000","last_unstale":"2024-09-11T11:04:17.440090+0000","last_undegraded":"2024-09-11T11:04:17.440090+0000","last_fullsized":"2024-09-11T11:04:17.440090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:14.471785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847754+0000","last_change":"2024-09-11T11:01:03.336607+0000","last_active":"2024-09-11T11:02:42.847754+0000","last_peered":"2024-09-11T11:02:42.847754+0000","last_clean":"2024-09-11T11:02:42.847754+0000","last_became_active":"2024-09-11T11:01:03.331816+0000","last_became_peered":"2024-09-11T11:01:03.331816+0000","last_unstale":"2024-09-11T11:02:42.847754+0000","last_undegraded":"2024-09-11T11:02:42.847754+0000","last_fullsized":"2024-09-11T11:02:42.847754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:04:39.058034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.277728+0000","last_change":"2024-09-11T11:01:07.364299+0000","last_active":"2024-09-11T11:03:13.277728+0000","last_peered":"2024-09-11T11:03:13.277728+0000","last_clean":"2024-09-11T11:03:13.277728+0000","last_became_active":"2024-09-11T11:01:07.363545+0000","last_became_peered":"2024-09-11T11:01:07.363545+0000","last_unstale":"2024-09-11T11:03:13.277728+0000","last_undegraded":"2024-09-11T11:03:13.277728+0000","last_fullsized":"2024-09-11T11:03:13.277728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:17.840143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'32","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.871444+0000","last_change":"2024-09-11T11:01:09.378071+0000","last_active":"2024-09-11T11:04:16.871444+0000","last_peered":"2024-09-11T11:04:16.871444+0000","last_clean":"2024-09-11T11:04:16.871444+0000","last_became_active":"2024-09-11T11:01:09.377586+0000","last_became_peered":"2024-09-11T11:01:09.377586+0000","last_unstale":"2024-09-11T11:04:16.871444+0000","last_undegraded":"2024-09-11T11:04:16.871444+0000","last_fullsized":"2024-09-11T11:04:16.871444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:54.076155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499591+0000","last_change":"2024-09-11T11:01:11.401725+0000","last_active":"2024-09-11T11:02:42.499591+0000","last_peered":"2024-09-11T11:02:42.499591+0000","last_clean":"2024-09-11T11:02:42.499591+0000","last_became_active":"2024-09-11T11:01:11.401078+0000","last_became_peered":"2024-09-11T11:01:11.401078+0000","last_unstale":"2024-09-11T11:02:42.499591+0000","last_undegraded":"2024-09-11T11:02:42.499591+0000","last_fullsized":"2024-09-11T11:02:42.499591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:58:17.003022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.925565+0000","last_change":"2024-09-11T11:01:13.422050+0000","last_active":"2024-09-11T11:03:14.925565+0000","last_peered":"2024-09-11T11:03:14.925565+0000","last_clean":"2024-09-11T11:03:14.925565+0000","last_became_active":"2024-09-11T11:01:13.421231+0000","last_became_peered":"2024-09-11T11:01:13.421231+0000","last_unstale":"2024-09-11T11:03:14.925565+0000","last_undegraded":"2024-09-11T11:03:14.925565+0000","last_fullsized":"2024-09-11T11:03:14.925565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:19.013089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'12","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855598+0000","last_change":"2024-09-11T11:01:05.340309+0000","last_active":"2024-09-11T11:04:17.855598+0000","last_peered":"2024-09-11T11:04:17.855598+0000","last_clean":"2024-09-11T11:04:17.855598+0000","last_became_active":"2024-09-11T11:01:05.339760+0000","last_became_peered":"2024-09-11T11:01:05.339760+0000","last_unstale":"2024-09-11T11:04:17.855598+0000","last_undegraded":"2024-09-11T11:04:17.855598+0000","last_fullsized":"2024-09-11T11:04:17.855598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:03.072232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.496287+0000","last_change":"2024-09-11T11:01:03.338307+0000","last_active":"2024-09-11T11:02:42.496287+0000","last_peered":"2024-09-11T11:02:42.496287+0000","last_clean":"2024-09-11T11:02:42.496287+0000","last_became_active":"2024-09-11T11:01:03.338039+0000","last_became_peered":"2024-09-11T11:01:03.338039+0000","last_unstale":"2024-09-11T11:02:42.496287+0000","last_undegraded":"2024-09-11T11:02:42.496287+0000","last_fullsized":"2024-09-11T11:02:42.496287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:25:25.632777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845571+0000","last_change":"2024-09-11T11:01:05.333022+0000","last_active":"2024-09-11T11:02:42.845571+0000","last_peered":"2024-09-11T11:02:42.845571+0000","last_clean":"2024-09-11T11:02:42.845571+0000","last_became_active":"2024-09-11T11:01:05.332632+0000","last_became_peered":"2024-09-11T11:01:05.332632+0000","last_unstale":"2024-09-11T11:02:42.845571+0000","last_undegraded":"2024-09-11T11:02:42.845571+0000","last_fullsized":"2024-09-11T11:02:42.845571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:54:07.782353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497427+0000","last_change":"2024-09-11T11:01:03.327803+0000","last_active":"2024-09-11T11:02:42.497427+0000","last_peered":"2024-09-11T11:02:42.497427+0000","last_clean":"2024-09-11T11:02:42.497427+0000","last_became_active":"2024-09-11T11:01:03.327428+0000","last_became_peered":"2024-09-11T11:01:03.327428+0000","last_unstale":"2024-09-11T11:02:42.497427+0000","last_undegraded":"2024-09-11T11:02:42.497427+0000","last_fullsized":"2024-09-11T11:02:42.497427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:27:21.561913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.037418+0000","last_change":"2024-09-11T11:01:05.349740+0000","last_active":"2024-09-11T11:03:16.037418+0000","last_peered":"2024-09-11T11:03:16.037418+0000","last_clean":"2024-09-11T11:03:16.037418+0000","last_became_active":"2024-09-11T11:01:05.348827+0000","last_became_peered":"2024-09-11T11:01:05.348827+0000","last_unstale":"2024-09-11T11:03:16.037418+0000","last_undegraded":"2024-09-11T11:03:16.037418+0000","last_fullsized":"2024-09-11T11:03:16.037418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:11.303487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'3","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110919+0000","last_change":"2024-09-11T11:01:03.333973+0000","last_active":"2024-09-11T11:02:42.110919+0000","last_peered":"2024-09-11T11:02:42.110919+0000","last_clean":"2024-09-11T11:02:42.110919+0000","last_became_active":"2024-09-11T11:01:03.333729+0000","last_became_peered":"2024-09-11T11:01:03.333729+0000","last_unstale":"2024-09-11T11:02:42.110919+0000","last_undegraded":"2024-09-11T11:02:42.110919+0000","last_fullsized":"2024-09-11T11:02:42.110919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:23.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.853794+0000","last_change":"2024-09-11T11:01:05.333462+0000","last_active":"2024-09-11T11:04:17.853794+0000","last_peered":"2024-09-11T11:04:17.853794+0000","last_clean":"2024-09-11T11:04:17.853794+0000","last_became_active":"2024-09-11T11:01:05.332274+0000","last_became_peered":"2024-09-11T11:01:05.332274+0000","last_unstale":"2024-09-11T11:04:17.853794+0000","last_undegraded":"2024-09-11T11:04:17.853794+0000","last_fullsized":"2024-09-11T11:04:17.853794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:09.062077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498350+0000","last_change":"2024-09-11T11:01:03.335348+0000","last_active":"2024-09-11T11:02:42.498350+0000","last_peered":"2024-09-11T11:02:42.498350+0000","last_clean":"2024-09-11T11:02:42.498350+0000","last_became_active":"2024-09-11T11:01:03.335054+0000","last_became_peered":"2024-09-11T11:01:03.335054+0000","last_unstale":"2024-09-11T11:02:42.498350+0000","last_undegraded":"2024-09-11T11:02:42.498350+0000","last_fullsized":"2024-09-11T11:02:42.498350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:12.676263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115911+0000","last_change":"2024-09-11T11:01:05.343162+0000","last_active":"2024-09-11T11:02:42.115911+0000","last_peered":"2024-09-11T11:02:42.115911+0000","last_clean":"2024-09-11T11:02:42.115911+0000","last_became_active":"2024-09-11T11:01:05.330065+0000","last_became_peered":"2024-09-11T11:01:05.330065+0000","last_unstale":"2024-09-11T11:02:42.115911+0000","last_undegraded":"2024-09-11T11:02:42.115911+0000","last_fullsized":"2024-09-11T11:02:42.115911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:28.667270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114035+0000","last_change":"2024-09-11T11:01:03.351261+0000","last_active":"2024-09-11T11:02:42.114035+0000","last_peered":"2024-09-11T11:02:42.114035+0000","last_clean":"2024-09-11T11:02:42.114035+0000","last_became_active":"2024-09-11T11:01:03.349971+0000","last_became_peered":"2024-09-11T11:01:03.349971+0000","last_unstale":"2024-09-11T11:02:42.114035+0000","last_undegraded":"2024-09-11T11:02:42.114035+0000","last_fullsized":"2024-09-11T11:02:42.114035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:03.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842469+0000","last_change":"2024-09-11T11:01:05.342800+0000","last_active":"2024-09-11T11:02:42.842469+0000","last_peered":"2024-09-11T11:02:42.842469+0000","last_clean":"2024-09-11T11:02:42.842469+0000","last_became_active":"2024-09-11T11:01:05.342092+0000","last_became_peered":"2024-09-11T11:01:05.342092+0000","last_unstale":"2024-09-11T11:02:42.842469+0000","last_undegraded":"2024-09-11T11:02:42.842469+0000","last_fullsized":"2024-09-11T11:02:42.842469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:51.745730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844893+0000","last_change":"2024-09-11T11:01:42.061260+0000","last_active":"2024-09-11T11:02:42.844893+0000","last_peered":"2024-09-11T11:02:42.844893+0000","last_clean":"2024-09-11T11:02:42.844893+0000","last_became_active":"2024-09-11T11:01:42.060500+0000","last_became_peered":"2024-09-11T11:01:42.060500+0000","last_unstale":"2024-09-11T11:02:42.844893+0000","last_undegraded":"2024-09-11T11:02:42.844893+0000","last_fullsized":"2024-09-11T11:02:42.844893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:12.528032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.769675+0000","last_change":"2024-09-11T11:01:05.346623+0000","last_active":"2024-09-11T11:04:17.769675+0000","last_peered":"2024-09-11T11:04:17.769675+0000","last_clean":"2024-09-11T11:04:17.769675+0000","last_became_active":"2024-09-11T11:01:05.346179+0000","last_became_peered":"2024-09-11T11:01:05.346179+0000","last_unstale":"2024-09-11T11:04:17.769675+0000","last_undegraded":"2024-09-11T11:04:17.769675+0000","last_fullsized":"2024-09-11T11:04:17.769675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:30.170950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.348790+0000","last_change":"2024-09-11T11:01:03.317928+0000","last_active":"2024-09-11T11:04:17.348790+0000","last_peered":"2024-09-11T11:04:17.348790+0000","last_clean":"2024-09-11T11:04:17.348790+0000","last_became_active":"2024-09-11T11:01:03.315737+0000","last_became_peered":"2024-09-11T11:01:03.315737+0000","last_unstale":"2024-09-11T11:04:17.348790+0000","last_undegraded":"2024-09-11T11:04:17.348790+0000","last_fullsized":"2024-09-11T11:04:17.348790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:47.506757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:11.035873+0000","last_change":"2024-09-11T11:01:05.333619+0000","last_active":"2024-09-11T11:03:11.035873+0000","last_peered":"2024-09-11T11:03:11.035873+0000","last_clean":"2024-09-11T11:03:11.035873+0000","last_became_active":"2024-09-11T11:01:05.331901+0000","last_became_peered":"2024-09-11T11:01:05.331901+0000","last_unstale":"2024-09-11T11:03:11.035873+0000","last_undegraded":"2024-09-11T11:03:11.035873+0000","last_fullsized":"2024-09-11T11:03:11.035873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:08.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116431+0000","last_change":"2024-09-11T11:01:03.351395+0000","last_active":"2024-09-11T11:02:42.116431+0000","last_peered":"2024-09-11T11:02:42.116431+0000","last_clean":"2024-09-11T11:02:42.116431+0000","last_became_active":"2024-09-11T11:01:03.351125+0000","last_became_peered":"2024-09-11T11:01:03.351125+0000","last_unstale":"2024-09-11T11:02:42.116431+0000","last_undegraded":"2024-09-11T11:02:42.116431+0000","last_fullsized":"2024-09-11T11:02:42.116431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:02.814616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.040093+0000","last_change":"2024-09-11T11:01:05.333352+0000","last_active":"2024-09-11T11:03:28.040093+0000","last_peered":"2024-09-11T11:03:28.040093+0000","last_clean":"2024-09-11T11:03:28.040093+0000","last_became_active":"2024-09-11T11:01:05.332203+0000","last_became_peered":"2024-09-11T11:01:05.332203+0000","last_unstale":"2024-09-11T11:03:28.040093+0000","last_undegraded":"2024-09-11T11:03:28.040093+0000","last_fullsized":"2024-09-11T11:03:28.040093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:03.791497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109549+0000","last_change":"2024-09-11T11:01:03.337164+0000","last_active":"2024-09-11T11:02:42.109549+0000","last_peered":"2024-09-11T11:02:42.109549+0000","last_clean":"2024-09-11T11:02:42.109549+0000","last_became_active":"2024-09-11T11:01:03.336786+0000","last_became_peered":"2024-09-11T11:01:03.336786+0000","last_unstale":"2024-09-11T11:02:42.109549+0000","last_undegraded":"2024-09-11T11:02:42.109549+0000","last_fullsized":"2024-09-11T11:02:42.109549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:42.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.920771+0000","last_change":"2024-09-11T11:01:05.333095+0000","last_active":"2024-09-11T11:04:17.920771+0000","last_peered":"2024-09-11T11:04:17.920771+0000","last_clean":"2024-09-11T11:04:17.920771+0000","last_became_active":"2024-09-11T11:01:05.332747+0000","last_became_peered":"2024-09-11T11:01:05.332747+0000","last_unstale":"2024-09-11T11:04:17.920771+0000","last_undegraded":"2024-09-11T11:04:17.920771+0000","last_fullsized":"2024-09-11T11:04:17.920771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:41:08.367843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.571216+0000","last_change":"2024-09-11T11:01:03.336167+0000","last_active":"2024-09-11T11:03:16.571216+0000","last_peered":"2024-09-11T11:03:16.571216+0000","last_clean":"2024-09-11T11:03:16.571216+0000","last_became_active":"2024-09-11T11:01:03.335854+0000","last_became_peered":"2024-09-11T11:01:03.335854+0000","last_unstale":"2024-09-11T11:03:16.571216+0000","last_undegraded":"2024-09-11T11:03:16.571216+0000","last_fullsized":"2024-09-11T11:03:16.571216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:04:39.058034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499524+0000","last_change":"2024-09-11T11:01:05.344244+0000","last_active":"2024-09-11T11:02:42.499524+0000","last_peered":"2024-09-11T11:02:42.499524+0000","last_clean":"2024-09-11T11:02:42.499524+0000","last_became_active":"2024-09-11T11:01:05.343590+0000","last_became_peered":"2024-09-11T11:01:05.343590+0000","last_unstale":"2024-09-11T11:02:42.499524+0000","last_undegraded":"2024-09-11T11:02:42.499524+0000","last_fullsized":"2024-09-11T11:02:42.499524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:30.774404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124182+0000","last_change":"2024-09-11T11:01:03.339537+0000","last_active":"2024-09-11T11:02:42.124182+0000","last_peered":"2024-09-11T11:02:42.124182+0000","last_clean":"2024-09-11T11:02:42.124182+0000","last_became_active":"2024-09-11T11:01:03.336224+0000","last_became_peered":"2024-09-11T11:01:03.336224+0000","last_unstale":"2024-09-11T11:02:42.124182+0000","last_undegraded":"2024-09-11T11:02:42.124182+0000","last_fullsized":"2024-09-11T11:02:42.124182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:32.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845373+0000","last_change":"2024-09-11T11:01:05.342088+0000","last_active":"2024-09-11T11:02:42.845373+0000","last_peered":"2024-09-11T11:02:42.845373+0000","last_clean":"2024-09-11T11:02:42.845373+0000","last_became_active":"2024-09-11T11:01:05.341761+0000","last_became_peered":"2024-09-11T11:01:05.341761+0000","last_unstale":"2024-09-11T11:02:42.845373+0000","last_undegraded":"2024-09-11T11:02:42.845373+0000","last_fullsized":"2024-09-11T11:02:42.845373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:27:41.532168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843144+0000","last_change":"2024-09-11T11:01:03.320022+0000","last_active":"2024-09-11T11:02:42.843144+0000","last_peered":"2024-09-11T11:02:42.843144+0000","last_clean":"2024-09-11T11:02:42.843144+0000","last_became_active":"2024-09-11T11:01:03.318984+0000","last_became_peered":"2024-09-11T11:01:03.318984+0000","last_unstale":"2024-09-11T11:02:42.843144+0000","last_undegraded":"2024-09-11T11:02:42.843144+0000","last_fullsized":"2024-09-11T11:02:42.843144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:12.827913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770617+0000","last_change":"2024-09-11T11:01:42.059933+0000","last_active":"2024-09-11T11:04:17.770617+0000","last_peered":"2024-09-11T11:04:17.770617+0000","last_clean":"2024-09-11T11:04:17.770617+0000","last_became_active":"2024-09-11T11:01:42.059147+0000","last_became_peered":"2024-09-11T11:01:42.059147+0000","last_unstale":"2024-09-11T11:04:17.770617+0000","last_undegraded":"2024-09-11T11:04:17.770617+0000","last_fullsized":"2024-09-11T11:04:17.770617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:38.857591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112605+0000","last_change":"2024-09-11T11:01:03.350789+0000","last_active":"2024-09-11T11:02:42.112605+0000","last_peered":"2024-09-11T11:02:42.112605+0000","last_clean":"2024-09-11T11:02:42.112605+0000","last_became_active":"2024-09-11T11:01:03.349120+0000","last_became_peered":"2024-09-11T11:01:03.349120+0000","last_unstale":"2024-09-11T11:02:42.112605+0000","last_undegraded":"2024-09-11T11:02:42.112605+0000","last_fullsized":"2024-09-11T11:02:42.112605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:22.337303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938385+0000","last_change":"2024-09-11T11:01:05.343458+0000","last_active":"2024-09-11T11:04:17.938385+0000","last_peered":"2024-09-11T11:04:17.938385+0000","last_clean":"2024-09-11T11:04:17.938385+0000","last_became_active":"2024-09-11T11:01:05.343121+0000","last_became_peered":"2024-09-11T11:01:05.343121+0000","last_unstale":"2024-09-11T11:04:17.938385+0000","last_undegraded":"2024-09-11T11:04:17.938385+0000","last_fullsized":"2024-09-11T11:04:17.938385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:38.168723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844476+0000","last_change":"2024-09-11T11:01:42.056195+0000","last_active":"2024-09-11T11:02:42.844476+0000","last_peered":"2024-09-11T11:02:42.844476+0000","last_clean":"2024-09-11T11:02:42.844476+0000","last_became_active":"2024-09-11T11:01:42.055356+0000","last_became_peered":"2024-09-11T11:01:42.055356+0000","last_unstale":"2024-09-11T11:02:42.844476+0000","last_undegraded":"2024-09-11T11:02:42.844476+0000","last_fullsized":"2024-09-11T11:02:42.844476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:33.310470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110479+0000","last_change":"2024-09-11T11:01:05.346901+0000","last_active":"2024-09-11T11:02:42.110479+0000","last_peered":"2024-09-11T11:02:42.110479+0000","last_clean":"2024-09-11T11:02:42.110479+0000","last_became_active":"2024-09-11T11:01:05.346563+0000","last_became_peered":"2024-09-11T11:01:05.346563+0000","last_unstale":"2024-09-11T11:02:42.110479+0000","last_undegraded":"2024-09-11T11:02:42.110479+0000","last_fullsized":"2024-09-11T11:02:42.110479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:02.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499542+0000","last_change":"2024-09-11T11:01:03.316299+0000","last_active":"2024-09-11T11:02:42.499542+0000","last_peered":"2024-09-11T11:02:42.499542+0000","last_clean":"2024-09-11T11:02:42.499542+0000","last_became_active":"2024-09-11T11:01:03.315651+0000","last_became_peered":"2024-09-11T11:01:03.315651+0000","last_unstale":"2024-09-11T11:02:42.499542+0000","last_undegraded":"2024-09-11T11:02:42.499542+0000","last_fullsized":"2024-09-11T11:02:42.499542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:12:09.647986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.818259+0000","last_change":"2024-09-11T11:01:05.348683+0000","last_active":"2024-09-11T11:03:16.818259+0000","last_peered":"2024-09-11T11:03:16.818259+0000","last_clean":"2024-09-11T11:03:16.818259+0000","last_became_active":"2024-09-11T11:01:05.347760+0000","last_became_peered":"2024-09-11T11:01:05.347760+0000","last_unstale":"2024-09-11T11:03:16.818259+0000","last_undegraded":"2024-09-11T11:03:16.818259+0000","last_fullsized":"2024-09-11T11:03:16.818259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:28:39.642991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116664+0000","last_change":"2024-09-11T11:01:03.340726+0000","last_active":"2024-09-11T11:02:42.116664+0000","last_peered":"2024-09-11T11:02:42.116664+0000","last_clean":"2024-09-11T11:02:42.116664+0000","last_became_active":"2024-09-11T11:01:03.337667+0000","last_became_peered":"2024-09-11T11:01:03.337667+0000","last_unstale":"2024-09-11T11:02:42.116664+0000","last_undegraded":"2024-09-11T11:02:42.116664+0000","last_fullsized":"2024-09-11T11:02:42.116664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:41:38.836874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121715+0000","last_change":"2024-09-11T11:01:03.322086+0000","last_active":"2024-09-11T11:02:42.121715+0000","last_peered":"2024-09-11T11:02:42.121715+0000","last_clean":"2024-09-11T11:02:42.121715+0000","last_became_active":"2024-09-11T11:01:03.321242+0000","last_became_peered":"2024-09-11T11:01:03.321242+0000","last_unstale":"2024-09-11T11:02:42.121715+0000","last_undegraded":"2024-09-11T11:02:42.121715+0000","last_fullsized":"2024-09-11T11:02:42.121715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:55.170368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.437700+0000","last_change":"2024-09-11T11:01:05.344698+0000","last_active":"2024-09-11T11:04:17.437700+0000","last_peered":"2024-09-11T11:04:17.437700+0000","last_clean":"2024-09-11T11:04:17.437700+0000","last_became_active":"2024-09-11T11:01:05.344285+0000","last_became_peered":"2024-09-11T11:01:05.344285+0000","last_unstale":"2024-09-11T11:04:17.437700+0000","last_undegraded":"2024-09-11T11:04:17.437700+0000","last_fullsized":"2024-09-11T11:04:17.437700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:08:02.954788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842659+0000","last_change":"2024-09-11T11:01:03.325391+0000","last_active":"2024-09-11T11:02:42.842659+0000","last_peered":"2024-09-11T11:02:42.842659+0000","last_clean":"2024-09-11T11:02:42.842659+0000","last_became_active":"2024-09-11T11:01:03.320391+0000","last_became_peered":"2024-09-11T11:01:03.320391+0000","last_unstale":"2024-09-11T11:02:42.842659+0000","last_undegraded":"2024-09-11T11:02:42.842659+0000","last_fullsized":"2024-09-11T11:02:42.842659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:25:59.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498432+0000","last_change":"2024-09-11T11:01:42.076222+0000","last_active":"2024-09-11T11:02:42.498432+0000","last_peered":"2024-09-11T11:02:42.498432+0000","last_clean":"2024-09-11T11:02:42.498432+0000","last_became_active":"2024-09-11T11:01:42.069954+0000","last_became_peered":"2024-09-11T11:01:42.069954+0000","last_unstale":"2024-09-11T11:02:42.498432+0000","last_undegraded":"2024-09-11T11:02:42.498432+0000","last_fullsized":"2024-09-11T11:02:42.498432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:10:17.552581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1608,"num_read_kb":1498,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":5172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":5296128,"data_stored":4991137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48684,"kb_used_data":9180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323156,"statfs":{"total":96636764160,"available":96586911744,"internally_reserved":0,"allocated":9400320,"data_stored":9132733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61668,"kb_used_data":22164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94310172,"statfs":{"total":96636764160,"available":96573616128,"internally_reserved":0,"allocated":22695936,"data_stored":22359925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56380,"kb_used_data":16876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315460,"statfs":{"total":96636764160,"available":96579031040,"internally_reserved":0,"allocated":17281024,"data_stored":16933829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:04:49.824 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:04:49.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f6214a26640 1 Processor -- start 2024-09-11T11:04:49.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f6214a26640 1 -- start start 2024-09-11T11:04:49.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f6214a26640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f621006d0e0 0x7f621006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:49.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f6214a26640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6210071c10 con 0x7f621006da00 2024-09-11T11:04:49.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f6214a26640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6210072230 con 0x7f621006d0e0 2024-09-11T11:04:49.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f620e59c640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f621006d0e0 0x7f621006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:49.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f620dd9b640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f621006da00 0x7f621012ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50588/0 (socket says 172.21.15.102:50588) 2024-09-11T11:04:49.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f620dd9b640 1 -- 172.21.15.102:0/774282972 learned_addr learned my addr 172.21.15.102:0/774282972 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:49.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f620e59c640 1 -- 172.21.15.102:0/774282972 >> v1:172.21.15.102:6789/0 conn(0x7f621006da00 legacy=0x7f621012ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.979+0000 7f620e59c640 1 -- 172.21.15.102:0/774282972 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62100709e0 con 0x7f621006d0e0 2024-09-11T11:04:49.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f620e59c640 1 --2- 172.21.15.102:0/774282972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621006d4c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009740 tx=0x7f61f801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290410696f93685e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:49.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f620d59a640 1 -- 172.21.15.102:0/774282972 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f80b0070 con 0x7f621006d0e0 2024-09-11T11:04:49.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f620d59a640 1 -- 172.21.15.102:0/774282972 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f80ab530 con 0x7f621006d0e0 2024-09-11T11:04:49.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f620d59a640 1 -- 172.21.15.102:0/774282972 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f80ab830 con 0x7f621006d0e0 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 -- 172.21.15.102:0/774282972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 msgr2=0x7f621006d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 --2- 172.21.15.102:0/774282972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621006d4c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009740 tx=0x7f61f801c370 comp rx=0 tx=0).stop 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 -- 172.21.15.102:0/774282972 shutdown_connections 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 --2- 172.21.15.102:0/774282972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621006d4c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 -- 172.21.15.102:0/774282972 >> 172.21.15.102:0/774282972 conn(0x7f6210099a50 msgr2=0x7f62100972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 -- 172.21.15.102:0/774282972 shutdown_connections 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 -- 172.21.15.102:0/774282972 wait complete. 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 Processor -- start 2024-09-11T11:04:49.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 -- start start 2024-09-11T11:04:49.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621012b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:49.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f6214a26640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6210134e80 con 0x7f621006d0e0 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f620e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621012b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f620e59c640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621012b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48568/0 (socket says 172.21.15.102:48568) 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.983+0000 7f620e59c640 1 -- 172.21.15.102:0/3710293380 learned_addr learned my addr 172.21.15.102:0/3710293380 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f620e59c640 1 -- 172.21.15.102:0/3710293380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f621012b900 con 0x7f621006d0e0 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f620e59c640 1 --2- 172.21.15.102:0/3710293380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621012b3c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f61f80ae040 tx=0x7f61f801abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6206ffd640 1 -- 172.21.15.102:0/3710293380 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f80b0050 con 0x7f621006d0e0 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6206ffd640 1 -- 172.21.15.102:0/3710293380 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61f80b1040 con 0x7f621006d0e0 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f621012bad0 con 0x7f621006d0e0 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6206ffd640 1 -- 172.21.15.102:0/3710293380 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61f80b5780 con 0x7f621006d0e0 2024-09-11T11:04:49.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f621012bf90 con 0x7f621006d0e0 2024-09-11T11:04:49.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6206ffd640 1 -- 172.21.15.102:0/3710293380 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f61f80be030 con 0x7f621006d0e0 2024-09-11T11:04:49.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f621006d4c0 con 0x7f621006d0e0 2024-09-11T11:04:49.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6206ffd640 1 --2- 172.21.15.102:0/3710293380 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f61f0035db0 0x7f61f0038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:49.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f6206ffd640 1 -- 172.21.15.102:0/3710293380 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f61f80bc070 con 0x7f621006d0e0 2024-09-11T11:04:49.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f620dd9b640 1 --2- 172.21.15.102:0/3710293380 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f61f0035db0 0x7f61f0038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:49.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.987+0000 7f620dd9b640 1 --2- 172.21.15.102:0/3710293380 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f61f0035db0 0x7f61f0038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6200001610 tx=0x7f6200007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:49.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:49.991+0000 7f6206ffd640 1 -- 172.21.15.102:0/3710293380 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f61f80c5060 con 0x7f621006d0e0 2024-09-11T11:04:50.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.151+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6210072710 con 0x7f61f0035db0 2024-09-11T11:04:50.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.195+0000 7f6206ffd640 1 -- 172.21.15.102:0/3710293380 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665564 (secure 0 0 0) 0x7f62000058c0 con 0x7f61f0035db0 2024-09-11T11:04:50.204 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:04:50.211 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:04:50.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f61f0035db0 msgr2=0x7f61f0038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 --2- 172.21.15.102:0/3710293380 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f61f0035db0 0x7f61f0038270 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6200001610 tx=0x7f6200007ad0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 msgr2=0x7f621012b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 --2- 172.21.15.102:0/3710293380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621012b3c0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f61f80ae040 tx=0x7f61f801abb0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 shutdown_connections 2024-09-11T11:04:50.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 --2- 172.21.15.102:0/3710293380 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f61f0035db0 0x7f61f0038270 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 --2- 172.21.15.102:0/3710293380 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f621006d0e0 0x7f621012b3c0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 >> 172.21.15.102:0/3710293380 conn(0x7f6210099a50 msgr2=0x7f621009b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:50.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 shutdown_connections 2024-09-11T11:04:50.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.203+0000 7f6214a26640 1 -- 172.21.15.102:0/3710293380 wait complete. 2024-09-11T11:04:50.225 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-11T11:04:49.048110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412808,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4874,"num_read_kb":4455,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":207248,"kb_used_data":53392,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377280112,"statfs":{"total":386547056640,"available":386334834688,"internally_reserved":0,"allocated":54673408,"data_stored":53417624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006488"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129252+0000","last_change":"2024-09-11T11:01:03.337877+0000","last_active":"2024-09-11T11:02:42.129252+0000","last_peered":"2024-09-11T11:02:42.129252+0000","last_clean":"2024-09-11T11:02:42.129252+0000","last_became_active":"2024-09-11T11:01:03.336333+0000","last_became_peered":"2024-09-11T11:01:03.336333+0000","last_unstale":"2024-09-11T11:02:42.129252+0000","last_undegraded":"2024-09-11T11:02:42.129252+0000","last_fullsized":"2024-09-11T11:02:42.129252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:39.536350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573739+0000","last_change":"2024-09-11T11:01:05.334117+0000","last_active":"2024-09-11T11:04:17.573739+0000","last_peered":"2024-09-11T11:04:17.573739+0000","last_clean":"2024-09-11T11:04:17.573739+0000","last_became_active":"2024-09-11T11:01:05.332897+0000","last_became_peered":"2024-09-11T11:01:05.332897+0000","last_unstale":"2024-09-11T11:04:17.573739+0000","last_undegraded":"2024-09-11T11:04:17.573739+0000","last_fullsized":"2024-09-11T11:04:17.573739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:30.170950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845264+0000","last_change":"2024-09-11T11:01:03.346417+0000","last_active":"2024-09-11T11:02:42.845264+0000","last_peered":"2024-09-11T11:02:42.845264+0000","last_clean":"2024-09-11T11:02:42.845264+0000","last_became_active":"2024-09-11T11:01:03.346113+0000","last_became_peered":"2024-09-11T11:01:03.346113+0000","last_unstale":"2024-09-11T11:02:42.845264+0000","last_undegraded":"2024-09-11T11:02:42.845264+0000","last_fullsized":"2024-09-11T11:02:42.845264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:42.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836745+0000","last_change":"2024-09-11T11:01:05.333693+0000","last_active":"2024-09-11T11:03:16.836745+0000","last_peered":"2024-09-11T11:03:16.836745+0000","last_clean":"2024-09-11T11:03:16.836745+0000","last_became_active":"2024-09-11T11:01:05.330885+0000","last_became_peered":"2024-09-11T11:01:05.330885+0000","last_unstale":"2024-09-11T11:03:16.836745+0000","last_undegraded":"2024-09-11T11:03:16.836745+0000","last_fullsized":"2024-09-11T11:03:16.836745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:17:27.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112814+0000","last_change":"2024-09-11T11:01:03.346111+0000","last_active":"2024-09-11T11:02:42.112814+0000","last_peered":"2024-09-11T11:02:42.112814+0000","last_clean":"2024-09-11T11:02:42.112814+0000","last_became_active":"2024-09-11T11:01:03.345673+0000","last_became_peered":"2024-09-11T11:01:03.345673+0000","last_unstale":"2024-09-11T11:02:42.112814+0000","last_undegraded":"2024-09-11T11:02:42.112814+0000","last_fullsized":"2024-09-11T11:02:42.112814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:11.883100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.436815+0000","last_change":"2024-09-11T11:01:05.331041+0000","last_active":"2024-09-11T11:04:17.436815+0000","last_peered":"2024-09-11T11:04:17.436815+0000","last_clean":"2024-09-11T11:04:17.436815+0000","last_became_active":"2024-09-11T11:01:05.330639+0000","last_became_peered":"2024-09-11T11:01:05.330639+0000","last_unstale":"2024-09-11T11:04:17.436815+0000","last_undegraded":"2024-09-11T11:04:17.436815+0000","last_fullsized":"2024-09-11T11:04:17.436815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:51.046871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.721051+0000","last_change":"2024-09-11T11:01:03.335434+0000","last_active":"2024-09-11T11:03:16.721051+0000","last_peered":"2024-09-11T11:03:16.721051+0000","last_clean":"2024-09-11T11:03:16.721051+0000","last_became_active":"2024-09-11T11:01:03.335132+0000","last_became_peered":"2024-09-11T11:01:03.335132+0000","last_unstale":"2024-09-11T11:03:16.721051+0000","last_undegraded":"2024-09-11T11:03:16.721051+0000","last_fullsized":"2024-09-11T11:03:16.721051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:27.769400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573787+0000","last_change":"2024-09-11T11:01:05.344140+0000","last_active":"2024-09-11T11:04:17.573787+0000","last_peered":"2024-09-11T11:04:17.573787+0000","last_clean":"2024-09-11T11:04:17.573787+0000","last_became_active":"2024-09-11T11:01:05.339018+0000","last_became_peered":"2024-09-11T11:01:05.339018+0000","last_unstale":"2024-09-11T11:04:17.573787+0000","last_undegraded":"2024-09-11T11:04:17.573787+0000","last_fullsized":"2024-09-11T11:04:17.573787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:03.791497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124006+0000","last_change":"2024-09-11T11:01:03.324287+0000","last_active":"2024-09-11T11:02:42.124006+0000","last_peered":"2024-09-11T11:02:42.124006+0000","last_clean":"2024-09-11T11:02:42.124006+0000","last_became_active":"2024-09-11T11:01:03.322877+0000","last_became_peered":"2024-09-11T11:01:03.322877+0000","last_unstale":"2024-09-11T11:02:42.124006+0000","last_undegraded":"2024-09-11T11:02:42.124006+0000","last_fullsized":"2024-09-11T11:02:42.124006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:03.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'7","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.837597+0000","last_change":"2024-09-11T11:01:05.354323+0000","last_active":"2024-09-11T11:03:16.837597+0000","last_peered":"2024-09-11T11:03:16.837597+0000","last_clean":"2024-09-11T11:03:16.837597+0000","last_became_active":"2024-09-11T11:01:05.353908+0000","last_became_peered":"2024-09-11T11:01:05.353908+0000","last_unstale":"2024-09-11T11:03:16.837597+0000","last_undegraded":"2024-09-11T11:03:16.837597+0000","last_fullsized":"2024-09-11T11:03:16.837597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:11:14.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124871+0000","last_change":"2024-09-11T11:01:03.346652+0000","last_active":"2024-09-11T11:02:42.124871+0000","last_peered":"2024-09-11T11:02:42.124871+0000","last_clean":"2024-09-11T11:02:42.124871+0000","last_became_active":"2024-09-11T11:01:03.345964+0000","last_became_peered":"2024-09-11T11:01:03.345964+0000","last_unstale":"2024-09-11T11:02:42.124871+0000","last_undegraded":"2024-09-11T11:02:42.124871+0000","last_fullsized":"2024-09-11T11:02:42.124871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:12.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'14","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921127+0000","last_change":"2024-09-11T11:01:05.346892+0000","last_active":"2024-09-11T11:04:17.921127+0000","last_peered":"2024-09-11T11:04:17.921127+0000","last_clean":"2024-09-11T11:04:17.921127+0000","last_became_active":"2024-09-11T11:01:05.345664+0000","last_became_peered":"2024-09-11T11:01:05.345664+0000","last_unstale":"2024-09-11T11:04:17.921127+0000","last_undegraded":"2024-09-11T11:04:17.921127+0000","last_fullsized":"2024-09-11T11:04:17.921127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:15.826673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110283+0000","last_change":"2024-09-11T11:01:03.349146+0000","last_active":"2024-09-11T11:02:42.110283+0000","last_peered":"2024-09-11T11:02:42.110283+0000","last_clean":"2024-09-11T11:02:42.110283+0000","last_became_active":"2024-09-11T11:01:03.348822+0000","last_became_peered":"2024-09-11T11:01:03.348822+0000","last_unstale":"2024-09-11T11:02:42.110283+0000","last_undegraded":"2024-09-11T11:02:42.110283+0000","last_fullsized":"2024-09-11T11:02:42.110283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:25.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127393+0000","last_change":"2024-09-11T11:01:05.347306+0000","last_active":"2024-09-11T11:02:42.127393+0000","last_peered":"2024-09-11T11:02:42.127393+0000","last_clean":"2024-09-11T11:02:42.127393+0000","last_became_active":"2024-09-11T11:01:05.345698+0000","last_became_peered":"2024-09-11T11:01:05.345698+0000","last_unstale":"2024-09-11T11:02:42.127393+0000","last_undegraded":"2024-09-11T11:02:42.127393+0000","last_fullsized":"2024-09-11T11:02:42.127393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:41:08.367843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.750645+0000","last_change":"2024-09-11T11:01:03.336343+0000","last_active":"2024-09-11T11:03:12.750645+0000","last_peered":"2024-09-11T11:03:12.750645+0000","last_clean":"2024-09-11T11:03:12.750645+0000","last_became_active":"2024-09-11T11:01:03.335830+0000","last_became_peered":"2024-09-11T11:01:03.335830+0000","last_unstale":"2024-09-11T11:03:12.750645+0000","last_undegraded":"2024-09-11T11:03:12.750645+0000","last_fullsized":"2024-09-11T11:03:12.750645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:12:21.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.021931+0000","last_change":"2024-09-11T11:01:05.344202+0000","last_active":"2024-09-11T11:04:18.021931+0000","last_peered":"2024-09-11T11:04:18.021931+0000","last_clean":"2024-09-11T11:04:18.021931+0000","last_became_active":"2024-09-11T11:01:05.343805+0000","last_became_peered":"2024-09-11T11:01:05.343805+0000","last_unstale":"2024-09-11T11:04:18.021931+0000","last_undegraded":"2024-09-11T11:04:18.021931+0000","last_fullsized":"2024-09-11T11:04:18.021931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:37:30.179996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122512+0000","last_change":"2024-09-11T11:01:05.333623+0000","last_active":"2024-09-11T11:02:42.122512+0000","last_peered":"2024-09-11T11:02:42.122512+0000","last_clean":"2024-09-11T11:02:42.122512+0000","last_became_active":"2024-09-11T11:01:05.332915+0000","last_became_peered":"2024-09-11T11:01:05.332915+0000","last_unstale":"2024-09-11T11:02:42.122512+0000","last_undegraded":"2024-09-11T11:02:42.122512+0000","last_fullsized":"2024-09-11T11:02:42.122512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:37.428238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847796+0000","last_change":"2024-09-11T11:01:03.347195+0000","last_active":"2024-09-11T11:02:42.847796+0000","last_peered":"2024-09-11T11:02:42.847796+0000","last_clean":"2024-09-11T11:02:42.847796+0000","last_became_active":"2024-09-11T11:01:03.346878+0000","last_became_peered":"2024-09-11T11:01:03.346878+0000","last_unstale":"2024-09-11T11:02:42.847796+0000","last_undegraded":"2024-09-11T11:02:42.847796+0000","last_fullsized":"2024-09-11T11:02:42.847796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:23.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.837531+0000","last_change":"2024-09-11T11:01:42.051383+0000","last_active":"2024-09-11T11:03:16.837531+0000","last_peered":"2024-09-11T11:03:16.837531+0000","last_clean":"2024-09-11T11:03:16.837531+0000","last_became_active":"2024-09-11T11:01:42.050609+0000","last_became_peered":"2024-09-11T11:01:42.050609+0000","last_unstale":"2024-09-11T11:03:16.837531+0000","last_undegraded":"2024-09-11T11:03:16.837531+0000","last_fullsized":"2024-09-11T11:03:16.837531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:02:47.432629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500359+0000","last_change":"2024-09-11T11:01:03.335675+0000","last_active":"2024-09-11T11:02:42.500359+0000","last_peered":"2024-09-11T11:02:42.500359+0000","last_clean":"2024-09-11T11:02:42.500359+0000","last_became_active":"2024-09-11T11:01:03.335121+0000","last_became_peered":"2024-09-11T11:01:03.335121+0000","last_unstale":"2024-09-11T11:02:42.500359+0000","last_undegraded":"2024-09-11T11:02:42.500359+0000","last_fullsized":"2024-09-11T11:02:42.500359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:09:08.817967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124476+0000","last_change":"2024-09-11T11:01:05.332966+0000","last_active":"2024-09-11T11:02:42.124476+0000","last_peered":"2024-09-11T11:02:42.124476+0000","last_clean":"2024-09-11T11:02:42.124476+0000","last_became_active":"2024-09-11T11:01:05.332299+0000","last_became_peered":"2024-09-11T11:01:05.332299+0000","last_unstale":"2024-09-11T11:02:42.124476+0000","last_undegraded":"2024-09-11T11:02:42.124476+0000","last_fullsized":"2024-09-11T11:02:42.124476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:16:36.575022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.128827+0000","last_change":"2024-09-11T11:01:03.346356+0000","last_active":"2024-09-11T11:02:42.128827+0000","last_peered":"2024-09-11T11:02:42.128827+0000","last_clean":"2024-09-11T11:02:42.128827+0000","last_became_active":"2024-09-11T11:01:03.345528+0000","last_became_peered":"2024-09-11T11:01:03.345528+0000","last_unstale":"2024-09-11T11:02:42.128827+0000","last_undegraded":"2024-09-11T11:02:42.128827+0000","last_fullsized":"2024-09-11T11:02:42.128827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:22.337303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855579+0000","last_change":"2024-09-11T11:01:05.353141+0000","last_active":"2024-09-11T11:04:17.855579+0000","last_peered":"2024-09-11T11:04:17.855579+0000","last_clean":"2024-09-11T11:04:17.855579+0000","last_became_active":"2024-09-11T11:01:05.352754+0000","last_became_peered":"2024-09-11T11:01:05.352754+0000","last_unstale":"2024-09-11T11:04:17.855579+0000","last_undegraded":"2024-09-11T11:04:17.855579+0000","last_fullsized":"2024-09-11T11:04:17.855579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:13.106892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.125934+0000","last_change":"2024-09-11T11:01:03.323543+0000","last_active":"2024-09-11T11:02:42.125934+0000","last_peered":"2024-09-11T11:02:42.125934+0000","last_clean":"2024-09-11T11:02:42.125934+0000","last_became_active":"2024-09-11T11:01:03.321411+0000","last_became_peered":"2024-09-11T11:01:03.321411+0000","last_unstale":"2024-09-11T11:02:42.125934+0000","last_undegraded":"2024-09-11T11:02:42.125934+0000","last_fullsized":"2024-09-11T11:02:42.125934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:47:39.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'32","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.854585+0000","last_change":"2024-09-11T11:01:05.337548+0000","last_active":"2024-09-11T11:04:17.854585+0000","last_peered":"2024-09-11T11:04:17.854585+0000","last_clean":"2024-09-11T11:04:17.854585+0000","last_became_active":"2024-09-11T11:01:05.337040+0000","last_became_peered":"2024-09-11T11:01:05.337040+0000","last_unstale":"2024-09-11T11:04:17.854585+0000","last_undegraded":"2024-09-11T11:04:17.854585+0000","last_fullsized":"2024-09-11T11:04:17.854585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:06.158539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.757156+0000","last_change":"2024-09-11T11:01:03.334314+0000","last_active":"2024-09-11T11:04:17.757156+0000","last_peered":"2024-09-11T11:04:17.757156+0000","last_clean":"2024-09-11T11:04:17.757156+0000","last_became_active":"2024-09-11T11:01:03.333820+0000","last_became_peered":"2024-09-11T11:01:03.333820+0000","last_unstale":"2024-09-11T11:04:17.757156+0000","last_undegraded":"2024-09-11T11:04:17.757156+0000","last_fullsized":"2024-09-11T11:04:17.757156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:32:19.168897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.574261+0000","last_change":"2024-09-11T11:01:05.342829+0000","last_active":"2024-09-11T11:04:17.574261+0000","last_peered":"2024-09-11T11:04:17.574261+0000","last_clean":"2024-09-11T11:04:17.574261+0000","last_became_active":"2024-09-11T11:01:05.342461+0000","last_became_peered":"2024-09-11T11:01:05.342461+0000","last_unstale":"2024-09-11T11:04:17.574261+0000","last_undegraded":"2024-09-11T11:04:17.574261+0000","last_fullsized":"2024-09-11T11:04:17.574261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:01:49.773250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.267054+0000","last_change":"2024-09-11T11:01:03.346138+0000","last_active":"2024-09-11T11:04:17.267054+0000","last_peered":"2024-09-11T11:04:17.267054+0000","last_clean":"2024-09-11T11:04:17.267054+0000","last_became_active":"2024-09-11T11:01:03.345866+0000","last_became_peered":"2024-09-11T11:01:03.345866+0000","last_unstale":"2024-09-11T11:04:17.267054+0000","last_undegraded":"2024-09-11T11:04:17.267054+0000","last_fullsized":"2024-09-11T11:04:17.267054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:08.559205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4834176,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.814618+0000","last_change":"2024-09-11T11:01:13.415583+0000","last_active":"2024-09-11T11:04:17.814618+0000","last_peered":"2024-09-11T11:04:17.814618+0000","last_clean":"2024-09-11T11:04:17.814618+0000","last_became_active":"2024-09-11T11:01:13.410232+0000","last_became_peered":"2024-09-11T11:01:13.410232+0000","last_unstale":"2024-09-11T11:04:17.814618+0000","last_undegraded":"2024-09-11T11:04:17.814618+0000","last_fullsized":"2024-09-11T11:04:17.814618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:58.102633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'14","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.435955+0000","last_change":"2024-09-11T11:01:05.347684+0000","last_active":"2024-09-11T11:04:17.435955+0000","last_peered":"2024-09-11T11:04:17.435955+0000","last_clean":"2024-09-11T11:04:17.435955+0000","last_became_active":"2024-09-11T11:01:05.347254+0000","last_became_peered":"2024-09-11T11:01:05.347254+0000","last_unstale":"2024-09-11T11:04:17.435955+0000","last_undegraded":"2024-09-11T11:04:17.435955+0000","last_fullsized":"2024-09-11T11:04:17.435955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:37.428238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.729046+0000","last_change":"2024-09-11T11:01:03.341239+0000","last_active":"2024-09-11T11:04:17.729046+0000","last_peered":"2024-09-11T11:04:17.729046+0000","last_clean":"2024-09-11T11:04:17.729046+0000","last_became_active":"2024-09-11T11:01:03.340851+0000","last_became_peered":"2024-09-11T11:01:03.340851+0000","last_unstale":"2024-09-11T11:04:17.729046+0000","last_undegraded":"2024-09-11T11:04:17.729046+0000","last_fullsized":"2024-09-11T11:04:17.729046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:47:39.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113676+0000","last_change":"2024-09-11T11:01:07.364976+0000","last_active":"2024-09-11T11:02:42.113676+0000","last_peered":"2024-09-11T11:02:42.113676+0000","last_clean":"2024-09-11T11:02:42.113676+0000","last_became_active":"2024-09-11T11:01:07.363392+0000","last_became_peered":"2024-09-11T11:01:07.363392+0000","last_unstale":"2024-09-11T11:02:42.113676+0000","last_undegraded":"2024-09-11T11:02:42.113676+0000","last_fullsized":"2024-09-11T11:02:42.113676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:33.505775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.891552+0000","last_change":"2024-09-11T11:01:09.392616+0000","last_active":"2024-09-11T11:03:14.891552+0000","last_peered":"2024-09-11T11:03:14.891552+0000","last_clean":"2024-09-11T11:03:14.891552+0000","last_became_active":"2024-09-11T11:01:09.392044+0000","last_became_peered":"2024-09-11T11:01:09.392044+0000","last_unstale":"2024-09-11T11:03:14.891552+0000","last_undegraded":"2024-09-11T11:03:14.891552+0000","last_fullsized":"2024-09-11T11:03:14.891552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:06.838378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129542+0000","last_change":"2024-09-11T11:01:11.400422+0000","last_active":"2024-09-11T11:02:42.129542+0000","last_peered":"2024-09-11T11:02:42.129542+0000","last_clean":"2024-09-11T11:02:42.129542+0000","last_became_active":"2024-09-11T11:01:11.399820+0000","last_became_peered":"2024-09-11T11:01:11.399820+0000","last_unstale":"2024-09-11T11:02:42.129542+0000","last_undegraded":"2024-09-11T11:02:42.129542+0000","last_fullsized":"2024-09-11T11:02:42.129542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:20.584480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121749+0000","last_change":"2024-09-11T11:01:13.421600+0000","last_active":"2024-09-11T11:02:42.121749+0000","last_peered":"2024-09-11T11:02:42.121749+0000","last_clean":"2024-09-11T11:02:42.121749+0000","last_became_active":"2024-09-11T11:01:13.420843+0000","last_became_peered":"2024-09-11T11:01:13.420843+0000","last_unstale":"2024-09-11T11:02:42.121749+0000","last_undegraded":"2024-09-11T11:02:42.121749+0000","last_fullsized":"2024-09-11T11:02:42.121749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:32:51.362925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'17","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.870018+0000","last_change":"2024-09-11T11:01:05.335422+0000","last_active":"2024-09-11T11:04:17.870018+0000","last_peered":"2024-09-11T11:04:17.870018+0000","last_clean":"2024-09-11T11:04:17.870018+0000","last_became_active":"2024-09-11T11:01:05.334085+0000","last_became_peered":"2024-09-11T11:01:05.334085+0000","last_unstale":"2024-09-11T11:04:17.870018+0000","last_undegraded":"2024-09-11T11:04:17.870018+0000","last_fullsized":"2024-09-11T11:04:17.870018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:14.677319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.775271+0000","last_change":"2024-09-11T11:01:03.335761+0000","last_active":"2024-09-11T11:03:16.775271+0000","last_peered":"2024-09-11T11:03:16.775271+0000","last_clean":"2024-09-11T11:03:16.775271+0000","last_became_active":"2024-09-11T11:01:03.335439+0000","last_became_peered":"2024-09-11T11:01:03.335439+0000","last_unstale":"2024-09-11T11:03:16.775271+0000","last_undegraded":"2024-09-11T11:03:16.775271+0000","last_fullsized":"2024-09-11T11:03:16.775271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:15:21.556672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113629+0000","last_change":"2024-09-11T11:01:07.354963+0000","last_active":"2024-09-11T11:02:42.113629+0000","last_peered":"2024-09-11T11:02:42.113629+0000","last_clean":"2024-09-11T11:02:42.113629+0000","last_became_active":"2024-09-11T11:01:07.350851+0000","last_became_peered":"2024-09-11T11:01:07.350851+0000","last_unstale":"2024-09-11T11:02:42.113629+0000","last_undegraded":"2024-09-11T11:02:42.113629+0000","last_fullsized":"2024-09-11T11:02:42.113629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:35:29.768861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845742+0000","last_change":"2024-09-11T11:01:09.383885+0000","last_active":"2024-09-11T11:02:42.845742+0000","last_peered":"2024-09-11T11:02:42.845742+0000","last_clean":"2024-09-11T11:02:42.845742+0000","last_became_active":"2024-09-11T11:01:09.382890+0000","last_became_peered":"2024-09-11T11:01:09.382890+0000","last_unstale":"2024-09-11T11:02:42.845742+0000","last_undegraded":"2024-09-11T11:02:42.845742+0000","last_fullsized":"2024-09-11T11:02:42.845742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:07.186578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126516+0000","last_change":"2024-09-11T11:01:11.401654+0000","last_active":"2024-09-11T11:02:42.126516+0000","last_peered":"2024-09-11T11:02:42.126516+0000","last_clean":"2024-09-11T11:02:42.126516+0000","last_became_active":"2024-09-11T11:01:11.400881+0000","last_became_peered":"2024-09-11T11:01:11.400881+0000","last_unstale":"2024-09-11T11:02:42.126516+0000","last_undegraded":"2024-09-11T11:02:42.126516+0000","last_fullsized":"2024-09-11T11:02:42.126516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:35:07.181778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110054+0000","last_change":"2024-09-11T11:01:13.423960+0000","last_active":"2024-09-11T11:02:42.110054+0000","last_peered":"2024-09-11T11:02:42.110054+0000","last_clean":"2024-09-11T11:02:42.110054+0000","last_became_active":"2024-09-11T11:01:13.422439+0000","last_became_peered":"2024-09-11T11:01:13.422439+0000","last_unstale":"2024-09-11T11:02:42.110054+0000","last_undegraded":"2024-09-11T11:02:42.110054+0000","last_fullsized":"2024-09-11T11:02:42.110054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:51.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113671+0000","last_change":"2024-09-11T11:01:05.343880+0000","last_active":"2024-09-11T11:02:42.113671+0000","last_peered":"2024-09-11T11:02:42.113671+0000","last_clean":"2024-09-11T11:02:42.113671+0000","last_became_active":"2024-09-11T11:01:05.343489+0000","last_became_peered":"2024-09-11T11:01:05.343489+0000","last_unstale":"2024-09-11T11:02:42.113671+0000","last_undegraded":"2024-09-11T11:02:42.113671+0000","last_fullsized":"2024-09-11T11:02:42.113671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:27:12.077223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121664+0000","last_change":"2024-09-11T11:01:03.338861+0000","last_active":"2024-09-11T11:02:42.121664+0000","last_peered":"2024-09-11T11:02:42.121664+0000","last_clean":"2024-09-11T11:02:42.121664+0000","last_became_active":"2024-09-11T11:01:03.337993+0000","last_became_peered":"2024-09-11T11:01:03.337993+0000","last_unstale":"2024-09-11T11:02:42.121664+0000","last_undegraded":"2024-09-11T11:02:42.121664+0000","last_fullsized":"2024-09-11T11:02:42.121664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:02.814616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116892+0000","last_change":"2024-09-11T11:01:07.364400+0000","last_active":"2024-09-11T11:02:42.116892+0000","last_peered":"2024-09-11T11:02:42.116892+0000","last_clean":"2024-09-11T11:02:42.116892+0000","last_became_active":"2024-09-11T11:01:07.363656+0000","last_became_peered":"2024-09-11T11:01:07.363656+0000","last_unstale":"2024-09-11T11:02:42.116892+0000","last_undegraded":"2024-09-11T11:02:42.116892+0000","last_fullsized":"2024-09-11T11:02:42.116892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:51.467819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.772825+0000","last_change":"2024-09-11T11:01:09.365976+0000","last_active":"2024-09-11T11:03:12.772825+0000","last_peered":"2024-09-11T11:03:12.772825+0000","last_clean":"2024-09-11T11:03:12.772825+0000","last_became_active":"2024-09-11T11:01:09.365291+0000","last_became_peered":"2024-09-11T11:01:09.365291+0000","last_unstale":"2024-09-11T11:03:12.772825+0000","last_undegraded":"2024-09-11T11:03:12.772825+0000","last_fullsized":"2024-09-11T11:03:12.772825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:26.467645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":386,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597318+0000","last_change":"2024-09-11T11:01:11.385545+0000","last_active":"2024-09-11T11:04:17.597318+0000","last_peered":"2024-09-11T11:04:17.597318+0000","last_clean":"2024-09-11T11:04:17.597318+0000","last_became_active":"2024-09-11T11:01:11.384635+0000","last_became_peered":"2024-09-11T11:01:11.384635+0000","last_unstale":"2024-09-11T11:04:17.597318+0000","last_undegraded":"2024-09-11T11:04:17.597318+0000","last_fullsized":"2024-09-11T11:04:17.597318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:41.366917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498281+0000","last_change":"2024-09-11T11:01:13.420839+0000","last_active":"2024-09-11T11:02:42.498281+0000","last_peered":"2024-09-11T11:02:42.498281+0000","last_clean":"2024-09-11T11:02:42.498281+0000","last_became_active":"2024-09-11T11:01:13.413465+0000","last_became_peered":"2024-09-11T11:01:13.413465+0000","last_unstale":"2024-09-11T11:02:42.498281+0000","last_undegraded":"2024-09-11T11:02:42.498281+0000","last_fullsized":"2024-09-11T11:02:42.498281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:12.707001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'18","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770490+0000","last_change":"2024-09-11T11:01:05.347779+0000","last_active":"2024-09-11T11:04:17.770490+0000","last_peered":"2024-09-11T11:04:17.770490+0000","last_clean":"2024-09-11T11:04:17.770490+0000","last_became_active":"2024-09-11T11:01:05.347434+0000","last_became_peered":"2024-09-11T11:01:05.347434+0000","last_unstale":"2024-09-11T11:04:17.770490+0000","last_undegraded":"2024-09-11T11:04:17.770490+0000","last_fullsized":"2024-09-11T11:04:17.770490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:14.471785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.216896+0000","last_change":"2024-09-11T11:01:03.322006+0000","last_active":"2024-09-11T11:04:17.216896+0000","last_peered":"2024-09-11T11:04:17.216896+0000","last_clean":"2024-09-11T11:04:17.216896+0000","last_became_active":"2024-09-11T11:01:03.320684+0000","last_became_peered":"2024-09-11T11:01:03.320684+0000","last_unstale":"2024-09-11T11:04:17.216896+0000","last_undegraded":"2024-09-11T11:04:17.216896+0000","last_fullsized":"2024-09-11T11:04:17.216896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:11.801971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127569+0000","last_change":"2024-09-11T11:01:07.343287+0000","last_active":"2024-09-11T11:02:42.127569+0000","last_peered":"2024-09-11T11:02:42.127569+0000","last_clean":"2024-09-11T11:02:42.127569+0000","last_became_active":"2024-09-11T11:01:07.342607+0000","last_became_peered":"2024-09-11T11:01:07.342607+0000","last_unstale":"2024-09-11T11:02:42.127569+0000","last_undegraded":"2024-09-11T11:02:42.127569+0000","last_fullsized":"2024-09-11T11:02:42.127569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:33:47.987384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.883742+0000","last_change":"2024-09-11T11:01:09.367726+0000","last_active":"2024-09-11T11:03:14.883742+0000","last_peered":"2024-09-11T11:03:14.883742+0000","last_clean":"2024-09-11T11:03:14.883742+0000","last_became_active":"2024-09-11T11:01:09.366811+0000","last_became_peered":"2024-09-11T11:01:09.366811+0000","last_unstale":"2024-09-11T11:03:14.883742+0000","last_undegraded":"2024-09-11T11:03:14.883742+0000","last_fullsized":"2024-09-11T11:03:14.883742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:56:57.446929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.928557+0000","last_change":"2024-09-11T11:01:11.399976+0000","last_active":"2024-09-11T11:04:17.928557+0000","last_peered":"2024-09-11T11:04:17.928557+0000","last_clean":"2024-09-11T11:04:17.928557+0000","last_became_active":"2024-09-11T11:01:11.399213+0000","last_became_peered":"2024-09-11T11:01:11.399213+0000","last_unstale":"2024-09-11T11:04:17.928557+0000","last_undegraded":"2024-09-11T11:04:17.928557+0000","last_fullsized":"2024-09-11T11:04:17.928557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:38.273109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573835+0000","last_change":"2024-09-11T11:01:05.330488+0000","last_active":"2024-09-11T11:04:17.573835+0000","last_peered":"2024-09-11T11:04:17.573835+0000","last_clean":"2024-09-11T11:04:17.573835+0000","last_became_active":"2024-09-11T11:01:05.330091+0000","last_became_peered":"2024-09-11T11:01:05.330091+0000","last_unstale":"2024-09-11T11:04:17.573835+0000","last_undegraded":"2024-09-11T11:04:17.573835+0000","last_fullsized":"2024-09-11T11:04:17.573835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:03.072232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127186+0000","last_change":"2024-09-11T11:01:03.338267+0000","last_active":"2024-09-11T11:02:42.127186+0000","last_peered":"2024-09-11T11:02:42.127186+0000","last_clean":"2024-09-11T11:02:42.127186+0000","last_became_active":"2024-09-11T11:01:03.337496+0000","last_became_peered":"2024-09-11T11:01:03.337496+0000","last_unstale":"2024-09-11T11:02:42.127186+0000","last_undegraded":"2024-09-11T11:02:42.127186+0000","last_fullsized":"2024-09-11T11:02:42.127186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:32:02.436613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843554+0000","last_change":"2024-09-11T11:01:07.366981+0000","last_active":"2024-09-11T11:02:42.843554+0000","last_peered":"2024-09-11T11:02:42.843554+0000","last_clean":"2024-09-11T11:02:42.843554+0000","last_became_active":"2024-09-11T11:01:07.366115+0000","last_became_peered":"2024-09-11T11:01:07.366115+0000","last_unstale":"2024-09-11T11:02:42.843554+0000","last_undegraded":"2024-09-11T11:02:42.843554+0000","last_fullsized":"2024-09-11T11:02:42.843554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:28:41.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.901157+0000","last_change":"2024-09-11T11:01:09.377146+0000","last_active":"2024-09-11T11:03:14.901157+0000","last_peered":"2024-09-11T11:03:14.901157+0000","last_clean":"2024-09-11T11:03:14.901157+0000","last_became_active":"2024-09-11T11:01:09.376242+0000","last_became_peered":"2024-09-11T11:01:09.376242+0000","last_unstale":"2024-09-11T11:03:14.901157+0000","last_undegraded":"2024-09-11T11:03:14.901157+0000","last_fullsized":"2024-09-11T11:03:14.901157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:27.367457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842086+0000","last_change":"2024-09-11T11:01:11.378387+0000","last_active":"2024-09-11T11:02:42.842086+0000","last_peered":"2024-09-11T11:02:42.842086+0000","last_clean":"2024-09-11T11:02:42.842086+0000","last_became_active":"2024-09-11T11:01:11.377655+0000","last_became_peered":"2024-09-11T11:01:11.377655+0000","last_unstale":"2024-09-11T11:02:42.842086+0000","last_undegraded":"2024-09-11T11:02:42.842086+0000","last_fullsized":"2024-09-11T11:02:42.842086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:45.529658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499873+0000","last_change":"2024-09-11T11:01:13.421261+0000","last_active":"2024-09-11T11:02:42.499873+0000","last_peered":"2024-09-11T11:02:42.499873+0000","last_clean":"2024-09-11T11:02:42.499873+0000","last_became_active":"2024-09-11T11:01:13.420299+0000","last_became_peered":"2024-09-11T11:01:13.420299+0000","last_unstale":"2024-09-11T11:02:42.499873+0000","last_undegraded":"2024-09-11T11:02:42.499873+0000","last_fullsized":"2024-09-11T11:02:42.499873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:06:26.945332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842409+0000","last_change":"2024-09-11T11:01:05.355473+0000","last_active":"2024-09-11T11:02:42.842409+0000","last_peered":"2024-09-11T11:02:42.842409+0000","last_clean":"2024-09-11T11:02:42.842409+0000","last_became_active":"2024-09-11T11:01:05.355135+0000","last_became_peered":"2024-09-11T11:01:05.355135+0000","last_unstale":"2024-09-11T11:02:42.842409+0000","last_undegraded":"2024-09-11T11:02:42.842409+0000","last_fullsized":"2024-09-11T11:02:42.842409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:47.491766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126834+0000","last_change":"2024-09-11T11:01:03.322857+0000","last_active":"2024-09-11T11:02:42.126834+0000","last_peered":"2024-09-11T11:02:42.126834+0000","last_clean":"2024-09-11T11:02:42.126834+0000","last_became_active":"2024-09-11T11:01:03.320605+0000","last_became_peered":"2024-09-11T11:01:03.320605+0000","last_unstale":"2024-09-11T11:02:42.126834+0000","last_undegraded":"2024-09-11T11:02:42.126834+0000","last_fullsized":"2024-09-11T11:02:42.126834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:02.081735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497680+0000","last_change":"2024-09-11T11:01:07.349262+0000","last_active":"2024-09-11T11:02:42.497680+0000","last_peered":"2024-09-11T11:02:42.497680+0000","last_clean":"2024-09-11T11:02:42.497680+0000","last_became_active":"2024-09-11T11:01:07.348627+0000","last_became_peered":"2024-09-11T11:01:07.348627+0000","last_unstale":"2024-09-11T11:02:42.497680+0000","last_undegraded":"2024-09-11T11:02:42.497680+0000","last_fullsized":"2024-09-11T11:02:42.497680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:14:29.786650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.841432+0000","last_change":"2024-09-11T11:01:09.385906+0000","last_active":"2024-09-11T11:03:16.841432+0000","last_peered":"2024-09-11T11:03:16.841432+0000","last_clean":"2024-09-11T11:03:16.841432+0000","last_became_active":"2024-09-11T11:01:09.384478+0000","last_became_peered":"2024-09-11T11:01:09.384478+0000","last_unstale":"2024-09-11T11:03:16.841432+0000","last_undegraded":"2024-09-11T11:03:16.841432+0000","last_fullsized":"2024-09-11T11:03:16.841432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:10.751059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112388+0000","last_change":"2024-09-11T11:01:11.402062+0000","last_active":"2024-09-11T11:02:42.112388+0000","last_peered":"2024-09-11T11:02:42.112388+0000","last_clean":"2024-09-11T11:02:42.112388+0000","last_became_active":"2024-09-11T11:01:11.401382+0000","last_became_peered":"2024-09-11T11:01:11.401382+0000","last_unstale":"2024-09-11T11:02:42.112388+0000","last_undegraded":"2024-09-11T11:02:42.112388+0000","last_fullsized":"2024-09-11T11:02:42.112388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:09.834093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844778+0000","last_change":"2024-09-11T11:01:13.419597+0000","last_active":"2024-09-11T11:02:42.844778+0000","last_peered":"2024-09-11T11:02:42.844778+0000","last_clean":"2024-09-11T11:02:42.844778+0000","last_became_active":"2024-09-11T11:01:13.415041+0000","last_became_peered":"2024-09-11T11:01:13.415041+0000","last_unstale":"2024-09-11T11:02:42.844778+0000","last_undegraded":"2024-09-11T11:02:42.844778+0000","last_fullsized":"2024-09-11T11:02:42.844778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:25.378088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'8","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921023+0000","last_change":"2024-09-11T11:01:05.347855+0000","last_active":"2024-09-11T11:04:17.921023+0000","last_peered":"2024-09-11T11:04:17.921023+0000","last_clean":"2024-09-11T11:04:17.921023+0000","last_became_active":"2024-09-11T11:01:05.347137+0000","last_became_peered":"2024-09-11T11:01:05.347137+0000","last_unstale":"2024-09-11T11:04:17.921023+0000","last_undegraded":"2024-09-11T11:04:17.921023+0000","last_fullsized":"2024-09-11T11:04:17.921023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:31:24.806914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127018+0000","last_change":"2024-09-11T11:01:42.098396+0000","last_active":"2024-09-11T11:02:42.127018+0000","last_peered":"2024-09-11T11:02:42.127018+0000","last_clean":"2024-09-11T11:02:42.127018+0000","last_became_active":"2024-09-11T11:01:42.065732+0000","last_became_peered":"2024-09-11T11:01:42.065732+0000","last_unstale":"2024-09-11T11:02:42.127018+0000","last_undegraded":"2024-09-11T11:02:42.127018+0000","last_fullsized":"2024-09-11T11:02:42.127018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:11:20.458955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498082+0000","last_change":"2024-09-11T11:01:42.064065+0000","last_active":"2024-09-11T11:02:42.498082+0000","last_peered":"2024-09-11T11:02:42.498082+0000","last_clean":"2024-09-11T11:02:42.498082+0000","last_became_active":"2024-09-11T11:01:42.062781+0000","last_became_peered":"2024-09-11T11:01:42.062781+0000","last_unstale":"2024-09-11T11:02:42.498082+0000","last_undegraded":"2024-09-11T11:02:42.498082+0000","last_fullsized":"2024-09-11T11:02:42.498082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:38:04.790112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.904313+0000","last_change":"2024-09-11T11:01:09.362905+0000","last_active":"2024-09-11T11:03:14.904313+0000","last_peered":"2024-09-11T11:03:14.904313+0000","last_clean":"2024-09-11T11:03:14.904313+0000","last_became_active":"2024-09-11T11:01:09.362260+0000","last_became_peered":"2024-09-11T11:01:09.362260+0000","last_unstale":"2024-09-11T11:03:14.904313+0000","last_undegraded":"2024-09-11T11:03:14.904313+0000","last_fullsized":"2024-09-11T11:03:14.904313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:49:20.880526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":380,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.121670+0000","last_change":"2024-09-11T11:01:11.392542+0000","last_active":"2024-09-11T11:04:18.121670+0000","last_peered":"2024-09-11T11:04:18.121670+0000","last_clean":"2024-09-11T11:04:18.121670+0000","last_became_active":"2024-09-11T11:01:11.391826+0000","last_became_peered":"2024-09-11T11:01:11.391826+0000","last_unstale":"2024-09-11T11:04:18.121670+0000","last_undegraded":"2024-09-11T11:04:18.121670+0000","last_fullsized":"2024-09-11T11:04:18.121670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:38:29.310699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844769+0000","last_change":"2024-09-11T11:01:13.429296+0000","last_active":"2024-09-11T11:02:42.844769+0000","last_peered":"2024-09-11T11:02:42.844769+0000","last_clean":"2024-09-11T11:02:42.844769+0000","last_became_active":"2024-09-11T11:01:13.428914+0000","last_became_peered":"2024-09-11T11:01:13.428914+0000","last_unstale":"2024-09-11T11:02:42.844769+0000","last_undegraded":"2024-09-11T11:02:42.844769+0000","last_fullsized":"2024-09-11T11:02:42.844769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:03.330930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921462+0000","last_change":"2024-09-11T11:01:05.340468+0000","last_active":"2024-09-11T11:04:17.921462+0000","last_peered":"2024-09-11T11:04:17.921462+0000","last_clean":"2024-09-11T11:04:17.921462+0000","last_became_active":"2024-09-11T11:01:05.340069+0000","last_became_peered":"2024-09-11T11:01:05.340069+0000","last_unstale":"2024-09-11T11:04:17.921462+0000","last_undegraded":"2024-09-11T11:04:17.921462+0000","last_fullsized":"2024-09-11T11:04:17.921462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:10.394106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.390386+0000","last_change":"2024-09-11T11:01:03.334480+0000","last_active":"2024-09-11T11:04:17.390386+0000","last_peered":"2024-09-11T11:04:17.390386+0000","last_clean":"2024-09-11T11:04:17.390386+0000","last_became_active":"2024-09-11T11:01:03.333740+0000","last_became_peered":"2024-09-11T11:01:03.333740+0000","last_unstale":"2024-09-11T11:04:17.390386+0000","last_undegraded":"2024-09-11T11:04:17.390386+0000","last_fullsized":"2024-09-11T11:04:17.390386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:50:26.785068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498170+0000","last_change":"2024-09-11T11:01:07.355314+0000","last_active":"2024-09-11T11:02:42.498170+0000","last_peered":"2024-09-11T11:02:42.498170+0000","last_clean":"2024-09-11T11:02:42.498170+0000","last_became_active":"2024-09-11T11:01:07.354827+0000","last_became_peered":"2024-09-11T11:01:07.354827+0000","last_unstale":"2024-09-11T11:02:42.498170+0000","last_undegraded":"2024-09-11T11:02:42.498170+0000","last_fullsized":"2024-09-11T11:02:42.498170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:19:54.907620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'54","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.906396+0000","last_change":"2024-09-11T11:01:09.378757+0000","last_active":"2024-09-11T11:03:14.906396+0000","last_peered":"2024-09-11T11:03:14.906396+0000","last_clean":"2024-09-11T11:03:14.906396+0000","last_became_active":"2024-09-11T11:01:09.374320+0000","last_became_peered":"2024-09-11T11:01:09.374320+0000","last_unstale":"2024-09-11T11:03:14.906396+0000","last_undegraded":"2024-09-11T11:03:14.906396+0000","last_fullsized":"2024-09-11T11:03:14.906396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:24:56.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497933+0000","last_change":"2024-09-11T11:01:11.399906+0000","last_active":"2024-09-11T11:02:42.497933+0000","last_peered":"2024-09-11T11:02:42.497933+0000","last_clean":"2024-09-11T11:02:42.497933+0000","last_became_active":"2024-09-11T11:01:11.399118+0000","last_became_peered":"2024-09-11T11:01:11.399118+0000","last_unstale":"2024-09-11T11:02:42.497933+0000","last_undegraded":"2024-09-11T11:02:42.497933+0000","last_fullsized":"2024-09-11T11:02:42.497933+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:55:10.905238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.082661+0000","last_change":"2024-09-11T11:01:13.419418+0000","last_active":"2024-09-11T11:04:18.082661+0000","last_peered":"2024-09-11T11:04:18.082661+0000","last_clean":"2024-09-11T11:04:18.082661+0000","last_became_active":"2024-09-11T11:01:13.415242+0000","last_became_peered":"2024-09-11T11:01:13.415242+0000","last_unstale":"2024-09-11T11:04:18.082661+0000","last_undegraded":"2024-09-11T11:04:18.082661+0000","last_fullsized":"2024-09-11T11:04:18.082661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:11.846013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845729+0000","last_change":"2024-09-11T11:01:05.348021+0000","last_active":"2024-09-11T11:02:42.845729+0000","last_peered":"2024-09-11T11:02:42.845729+0000","last_clean":"2024-09-11T11:02:42.845729+0000","last_became_active":"2024-09-11T11:01:05.347367+0000","last_became_peered":"2024-09-11T11:01:05.347367+0000","last_unstale":"2024-09-11T11:02:42.845729+0000","last_undegraded":"2024-09-11T11:02:42.845729+0000","last_fullsized":"2024-09-11T11:02:42.845729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:39:58.017666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113078+0000","last_change":"2024-09-11T11:01:03.349349+0000","last_active":"2024-09-11T11:02:42.113078+0000","last_peered":"2024-09-11T11:02:42.113078+0000","last_clean":"2024-09-11T11:02:42.113078+0000","last_became_active":"2024-09-11T11:01:03.349051+0000","last_became_peered":"2024-09-11T11:01:03.349051+0000","last_unstale":"2024-09-11T11:02:42.113078+0000","last_undegraded":"2024-09-11T11:02:42.113078+0000","last_fullsized":"2024-09-11T11:02:42.113078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:55.170368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499811+0000","last_change":"2024-09-11T11:01:07.345118+0000","last_active":"2024-09-11T11:02:42.499811+0000","last_peered":"2024-09-11T11:02:42.499811+0000","last_clean":"2024-09-11T11:02:42.499811+0000","last_became_active":"2024-09-11T11:01:07.344509+0000","last_became_peered":"2024-09-11T11:01:07.344509+0000","last_unstale":"2024-09-11T11:02:42.499811+0000","last_undegraded":"2024-09-11T11:02:42.499811+0000","last_fullsized":"2024-09-11T11:02:42.499811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:59:57.440549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.872442+0000","last_change":"2024-09-11T11:01:09.377401+0000","last_active":"2024-09-11T11:03:14.872442+0000","last_peered":"2024-09-11T11:03:14.872442+0000","last_clean":"2024-09-11T11:03:14.872442+0000","last_became_active":"2024-09-11T11:01:09.376576+0000","last_became_peered":"2024-09-11T11:01:09.376576+0000","last_unstale":"2024-09-11T11:03:14.872442+0000","last_undegraded":"2024-09-11T11:03:14.872442+0000","last_fullsized":"2024-09-11T11:03:14.872442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:35.979322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114062+0000","last_change":"2024-09-11T11:01:11.394988+0000","last_active":"2024-09-11T11:02:42.114062+0000","last_peered":"2024-09-11T11:02:42.114062+0000","last_clean":"2024-09-11T11:02:42.114062+0000","last_became_active":"2024-09-11T11:01:11.394215+0000","last_became_peered":"2024-09-11T11:01:11.394215+0000","last_unstale":"2024-09-11T11:02:42.114062+0000","last_undegraded":"2024-09-11T11:02:42.114062+0000","last_fullsized":"2024-09-11T11:02:42.114062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:01.319010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.482720+0000","last_change":"2024-09-11T11:01:13.391142+0000","last_active":"2024-09-11T11:03:14.482720+0000","last_peered":"2024-09-11T11:03:14.482720+0000","last_clean":"2024-09-11T11:03:14.482720+0000","last_became_active":"2024-09-11T11:01:13.390538+0000","last_became_peered":"2024-09-11T11:01:13.390538+0000","last_unstale":"2024-09-11T11:03:14.482720+0000","last_undegraded":"2024-09-11T11:03:14.482720+0000","last_fullsized":"2024-09-11T11:03:14.482720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:22.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836912+0000","last_change":"2024-09-11T11:01:05.332887+0000","last_active":"2024-09-11T11:03:16.836912+0000","last_peered":"2024-09-11T11:03:16.836912+0000","last_clean":"2024-09-11T11:03:16.836912+0000","last_became_active":"2024-09-11T11:01:05.332138+0000","last_became_peered":"2024-09-11T11:01:05.332138+0000","last_unstale":"2024-09-11T11:03:16.836912+0000","last_undegraded":"2024-09-11T11:03:16.836912+0000","last_fullsized":"2024-09-11T11:03:16.836912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:58.679274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123858+0000","last_change":"2024-09-11T11:01:03.321735+0000","last_active":"2024-09-11T11:02:42.123858+0000","last_peered":"2024-09-11T11:02:42.123858+0000","last_clean":"2024-09-11T11:02:42.123858+0000","last_became_active":"2024-09-11T11:01:03.320906+0000","last_became_peered":"2024-09-11T11:01:03.320906+0000","last_unstale":"2024-09-11T11:02:42.123858+0000","last_undegraded":"2024-09-11T11:02:42.123858+0000","last_fullsized":"2024-09-11T11:02:42.123858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:36.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843009+0000","last_change":"2024-09-11T11:01:07.367900+0000","last_active":"2024-09-11T11:02:42.843009+0000","last_peered":"2024-09-11T11:02:42.843009+0000","last_clean":"2024-09-11T11:02:42.843009+0000","last_became_active":"2024-09-11T11:01:07.367554+0000","last_became_peered":"2024-09-11T11:01:07.367554+0000","last_unstale":"2024-09-11T11:02:42.843009+0000","last_undegraded":"2024-09-11T11:02:42.843009+0000","last_fullsized":"2024-09-11T11:02:42.843009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:52.335084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'38","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.916885+0000","last_change":"2024-09-11T11:01:09.367972+0000","last_active":"2024-09-11T11:03:14.916885+0000","last_peered":"2024-09-11T11:03:14.916885+0000","last_clean":"2024-09-11T11:03:14.916885+0000","last_became_active":"2024-09-11T11:01:09.367246+0000","last_became_peered":"2024-09-11T11:01:09.367246+0000","last_unstale":"2024-09-11T11:03:14.916885+0000","last_undegraded":"2024-09-11T11:03:14.916885+0000","last_fullsized":"2024-09-11T11:03:14.916885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:32.334281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":414,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.093944+0000","last_change":"2024-09-11T11:01:11.393113+0000","last_active":"2024-09-11T11:04:18.093944+0000","last_peered":"2024-09-11T11:04:18.093944+0000","last_clean":"2024-09-11T11:04:18.093944+0000","last_became_active":"2024-09-11T11:01:11.392359+0000","last_became_peered":"2024-09-11T11:01:11.392359+0000","last_unstale":"2024-09-11T11:04:18.093944+0000","last_undegraded":"2024-09-11T11:04:18.093944+0000","last_fullsized":"2024-09-11T11:04:18.093944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:39.923836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'16","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.875398+0000","last_change":"2024-09-11T11:01:13.418955+0000","last_active":"2024-09-11T11:04:17.875398+0000","last_peered":"2024-09-11T11:04:17.875398+0000","last_clean":"2024-09-11T11:04:17.875398+0000","last_became_active":"2024-09-11T11:01:13.415115+0000","last_became_peered":"2024-09-11T11:01:13.415115+0000","last_unstale":"2024-09-11T11:04:17.875398+0000","last_undegraded":"2024-09-11T11:04:17.875398+0000","last_fullsized":"2024-09-11T11:04:17.875398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:40.005800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770486+0000","last_change":"2024-09-11T11:01:05.337583+0000","last_active":"2024-09-11T11:04:17.770486+0000","last_peered":"2024-09-11T11:04:17.770486+0000","last_clean":"2024-09-11T11:04:17.770486+0000","last_became_active":"2024-09-11T11:01:05.337055+0000","last_became_peered":"2024-09-11T11:01:05.337055+0000","last_unstale":"2024-09-11T11:04:17.770486+0000","last_undegraded":"2024-09-11T11:04:17.770486+0000","last_fullsized":"2024-09-11T11:04:17.770486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:52.604892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.743722+0000","last_change":"2024-09-11T11:01:03.336594+0000","last_active":"2024-09-11T11:04:17.743722+0000","last_peered":"2024-09-11T11:04:17.743722+0000","last_clean":"2024-09-11T11:04:17.743722+0000","last_became_active":"2024-09-11T11:01:03.334392+0000","last_became_peered":"2024-09-11T11:01:03.334392+0000","last_unstale":"2024-09-11T11:04:17.743722+0000","last_undegraded":"2024-09-11T11:04:17.743722+0000","last_fullsized":"2024-09-11T11:04:17.743722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:14.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.333038+0000","last_change":"2024-09-11T11:01:07.360933+0000","last_active":"2024-09-11T11:03:16.333038+0000","last_peered":"2024-09-11T11:03:16.333038+0000","last_clean":"2024-09-11T11:03:16.333038+0000","last_became_active":"2024-09-11T11:01:07.360348+0000","last_became_peered":"2024-09-11T11:01:07.360348+0000","last_unstale":"2024-09-11T11:03:16.333038+0000","last_undegraded":"2024-09-11T11:03:16.333038+0000","last_fullsized":"2024-09-11T11:03:16.333038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:05.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.519176+0000","last_change":"2024-09-11T11:02:42.518145+0000","last_active":"2024-09-11T11:02:42.519176+0000","last_peered":"2024-09-11T11:02:42.519176+0000","last_clean":"2024-09-11T11:02:42.519176+0000","last_became_active":"2024-09-11T11:02:42.501712+0000","last_became_peered":"2024-09-11T11:02:42.501712+0000","last_unstale":"2024-09-11T11:02:42.519176+0000","last_undegraded":"2024-09-11T11:02:42.519176+0000","last_fullsized":"2024-09-11T11:02:42.519176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:53.342864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.034092+0000","last_change":"2024-09-11T11:01:11.386158+0000","last_active":"2024-09-11T11:04:18.034092+0000","last_peered":"2024-09-11T11:04:18.034092+0000","last_clean":"2024-09-11T11:04:18.034092+0000","last_became_active":"2024-09-11T11:01:11.384776+0000","last_became_peered":"2024-09-11T11:01:11.384776+0000","last_unstale":"2024-09-11T11:04:18.034092+0000","last_undegraded":"2024-09-11T11:04:18.034092+0000","last_fullsized":"2024-09-11T11:04:18.034092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:00.643395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.829302+0000","last_change":"2024-09-11T11:01:13.419039+0000","last_active":"2024-09-11T11:03:16.829302+0000","last_peered":"2024-09-11T11:03:16.829302+0000","last_clean":"2024-09-11T11:03:16.829302+0000","last_became_active":"2024-09-11T11:01:13.418296+0000","last_became_peered":"2024-09-11T11:01:13.418296+0000","last_unstale":"2024-09-11T11:03:16.829302+0000","last_undegraded":"2024-09-11T11:03:16.829302+0000","last_fullsized":"2024-09-11T11:03:16.829302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:38:59.936533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.920553+0000","last_change":"2024-09-11T11:01:05.348048+0000","last_active":"2024-09-11T11:04:17.920553+0000","last_peered":"2024-09-11T11:04:17.920553+0000","last_clean":"2024-09-11T11:04:17.920553+0000","last_became_active":"2024-09-11T11:01:05.347644+0000","last_became_peered":"2024-09-11T11:01:05.347644+0000","last_unstale":"2024-09-11T11:04:17.920553+0000","last_undegraded":"2024-09-11T11:04:17.920553+0000","last_fullsized":"2024-09-11T11:04:17.920553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:28.667270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109195+0000","last_change":"2024-09-11T11:01:03.349954+0000","last_active":"2024-09-11T11:02:42.109195+0000","last_peered":"2024-09-11T11:02:42.109195+0000","last_clean":"2024-09-11T11:02:42.109195+0000","last_became_active":"2024-09-11T11:01:03.349605+0000","last_became_peered":"2024-09-11T11:01:03.349605+0000","last_unstale":"2024-09-11T11:02:42.109195+0000","last_undegraded":"2024-09-11T11:02:42.109195+0000","last_fullsized":"2024-09-11T11:02:42.109195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:42.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113995+0000","last_change":"2024-09-11T11:01:07.355413+0000","last_active":"2024-09-11T11:02:42.113995+0000","last_peered":"2024-09-11T11:02:42.113995+0000","last_clean":"2024-09-11T11:02:42.113995+0000","last_became_active":"2024-09-11T11:01:07.351403+0000","last_became_peered":"2024-09-11T11:01:07.351403+0000","last_unstale":"2024-09-11T11:02:42.113995+0000","last_undegraded":"2024-09-11T11:02:42.113995+0000","last_fullsized":"2024-09-11T11:02:42.113995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:36:28.171191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'38","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.894816+0000","last_change":"2024-09-11T11:01:09.377243+0000","last_active":"2024-09-11T11:03:14.894816+0000","last_peered":"2024-09-11T11:03:14.894816+0000","last_clean":"2024-09-11T11:03:14.894816+0000","last_became_active":"2024-09-11T11:01:09.376340+0000","last_became_peered":"2024-09-11T11:01:09.376340+0000","last_unstale":"2024-09-11T11:03:14.894816+0000","last_undegraded":"2024-09-11T11:03:14.894816+0000","last_fullsized":"2024-09-11T11:03:14.894816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:34:10.669607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126520+0000","last_change":"2024-09-11T11:01:11.386915+0000","last_active":"2024-09-11T11:02:42.126520+0000","last_peered":"2024-09-11T11:02:42.126520+0000","last_clean":"2024-09-11T11:02:42.126520+0000","last_became_active":"2024-09-11T11:01:11.385523+0000","last_became_peered":"2024-09-11T11:01:11.385523+0000","last_unstale":"2024-09-11T11:02:42.126520+0000","last_undegraded":"2024-09-11T11:02:42.126520+0000","last_fullsized":"2024-09-11T11:02:42.126520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:46:58.221514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'6","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.989822+0000","last_change":"2024-09-11T11:01:13.408216+0000","last_active":"2024-09-11T11:04:17.989822+0000","last_peered":"2024-09-11T11:04:17.989822+0000","last_clean":"2024-09-11T11:04:17.989822+0000","last_became_active":"2024-09-11T11:01:13.403125+0000","last_became_peered":"2024-09-11T11:01:13.403125+0000","last_unstale":"2024-09-11T11:04:17.989822+0000","last_undegraded":"2024-09-11T11:04:17.989822+0000","last_fullsized":"2024-09-11T11:04:17.989822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:20.557182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'22","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.856373+0000","last_change":"2024-09-11T11:01:05.346169+0000","last_active":"2024-09-11T11:04:17.856373+0000","last_peered":"2024-09-11T11:04:17.856373+0000","last_clean":"2024-09-11T11:04:17.856373+0000","last_became_active":"2024-09-11T11:01:05.345474+0000","last_became_peered":"2024-09-11T11:01:05.345474+0000","last_unstale":"2024-09-11T11:04:17.856373+0000","last_undegraded":"2024-09-11T11:04:17.856373+0000","last_fullsized":"2024-09-11T11:04:17.856373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:50.321614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":206,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.841643+0000","last_change":"2024-09-11T11:00:51.371382+0000","last_active":"2024-09-11T11:02:42.841643+0000","last_peered":"2024-09-11T11:02:42.841643+0000","last_clean":"2024-09-11T11:02:42.841643+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:02:42.841643+0000","last_undegraded":"2024-09-11T11:02:42.841643+0000","last_fullsized":"2024-09-11T11:02:42.841643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_clean_scrub_stamp":"2024-09-11T11:00:49.442581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:56.798705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124201+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:02:42.124201+0000","last_peered":"2024-09-11T11:02:42.124201+0000","last_clean":"2024-09-11T11:02:42.124201+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:02:42.124201+0000","last_undegraded":"2024-09-11T11:02:42.124201+0000","last_fullsized":"2024-09-11T11:02:42.124201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:29.398076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110553+0000","last_change":"2024-09-11T11:01:03.345152+0000","last_active":"2024-09-11T11:02:42.110553+0000","last_peered":"2024-09-11T11:02:42.110553+0000","last_clean":"2024-09-11T11:02:42.110553+0000","last_became_active":"2024-09-11T11:01:03.334611+0000","last_became_peered":"2024-09-11T11:01:03.334611+0000","last_unstale":"2024-09-11T11:02:42.110553+0000","last_undegraded":"2024-09-11T11:02:42.110553+0000","last_fullsized":"2024-09-11T11:02:42.110553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:26:54.046187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843252+0000","last_change":"2024-09-11T11:01:07.352085+0000","last_active":"2024-09-11T11:02:42.843252+0000","last_peered":"2024-09-11T11:02:42.843252+0000","last_clean":"2024-09-11T11:02:42.843252+0000","last_became_active":"2024-09-11T11:01:07.348530+0000","last_became_peered":"2024-09-11T11:01:07.348530+0000","last_unstale":"2024-09-11T11:02:42.843252+0000","last_undegraded":"2024-09-11T11:02:42.843252+0000","last_fullsized":"2024-09-11T11:02:42.843252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:05.458479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.915190+0000","last_change":"2024-09-11T11:01:09.370703+0000","last_active":"2024-09-11T11:03:14.915190+0000","last_peered":"2024-09-11T11:03:14.915190+0000","last_clean":"2024-09-11T11:03:14.915190+0000","last_became_active":"2024-09-11T11:01:09.369066+0000","last_became_peered":"2024-09-11T11:01:09.369066+0000","last_unstale":"2024-09-11T11:03:14.915190+0000","last_undegraded":"2024-09-11T11:03:14.915190+0000","last_fullsized":"2024-09-11T11:03:14.915190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:36.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113047+0000","last_change":"2024-09-11T11:01:11.396326+0000","last_active":"2024-09-11T11:02:42.113047+0000","last_peered":"2024-09-11T11:02:42.113047+0000","last_clean":"2024-09-11T11:02:42.113047+0000","last_became_active":"2024-09-11T11:01:11.394277+0000","last_became_peered":"2024-09-11T11:01:11.394277+0000","last_unstale":"2024-09-11T11:02:42.113047+0000","last_undegraded":"2024-09-11T11:02:42.113047+0000","last_fullsized":"2024-09-11T11:02:42.113047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:23.366168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.947140+0000","last_change":"2024-09-11T11:01:13.413493+0000","last_active":"2024-09-11T11:04:17.947140+0000","last_peered":"2024-09-11T11:04:17.947140+0000","last_clean":"2024-09-11T11:04:17.947140+0000","last_became_active":"2024-09-11T11:01:13.412615+0000","last_became_peered":"2024-09-11T11:01:13.412615+0000","last_unstale":"2024-09-11T11:04:17.947140+0000","last_undegraded":"2024-09-11T11:04:17.947140+0000","last_fullsized":"2024-09-11T11:04:17.947140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:01.417923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.856351+0000","last_change":"2024-09-11T11:01:05.348037+0000","last_active":"2024-09-11T11:04:17.856351+0000","last_peered":"2024-09-11T11:04:17.856351+0000","last_clean":"2024-09-11T11:04:17.856351+0000","last_became_active":"2024-09-11T11:01:05.346710+0000","last_became_peered":"2024-09-11T11:01:05.346710+0000","last_unstale":"2024-09-11T11:04:17.856351+0000","last_undegraded":"2024-09-11T11:04:17.856351+0000","last_fullsized":"2024-09-11T11:04:17.856351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:08.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122859+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:02:42.122859+0000","last_peered":"2024-09-11T11:02:42.122859+0000","last_clean":"2024-09-11T11:02:42.122859+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:02:42.122859+0000","last_undegraded":"2024-09-11T11:02:42.122859+0000","last_fullsized":"2024-09-11T11:02:42.122859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:31:53.046144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844373+0000","last_change":"2024-09-11T11:01:03.326592+0000","last_active":"2024-09-11T11:02:42.844373+0000","last_peered":"2024-09-11T11:02:42.844373+0000","last_clean":"2024-09-11T11:02:42.844373+0000","last_became_active":"2024-09-11T11:01:03.325795+0000","last_became_peered":"2024-09-11T11:01:03.325795+0000","last_unstale":"2024-09-11T11:02:42.844373+0000","last_undegraded":"2024-09-11T11:02:42.844373+0000","last_fullsized":"2024-09-11T11:02:42.844373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:12:21.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129384+0000","last_change":"2024-09-11T11:01:07.361191+0000","last_active":"2024-09-11T11:02:42.129384+0000","last_peered":"2024-09-11T11:02:42.129384+0000","last_clean":"2024-09-11T11:02:42.129384+0000","last_became_active":"2024-09-11T11:01:07.360718+0000","last_became_peered":"2024-09-11T11:01:07.360718+0000","last_unstale":"2024-09-11T11:02:42.129384+0000","last_undegraded":"2024-09-11T11:02:42.129384+0000","last_fullsized":"2024-09-11T11:02:42.129384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:36:44.262635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'273","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597426+0000","last_change":"2024-09-11T11:01:09.377670+0000","last_active":"2024-09-11T11:04:17.597426+0000","last_peered":"2024-09-11T11:04:17.597426+0000","last_clean":"2024-09-11T11:04:17.597426+0000","last_became_active":"2024-09-11T11:01:09.376555+0000","last_became_peered":"2024-09-11T11:01:09.376555+0000","last_unstale":"2024-09-11T11:04:17.597426+0000","last_undegraded":"2024-09-11T11:04:17.597426+0000","last_fullsized":"2024-09-11T11:04:17.597426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:13.150085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112535+0000","last_change":"2024-09-11T11:01:11.400937+0000","last_active":"2024-09-11T11:02:42.112535+0000","last_peered":"2024-09-11T11:02:42.112535+0000","last_clean":"2024-09-11T11:02:42.112535+0000","last_became_active":"2024-09-11T11:01:11.400253+0000","last_became_peered":"2024-09-11T11:01:11.400253+0000","last_unstale":"2024-09-11T11:02:42.112535+0000","last_undegraded":"2024-09-11T11:02:42.112535+0000","last_fullsized":"2024-09-11T11:02:42.112535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:56.090713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'11","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843512+0000","last_change":"2024-09-11T11:01:13.422211+0000","last_active":"2024-09-11T11:02:42.843512+0000","last_peered":"2024-09-11T11:02:42.843512+0000","last_clean":"2024-09-11T11:02:42.843512+0000","last_became_active":"2024-09-11T11:01:13.421491+0000","last_became_peered":"2024-09-11T11:01:13.421491+0000","last_unstale":"2024-09-11T11:02:42.843512+0000","last_undegraded":"2024-09-11T11:02:42.843512+0000","last_fullsized":"2024-09-11T11:02:42.843512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:09:11.421051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.442243+0000","last_change":"2024-09-11T11:01:05.347801+0000","last_active":"2024-09-11T11:04:17.442243+0000","last_peered":"2024-09-11T11:04:17.442243+0000","last_clean":"2024-09-11T11:04:17.442243+0000","last_became_active":"2024-09-11T11:01:05.347359+0000","last_became_peered":"2024-09-11T11:01:05.347359+0000","last_unstale":"2024-09-11T11:04:17.442243+0000","last_undegraded":"2024-09-11T11:04:17.442243+0000","last_fullsized":"2024-09-11T11:04:17.442243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:17:27.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.496965+0000","last_change":"2024-09-11T11:00:56.127438+0000","last_active":"2024-09-11T11:02:42.496965+0000","last_peered":"2024-09-11T11:02:42.496965+0000","last_clean":"2024-09-11T11:02:42.496965+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:02:42.496965+0000","last_undegraded":"2024-09-11T11:02:42.496965+0000","last_fullsized":"2024-09-11T11:02:42.496965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:21.503625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842035+0000","last_change":"2024-09-11T11:01:03.325786+0000","last_active":"2024-09-11T11:02:42.842035+0000","last_peered":"2024-09-11T11:02:42.842035+0000","last_clean":"2024-09-11T11:02:42.842035+0000","last_became_active":"2024-09-11T11:01:03.325168+0000","last_became_peered":"2024-09-11T11:01:03.325168+0000","last_unstale":"2024-09-11T11:02:42.842035+0000","last_undegraded":"2024-09-11T11:02:42.842035+0000","last_fullsized":"2024-09-11T11:02:42.842035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:26.401311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":223,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.332529+0000","last_change":"2024-09-11T11:01:07.348097+0000","last_active":"2024-09-11T11:03:16.332529+0000","last_peered":"2024-09-11T11:03:16.332529+0000","last_clean":"2024-09-11T11:03:16.332529+0000","last_became_active":"2024-09-11T11:01:07.345998+0000","last_became_peered":"2024-09-11T11:01:07.345998+0000","last_unstale":"2024-09-11T11:03:16.332529+0000","last_undegraded":"2024-09-11T11:03:16.332529+0000","last_fullsized":"2024-09-11T11:03:16.332529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:01:22.783881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'17","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.944373+0000","last_change":"2024-09-11T11:01:09.372579+0000","last_active":"2024-09-11T11:04:17.944373+0000","last_peered":"2024-09-11T11:04:17.944373+0000","last_clean":"2024-09-11T11:04:17.944373+0000","last_became_active":"2024-09-11T11:01:09.371816+0000","last_became_peered":"2024-09-11T11:01:09.371816+0000","last_unstale":"2024-09-11T11:04:17.944373+0000","last_undegraded":"2024-09-11T11:04:17.944373+0000","last_fullsized":"2024-09-11T11:04:17.944373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:35.245802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843529+0000","last_change":"2024-09-11T11:01:11.392823+0000","last_active":"2024-09-11T11:02:42.843529+0000","last_peered":"2024-09-11T11:02:42.843529+0000","last_clean":"2024-09-11T11:02:42.843529+0000","last_became_active":"2024-09-11T11:01:11.392208+0000","last_became_peered":"2024-09-11T11:01:11.392208+0000","last_unstale":"2024-09-11T11:02:42.843529+0000","last_undegraded":"2024-09-11T11:02:42.843529+0000","last_fullsized":"2024-09-11T11:02:42.843529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:42:29.363507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114046+0000","last_change":"2024-09-11T11:01:13.408511+0000","last_active":"2024-09-11T11:02:42.114046+0000","last_peered":"2024-09-11T11:02:42.114046+0000","last_clean":"2024-09-11T11:02:42.114046+0000","last_became_active":"2024-09-11T11:01:13.406863+0000","last_became_peered":"2024-09-11T11:01:13.406863+0000","last_unstale":"2024-09-11T11:02:42.114046+0000","last_undegraded":"2024-09-11T11:02:42.114046+0000","last_fullsized":"2024-09-11T11:02:42.114046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:54.284696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845057+0000","last_change":"2024-09-11T11:01:05.333748+0000","last_active":"2024-09-11T11:02:42.845057+0000","last_peered":"2024-09-11T11:02:42.845057+0000","last_clean":"2024-09-11T11:02:42.845057+0000","last_became_active":"2024-09-11T11:01:05.332361+0000","last_became_peered":"2024-09-11T11:01:05.332361+0000","last_unstale":"2024-09-11T11:02:42.845057+0000","last_undegraded":"2024-09-11T11:02:42.845057+0000","last_fullsized":"2024-09-11T11:02:42.845057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:40:25.995301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123553+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:02:42.123553+0000","last_peered":"2024-09-11T11:02:42.123553+0000","last_clean":"2024-09-11T11:02:42.123553+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:02:42.123553+0000","last_undegraded":"2024-09-11T11:02:42.123553+0000","last_fullsized":"2024-09-11T11:02:42.123553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:00.420708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123842+0000","last_change":"2024-09-11T11:01:03.328169+0000","last_active":"2024-09-11T11:02:42.123842+0000","last_peered":"2024-09-11T11:02:42.123842+0000","last_clean":"2024-09-11T11:02:42.123842+0000","last_became_active":"2024-09-11T11:01:03.327456+0000","last_became_peered":"2024-09-11T11:01:03.327456+0000","last_unstale":"2024-09-11T11:02:42.123842+0000","last_undegraded":"2024-09-11T11:02:42.123842+0000","last_fullsized":"2024-09-11T11:02:42.123842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:11.883100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845875+0000","last_change":"2024-09-11T11:01:07.369393+0000","last_active":"2024-09-11T11:02:42.845875+0000","last_peered":"2024-09-11T11:02:42.845875+0000","last_clean":"2024-09-11T11:02:42.845875+0000","last_became_active":"2024-09-11T11:01:07.367962+0000","last_became_peered":"2024-09-11T11:01:07.367962+0000","last_unstale":"2024-09-11T11:02:42.845875+0000","last_undegraded":"2024-09-11T11:02:42.845875+0000","last_fullsized":"2024-09-11T11:02:42.845875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:35:29.768861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.859766+0000","last_change":"2024-09-11T11:01:09.390513+0000","last_active":"2024-09-11T11:04:16.859766+0000","last_peered":"2024-09-11T11:04:16.859766+0000","last_clean":"2024-09-11T11:04:16.859766+0000","last_became_active":"2024-09-11T11:01:09.389732+0000","last_became_peered":"2024-09-11T11:01:09.389732+0000","last_unstale":"2024-09-11T11:04:16.859766+0000","last_undegraded":"2024-09-11T11:04:16.859766+0000","last_fullsized":"2024-09-11T11:04:16.859766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:21.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116921+0000","last_change":"2024-09-11T11:01:11.398218+0000","last_active":"2024-09-11T11:02:42.116921+0000","last_peered":"2024-09-11T11:02:42.116921+0000","last_clean":"2024-09-11T11:02:42.116921+0000","last_became_active":"2024-09-11T11:01:11.397467+0000","last_became_peered":"2024-09-11T11:01:11.397467+0000","last_unstale":"2024-09-11T11:02:42.116921+0000","last_undegraded":"2024-09-11T11:02:42.116921+0000","last_fullsized":"2024-09-11T11:02:42.116921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:09:09.409131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.026023+0000","last_change":"2024-09-11T11:01:13.418703+0000","last_active":"2024-09-11T11:04:18.026023+0000","last_peered":"2024-09-11T11:04:18.026023+0000","last_clean":"2024-09-11T11:04:18.026023+0000","last_became_active":"2024-09-11T11:01:13.414898+0000","last_became_peered":"2024-09-11T11:01:13.414898+0000","last_unstale":"2024-09-11T11:04:18.026023+0000","last_undegraded":"2024-09-11T11:04:18.026023+0000","last_fullsized":"2024-09-11T11:04:18.026023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:40.285029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.769897+0000","last_change":"2024-09-11T11:01:05.343143+0000","last_active":"2024-09-11T11:04:17.769897+0000","last_peered":"2024-09-11T11:04:17.769897+0000","last_clean":"2024-09-11T11:04:17.769897+0000","last_became_active":"2024-09-11T11:01:05.342651+0000","last_became_peered":"2024-09-11T11:01:05.342651+0000","last_unstale":"2024-09-11T11:04:17.769897+0000","last_undegraded":"2024-09-11T11:04:17.769897+0000","last_fullsized":"2024-09-11T11:04:17.769897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:48:14.974986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126841+0000","last_change":"2024-09-11T11:01:03.338569+0000","last_active":"2024-09-11T11:02:42.126841+0000","last_peered":"2024-09-11T11:02:42.126841+0000","last_clean":"2024-09-11T11:02:42.126841+0000","last_became_active":"2024-09-11T11:01:03.336412+0000","last_became_peered":"2024-09-11T11:01:03.336412+0000","last_unstale":"2024-09-11T11:02:42.126841+0000","last_undegraded":"2024-09-11T11:02:42.126841+0000","last_fullsized":"2024-09-11T11:02:42.126841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:54:35.346732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843492+0000","last_change":"2024-09-11T11:00:55.878837+0000","last_active":"2024-09-11T11:02:42.843492+0000","last_peered":"2024-09-11T11:02:42.843492+0000","last_clean":"2024-09-11T11:02:42.843492+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:02:42.843492+0000","last_undegraded":"2024-09-11T11:02:42.843492+0000","last_fullsized":"2024-09-11T11:02:42.843492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.033101+0000","last_change":"2024-09-11T11:01:07.359762+0000","last_active":"2024-09-11T11:03:13.033101+0000","last_peered":"2024-09-11T11:03:13.033101+0000","last_clean":"2024-09-11T11:03:13.033101+0000","last_became_active":"2024-09-11T11:01:07.359228+0000","last_became_peered":"2024-09-11T11:01:07.359228+0000","last_unstale":"2024-09-11T11:03:13.033101+0000","last_undegraded":"2024-09-11T11:03:13.033101+0000","last_fullsized":"2024-09-11T11:03:13.033101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:33:49.649502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'62","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.915603+0000","last_change":"2024-09-11T11:01:09.361376+0000","last_active":"2024-09-11T11:03:14.915603+0000","last_peered":"2024-09-11T11:03:14.915603+0000","last_clean":"2024-09-11T11:03:14.915603+0000","last_became_active":"2024-09-11T11:01:09.360676+0000","last_became_peered":"2024-09-11T11:01:09.360676+0000","last_unstale":"2024-09-11T11:03:14.915603+0000","last_undegraded":"2024-09-11T11:03:14.915603+0000","last_fullsized":"2024-09-11T11:03:14.915603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:50.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123302+0000","last_change":"2024-09-11T11:01:11.386663+0000","last_active":"2024-09-11T11:02:42.123302+0000","last_peered":"2024-09-11T11:02:42.123302+0000","last_clean":"2024-09-11T11:02:42.123302+0000","last_became_active":"2024-09-11T11:01:11.384826+0000","last_became_peered":"2024-09-11T11:01:11.384826+0000","last_unstale":"2024-09-11T11:02:42.123302+0000","last_undegraded":"2024-09-11T11:02:42.123302+0000","last_fullsized":"2024-09-11T11:02:42.123302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:19.464704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.703110+0000","last_change":"2024-09-11T11:01:13.422273+0000","last_active":"2024-09-11T11:03:16.703110+0000","last_peered":"2024-09-11T11:03:16.703110+0000","last_clean":"2024-09-11T11:03:16.703110+0000","last_became_active":"2024-09-11T11:01:13.421181+0000","last_became_peered":"2024-09-11T11:01:13.421181+0000","last_unstale":"2024-09-11T11:03:16.703110+0000","last_undegraded":"2024-09-11T11:03:16.703110+0000","last_fullsized":"2024-09-11T11:03:16.703110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:34.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855771+0000","last_change":"2024-09-11T11:01:05.354294+0000","last_active":"2024-09-11T11:04:17.855771+0000","last_peered":"2024-09-11T11:04:17.855771+0000","last_clean":"2024-09-11T11:04:17.855771+0000","last_became_active":"2024-09-11T11:01:05.353896+0000","last_became_peered":"2024-09-11T11:01:05.353896+0000","last_unstale":"2024-09-11T11:04:17.855771+0000","last_undegraded":"2024-09-11T11:04:17.855771+0000","last_fullsized":"2024-09-11T11:04:17.855771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:59.773137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843845+0000","last_change":"2024-09-11T11:01:03.325763+0000","last_active":"2024-09-11T11:02:42.843845+0000","last_peered":"2024-09-11T11:02:42.843845+0000","last_clean":"2024-09-11T11:02:42.843845+0000","last_became_active":"2024-09-11T11:01:03.324923+0000","last_became_peered":"2024-09-11T11:01:03.324923+0000","last_unstale":"2024-09-11T11:02:42.843845+0000","last_undegraded":"2024-09-11T11:02:42.843845+0000","last_fullsized":"2024-09-11T11:02:42.843845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:14.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126572+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:02:42.126572+0000","last_peered":"2024-09-11T11:02:42.126572+0000","last_clean":"2024-09-11T11:02:42.126572+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:02:42.126572+0000","last_undegraded":"2024-09-11T11:02:42.126572+0000","last_fullsized":"2024-09-11T11:02:42.126572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122843+0000","last_change":"2024-09-11T11:01:07.360915+0000","last_active":"2024-09-11T11:02:42.122843+0000","last_peered":"2024-09-11T11:02:42.122843+0000","last_clean":"2024-09-11T11:02:42.122843+0000","last_became_active":"2024-09-11T11:01:07.360208+0000","last_became_peered":"2024-09-11T11:01:07.360208+0000","last_unstale":"2024-09-11T11:02:42.122843+0000","last_undegraded":"2024-09-11T11:02:42.122843+0000","last_fullsized":"2024-09-11T11:02:42.122843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:39.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843864+0000","last_change":"2024-09-11T11:01:09.383166+0000","last_active":"2024-09-11T11:02:42.843864+0000","last_peered":"2024-09-11T11:02:42.843864+0000","last_clean":"2024-09-11T11:02:42.843864+0000","last_became_active":"2024-09-11T11:01:09.382364+0000","last_became_peered":"2024-09-11T11:01:09.382364+0000","last_unstale":"2024-09-11T11:02:42.843864+0000","last_undegraded":"2024-09-11T11:02:42.843864+0000","last_fullsized":"2024-09-11T11:02:42.843864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:41.311952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":351,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.596675+0000","last_change":"2024-09-11T11:01:11.395761+0000","last_active":"2024-09-11T11:04:17.596675+0000","last_peered":"2024-09-11T11:04:17.596675+0000","last_clean":"2024-09-11T11:04:17.596675+0000","last_became_active":"2024-09-11T11:01:11.395016+0000","last_became_peered":"2024-09-11T11:01:11.395016+0000","last_unstale":"2024-09-11T11:04:17.596675+0000","last_undegraded":"2024-09-11T11:04:17.596675+0000","last_fullsized":"2024-09-11T11:04:17.596675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:12.765617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.831484+0000","last_change":"2024-09-11T11:01:13.423655+0000","last_active":"2024-09-11T11:04:17.831484+0000","last_peered":"2024-09-11T11:04:17.831484+0000","last_clean":"2024-09-11T11:04:17.831484+0000","last_became_active":"2024-09-11T11:01:13.422825+0000","last_became_peered":"2024-09-11T11:01:13.422825+0000","last_unstale":"2024-09-11T11:04:17.831484+0000","last_undegraded":"2024-09-11T11:04:17.831484+0000","last_fullsized":"2024-09-11T11:04:17.831484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:56.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'12","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.767965+0000","last_change":"2024-09-11T11:01:42.069205+0000","last_active":"2024-09-11T11:03:12.767965+0000","last_peered":"2024-09-11T11:03:12.767965+0000","last_clean":"2024-09-11T11:03:12.767965+0000","last_became_active":"2024-09-11T11:01:42.049256+0000","last_became_peered":"2024-09-11T11:01:42.049256+0000","last_unstale":"2024-09-11T11:03:12.767965+0000","last_undegraded":"2024-09-11T11:03:12.767965+0000","last_fullsized":"2024-09-11T11:03:12.767965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:18:53.891454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.750448+0000","last_change":"2024-09-11T11:01:03.351057+0000","last_active":"2024-09-11T11:04:17.750448+0000","last_peered":"2024-09-11T11:04:17.750448+0000","last_clean":"2024-09-11T11:04:17.750448+0000","last_became_active":"2024-09-11T11:01:03.349487+0000","last_became_peered":"2024-09-11T11:01:03.349487+0000","last_unstale":"2024-09-11T11:04:17.750448+0000","last_undegraded":"2024-09-11T11:04:17.750448+0000","last_fullsized":"2024-09-11T11:04:17.750448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:03.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845075+0000","last_change":"2024-09-11T11:00:55.878899+0000","last_active":"2024-09-11T11:02:42.845075+0000","last_peered":"2024-09-11T11:02:42.845075+0000","last_clean":"2024-09-11T11:02:42.845075+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:02:42.845075+0000","last_undegraded":"2024-09-11T11:02:42.845075+0000","last_fullsized":"2024-09-11T11:02:42.845075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:24.156776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122524+0000","last_change":"2024-09-11T11:01:07.344789+0000","last_active":"2024-09-11T11:02:42.122524+0000","last_peered":"2024-09-11T11:02:42.122524+0000","last_clean":"2024-09-11T11:02:42.122524+0000","last_became_active":"2024-09-11T11:01:07.344021+0000","last_became_peered":"2024-09-11T11:01:07.344021+0000","last_unstale":"2024-09-11T11:02:42.122524+0000","last_undegraded":"2024-09-11T11:02:42.122524+0000","last_fullsized":"2024-09-11T11:02:42.122524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:48:47.594716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111150+0000","last_change":"2024-09-11T11:01:09.380595+0000","last_active":"2024-09-11T11:02:42.111150+0000","last_peered":"2024-09-11T11:02:42.111150+0000","last_clean":"2024-09-11T11:02:42.111150+0000","last_became_active":"2024-09-11T11:01:09.379372+0000","last_became_peered":"2024-09-11T11:01:09.379372+0000","last_unstale":"2024-09-11T11:02:42.111150+0000","last_undegraded":"2024-09-11T11:02:42.111150+0000","last_fullsized":"2024-09-11T11:02:42.111150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:43.515100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.084413+0000","last_change":"2024-09-11T11:01:11.404411+0000","last_active":"2024-09-11T11:04:18.084413+0000","last_peered":"2024-09-11T11:04:18.084413+0000","last_clean":"2024-09-11T11:04:18.084413+0000","last_became_active":"2024-09-11T11:01:11.403355+0000","last_became_peered":"2024-09-11T11:01:11.403355+0000","last_unstale":"2024-09-11T11:04:18.084413+0000","last_undegraded":"2024-09-11T11:04:18.084413+0000","last_fullsized":"2024-09-11T11:04:18.084413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:37.993880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843018+0000","last_change":"2024-09-11T11:01:13.420938+0000","last_active":"2024-09-11T11:02:42.843018+0000","last_peered":"2024-09-11T11:02:42.843018+0000","last_clean":"2024-09-11T11:02:42.843018+0000","last_became_active":"2024-09-11T11:01:13.415413+0000","last_became_peered":"2024-09-11T11:01:13.415413+0000","last_unstale":"2024-09-11T11:02:42.843018+0000","last_undegraded":"2024-09-11T11:02:42.843018+0000","last_fullsized":"2024-09-11T11:02:42.843018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:06:12.988613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'13","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938421+0000","last_change":"2024-09-11T11:01:05.339012+0000","last_active":"2024-09-11T11:04:17.938421+0000","last_peered":"2024-09-11T11:04:17.938421+0000","last_clean":"2024-09-11T11:04:17.938421+0000","last_became_active":"2024-09-11T11:01:05.338465+0000","last_became_peered":"2024-09-11T11:01:05.338465+0000","last_unstale":"2024-09-11T11:04:17.938421+0000","last_undegraded":"2024-09-11T11:04:17.938421+0000","last_fullsized":"2024-09-11T11:04:17.938421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:07:59.232948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.736226+0000","last_change":"2024-09-11T11:01:03.327083+0000","last_active":"2024-09-11T11:04:17.736226+0000","last_peered":"2024-09-11T11:04:17.736226+0000","last_clean":"2024-09-11T11:04:17.736226+0000","last_became_active":"2024-09-11T11:01:03.325009+0000","last_became_peered":"2024-09-11T11:01:03.325009+0000","last_unstale":"2024-09-11T11:04:17.736226+0000","last_undegraded":"2024-09-11T11:04:17.736226+0000","last_fullsized":"2024-09-11T11:04:17.736226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:07.534323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127143+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:02:42.127143+0000","last_peered":"2024-09-11T11:02:42.127143+0000","last_clean":"2024-09-11T11:02:42.127143+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:02:42.127143+0000","last_undegraded":"2024-09-11T11:02:42.127143+0000","last_fullsized":"2024-09-11T11:02:42.127143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:52:42.400043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110145+0000","last_change":"2024-09-11T11:01:07.364237+0000","last_active":"2024-09-11T11:02:42.110145+0000","last_peered":"2024-09-11T11:02:42.110145+0000","last_clean":"2024-09-11T11:02:42.110145+0000","last_became_active":"2024-09-11T11:01:07.363499+0000","last_became_peered":"2024-09-11T11:01:07.363499+0000","last_unstale":"2024-09-11T11:02:42.110145+0000","last_undegraded":"2024-09-11T11:02:42.110145+0000","last_fullsized":"2024-09-11T11:02:42.110145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:05.458479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'82","reported_seq":158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.890359+0000","last_change":"2024-09-11T11:01:09.372054+0000","last_active":"2024-09-11T11:03:14.890359+0000","last_peered":"2024-09-11T11:03:14.890359+0000","last_clean":"2024-09-11T11:03:14.890359+0000","last_became_active":"2024-09-11T11:01:09.371312+0000","last_became_peered":"2024-09-11T11:01:09.371312+0000","last_unstale":"2024-09-11T11:03:14.890359+0000","last_undegraded":"2024-09-11T11:03:14.890359+0000","last_fullsized":"2024-09-11T11:03:14.890359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:16.530704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111457+0000","last_change":"2024-09-11T11:01:11.384314+0000","last_active":"2024-09-11T11:02:42.111457+0000","last_peered":"2024-09-11T11:02:42.111457+0000","last_clean":"2024-09-11T11:02:42.111457+0000","last_became_active":"2024-09-11T11:01:11.383342+0000","last_became_peered":"2024-09-11T11:01:11.383342+0000","last_unstale":"2024-09-11T11:02:42.111457+0000","last_undegraded":"2024-09-11T11:02:42.111457+0000","last_fullsized":"2024-09-11T11:02:42.111457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:19.950700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500048+0000","last_change":"2024-09-11T11:01:13.418374+0000","last_active":"2024-09-11T11:02:42.500048+0000","last_peered":"2024-09-11T11:02:42.500048+0000","last_clean":"2024-09-11T11:02:42.500048+0000","last_became_active":"2024-09-11T11:01:13.413156+0000","last_became_peered":"2024-09-11T11:01:13.413156+0000","last_unstale":"2024-09-11T11:02:42.500048+0000","last_undegraded":"2024-09-11T11:02:42.500048+0000","last_fullsized":"2024-09-11T11:02:42.500048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:07:28.142970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500143+0000","last_change":"2024-09-11T11:01:13.418594+0000","last_active":"2024-09-11T11:02:42.500143+0000","last_peered":"2024-09-11T11:02:42.500143+0000","last_clean":"2024-09-11T11:02:42.500143+0000","last_became_active":"2024-09-11T11:01:13.413535+0000","last_became_peered":"2024-09-11T11:01:13.413535+0000","last_unstale":"2024-09-11T11:02:42.500143+0000","last_undegraded":"2024-09-11T11:02:42.500143+0000","last_fullsized":"2024-09-11T11:02:42.500143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:31:24.015178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'9","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036251+0000","last_change":"2024-09-11T11:01:05.338098+0000","last_active":"2024-09-11T11:03:28.036251+0000","last_peered":"2024-09-11T11:03:28.036251+0000","last_clean":"2024-09-11T11:03:28.036251+0000","last_became_active":"2024-09-11T11:01:05.337509+0000","last_became_peered":"2024-09-11T11:01:05.337509+0000","last_unstale":"2024-09-11T11:03:28.036251+0000","last_undegraded":"2024-09-11T11:03:28.036251+0000","last_fullsized":"2024-09-11T11:03:28.036251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:26.300276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124980+0000","last_change":"2024-09-11T11:01:03.321762+0000","last_active":"2024-09-11T11:02:42.124980+0000","last_peered":"2024-09-11T11:02:42.124980+0000","last_clean":"2024-09-11T11:02:42.124980+0000","last_became_active":"2024-09-11T11:01:03.320981+0000","last_became_peered":"2024-09-11T11:01:03.320981+0000","last_unstale":"2024-09-11T11:02:42.124980+0000","last_undegraded":"2024-09-11T11:02:42.124980+0000","last_fullsized":"2024-09-11T11:02:42.124980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:03.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842801+0000","last_change":"2024-09-11T11:01:07.369265+0000","last_active":"2024-09-11T11:02:42.842801+0000","last_peered":"2024-09-11T11:02:42.842801+0000","last_clean":"2024-09-11T11:02:42.842801+0000","last_became_active":"2024-09-11T11:01:07.367778+0000","last_became_peered":"2024-09-11T11:01:07.367778+0000","last_unstale":"2024-09-11T11:02:42.842801+0000","last_undegraded":"2024-09-11T11:02:42.842801+0000","last_fullsized":"2024-09-11T11:02:42.842801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:13.316958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.901680+0000","last_change":"2024-09-11T11:01:09.372426+0000","last_active":"2024-09-11T11:03:14.901680+0000","last_peered":"2024-09-11T11:03:14.901680+0000","last_clean":"2024-09-11T11:03:14.901680+0000","last_became_active":"2024-09-11T11:01:09.369318+0000","last_became_peered":"2024-09-11T11:01:09.369318+0000","last_unstale":"2024-09-11T11:03:14.901680+0000","last_undegraded":"2024-09-11T11:03:14.901680+0000","last_fullsized":"2024-09-11T11:03:14.901680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:11.108714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111320+0000","last_change":"2024-09-11T11:01:11.397868+0000","last_active":"2024-09-11T11:02:42.111320+0000","last_peered":"2024-09-11T11:02:42.111320+0000","last_clean":"2024-09-11T11:02:42.111320+0000","last_became_active":"2024-09-11T11:01:11.396833+0000","last_became_peered":"2024-09-11T11:01:11.396833+0000","last_unstale":"2024-09-11T11:02:42.111320+0000","last_undegraded":"2024-09-11T11:02:42.111320+0000","last_fullsized":"2024-09-11T11:02:42.111320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:06:10.976693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.485342+0000","last_change":"2024-09-11T11:01:13.408361+0000","last_active":"2024-09-11T11:03:14.485342+0000","last_peered":"2024-09-11T11:03:14.485342+0000","last_clean":"2024-09-11T11:03:14.485342+0000","last_became_active":"2024-09-11T11:01:13.407663+0000","last_became_peered":"2024-09-11T11:01:13.407663+0000","last_unstale":"2024-09-11T11:03:14.485342+0000","last_undegraded":"2024-09-11T11:03:14.485342+0000","last_fullsized":"2024-09-11T11:03:14.485342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:55:13.024275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.572787+0000","last_change":"2024-09-11T11:01:05.340874+0000","last_active":"2024-09-11T11:04:17.572787+0000","last_peered":"2024-09-11T11:04:17.572787+0000","last_clean":"2024-09-11T11:04:17.572787+0000","last_became_active":"2024-09-11T11:01:05.340457+0000","last_became_peered":"2024-09-11T11:01:05.340457+0000","last_unstale":"2024-09-11T11:04:17.572787+0000","last_undegraded":"2024-09-11T11:04:17.572787+0000","last_fullsized":"2024-09-11T11:04:17.572787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:13:20.748246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498765+0000","last_change":"2024-09-11T11:01:03.336186+0000","last_active":"2024-09-11T11:02:42.498765+0000","last_peered":"2024-09-11T11:02:42.498765+0000","last_clean":"2024-09-11T11:02:42.498765+0000","last_became_active":"2024-09-11T11:01:03.335235+0000","last_became_peered":"2024-09-11T11:01:03.335235+0000","last_unstale":"2024-09-11T11:02:42.498765+0000","last_undegraded":"2024-09-11T11:02:42.498765+0000","last_fullsized":"2024-09-11T11:02:42.498765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:32:59.574503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.504244+0000","last_change":"2024-09-11T11:02:42.502850+0000","last_active":"2024-09-11T11:02:42.504244+0000","last_peered":"2024-09-11T11:02:42.504244+0000","last_clean":"2024-09-11T11:02:42.504244+0000","last_became_active":"2024-09-11T11:02:42.501867+0000","last_became_peered":"2024-09-11T11:02:42.501867+0000","last_unstale":"2024-09-11T11:02:42.504244+0000","last_undegraded":"2024-09-11T11:02:42.504244+0000","last_fullsized":"2024-09-11T11:02:42.504244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:44:22.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.868748+0000","last_change":"2024-09-11T11:01:09.363815+0000","last_active":"2024-09-11T11:04:16.868748+0000","last_peered":"2024-09-11T11:04:16.868748+0000","last_clean":"2024-09-11T11:04:16.868748+0000","last_became_active":"2024-09-11T11:01:09.362975+0000","last_became_peered":"2024-09-11T11:01:09.362975+0000","last_unstale":"2024-09-11T11:04:16.868748+0000","last_undegraded":"2024-09-11T11:04:16.868748+0000","last_fullsized":"2024-09-11T11:04:16.868748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:48:49.614061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497830+0000","last_change":"2024-09-11T11:01:11.393863+0000","last_active":"2024-09-11T11:02:42.497830+0000","last_peered":"2024-09-11T11:02:42.497830+0000","last_clean":"2024-09-11T11:02:42.497830+0000","last_became_active":"2024-09-11T11:01:11.393181+0000","last_became_peered":"2024-09-11T11:01:11.393181+0000","last_unstale":"2024-09-11T11:02:42.497830+0000","last_undegraded":"2024-09-11T11:02:42.497830+0000","last_fullsized":"2024-09-11T11:02:42.497830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:48.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.983086+0000","last_change":"2024-09-11T11:01:13.419907+0000","last_active":"2024-09-11T11:04:16.983086+0000","last_peered":"2024-09-11T11:04:16.983086+0000","last_clean":"2024-09-11T11:04:16.983086+0000","last_became_active":"2024-09-11T11:01:13.419238+0000","last_became_peered":"2024-09-11T11:01:13.419238+0000","last_unstale":"2024-09-11T11:04:16.983086+0000","last_undegraded":"2024-09-11T11:04:16.983086+0000","last_fullsized":"2024-09-11T11:04:16.983086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:21.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921392+0000","last_change":"2024-09-11T11:01:42.073807+0000","last_active":"2024-09-11T11:04:17.921392+0000","last_peered":"2024-09-11T11:04:17.921392+0000","last_clean":"2024-09-11T11:04:17.921392+0000","last_became_active":"2024-09-11T11:01:42.058258+0000","last_became_peered":"2024-09-11T11:01:42.058258+0000","last_unstale":"2024-09-11T11:04:17.921392+0000","last_undegraded":"2024-09-11T11:04:17.921392+0000","last_fullsized":"2024-09-11T11:04:17.921392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:23:48.191355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127148+0000","last_change":"2024-09-11T11:01:03.339928+0000","last_active":"2024-09-11T11:02:42.127148+0000","last_peered":"2024-09-11T11:02:42.127148+0000","last_clean":"2024-09-11T11:02:42.127148+0000","last_became_active":"2024-09-11T11:01:03.337144+0000","last_became_peered":"2024-09-11T11:01:03.337144+0000","last_unstale":"2024-09-11T11:02:42.127148+0000","last_undegraded":"2024-09-11T11:02:42.127148+0000","last_fullsized":"2024-09-11T11:02:42.127148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:53:40.334818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"36'4","reported_seq":230,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.319107+0000","last_change":"2024-09-11T11:01:07.358746+0000","last_active":"2024-09-11T11:03:16.319107+0000","last_peered":"2024-09-11T11:03:16.319107+0000","last_clean":"2024-09-11T11:03:16.319107+0000","last_became_active":"2024-09-11T11:01:07.358156+0000","last_became_peered":"2024-09-11T11:01:07.358156+0000","last_unstale":"2024-09-11T11:03:16.319107+0000","last_undegraded":"2024-09-11T11:03:16.319107+0000","last_fullsized":"2024-09-11T11:03:16.319107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:14.921699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'41","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.362531+0000","last_change":"2024-09-11T11:01:09.385303+0000","last_active":"2024-09-11T11:04:17.362531+0000","last_peered":"2024-09-11T11:04:17.362531+0000","last_clean":"2024-09-11T11:04:17.362531+0000","last_became_active":"2024-09-11T11:01:09.380595+0000","last_became_peered":"2024-09-11T11:01:09.380595+0000","last_unstale":"2024-09-11T11:04:17.362531+0000","last_undegraded":"2024-09-11T11:04:17.362531+0000","last_fullsized":"2024-09-11T11:04:17.362531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:12:15.180214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":63,"num_read_kb":66,"num_write":48,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.841780+0000","last_change":"2024-09-11T11:01:11.402562+0000","last_active":"2024-09-11T11:02:42.841780+0000","last_peered":"2024-09-11T11:02:42.841780+0000","last_clean":"2024-09-11T11:02:42.841780+0000","last_became_active":"2024-09-11T11:01:11.401847+0000","last_became_peered":"2024-09-11T11:01:11.401847+0000","last_unstale":"2024-09-11T11:02:42.841780+0000","last_undegraded":"2024-09-11T11:02:42.841780+0000","last_fullsized":"2024-09-11T11:02:42.841780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:24:37.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110992+0000","last_change":"2024-09-11T11:01:13.397280+0000","last_active":"2024-09-11T11:02:42.110992+0000","last_peered":"2024-09-11T11:02:42.110992+0000","last_clean":"2024-09-11T11:02:42.110992+0000","last_became_active":"2024-09-11T11:01:13.395231+0000","last_became_peered":"2024-09-11T11:01:13.395231+0000","last_unstale":"2024-09-11T11:02:42.110992+0000","last_undegraded":"2024-09-11T11:02:42.110992+0000","last_fullsized":"2024-09-11T11:02:42.110992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:00:32.324647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.940026+0000","last_change":"2024-09-11T11:01:05.348465+0000","last_active":"2024-09-11T11:04:17.940026+0000","last_peered":"2024-09-11T11:04:17.940026+0000","last_clean":"2024-09-11T11:04:17.940026+0000","last_became_active":"2024-09-11T11:01:05.348002+0000","last_became_peered":"2024-09-11T11:01:05.348002+0000","last_unstale":"2024-09-11T11:04:17.940026+0000","last_undegraded":"2024-09-11T11:04:17.940026+0000","last_fullsized":"2024-09-11T11:04:17.940026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:27:41.532168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847625+0000","last_change":"2024-09-11T11:01:03.338184+0000","last_active":"2024-09-11T11:02:42.847625+0000","last_peered":"2024-09-11T11:02:42.847625+0000","last_clean":"2024-09-11T11:02:42.847625+0000","last_became_active":"2024-09-11T11:01:03.330782+0000","last_became_peered":"2024-09-11T11:01:03.330782+0000","last_unstale":"2024-09-11T11:02:42.847625+0000","last_undegraded":"2024-09-11T11:02:42.847625+0000","last_fullsized":"2024-09-11T11:02:42.847625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:42.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111231+0000","last_change":"2024-09-11T11:01:07.351359+0000","last_active":"2024-09-11T11:02:42.111231+0000","last_peered":"2024-09-11T11:02:42.111231+0000","last_clean":"2024-09-11T11:02:42.111231+0000","last_became_active":"2024-09-11T11:01:07.350685+0000","last_became_peered":"2024-09-11T11:01:07.350685+0000","last_unstale":"2024-09-11T11:02:42.111231+0000","last_undegraded":"2024-09-11T11:02:42.111231+0000","last_fullsized":"2024-09-11T11:02:42.111231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:39.784471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.876511+0000","last_change":"2024-09-11T11:01:09.363365+0000","last_active":"2024-09-11T11:03:14.876511+0000","last_peered":"2024-09-11T11:03:14.876511+0000","last_clean":"2024-09-11T11:03:14.876511+0000","last_became_active":"2024-09-11T11:01:09.362483+0000","last_became_peered":"2024-09-11T11:01:09.362483+0000","last_unstale":"2024-09-11T11:03:14.876511+0000","last_undegraded":"2024-09-11T11:03:14.876511+0000","last_fullsized":"2024-09-11T11:03:14.876511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:30.250968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500588+0000","last_change":"2024-09-11T11:01:11.399469+0000","last_active":"2024-09-11T11:02:42.500588+0000","last_peered":"2024-09-11T11:02:42.500588+0000","last_clean":"2024-09-11T11:02:42.500588+0000","last_became_active":"2024-09-11T11:01:11.398843+0000","last_became_peered":"2024-09-11T11:01:11.398843+0000","last_unstale":"2024-09-11T11:02:42.500588+0000","last_undegraded":"2024-09-11T11:02:42.500588+0000","last_fullsized":"2024-09-11T11:02:42.500588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:44:43.419308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770552+0000","last_change":"2024-09-11T11:01:05.348376+0000","last_active":"2024-09-11T11:04:17.770552+0000","last_peered":"2024-09-11T11:04:17.770552+0000","last_clean":"2024-09-11T11:04:17.770552+0000","last_became_active":"2024-09-11T11:01:05.347496+0000","last_became_peered":"2024-09-11T11:01:05.347496+0000","last_unstale":"2024-09-11T11:04:17.770552+0000","last_undegraded":"2024-09-11T11:04:17.770552+0000","last_fullsized":"2024-09-11T11:04:17.770552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:32.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109337+0000","last_change":"2024-09-11T11:01:03.349185+0000","last_active":"2024-09-11T11:02:42.109337+0000","last_peered":"2024-09-11T11:02:42.109337+0000","last_clean":"2024-09-11T11:02:42.109337+0000","last_became_active":"2024-09-11T11:01:03.348849+0000","last_became_peered":"2024-09-11T11:01:03.348849+0000","last_unstale":"2024-09-11T11:02:42.109337+0000","last_undegraded":"2024-09-11T11:02:42.109337+0000","last_fullsized":"2024-09-11T11:02:42.109337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:33.180623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847481+0000","last_change":"2024-09-11T11:01:07.366791+0000","last_active":"2024-09-11T11:02:42.847481+0000","last_peered":"2024-09-11T11:02:42.847481+0000","last_clean":"2024-09-11T11:02:42.847481+0000","last_became_active":"2024-09-11T11:01:07.365953+0000","last_became_peered":"2024-09-11T11:01:07.365953+0000","last_unstale":"2024-09-11T11:02:42.847481+0000","last_undegraded":"2024-09-11T11:02:42.847481+0000","last_fullsized":"2024-09-11T11:02:42.847481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:09:50.935366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.912449+0000","last_change":"2024-09-11T11:01:09.375348+0000","last_active":"2024-09-11T11:03:14.912449+0000","last_peered":"2024-09-11T11:03:14.912449+0000","last_clean":"2024-09-11T11:03:14.912449+0000","last_became_active":"2024-09-11T11:01:09.374937+0000","last_became_peered":"2024-09-11T11:01:09.374937+0000","last_unstale":"2024-09-11T11:03:14.912449+0000","last_undegraded":"2024-09-11T11:03:14.912449+0000","last_fullsized":"2024-09-11T11:03:14.912449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:33:50.006729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499366+0000","last_change":"2024-09-11T11:01:11.395444+0000","last_active":"2024-09-11T11:02:42.499366+0000","last_peered":"2024-09-11T11:02:42.499366+0000","last_clean":"2024-09-11T11:02:42.499366+0000","last_became_active":"2024-09-11T11:01:11.394849+0000","last_became_peered":"2024-09-11T11:01:11.394849+0000","last_unstale":"2024-09-11T11:02:42.499366+0000","last_undegraded":"2024-09-11T11:02:42.499366+0000","last_fullsized":"2024-09-11T11:02:42.499366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:14:10.559226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.693746+0000","last_change":"2024-09-11T11:01:13.416940+0000","last_active":"2024-09-11T11:03:16.693746+0000","last_peered":"2024-09-11T11:03:16.693746+0000","last_clean":"2024-09-11T11:03:16.693746+0000","last_became_active":"2024-09-11T11:01:13.416414+0000","last_became_peered":"2024-09-11T11:01:13.416414+0000","last_unstale":"2024-09-11T11:03:16.693746+0000","last_undegraded":"2024-09-11T11:03:16.693746+0000","last_fullsized":"2024-09-11T11:03:16.693746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:02:37.102253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845863+0000","last_change":"2024-09-11T11:01:05.340233+0000","last_active":"2024-09-11T11:02:42.845863+0000","last_peered":"2024-09-11T11:02:42.845863+0000","last_clean":"2024-09-11T11:02:42.845863+0000","last_became_active":"2024-09-11T11:01:05.339898+0000","last_became_peered":"2024-09-11T11:01:05.339898+0000","last_unstale":"2024-09-11T11:02:42.845863+0000","last_undegraded":"2024-09-11T11:02:42.845863+0000","last_fullsized":"2024-09-11T11:02:42.845863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:51.046871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'3","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.039656+0000","last_change":"2024-09-11T11:01:42.094568+0000","last_active":"2024-09-11T11:03:28.039656+0000","last_peered":"2024-09-11T11:03:28.039656+0000","last_clean":"2024-09-11T11:03:28.039656+0000","last_became_active":"2024-09-11T11:01:42.058648+0000","last_became_peered":"2024-09-11T11:01:42.058648+0000","last_unstale":"2024-09-11T11:03:28.039656+0000","last_undegraded":"2024-09-11T11:03:28.039656+0000","last_fullsized":"2024-09-11T11:03:28.039656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:41.034099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129527+0000","last_change":"2024-09-11T11:01:07.340610+0000","last_active":"2024-09-11T11:02:42.129527+0000","last_peered":"2024-09-11T11:02:42.129527+0000","last_clean":"2024-09-11T11:02:42.129527+0000","last_became_active":"2024-09-11T11:01:07.340147+0000","last_became_peered":"2024-09-11T11:01:07.340147+0000","last_unstale":"2024-09-11T11:02:42.129527+0000","last_undegraded":"2024-09-11T11:02:42.129527+0000","last_fullsized":"2024-09-11T11:02:42.129527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:59:55.768264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.878428+0000","last_change":"2024-09-11T11:01:09.372272+0000","last_active":"2024-09-11T11:03:14.878428+0000","last_peered":"2024-09-11T11:03:14.878428+0000","last_clean":"2024-09-11T11:03:14.878428+0000","last_became_active":"2024-09-11T11:01:09.371522+0000","last_became_peered":"2024-09-11T11:01:09.371522+0000","last_unstale":"2024-09-11T11:03:14.878428+0000","last_undegraded":"2024-09-11T11:03:14.878428+0000","last_fullsized":"2024-09-11T11:03:14.878428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:58:05.506059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847450+0000","last_change":"2024-09-11T11:01:11.393543+0000","last_active":"2024-09-11T11:02:42.847450+0000","last_peered":"2024-09-11T11:02:42.847450+0000","last_clean":"2024-09-11T11:02:42.847450+0000","last_became_active":"2024-09-11T11:01:11.392489+0000","last_became_peered":"2024-09-11T11:01:11.392489+0000","last_unstale":"2024-09-11T11:02:42.847450+0000","last_undegraded":"2024-09-11T11:02:42.847450+0000","last_fullsized":"2024-09-11T11:02:42.847450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:57.060008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121990+0000","last_change":"2024-09-11T11:01:13.405032+0000","last_active":"2024-09-11T11:02:42.121990+0000","last_peered":"2024-09-11T11:02:42.121990+0000","last_clean":"2024-09-11T11:02:42.121990+0000","last_became_active":"2024-09-11T11:01:13.404341+0000","last_became_peered":"2024-09-11T11:01:13.404341+0000","last_unstale":"2024-09-11T11:02:42.121990+0000","last_undegraded":"2024-09-11T11:02:42.121990+0000","last_fullsized":"2024-09-11T11:02:42.121990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:41:29.058689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'18","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836712+0000","last_change":"2024-09-11T11:01:05.348158+0000","last_active":"2024-09-11T11:03:16.836712+0000","last_peered":"2024-09-11T11:03:16.836712+0000","last_clean":"2024-09-11T11:03:16.836712+0000","last_became_active":"2024-09-11T11:01:05.347745+0000","last_became_peered":"2024-09-11T11:01:05.347745+0000","last_unstale":"2024-09-11T11:03:16.836712+0000","last_undegraded":"2024-09-11T11:03:16.836712+0000","last_fullsized":"2024-09-11T11:03:16.836712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:16:36.575022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124170+0000","last_change":"2024-09-11T11:01:03.322039+0000","last_active":"2024-09-11T11:02:42.124170+0000","last_peered":"2024-09-11T11:02:42.124170+0000","last_clean":"2024-09-11T11:02:42.124170+0000","last_became_active":"2024-09-11T11:01:03.321106+0000","last_became_peered":"2024-09-11T11:01:03.321106+0000","last_unstale":"2024-09-11T11:02:42.124170+0000","last_undegraded":"2024-09-11T11:02:42.124170+0000","last_fullsized":"2024-09-11T11:02:42.124170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.482692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124610+0000","last_change":"2024-09-11T11:01:07.343664+0000","last_active":"2024-09-11T11:02:42.124610+0000","last_peered":"2024-09-11T11:02:42.124610+0000","last_clean":"2024-09-11T11:02:42.124610+0000","last_became_active":"2024-09-11T11:01:07.342760+0000","last_became_peered":"2024-09-11T11:01:07.342760+0000","last_unstale":"2024-09-11T11:02:42.124610+0000","last_undegraded":"2024-09-11T11:02:42.124610+0000","last_fullsized":"2024-09-11T11:02:42.124610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:48.492230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'34","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.465133+0000","last_change":"2024-09-11T11:01:09.390274+0000","last_active":"2024-09-11T11:04:17.465133+0000","last_peered":"2024-09-11T11:04:17.465133+0000","last_clean":"2024-09-11T11:04:17.465133+0000","last_became_active":"2024-09-11T11:01:09.389548+0000","last_became_peered":"2024-09-11T11:01:09.389548+0000","last_unstale":"2024-09-11T11:04:17.465133+0000","last_undegraded":"2024-09-11T11:04:17.465133+0000","last_fullsized":"2024-09-11T11:04:17.465133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:55.045450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847493+0000","last_change":"2024-09-11T11:01:11.391754+0000","last_active":"2024-09-11T11:02:42.847493+0000","last_peered":"2024-09-11T11:02:42.847493+0000","last_clean":"2024-09-11T11:02:42.847493+0000","last_became_active":"2024-09-11T11:01:11.391080+0000","last_became_peered":"2024-09-11T11:01:11.391080+0000","last_unstale":"2024-09-11T11:02:42.847493+0000","last_undegraded":"2024-09-11T11:02:42.847493+0000","last_fullsized":"2024-09-11T11:02:42.847493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:23.746419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.825662+0000","last_change":"2024-09-11T11:01:13.421751+0000","last_active":"2024-09-11T11:03:16.825662+0000","last_peered":"2024-09-11T11:03:16.825662+0000","last_clean":"2024-09-11T11:03:16.825662+0000","last_became_active":"2024-09-11T11:01:13.420844+0000","last_became_peered":"2024-09-11T11:01:13.420844+0000","last_unstale":"2024-09-11T11:03:16.825662+0000","last_undegraded":"2024-09-11T11:03:16.825662+0000","last_fullsized":"2024-09-11T11:03:16.825662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:01:42.372122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.443118+0000","last_change":"2024-09-11T11:01:05.339320+0000","last_active":"2024-09-11T11:04:17.443118+0000","last_peered":"2024-09-11T11:04:17.443118+0000","last_clean":"2024-09-11T11:04:17.443118+0000","last_became_active":"2024-09-11T11:01:05.338036+0000","last_became_peered":"2024-09-11T11:01:05.338036+0000","last_unstale":"2024-09-11T11:04:17.443118+0000","last_undegraded":"2024-09-11T11:04:17.443118+0000","last_fullsized":"2024-09-11T11:04:17.443118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:32.889486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.908157+0000","last_change":"2024-09-11T11:01:03.336252+0000","last_active":"2024-09-11T11:04:17.908157+0000","last_peered":"2024-09-11T11:04:17.908157+0000","last_clean":"2024-09-11T11:04:17.908157+0000","last_became_active":"2024-09-11T11:01:03.335959+0000","last_became_peered":"2024-09-11T11:01:03.335959+0000","last_unstale":"2024-09-11T11:04:17.908157+0000","last_undegraded":"2024-09-11T11:04:17.908157+0000","last_fullsized":"2024-09-11T11:04:17.908157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:07.534323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847461+0000","last_change":"2024-09-11T11:01:07.370087+0000","last_active":"2024-09-11T11:02:42.847461+0000","last_peered":"2024-09-11T11:02:42.847461+0000","last_clean":"2024-09-11T11:02:42.847461+0000","last_became_active":"2024-09-11T11:01:07.368853+0000","last_became_peered":"2024-09-11T11:01:07.368853+0000","last_unstale":"2024-09-11T11:02:42.847461+0000","last_undegraded":"2024-09-11T11:02:42.847461+0000","last_fullsized":"2024-09-11T11:02:42.847461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:39.784471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115820+0000","last_change":"2024-09-11T11:01:09.391884+0000","last_active":"2024-09-11T11:02:42.115820+0000","last_peered":"2024-09-11T11:02:42.115820+0000","last_clean":"2024-09-11T11:02:42.115820+0000","last_became_active":"2024-09-11T11:01:09.391249+0000","last_became_peered":"2024-09-11T11:01:09.391249+0000","last_unstale":"2024-09-11T11:02:42.115820+0000","last_undegraded":"2024-09-11T11:02:42.115820+0000","last_fullsized":"2024-09-11T11:02:42.115820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:42:27.348949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":371,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597039+0000","last_change":"2024-09-11T11:01:11.403073+0000","last_active":"2024-09-11T11:04:17.597039+0000","last_peered":"2024-09-11T11:04:17.597039+0000","last_clean":"2024-09-11T11:04:17.597039+0000","last_became_active":"2024-09-11T11:01:11.401400+0000","last_became_peered":"2024-09-11T11:01:11.401400+0000","last_unstale":"2024-09-11T11:04:17.597039+0000","last_undegraded":"2024-09-11T11:04:17.597039+0000","last_fullsized":"2024-09-11T11:04:17.597039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:49.090546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121310+0000","last_change":"2024-09-11T11:01:13.403086+0000","last_active":"2024-09-11T11:02:42.121310+0000","last_peered":"2024-09-11T11:02:42.121310+0000","last_clean":"2024-09-11T11:02:42.121310+0000","last_became_active":"2024-09-11T11:01:13.402406+0000","last_became_peered":"2024-09-11T11:01:13.402406+0000","last_unstale":"2024-09-11T11:02:42.121310+0000","last_undegraded":"2024-09-11T11:02:42.121310+0000","last_fullsized":"2024-09-11T11:02:42.121310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:56.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'5","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.038763+0000","last_change":"2024-09-11T11:01:05.353823+0000","last_active":"2024-09-11T11:03:38.038763+0000","last_peered":"2024-09-11T11:03:38.038763+0000","last_clean":"2024-09-11T11:03:38.038763+0000","last_became_active":"2024-09-11T11:01:05.353214+0000","last_became_peered":"2024-09-11T11:01:05.353214+0000","last_unstale":"2024-09-11T11:03:38.038763+0000","last_undegraded":"2024-09-11T11:03:38.038763+0000","last_fullsized":"2024-09-11T11:03:38.038763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:59:11.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844327+0000","last_change":"2024-09-11T11:01:03.346782+0000","last_active":"2024-09-11T11:02:42.844327+0000","last_peered":"2024-09-11T11:02:42.844327+0000","last_clean":"2024-09-11T11:02:42.844327+0000","last_became_active":"2024-09-11T11:01:03.346318+0000","last_became_peered":"2024-09-11T11:01:03.346318+0000","last_unstale":"2024-09-11T11:02:42.844327+0000","last_undegraded":"2024-09-11T11:02:42.844327+0000","last_fullsized":"2024-09-11T11:02:42.844327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:08.559205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843531+0000","last_change":"2024-09-11T11:01:07.369704+0000","last_active":"2024-09-11T11:02:42.843531+0000","last_peered":"2024-09-11T11:02:42.843531+0000","last_clean":"2024-09-11T11:02:42.843531+0000","last_became_active":"2024-09-11T11:01:07.368713+0000","last_became_peered":"2024-09-11T11:01:07.368713+0000","last_unstale":"2024-09-11T11:02:42.843531+0000","last_undegraded":"2024-09-11T11:02:42.843531+0000","last_fullsized":"2024-09-11T11:02:42.843531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:00:00.692745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.862353+0000","last_change":"2024-09-11T11:01:09.364363+0000","last_active":"2024-09-11T11:03:14.862353+0000","last_peered":"2024-09-11T11:03:14.862353+0000","last_clean":"2024-09-11T11:03:14.862353+0000","last_became_active":"2024-09-11T11:01:09.363530+0000","last_became_peered":"2024-09-11T11:01:09.363530+0000","last_unstale":"2024-09-11T11:03:14.862353+0000","last_undegraded":"2024-09-11T11:03:14.862353+0000","last_fullsized":"2024-09-11T11:03:14.862353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:20:25.511602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109273+0000","last_change":"2024-09-11T11:01:11.373298+0000","last_active":"2024-09-11T11:02:42.109273+0000","last_peered":"2024-09-11T11:02:42.109273+0000","last_clean":"2024-09-11T11:02:42.109273+0000","last_became_active":"2024-09-11T11:01:11.371526+0000","last_became_peered":"2024-09-11T11:01:11.371526+0000","last_unstale":"2024-09-11T11:02:42.109273+0000","last_undegraded":"2024-09-11T11:02:42.109273+0000","last_fullsized":"2024-09-11T11:02:42.109273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:18.545262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129245+0000","last_change":"2024-09-11T11:01:13.421954+0000","last_active":"2024-09-11T11:02:42.129245+0000","last_peered":"2024-09-11T11:02:42.129245+0000","last_clean":"2024-09-11T11:02:42.129245+0000","last_became_active":"2024-09-11T11:01:13.421220+0000","last_became_peered":"2024-09-11T11:01:13.421220+0000","last_unstale":"2024-09-11T11:02:42.129245+0000","last_undegraded":"2024-09-11T11:02:42.129245+0000","last_fullsized":"2024-09-11T11:02:42.129245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:37.260215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.769226+0000","last_change":"2024-09-11T11:01:05.348922+0000","last_active":"2024-09-11T11:03:12.769226+0000","last_peered":"2024-09-11T11:03:12.769226+0000","last_clean":"2024-09-11T11:03:12.769226+0000","last_became_active":"2024-09-11T11:01:05.348256+0000","last_became_peered":"2024-09-11T11:01:05.348256+0000","last_unstale":"2024-09-11T11:03:12.769226+0000","last_undegraded":"2024-09-11T11:03:12.769226+0000","last_fullsized":"2024-09-11T11:03:12.769226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:10:09.634465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127285+0000","last_change":"2024-09-11T11:01:03.323843+0000","last_active":"2024-09-11T11:02:42.127285+0000","last_peered":"2024-09-11T11:02:42.127285+0000","last_clean":"2024-09-11T11:02:42.127285+0000","last_became_active":"2024-09-11T11:01:03.323106+0000","last_became_peered":"2024-09-11T11:01:03.323106+0000","last_unstale":"2024-09-11T11:02:42.127285+0000","last_undegraded":"2024-09-11T11:02:42.127285+0000","last_fullsized":"2024-09-11T11:02:42.127285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:24:10.573016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124332+0000","last_change":"2024-09-11T11:01:07.347165+0000","last_active":"2024-09-11T11:02:42.124332+0000","last_peered":"2024-09-11T11:02:42.124332+0000","last_clean":"2024-09-11T11:02:42.124332+0000","last_became_active":"2024-09-11T11:01:07.346507+0000","last_became_peered":"2024-09-11T11:01:07.346507+0000","last_unstale":"2024-09-11T11:02:42.124332+0000","last_undegraded":"2024-09-11T11:02:42.124332+0000","last_fullsized":"2024-09-11T11:02:42.124332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:11.130739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.862649+0000","last_change":"2024-09-11T11:01:09.370064+0000","last_active":"2024-09-11T11:03:14.862649+0000","last_peered":"2024-09-11T11:03:14.862649+0000","last_clean":"2024-09-11T11:03:14.862649+0000","last_became_active":"2024-09-11T11:01:09.367104+0000","last_became_peered":"2024-09-11T11:01:09.367104+0000","last_unstale":"2024-09-11T11:03:14.862649+0000","last_undegraded":"2024-09-11T11:03:14.862649+0000","last_fullsized":"2024-09-11T11:03:14.862649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:42.885042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122669+0000","last_change":"2024-09-11T11:01:11.400983+0000","last_active":"2024-09-11T11:02:42.122669+0000","last_peered":"2024-09-11T11:02:42.122669+0000","last_clean":"2024-09-11T11:02:42.122669+0000","last_became_active":"2024-09-11T11:01:11.400269+0000","last_became_peered":"2024-09-11T11:01:11.400269+0000","last_unstale":"2024-09-11T11:02:42.122669+0000","last_undegraded":"2024-09-11T11:02:42.122669+0000","last_fullsized":"2024-09-11T11:02:42.122669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:48.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112745+0000","last_change":"2024-09-11T11:01:13.424386+0000","last_active":"2024-09-11T11:02:42.112745+0000","last_peered":"2024-09-11T11:02:42.112745+0000","last_clean":"2024-09-11T11:02:42.112745+0000","last_became_active":"2024-09-11T11:01:13.423466+0000","last_became_peered":"2024-09-11T11:01:13.423466+0000","last_unstale":"2024-09-11T11:02:42.112745+0000","last_undegraded":"2024-09-11T11:02:42.112745+0000","last_fullsized":"2024-09-11T11:02:42.112745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:51:02.142046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.574272+0000","last_change":"2024-09-11T11:01:05.334600+0000","last_active":"2024-09-11T11:04:17.574272+0000","last_peered":"2024-09-11T11:04:17.574272+0000","last_clean":"2024-09-11T11:04:17.574272+0000","last_became_active":"2024-09-11T11:01:05.334141+0000","last_became_peered":"2024-09-11T11:01:05.334141+0000","last_unstale":"2024-09-11T11:04:17.574272+0000","last_undegraded":"2024-09-11T11:04:17.574272+0000","last_fullsized":"2024-09-11T11:04:17.574272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:40:25.995301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115947+0000","last_change":"2024-09-11T11:01:03.340441+0000","last_active":"2024-09-11T11:02:42.115947+0000","last_peered":"2024-09-11T11:02:42.115947+0000","last_clean":"2024-09-11T11:02:42.115947+0000","last_became_active":"2024-09-11T11:01:03.337584+0000","last_became_peered":"2024-09-11T11:01:03.337584+0000","last_unstale":"2024-09-11T11:02:42.115947+0000","last_undegraded":"2024-09-11T11:02:42.115947+0000","last_fullsized":"2024-09-11T11:02:42.115947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:11.801971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842557+0000","last_change":"2024-09-11T11:01:07.366290+0000","last_active":"2024-09-11T11:02:42.842557+0000","last_peered":"2024-09-11T11:02:42.842557+0000","last_clean":"2024-09-11T11:02:42.842557+0000","last_became_active":"2024-09-11T11:01:07.365791+0000","last_became_peered":"2024-09-11T11:01:07.365791+0000","last_unstale":"2024-09-11T11:02:42.842557+0000","last_undegraded":"2024-09-11T11:02:42.842557+0000","last_fullsized":"2024-09-11T11:02:42.842557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:31:26.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.905215+0000","last_change":"2024-09-11T11:01:09.385201+0000","last_active":"2024-09-11T11:03:14.905215+0000","last_peered":"2024-09-11T11:03:14.905215+0000","last_clean":"2024-09-11T11:03:14.905215+0000","last_became_active":"2024-09-11T11:01:09.380531+0000","last_became_peered":"2024-09-11T11:01:09.380531+0000","last_unstale":"2024-09-11T11:03:14.905215+0000","last_undegraded":"2024-09-11T11:03:14.905215+0000","last_fullsized":"2024-09-11T11:03:14.905215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:30.066289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123409+0000","last_change":"2024-09-11T11:01:11.387269+0000","last_active":"2024-09-11T11:02:42.123409+0000","last_peered":"2024-09-11T11:02:42.123409+0000","last_clean":"2024-09-11T11:02:42.123409+0000","last_became_active":"2024-09-11T11:01:11.386302+0000","last_became_peered":"2024-09-11T11:01:11.386302+0000","last_unstale":"2024-09-11T11:02:42.123409+0000","last_undegraded":"2024-09-11T11:02:42.123409+0000","last_fullsized":"2024-09-11T11:02:42.123409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:54:54.650646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.580984+0000","last_change":"2024-09-11T11:01:13.423002+0000","last_active":"2024-09-11T11:04:17.580984+0000","last_peered":"2024-09-11T11:04:17.580984+0000","last_clean":"2024-09-11T11:04:17.580984+0000","last_became_active":"2024-09-11T11:01:13.422285+0000","last_became_peered":"2024-09-11T11:01:13.422285+0000","last_unstale":"2024-09-11T11:04:17.580984+0000","last_undegraded":"2024-09-11T11:04:17.580984+0000","last_fullsized":"2024-09-11T11:04:17.580984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:03:35.147747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.440090+0000","last_change":"2024-09-11T11:01:05.337161+0000","last_active":"2024-09-11T11:04:17.440090+0000","last_peered":"2024-09-11T11:04:17.440090+0000","last_clean":"2024-09-11T11:04:17.440090+0000","last_became_active":"2024-09-11T11:01:05.336680+0000","last_became_peered":"2024-09-11T11:01:05.336680+0000","last_unstale":"2024-09-11T11:04:17.440090+0000","last_undegraded":"2024-09-11T11:04:17.440090+0000","last_fullsized":"2024-09-11T11:04:17.440090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:14.471785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847754+0000","last_change":"2024-09-11T11:01:03.336607+0000","last_active":"2024-09-11T11:02:42.847754+0000","last_peered":"2024-09-11T11:02:42.847754+0000","last_clean":"2024-09-11T11:02:42.847754+0000","last_became_active":"2024-09-11T11:01:03.331816+0000","last_became_peered":"2024-09-11T11:01:03.331816+0000","last_unstale":"2024-09-11T11:02:42.847754+0000","last_undegraded":"2024-09-11T11:02:42.847754+0000","last_fullsized":"2024-09-11T11:02:42.847754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:04:39.058034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.277728+0000","last_change":"2024-09-11T11:01:07.364299+0000","last_active":"2024-09-11T11:03:13.277728+0000","last_peered":"2024-09-11T11:03:13.277728+0000","last_clean":"2024-09-11T11:03:13.277728+0000","last_became_active":"2024-09-11T11:01:07.363545+0000","last_became_peered":"2024-09-11T11:01:07.363545+0000","last_unstale":"2024-09-11T11:03:13.277728+0000","last_undegraded":"2024-09-11T11:03:13.277728+0000","last_fullsized":"2024-09-11T11:03:13.277728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:17.840143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'32","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.871444+0000","last_change":"2024-09-11T11:01:09.378071+0000","last_active":"2024-09-11T11:04:16.871444+0000","last_peered":"2024-09-11T11:04:16.871444+0000","last_clean":"2024-09-11T11:04:16.871444+0000","last_became_active":"2024-09-11T11:01:09.377586+0000","last_became_peered":"2024-09-11T11:01:09.377586+0000","last_unstale":"2024-09-11T11:04:16.871444+0000","last_undegraded":"2024-09-11T11:04:16.871444+0000","last_fullsized":"2024-09-11T11:04:16.871444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:54.076155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499591+0000","last_change":"2024-09-11T11:01:11.401725+0000","last_active":"2024-09-11T11:02:42.499591+0000","last_peered":"2024-09-11T11:02:42.499591+0000","last_clean":"2024-09-11T11:02:42.499591+0000","last_became_active":"2024-09-11T11:01:11.401078+0000","last_became_peered":"2024-09-11T11:01:11.401078+0000","last_unstale":"2024-09-11T11:02:42.499591+0000","last_undegraded":"2024-09-11T11:02:42.499591+0000","last_fullsized":"2024-09-11T11:02:42.499591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:58:17.003022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.925565+0000","last_change":"2024-09-11T11:01:13.422050+0000","last_active":"2024-09-11T11:03:14.925565+0000","last_peered":"2024-09-11T11:03:14.925565+0000","last_clean":"2024-09-11T11:03:14.925565+0000","last_became_active":"2024-09-11T11:01:13.421231+0000","last_became_peered":"2024-09-11T11:01:13.421231+0000","last_unstale":"2024-09-11T11:03:14.925565+0000","last_undegraded":"2024-09-11T11:03:14.925565+0000","last_fullsized":"2024-09-11T11:03:14.925565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:19.013089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'12","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855598+0000","last_change":"2024-09-11T11:01:05.340309+0000","last_active":"2024-09-11T11:04:17.855598+0000","last_peered":"2024-09-11T11:04:17.855598+0000","last_clean":"2024-09-11T11:04:17.855598+0000","last_became_active":"2024-09-11T11:01:05.339760+0000","last_became_peered":"2024-09-11T11:01:05.339760+0000","last_unstale":"2024-09-11T11:04:17.855598+0000","last_undegraded":"2024-09-11T11:04:17.855598+0000","last_fullsized":"2024-09-11T11:04:17.855598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:03.072232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.496287+0000","last_change":"2024-09-11T11:01:03.338307+0000","last_active":"2024-09-11T11:02:42.496287+0000","last_peered":"2024-09-11T11:02:42.496287+0000","last_clean":"2024-09-11T11:02:42.496287+0000","last_became_active":"2024-09-11T11:01:03.338039+0000","last_became_peered":"2024-09-11T11:01:03.338039+0000","last_unstale":"2024-09-11T11:02:42.496287+0000","last_undegraded":"2024-09-11T11:02:42.496287+0000","last_fullsized":"2024-09-11T11:02:42.496287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:25:25.632777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845571+0000","last_change":"2024-09-11T11:01:05.333022+0000","last_active":"2024-09-11T11:02:42.845571+0000","last_peered":"2024-09-11T11:02:42.845571+0000","last_clean":"2024-09-11T11:02:42.845571+0000","last_became_active":"2024-09-11T11:01:05.332632+0000","last_became_peered":"2024-09-11T11:01:05.332632+0000","last_unstale":"2024-09-11T11:02:42.845571+0000","last_undegraded":"2024-09-11T11:02:42.845571+0000","last_fullsized":"2024-09-11T11:02:42.845571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:54:07.782353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497427+0000","last_change":"2024-09-11T11:01:03.327803+0000","last_active":"2024-09-11T11:02:42.497427+0000","last_peered":"2024-09-11T11:02:42.497427+0000","last_clean":"2024-09-11T11:02:42.497427+0000","last_became_active":"2024-09-11T11:01:03.327428+0000","last_became_peered":"2024-09-11T11:01:03.327428+0000","last_unstale":"2024-09-11T11:02:42.497427+0000","last_undegraded":"2024-09-11T11:02:42.497427+0000","last_fullsized":"2024-09-11T11:02:42.497427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:27:21.561913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.037418+0000","last_change":"2024-09-11T11:01:05.349740+0000","last_active":"2024-09-11T11:03:16.037418+0000","last_peered":"2024-09-11T11:03:16.037418+0000","last_clean":"2024-09-11T11:03:16.037418+0000","last_became_active":"2024-09-11T11:01:05.348827+0000","last_became_peered":"2024-09-11T11:01:05.348827+0000","last_unstale":"2024-09-11T11:03:16.037418+0000","last_undegraded":"2024-09-11T11:03:16.037418+0000","last_fullsized":"2024-09-11T11:03:16.037418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:11.303487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'3","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110919+0000","last_change":"2024-09-11T11:01:03.333973+0000","last_active":"2024-09-11T11:02:42.110919+0000","last_peered":"2024-09-11T11:02:42.110919+0000","last_clean":"2024-09-11T11:02:42.110919+0000","last_became_active":"2024-09-11T11:01:03.333729+0000","last_became_peered":"2024-09-11T11:01:03.333729+0000","last_unstale":"2024-09-11T11:02:42.110919+0000","last_undegraded":"2024-09-11T11:02:42.110919+0000","last_fullsized":"2024-09-11T11:02:42.110919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:23.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.853794+0000","last_change":"2024-09-11T11:01:05.333462+0000","last_active":"2024-09-11T11:04:17.853794+0000","last_peered":"2024-09-11T11:04:17.853794+0000","last_clean":"2024-09-11T11:04:17.853794+0000","last_became_active":"2024-09-11T11:01:05.332274+0000","last_became_peered":"2024-09-11T11:01:05.332274+0000","last_unstale":"2024-09-11T11:04:17.853794+0000","last_undegraded":"2024-09-11T11:04:17.853794+0000","last_fullsized":"2024-09-11T11:04:17.853794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:09.062077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498350+0000","last_change":"2024-09-11T11:01:03.335348+0000","last_active":"2024-09-11T11:02:42.498350+0000","last_peered":"2024-09-11T11:02:42.498350+0000","last_clean":"2024-09-11T11:02:42.498350+0000","last_became_active":"2024-09-11T11:01:03.335054+0000","last_became_peered":"2024-09-11T11:01:03.335054+0000","last_unstale":"2024-09-11T11:02:42.498350+0000","last_undegraded":"2024-09-11T11:02:42.498350+0000","last_fullsized":"2024-09-11T11:02:42.498350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:12.676263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115911+0000","last_change":"2024-09-11T11:01:05.343162+0000","last_active":"2024-09-11T11:02:42.115911+0000","last_peered":"2024-09-11T11:02:42.115911+0000","last_clean":"2024-09-11T11:02:42.115911+0000","last_became_active":"2024-09-11T11:01:05.330065+0000","last_became_peered":"2024-09-11T11:01:05.330065+0000","last_unstale":"2024-09-11T11:02:42.115911+0000","last_undegraded":"2024-09-11T11:02:42.115911+0000","last_fullsized":"2024-09-11T11:02:42.115911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:28.667270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114035+0000","last_change":"2024-09-11T11:01:03.351261+0000","last_active":"2024-09-11T11:02:42.114035+0000","last_peered":"2024-09-11T11:02:42.114035+0000","last_clean":"2024-09-11T11:02:42.114035+0000","last_became_active":"2024-09-11T11:01:03.349971+0000","last_became_peered":"2024-09-11T11:01:03.349971+0000","last_unstale":"2024-09-11T11:02:42.114035+0000","last_undegraded":"2024-09-11T11:02:42.114035+0000","last_fullsized":"2024-09-11T11:02:42.114035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:03.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842469+0000","last_change":"2024-09-11T11:01:05.342800+0000","last_active":"2024-09-11T11:02:42.842469+0000","last_peered":"2024-09-11T11:02:42.842469+0000","last_clean":"2024-09-11T11:02:42.842469+0000","last_became_active":"2024-09-11T11:01:05.342092+0000","last_became_peered":"2024-09-11T11:01:05.342092+0000","last_unstale":"2024-09-11T11:02:42.842469+0000","last_undegraded":"2024-09-11T11:02:42.842469+0000","last_fullsized":"2024-09-11T11:02:42.842469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:51.745730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844893+0000","last_change":"2024-09-11T11:01:42.061260+0000","last_active":"2024-09-11T11:02:42.844893+0000","last_peered":"2024-09-11T11:02:42.844893+0000","last_clean":"2024-09-11T11:02:42.844893+0000","last_became_active":"2024-09-11T11:01:42.060500+0000","last_became_peered":"2024-09-11T11:01:42.060500+0000","last_unstale":"2024-09-11T11:02:42.844893+0000","last_undegraded":"2024-09-11T11:02:42.844893+0000","last_fullsized":"2024-09-11T11:02:42.844893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:12.528032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.769675+0000","last_change":"2024-09-11T11:01:05.346623+0000","last_active":"2024-09-11T11:04:17.769675+0000","last_peered":"2024-09-11T11:04:17.769675+0000","last_clean":"2024-09-11T11:04:17.769675+0000","last_became_active":"2024-09-11T11:01:05.346179+0000","last_became_peered":"2024-09-11T11:01:05.346179+0000","last_unstale":"2024-09-11T11:04:17.769675+0000","last_undegraded":"2024-09-11T11:04:17.769675+0000","last_fullsized":"2024-09-11T11:04:17.769675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:30.170950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.348790+0000","last_change":"2024-09-11T11:01:03.317928+0000","last_active":"2024-09-11T11:04:17.348790+0000","last_peered":"2024-09-11T11:04:17.348790+0000","last_clean":"2024-09-11T11:04:17.348790+0000","last_became_active":"2024-09-11T11:01:03.315737+0000","last_became_peered":"2024-09-11T11:01:03.315737+0000","last_unstale":"2024-09-11T11:04:17.348790+0000","last_undegraded":"2024-09-11T11:04:17.348790+0000","last_fullsized":"2024-09-11T11:04:17.348790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:47.506757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:11.035873+0000","last_change":"2024-09-11T11:01:05.333619+0000","last_active":"2024-09-11T11:03:11.035873+0000","last_peered":"2024-09-11T11:03:11.035873+0000","last_clean":"2024-09-11T11:03:11.035873+0000","last_became_active":"2024-09-11T11:01:05.331901+0000","last_became_peered":"2024-09-11T11:01:05.331901+0000","last_unstale":"2024-09-11T11:03:11.035873+0000","last_undegraded":"2024-09-11T11:03:11.035873+0000","last_fullsized":"2024-09-11T11:03:11.035873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:08.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116431+0000","last_change":"2024-09-11T11:01:03.351395+0000","last_active":"2024-09-11T11:02:42.116431+0000","last_peered":"2024-09-11T11:02:42.116431+0000","last_clean":"2024-09-11T11:02:42.116431+0000","last_became_active":"2024-09-11T11:01:03.351125+0000","last_became_peered":"2024-09-11T11:01:03.351125+0000","last_unstale":"2024-09-11T11:02:42.116431+0000","last_undegraded":"2024-09-11T11:02:42.116431+0000","last_fullsized":"2024-09-11T11:02:42.116431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:02.814616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.040093+0000","last_change":"2024-09-11T11:01:05.333352+0000","last_active":"2024-09-11T11:03:28.040093+0000","last_peered":"2024-09-11T11:03:28.040093+0000","last_clean":"2024-09-11T11:03:28.040093+0000","last_became_active":"2024-09-11T11:01:05.332203+0000","last_became_peered":"2024-09-11T11:01:05.332203+0000","last_unstale":"2024-09-11T11:03:28.040093+0000","last_undegraded":"2024-09-11T11:03:28.040093+0000","last_fullsized":"2024-09-11T11:03:28.040093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:03.791497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109549+0000","last_change":"2024-09-11T11:01:03.337164+0000","last_active":"2024-09-11T11:02:42.109549+0000","last_peered":"2024-09-11T11:02:42.109549+0000","last_clean":"2024-09-11T11:02:42.109549+0000","last_became_active":"2024-09-11T11:01:03.336786+0000","last_became_peered":"2024-09-11T11:01:03.336786+0000","last_unstale":"2024-09-11T11:02:42.109549+0000","last_undegraded":"2024-09-11T11:02:42.109549+0000","last_fullsized":"2024-09-11T11:02:42.109549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:42.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.920771+0000","last_change":"2024-09-11T11:01:05.333095+0000","last_active":"2024-09-11T11:04:17.920771+0000","last_peered":"2024-09-11T11:04:17.920771+0000","last_clean":"2024-09-11T11:04:17.920771+0000","last_became_active":"2024-09-11T11:01:05.332747+0000","last_became_peered":"2024-09-11T11:01:05.332747+0000","last_unstale":"2024-09-11T11:04:17.920771+0000","last_undegraded":"2024-09-11T11:04:17.920771+0000","last_fullsized":"2024-09-11T11:04:17.920771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:41:08.367843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.571216+0000","last_change":"2024-09-11T11:01:03.336167+0000","last_active":"2024-09-11T11:03:16.571216+0000","last_peered":"2024-09-11T11:03:16.571216+0000","last_clean":"2024-09-11T11:03:16.571216+0000","last_became_active":"2024-09-11T11:01:03.335854+0000","last_became_peered":"2024-09-11T11:01:03.335854+0000","last_unstale":"2024-09-11T11:03:16.571216+0000","last_undegraded":"2024-09-11T11:03:16.571216+0000","last_fullsized":"2024-09-11T11:03:16.571216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:04:39.058034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499524+0000","last_change":"2024-09-11T11:01:05.344244+0000","last_active":"2024-09-11T11:02:42.499524+0000","last_peered":"2024-09-11T11:02:42.499524+0000","last_clean":"2024-09-11T11:02:42.499524+0000","last_became_active":"2024-09-11T11:01:05.343590+0000","last_became_peered":"2024-09-11T11:01:05.343590+0000","last_unstale":"2024-09-11T11:02:42.499524+0000","last_undegraded":"2024-09-11T11:02:42.499524+0000","last_fullsized":"2024-09-11T11:02:42.499524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:30.774404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124182+0000","last_change":"2024-09-11T11:01:03.339537+0000","last_active":"2024-09-11T11:02:42.124182+0000","last_peered":"2024-09-11T11:02:42.124182+0000","last_clean":"2024-09-11T11:02:42.124182+0000","last_became_active":"2024-09-11T11:01:03.336224+0000","last_became_peered":"2024-09-11T11:01:03.336224+0000","last_unstale":"2024-09-11T11:02:42.124182+0000","last_undegraded":"2024-09-11T11:02:42.124182+0000","last_fullsized":"2024-09-11T11:02:42.124182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:32.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845373+0000","last_change":"2024-09-11T11:01:05.342088+0000","last_active":"2024-09-11T11:02:42.845373+0000","last_peered":"2024-09-11T11:02:42.845373+0000","last_clean":"2024-09-11T11:02:42.845373+0000","last_became_active":"2024-09-11T11:01:05.341761+0000","last_became_peered":"2024-09-11T11:01:05.341761+0000","last_unstale":"2024-09-11T11:02:42.845373+0000","last_undegraded":"2024-09-11T11:02:42.845373+0000","last_fullsized":"2024-09-11T11:02:42.845373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:27:41.532168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843144+0000","last_change":"2024-09-11T11:01:03.320022+0000","last_active":"2024-09-11T11:02:42.843144+0000","last_peered":"2024-09-11T11:02:42.843144+0000","last_clean":"2024-09-11T11:02:42.843144+0000","last_became_active":"2024-09-11T11:01:03.318984+0000","last_became_peered":"2024-09-11T11:01:03.318984+0000","last_unstale":"2024-09-11T11:02:42.843144+0000","last_undegraded":"2024-09-11T11:02:42.843144+0000","last_fullsized":"2024-09-11T11:02:42.843144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:12.827913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770617+0000","last_change":"2024-09-11T11:01:42.059933+0000","last_active":"2024-09-11T11:04:17.770617+0000","last_peered":"2024-09-11T11:04:17.770617+0000","last_clean":"2024-09-11T11:04:17.770617+0000","last_became_active":"2024-09-11T11:01:42.059147+0000","last_became_peered":"2024-09-11T11:01:42.059147+0000","last_unstale":"2024-09-11T11:04:17.770617+0000","last_undegraded":"2024-09-11T11:04:17.770617+0000","last_fullsized":"2024-09-11T11:04:17.770617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:38.857591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112605+0000","last_change":"2024-09-11T11:01:03.350789+0000","last_active":"2024-09-11T11:02:42.112605+0000","last_peered":"2024-09-11T11:02:42.112605+0000","last_clean":"2024-09-11T11:02:42.112605+0000","last_became_active":"2024-09-11T11:01:03.349120+0000","last_became_peered":"2024-09-11T11:01:03.349120+0000","last_unstale":"2024-09-11T11:02:42.112605+0000","last_undegraded":"2024-09-11T11:02:42.112605+0000","last_fullsized":"2024-09-11T11:02:42.112605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:22.337303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938385+0000","last_change":"2024-09-11T11:01:05.343458+0000","last_active":"2024-09-11T11:04:17.938385+0000","last_peered":"2024-09-11T11:04:17.938385+0000","last_clean":"2024-09-11T11:04:17.938385+0000","last_became_active":"2024-09-11T11:01:05.343121+0000","last_became_peered":"2024-09-11T11:01:05.343121+0000","last_unstale":"2024-09-11T11:04:17.938385+0000","last_undegraded":"2024-09-11T11:04:17.938385+0000","last_fullsized":"2024-09-11T11:04:17.938385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:38.168723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844476+0000","last_change":"2024-09-11T11:01:42.056195+0000","last_active":"2024-09-11T11:02:42.844476+0000","last_peered":"2024-09-11T11:02:42.844476+0000","last_clean":"2024-09-11T11:02:42.844476+0000","last_became_active":"2024-09-11T11:01:42.055356+0000","last_became_peered":"2024-09-11T11:01:42.055356+0000","last_unstale":"2024-09-11T11:02:42.844476+0000","last_undegraded":"2024-09-11T11:02:42.844476+0000","last_fullsized":"2024-09-11T11:02:42.844476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:33.310470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110479+0000","last_change":"2024-09-11T11:01:05.346901+0000","last_active":"2024-09-11T11:02:42.110479+0000","last_peered":"2024-09-11T11:02:42.110479+0000","last_clean":"2024-09-11T11:02:42.110479+0000","last_became_active":"2024-09-11T11:01:05.346563+0000","last_became_peered":"2024-09-11T11:01:05.346563+0000","last_unstale":"2024-09-11T11:02:42.110479+0000","last_undegraded":"2024-09-11T11:02:42.110479+0000","last_fullsized":"2024-09-11T11:02:42.110479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:02.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499542+0000","last_change":"2024-09-11T11:01:03.316299+0000","last_active":"2024-09-11T11:02:42.499542+0000","last_peered":"2024-09-11T11:02:42.499542+0000","last_clean":"2024-09-11T11:02:42.499542+0000","last_became_active":"2024-09-11T11:01:03.315651+0000","last_became_peered":"2024-09-11T11:01:03.315651+0000","last_unstale":"2024-09-11T11:02:42.499542+0000","last_undegraded":"2024-09-11T11:02:42.499542+0000","last_fullsized":"2024-09-11T11:02:42.499542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:12:09.647986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.818259+0000","last_change":"2024-09-11T11:01:05.348683+0000","last_active":"2024-09-11T11:03:16.818259+0000","last_peered":"2024-09-11T11:03:16.818259+0000","last_clean":"2024-09-11T11:03:16.818259+0000","last_became_active":"2024-09-11T11:01:05.347760+0000","last_became_peered":"2024-09-11T11:01:05.347760+0000","last_unstale":"2024-09-11T11:03:16.818259+0000","last_undegraded":"2024-09-11T11:03:16.818259+0000","last_fullsized":"2024-09-11T11:03:16.818259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:28:39.642991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116664+0000","last_change":"2024-09-11T11:01:03.340726+0000","last_active":"2024-09-11T11:02:42.116664+0000","last_peered":"2024-09-11T11:02:42.116664+0000","last_clean":"2024-09-11T11:02:42.116664+0000","last_became_active":"2024-09-11T11:01:03.337667+0000","last_became_peered":"2024-09-11T11:01:03.337667+0000","last_unstale":"2024-09-11T11:02:42.116664+0000","last_undegraded":"2024-09-11T11:02:42.116664+0000","last_fullsized":"2024-09-11T11:02:42.116664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:41:38.836874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121715+0000","last_change":"2024-09-11T11:01:03.322086+0000","last_active":"2024-09-11T11:02:42.121715+0000","last_peered":"2024-09-11T11:02:42.121715+0000","last_clean":"2024-09-11T11:02:42.121715+0000","last_became_active":"2024-09-11T11:01:03.321242+0000","last_became_peered":"2024-09-11T11:01:03.321242+0000","last_unstale":"2024-09-11T11:02:42.121715+0000","last_undegraded":"2024-09-11T11:02:42.121715+0000","last_fullsized":"2024-09-11T11:02:42.121715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:55.170368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.437700+0000","last_change":"2024-09-11T11:01:05.344698+0000","last_active":"2024-09-11T11:04:17.437700+0000","last_peered":"2024-09-11T11:04:17.437700+0000","last_clean":"2024-09-11T11:04:17.437700+0000","last_became_active":"2024-09-11T11:01:05.344285+0000","last_became_peered":"2024-09-11T11:01:05.344285+0000","last_unstale":"2024-09-11T11:04:17.437700+0000","last_undegraded":"2024-09-11T11:04:17.437700+0000","last_fullsized":"2024-09-11T11:04:17.437700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:08:02.954788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842659+0000","last_change":"2024-09-11T11:01:03.325391+0000","last_active":"2024-09-11T11:02:42.842659+0000","last_peered":"2024-09-11T11:02:42.842659+0000","last_clean":"2024-09-11T11:02:42.842659+0000","last_became_active":"2024-09-11T11:01:03.320391+0000","last_became_peered":"2024-09-11T11:01:03.320391+0000","last_unstale":"2024-09-11T11:02:42.842659+0000","last_undegraded":"2024-09-11T11:02:42.842659+0000","last_fullsized":"2024-09-11T11:02:42.842659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:25:59.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498432+0000","last_change":"2024-09-11T11:01:42.076222+0000","last_active":"2024-09-11T11:02:42.498432+0000","last_peered":"2024-09-11T11:02:42.498432+0000","last_clean":"2024-09-11T11:02:42.498432+0000","last_became_active":"2024-09-11T11:01:42.069954+0000","last_became_peered":"2024-09-11T11:01:42.069954+0000","last_unstale":"2024-09-11T11:02:42.498432+0000","last_undegraded":"2024-09-11T11:02:42.498432+0000","last_fullsized":"2024-09-11T11:02:42.498432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:10:17.552581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1608,"num_read_kb":1498,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":5172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":5296128,"data_stored":4991137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48684,"kb_used_data":9180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323156,"statfs":{"total":96636764160,"available":96586911744,"internally_reserved":0,"allocated":9400320,"data_stored":9132733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61668,"kb_used_data":22164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94310172,"statfs":{"total":96636764160,"available":96573616128,"internally_reserved":0,"allocated":22695936,"data_stored":22359925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56380,"kb_used_data":16876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315460,"statfs":{"total":96636764160,"available":96579031040,"internally_reserved":0,"allocated":17281024,"data_stored":16933829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:04:50.235 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T11:04:50.235 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:04:50.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadfdecc640 1 Processor -- start 2024-09-11T11:04:50.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadfdecc640 1 -- start start 2024-09-11T11:04:50.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadfdecc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fadf806e180 0x7fadf8133e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:50.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadfdecc640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadf806fc40 con 0x7fadf812ed70 2024-09-11T11:04:50.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadfdecc640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fadf806f930 con 0x7fadf806e180 2024-09-11T11:04:50.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadf77fe640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fadf812ed70 0x7fadf812f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50598/0 (socket says 172.21.15.102:50598) 2024-09-11T11:04:50.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadf77fe640 1 -- 172.21.15.102:0/827907298 learned_addr learned my addr 172.21.15.102:0/827907298 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:50.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadf6ffd640 1 --2- 172.21.15.102:0/827907298 >> v2:172.21.15.102:3300/0 conn(0x7fadf806e180 0x7fadf8133e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:50.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadf67fc640 1 -- 172.21.15.102:0/827907298 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553088071 0 0) 0x7fadf806fc40 con 0x7fadf812ed70 2024-09-11T11:04:50.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadf67fc640 1 -- 172.21.15.102:0/827907298 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fade0003530 con 0x7fadf812ed70 2024-09-11T11:04:50.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadf6ffd640 1 -- 172.21.15.102:0/827907298 >> v1:172.21.15.102:6789/0 conn(0x7fadf812ed70 legacy=0x7fadf812f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.387+0000 7fadf6ffd640 1 -- 172.21.15.102:0/827907298 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf806ea20 con 0x7fadf806e180 2024-09-11T11:04:50.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf6ffd640 1 --2- 172.21.15.102:0/827907298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf8133e50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fadec009740 tx=0x7fadec01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c07f587acf3fce8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:50.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf67fc640 1 -- 172.21.15.102:0/827907298 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec0b1070 con 0x7fadf806e180 2024-09-11T11:04:50.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf67fc640 1 -- 172.21.15.102:0/827907298 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadec0ac570 con 0x7fadf806e180 2024-09-11T11:04:50.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf67fc640 1 -- 172.21.15.102:0/827907298 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fadec0ac850 con 0x7fadf806e180 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- 172.21.15.102:0/827907298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 msgr2=0x7fadf8133e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 --2- 172.21.15.102:0/827907298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf8133e50 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fadec009740 tx=0x7fadec01c400 comp rx=0 tx=0).stop 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- 172.21.15.102:0/827907298 shutdown_connections 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 --2- 172.21.15.102:0/827907298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf8133e50 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- 172.21.15.102:0/827907298 >> 172.21.15.102:0/827907298 conn(0x7fadf809cd30 msgr2=0x7fadf809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- 172.21.15.102:0/827907298 shutdown_connections 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- 172.21.15.102:0/827907298 wait complete. 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 Processor -- start 2024-09-11T11:04:50.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- start start 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf81c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fadf8136f40 con 0x7fadf806e180 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf81c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf81c62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48580/0 (socket says 172.21.15.102:48580) 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf77fe640 1 -- 172.21.15.102:0/3085842886 learned_addr learned my addr 172.21.15.102:0/3085842886 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf77fe640 1 -- 172.21.15.102:0/3085842886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf8094150 con 0x7fadf806e180 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadf77fe640 1 --2- 172.21.15.102:0/3085842886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf81c62e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fade800c3d0 tx=0x7fade800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7faddffff640 1 -- 172.21.15.102:0/3085842886 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade8017070 con 0x7fadf806e180 2024-09-11T11:04:50.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7faddffff640 1 -- 172.21.15.102:0/3085842886 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8005ce0 con 0x7fadf806e180 2024-09-11T11:04:50.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf8093f10 con 0x7fadf806e180 2024-09-11T11:04:50.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7faddffff640 1 -- 172.21.15.102:0/3085842886 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade80070d0 con 0x7fadf806e180 2024-09-11T11:04:50.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf8094ba0 con 0x7fadf806e180 2024-09-11T11:04:50.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.391+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadf8094e30 con 0x7fadf806e180 2024-09-11T11:04:50.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.395+0000 7faddffff640 1 -- 172.21.15.102:0/3085842886 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fade801a070 con 0x7fadf806e180 2024-09-11T11:04:50.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.395+0000 7faddffff640 1 --2- 172.21.15.102:0/3085842886 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fade4035db0 0x7fade4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:50.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.395+0000 7faddffff640 1 -- 172.21.15.102:0/3085842886 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fade80484b0 con 0x7fadf806e180 2024-09-11T11:04:50.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.395+0000 7fadf6ffd640 1 --2- 172.21.15.102:0/3085842886 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fade4035db0 0x7fade4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:50.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.395+0000 7fadf6ffd640 1 --2- 172.21.15.102:0/3085842886 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fade4035db0 0x7fade4038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fadec0ae000 tx=0x7fadec0a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:50.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.399+0000 7faddffff640 1 -- 172.21.15.102:0/3085842886 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fade8019e10 con 0x7fadf806e180 2024-09-11T11:04:50.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.555+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fadf806e600 con 0x7fade4035db0 2024-09-11T11:04:50.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.599+0000 7faddffff640 1 -- 172.21.15.102:0/3085842886 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665564 (secure 0 0 0) 0x7fadf806e600 con 0x7fade4035db0 2024-09-11T11:04:50.603 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:04:50.613 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:04:50.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.607+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fade4035db0 msgr2=0x7fade4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.607+0000 7fadfdecc640 1 --2- 172.21.15.102:0/3085842886 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fade4035db0 0x7fade4038270 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fadec0ae000 tx=0x7fadec0a6070 comp rx=0 tx=0).stop 2024-09-11T11:04:50.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.607+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 msgr2=0x7fadf81c62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.607+0000 7fadfdecc640 1 --2- 172.21.15.102:0/3085842886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf81c62e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fade800c3d0 tx=0x7fade800c890 comp rx=0 tx=0).stop 2024-09-11T11:04:50.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.607+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 shutdown_connections 2024-09-11T11:04:50.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.607+0000 7fadfdecc640 1 --2- 172.21.15.102:0/3085842886 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fade4035db0 0x7fade4038270 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.607+0000 7fadfdecc640 1 --2- 172.21.15.102:0/3085842886 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fadf806e180 0x7fadf81c62e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.607+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 >> 172.21.15.102:0/3085842886 conn(0x7fadf809cd30 msgr2=0x7fadf812fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:50.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.611+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 shutdown_connections 2024-09-11T11:04:50.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.611+0000 7fadfdecc640 1 -- 172.21.15.102:0/3085842886 wait complete. 2024-09-11T11:04:50.632 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-11T11:04:49.048110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26412808,"num_objects":229,"num_object_clones":0,"num_object_copies":458,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4874,"num_read_kb":4455,"num_write":2108,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4480,"ondisk_log_size":4480,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":207248,"kb_used_data":53392,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377280112,"statfs":{"total":386547056640,"available":386334834688,"internally_reserved":0,"allocated":54673408,"data_stored":53417624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006488"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129252+0000","last_change":"2024-09-11T11:01:03.337877+0000","last_active":"2024-09-11T11:02:42.129252+0000","last_peered":"2024-09-11T11:02:42.129252+0000","last_clean":"2024-09-11T11:02:42.129252+0000","last_became_active":"2024-09-11T11:01:03.336333+0000","last_became_peered":"2024-09-11T11:01:03.336333+0000","last_unstale":"2024-09-11T11:02:42.129252+0000","last_undegraded":"2024-09-11T11:02:42.129252+0000","last_fullsized":"2024-09-11T11:02:42.129252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:39.536350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573739+0000","last_change":"2024-09-11T11:01:05.334117+0000","last_active":"2024-09-11T11:04:17.573739+0000","last_peered":"2024-09-11T11:04:17.573739+0000","last_clean":"2024-09-11T11:04:17.573739+0000","last_became_active":"2024-09-11T11:01:05.332897+0000","last_became_peered":"2024-09-11T11:01:05.332897+0000","last_unstale":"2024-09-11T11:04:17.573739+0000","last_undegraded":"2024-09-11T11:04:17.573739+0000","last_fullsized":"2024-09-11T11:04:17.573739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:30.170950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845264+0000","last_change":"2024-09-11T11:01:03.346417+0000","last_active":"2024-09-11T11:02:42.845264+0000","last_peered":"2024-09-11T11:02:42.845264+0000","last_clean":"2024-09-11T11:02:42.845264+0000","last_became_active":"2024-09-11T11:01:03.346113+0000","last_became_peered":"2024-09-11T11:01:03.346113+0000","last_unstale":"2024-09-11T11:02:42.845264+0000","last_undegraded":"2024-09-11T11:02:42.845264+0000","last_fullsized":"2024-09-11T11:02:42.845264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:42.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836745+0000","last_change":"2024-09-11T11:01:05.333693+0000","last_active":"2024-09-11T11:03:16.836745+0000","last_peered":"2024-09-11T11:03:16.836745+0000","last_clean":"2024-09-11T11:03:16.836745+0000","last_became_active":"2024-09-11T11:01:05.330885+0000","last_became_peered":"2024-09-11T11:01:05.330885+0000","last_unstale":"2024-09-11T11:03:16.836745+0000","last_undegraded":"2024-09-11T11:03:16.836745+0000","last_fullsized":"2024-09-11T11:03:16.836745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:17:27.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112814+0000","last_change":"2024-09-11T11:01:03.346111+0000","last_active":"2024-09-11T11:02:42.112814+0000","last_peered":"2024-09-11T11:02:42.112814+0000","last_clean":"2024-09-11T11:02:42.112814+0000","last_became_active":"2024-09-11T11:01:03.345673+0000","last_became_peered":"2024-09-11T11:01:03.345673+0000","last_unstale":"2024-09-11T11:02:42.112814+0000","last_undegraded":"2024-09-11T11:02:42.112814+0000","last_fullsized":"2024-09-11T11:02:42.112814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:11.883100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.436815+0000","last_change":"2024-09-11T11:01:05.331041+0000","last_active":"2024-09-11T11:04:17.436815+0000","last_peered":"2024-09-11T11:04:17.436815+0000","last_clean":"2024-09-11T11:04:17.436815+0000","last_became_active":"2024-09-11T11:01:05.330639+0000","last_became_peered":"2024-09-11T11:01:05.330639+0000","last_unstale":"2024-09-11T11:04:17.436815+0000","last_undegraded":"2024-09-11T11:04:17.436815+0000","last_fullsized":"2024-09-11T11:04:17.436815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:51.046871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.721051+0000","last_change":"2024-09-11T11:01:03.335434+0000","last_active":"2024-09-11T11:03:16.721051+0000","last_peered":"2024-09-11T11:03:16.721051+0000","last_clean":"2024-09-11T11:03:16.721051+0000","last_became_active":"2024-09-11T11:01:03.335132+0000","last_became_peered":"2024-09-11T11:01:03.335132+0000","last_unstale":"2024-09-11T11:03:16.721051+0000","last_undegraded":"2024-09-11T11:03:16.721051+0000","last_fullsized":"2024-09-11T11:03:16.721051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:27.769400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573787+0000","last_change":"2024-09-11T11:01:05.344140+0000","last_active":"2024-09-11T11:04:17.573787+0000","last_peered":"2024-09-11T11:04:17.573787+0000","last_clean":"2024-09-11T11:04:17.573787+0000","last_became_active":"2024-09-11T11:01:05.339018+0000","last_became_peered":"2024-09-11T11:01:05.339018+0000","last_unstale":"2024-09-11T11:04:17.573787+0000","last_undegraded":"2024-09-11T11:04:17.573787+0000","last_fullsized":"2024-09-11T11:04:17.573787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:03.791497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124006+0000","last_change":"2024-09-11T11:01:03.324287+0000","last_active":"2024-09-11T11:02:42.124006+0000","last_peered":"2024-09-11T11:02:42.124006+0000","last_clean":"2024-09-11T11:02:42.124006+0000","last_became_active":"2024-09-11T11:01:03.322877+0000","last_became_peered":"2024-09-11T11:01:03.322877+0000","last_unstale":"2024-09-11T11:02:42.124006+0000","last_undegraded":"2024-09-11T11:02:42.124006+0000","last_fullsized":"2024-09-11T11:02:42.124006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:03.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'7","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.837597+0000","last_change":"2024-09-11T11:01:05.354323+0000","last_active":"2024-09-11T11:03:16.837597+0000","last_peered":"2024-09-11T11:03:16.837597+0000","last_clean":"2024-09-11T11:03:16.837597+0000","last_became_active":"2024-09-11T11:01:05.353908+0000","last_became_peered":"2024-09-11T11:01:05.353908+0000","last_unstale":"2024-09-11T11:03:16.837597+0000","last_undegraded":"2024-09-11T11:03:16.837597+0000","last_fullsized":"2024-09-11T11:03:16.837597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:11:14.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124871+0000","last_change":"2024-09-11T11:01:03.346652+0000","last_active":"2024-09-11T11:02:42.124871+0000","last_peered":"2024-09-11T11:02:42.124871+0000","last_clean":"2024-09-11T11:02:42.124871+0000","last_became_active":"2024-09-11T11:01:03.345964+0000","last_became_peered":"2024-09-11T11:01:03.345964+0000","last_unstale":"2024-09-11T11:02:42.124871+0000","last_undegraded":"2024-09-11T11:02:42.124871+0000","last_fullsized":"2024-09-11T11:02:42.124871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:12.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'14","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921127+0000","last_change":"2024-09-11T11:01:05.346892+0000","last_active":"2024-09-11T11:04:17.921127+0000","last_peered":"2024-09-11T11:04:17.921127+0000","last_clean":"2024-09-11T11:04:17.921127+0000","last_became_active":"2024-09-11T11:01:05.345664+0000","last_became_peered":"2024-09-11T11:01:05.345664+0000","last_unstale":"2024-09-11T11:04:17.921127+0000","last_undegraded":"2024-09-11T11:04:17.921127+0000","last_fullsized":"2024-09-11T11:04:17.921127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:15.826673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110283+0000","last_change":"2024-09-11T11:01:03.349146+0000","last_active":"2024-09-11T11:02:42.110283+0000","last_peered":"2024-09-11T11:02:42.110283+0000","last_clean":"2024-09-11T11:02:42.110283+0000","last_became_active":"2024-09-11T11:01:03.348822+0000","last_became_peered":"2024-09-11T11:01:03.348822+0000","last_unstale":"2024-09-11T11:02:42.110283+0000","last_undegraded":"2024-09-11T11:02:42.110283+0000","last_fullsized":"2024-09-11T11:02:42.110283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:25.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127393+0000","last_change":"2024-09-11T11:01:05.347306+0000","last_active":"2024-09-11T11:02:42.127393+0000","last_peered":"2024-09-11T11:02:42.127393+0000","last_clean":"2024-09-11T11:02:42.127393+0000","last_became_active":"2024-09-11T11:01:05.345698+0000","last_became_peered":"2024-09-11T11:01:05.345698+0000","last_unstale":"2024-09-11T11:02:42.127393+0000","last_undegraded":"2024-09-11T11:02:42.127393+0000","last_fullsized":"2024-09-11T11:02:42.127393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:41:08.367843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.750645+0000","last_change":"2024-09-11T11:01:03.336343+0000","last_active":"2024-09-11T11:03:12.750645+0000","last_peered":"2024-09-11T11:03:12.750645+0000","last_clean":"2024-09-11T11:03:12.750645+0000","last_became_active":"2024-09-11T11:01:03.335830+0000","last_became_peered":"2024-09-11T11:01:03.335830+0000","last_unstale":"2024-09-11T11:03:12.750645+0000","last_undegraded":"2024-09-11T11:03:12.750645+0000","last_fullsized":"2024-09-11T11:03:12.750645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:12:21.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.021931+0000","last_change":"2024-09-11T11:01:05.344202+0000","last_active":"2024-09-11T11:04:18.021931+0000","last_peered":"2024-09-11T11:04:18.021931+0000","last_clean":"2024-09-11T11:04:18.021931+0000","last_became_active":"2024-09-11T11:01:05.343805+0000","last_became_peered":"2024-09-11T11:01:05.343805+0000","last_unstale":"2024-09-11T11:04:18.021931+0000","last_undegraded":"2024-09-11T11:04:18.021931+0000","last_fullsized":"2024-09-11T11:04:18.021931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:37:30.179996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122512+0000","last_change":"2024-09-11T11:01:05.333623+0000","last_active":"2024-09-11T11:02:42.122512+0000","last_peered":"2024-09-11T11:02:42.122512+0000","last_clean":"2024-09-11T11:02:42.122512+0000","last_became_active":"2024-09-11T11:01:05.332915+0000","last_became_peered":"2024-09-11T11:01:05.332915+0000","last_unstale":"2024-09-11T11:02:42.122512+0000","last_undegraded":"2024-09-11T11:02:42.122512+0000","last_fullsized":"2024-09-11T11:02:42.122512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:37.428238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847796+0000","last_change":"2024-09-11T11:01:03.347195+0000","last_active":"2024-09-11T11:02:42.847796+0000","last_peered":"2024-09-11T11:02:42.847796+0000","last_clean":"2024-09-11T11:02:42.847796+0000","last_became_active":"2024-09-11T11:01:03.346878+0000","last_became_peered":"2024-09-11T11:01:03.346878+0000","last_unstale":"2024-09-11T11:02:42.847796+0000","last_undegraded":"2024-09-11T11:02:42.847796+0000","last_fullsized":"2024-09-11T11:02:42.847796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:23.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.837531+0000","last_change":"2024-09-11T11:01:42.051383+0000","last_active":"2024-09-11T11:03:16.837531+0000","last_peered":"2024-09-11T11:03:16.837531+0000","last_clean":"2024-09-11T11:03:16.837531+0000","last_became_active":"2024-09-11T11:01:42.050609+0000","last_became_peered":"2024-09-11T11:01:42.050609+0000","last_unstale":"2024-09-11T11:03:16.837531+0000","last_undegraded":"2024-09-11T11:03:16.837531+0000","last_fullsized":"2024-09-11T11:03:16.837531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:02:47.432629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500359+0000","last_change":"2024-09-11T11:01:03.335675+0000","last_active":"2024-09-11T11:02:42.500359+0000","last_peered":"2024-09-11T11:02:42.500359+0000","last_clean":"2024-09-11T11:02:42.500359+0000","last_became_active":"2024-09-11T11:01:03.335121+0000","last_became_peered":"2024-09-11T11:01:03.335121+0000","last_unstale":"2024-09-11T11:02:42.500359+0000","last_undegraded":"2024-09-11T11:02:42.500359+0000","last_fullsized":"2024-09-11T11:02:42.500359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:09:08.817967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124476+0000","last_change":"2024-09-11T11:01:05.332966+0000","last_active":"2024-09-11T11:02:42.124476+0000","last_peered":"2024-09-11T11:02:42.124476+0000","last_clean":"2024-09-11T11:02:42.124476+0000","last_became_active":"2024-09-11T11:01:05.332299+0000","last_became_peered":"2024-09-11T11:01:05.332299+0000","last_unstale":"2024-09-11T11:02:42.124476+0000","last_undegraded":"2024-09-11T11:02:42.124476+0000","last_fullsized":"2024-09-11T11:02:42.124476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:16:36.575022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.128827+0000","last_change":"2024-09-11T11:01:03.346356+0000","last_active":"2024-09-11T11:02:42.128827+0000","last_peered":"2024-09-11T11:02:42.128827+0000","last_clean":"2024-09-11T11:02:42.128827+0000","last_became_active":"2024-09-11T11:01:03.345528+0000","last_became_peered":"2024-09-11T11:01:03.345528+0000","last_unstale":"2024-09-11T11:02:42.128827+0000","last_undegraded":"2024-09-11T11:02:42.128827+0000","last_fullsized":"2024-09-11T11:02:42.128827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:22.337303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855579+0000","last_change":"2024-09-11T11:01:05.353141+0000","last_active":"2024-09-11T11:04:17.855579+0000","last_peered":"2024-09-11T11:04:17.855579+0000","last_clean":"2024-09-11T11:04:17.855579+0000","last_became_active":"2024-09-11T11:01:05.352754+0000","last_became_peered":"2024-09-11T11:01:05.352754+0000","last_unstale":"2024-09-11T11:04:17.855579+0000","last_undegraded":"2024-09-11T11:04:17.855579+0000","last_fullsized":"2024-09-11T11:04:17.855579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:13.106892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.125934+0000","last_change":"2024-09-11T11:01:03.323543+0000","last_active":"2024-09-11T11:02:42.125934+0000","last_peered":"2024-09-11T11:02:42.125934+0000","last_clean":"2024-09-11T11:02:42.125934+0000","last_became_active":"2024-09-11T11:01:03.321411+0000","last_became_peered":"2024-09-11T11:01:03.321411+0000","last_unstale":"2024-09-11T11:02:42.125934+0000","last_undegraded":"2024-09-11T11:02:42.125934+0000","last_fullsized":"2024-09-11T11:02:42.125934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:47:39.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'32","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.854585+0000","last_change":"2024-09-11T11:01:05.337548+0000","last_active":"2024-09-11T11:04:17.854585+0000","last_peered":"2024-09-11T11:04:17.854585+0000","last_clean":"2024-09-11T11:04:17.854585+0000","last_became_active":"2024-09-11T11:01:05.337040+0000","last_became_peered":"2024-09-11T11:01:05.337040+0000","last_unstale":"2024-09-11T11:04:17.854585+0000","last_undegraded":"2024-09-11T11:04:17.854585+0000","last_fullsized":"2024-09-11T11:04:17.854585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:06.158539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.757156+0000","last_change":"2024-09-11T11:01:03.334314+0000","last_active":"2024-09-11T11:04:17.757156+0000","last_peered":"2024-09-11T11:04:17.757156+0000","last_clean":"2024-09-11T11:04:17.757156+0000","last_became_active":"2024-09-11T11:01:03.333820+0000","last_became_peered":"2024-09-11T11:01:03.333820+0000","last_unstale":"2024-09-11T11:04:17.757156+0000","last_undegraded":"2024-09-11T11:04:17.757156+0000","last_fullsized":"2024-09-11T11:04:17.757156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:32:19.168897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.574261+0000","last_change":"2024-09-11T11:01:05.342829+0000","last_active":"2024-09-11T11:04:17.574261+0000","last_peered":"2024-09-11T11:04:17.574261+0000","last_clean":"2024-09-11T11:04:17.574261+0000","last_became_active":"2024-09-11T11:01:05.342461+0000","last_became_peered":"2024-09-11T11:01:05.342461+0000","last_unstale":"2024-09-11T11:04:17.574261+0000","last_undegraded":"2024-09-11T11:04:17.574261+0000","last_fullsized":"2024-09-11T11:04:17.574261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:01:49.773250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.267054+0000","last_change":"2024-09-11T11:01:03.346138+0000","last_active":"2024-09-11T11:04:17.267054+0000","last_peered":"2024-09-11T11:04:17.267054+0000","last_clean":"2024-09-11T11:04:17.267054+0000","last_became_active":"2024-09-11T11:01:03.345866+0000","last_became_peered":"2024-09-11T11:01:03.345866+0000","last_unstale":"2024-09-11T11:04:17.267054+0000","last_undegraded":"2024-09-11T11:04:17.267054+0000","last_fullsized":"2024-09-11T11:04:17.267054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:08.559205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4834176,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.814618+0000","last_change":"2024-09-11T11:01:13.415583+0000","last_active":"2024-09-11T11:04:17.814618+0000","last_peered":"2024-09-11T11:04:17.814618+0000","last_clean":"2024-09-11T11:04:17.814618+0000","last_became_active":"2024-09-11T11:01:13.410232+0000","last_became_peered":"2024-09-11T11:01:13.410232+0000","last_unstale":"2024-09-11T11:04:17.814618+0000","last_undegraded":"2024-09-11T11:04:17.814618+0000","last_fullsized":"2024-09-11T11:04:17.814618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:58.102633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'14","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.435955+0000","last_change":"2024-09-11T11:01:05.347684+0000","last_active":"2024-09-11T11:04:17.435955+0000","last_peered":"2024-09-11T11:04:17.435955+0000","last_clean":"2024-09-11T11:04:17.435955+0000","last_became_active":"2024-09-11T11:01:05.347254+0000","last_became_peered":"2024-09-11T11:01:05.347254+0000","last_unstale":"2024-09-11T11:04:17.435955+0000","last_undegraded":"2024-09-11T11:04:17.435955+0000","last_fullsized":"2024-09-11T11:04:17.435955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:37.428238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.729046+0000","last_change":"2024-09-11T11:01:03.341239+0000","last_active":"2024-09-11T11:04:17.729046+0000","last_peered":"2024-09-11T11:04:17.729046+0000","last_clean":"2024-09-11T11:04:17.729046+0000","last_became_active":"2024-09-11T11:01:03.340851+0000","last_became_peered":"2024-09-11T11:01:03.340851+0000","last_unstale":"2024-09-11T11:04:17.729046+0000","last_undegraded":"2024-09-11T11:04:17.729046+0000","last_fullsized":"2024-09-11T11:04:17.729046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:47:39.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113676+0000","last_change":"2024-09-11T11:01:07.364976+0000","last_active":"2024-09-11T11:02:42.113676+0000","last_peered":"2024-09-11T11:02:42.113676+0000","last_clean":"2024-09-11T11:02:42.113676+0000","last_became_active":"2024-09-11T11:01:07.363392+0000","last_became_peered":"2024-09-11T11:01:07.363392+0000","last_unstale":"2024-09-11T11:02:42.113676+0000","last_undegraded":"2024-09-11T11:02:42.113676+0000","last_fullsized":"2024-09-11T11:02:42.113676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:33.505775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.891552+0000","last_change":"2024-09-11T11:01:09.392616+0000","last_active":"2024-09-11T11:03:14.891552+0000","last_peered":"2024-09-11T11:03:14.891552+0000","last_clean":"2024-09-11T11:03:14.891552+0000","last_became_active":"2024-09-11T11:01:09.392044+0000","last_became_peered":"2024-09-11T11:01:09.392044+0000","last_unstale":"2024-09-11T11:03:14.891552+0000","last_undegraded":"2024-09-11T11:03:14.891552+0000","last_fullsized":"2024-09-11T11:03:14.891552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:06.838378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129542+0000","last_change":"2024-09-11T11:01:11.400422+0000","last_active":"2024-09-11T11:02:42.129542+0000","last_peered":"2024-09-11T11:02:42.129542+0000","last_clean":"2024-09-11T11:02:42.129542+0000","last_became_active":"2024-09-11T11:01:11.399820+0000","last_became_peered":"2024-09-11T11:01:11.399820+0000","last_unstale":"2024-09-11T11:02:42.129542+0000","last_undegraded":"2024-09-11T11:02:42.129542+0000","last_fullsized":"2024-09-11T11:02:42.129542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:20.584480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121749+0000","last_change":"2024-09-11T11:01:13.421600+0000","last_active":"2024-09-11T11:02:42.121749+0000","last_peered":"2024-09-11T11:02:42.121749+0000","last_clean":"2024-09-11T11:02:42.121749+0000","last_became_active":"2024-09-11T11:01:13.420843+0000","last_became_peered":"2024-09-11T11:01:13.420843+0000","last_unstale":"2024-09-11T11:02:42.121749+0000","last_undegraded":"2024-09-11T11:02:42.121749+0000","last_fullsized":"2024-09-11T11:02:42.121749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:32:51.362925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'17","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.870018+0000","last_change":"2024-09-11T11:01:05.335422+0000","last_active":"2024-09-11T11:04:17.870018+0000","last_peered":"2024-09-11T11:04:17.870018+0000","last_clean":"2024-09-11T11:04:17.870018+0000","last_became_active":"2024-09-11T11:01:05.334085+0000","last_became_peered":"2024-09-11T11:01:05.334085+0000","last_unstale":"2024-09-11T11:04:17.870018+0000","last_undegraded":"2024-09-11T11:04:17.870018+0000","last_fullsized":"2024-09-11T11:04:17.870018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:14.677319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.775271+0000","last_change":"2024-09-11T11:01:03.335761+0000","last_active":"2024-09-11T11:03:16.775271+0000","last_peered":"2024-09-11T11:03:16.775271+0000","last_clean":"2024-09-11T11:03:16.775271+0000","last_became_active":"2024-09-11T11:01:03.335439+0000","last_became_peered":"2024-09-11T11:01:03.335439+0000","last_unstale":"2024-09-11T11:03:16.775271+0000","last_undegraded":"2024-09-11T11:03:16.775271+0000","last_fullsized":"2024-09-11T11:03:16.775271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:15:21.556672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113629+0000","last_change":"2024-09-11T11:01:07.354963+0000","last_active":"2024-09-11T11:02:42.113629+0000","last_peered":"2024-09-11T11:02:42.113629+0000","last_clean":"2024-09-11T11:02:42.113629+0000","last_became_active":"2024-09-11T11:01:07.350851+0000","last_became_peered":"2024-09-11T11:01:07.350851+0000","last_unstale":"2024-09-11T11:02:42.113629+0000","last_undegraded":"2024-09-11T11:02:42.113629+0000","last_fullsized":"2024-09-11T11:02:42.113629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:35:29.768861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845742+0000","last_change":"2024-09-11T11:01:09.383885+0000","last_active":"2024-09-11T11:02:42.845742+0000","last_peered":"2024-09-11T11:02:42.845742+0000","last_clean":"2024-09-11T11:02:42.845742+0000","last_became_active":"2024-09-11T11:01:09.382890+0000","last_became_peered":"2024-09-11T11:01:09.382890+0000","last_unstale":"2024-09-11T11:02:42.845742+0000","last_undegraded":"2024-09-11T11:02:42.845742+0000","last_fullsized":"2024-09-11T11:02:42.845742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:07.186578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126516+0000","last_change":"2024-09-11T11:01:11.401654+0000","last_active":"2024-09-11T11:02:42.126516+0000","last_peered":"2024-09-11T11:02:42.126516+0000","last_clean":"2024-09-11T11:02:42.126516+0000","last_became_active":"2024-09-11T11:01:11.400881+0000","last_became_peered":"2024-09-11T11:01:11.400881+0000","last_unstale":"2024-09-11T11:02:42.126516+0000","last_undegraded":"2024-09-11T11:02:42.126516+0000","last_fullsized":"2024-09-11T11:02:42.126516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:35:07.181778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110054+0000","last_change":"2024-09-11T11:01:13.423960+0000","last_active":"2024-09-11T11:02:42.110054+0000","last_peered":"2024-09-11T11:02:42.110054+0000","last_clean":"2024-09-11T11:02:42.110054+0000","last_became_active":"2024-09-11T11:01:13.422439+0000","last_became_peered":"2024-09-11T11:01:13.422439+0000","last_unstale":"2024-09-11T11:02:42.110054+0000","last_undegraded":"2024-09-11T11:02:42.110054+0000","last_fullsized":"2024-09-11T11:02:42.110054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:51.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113671+0000","last_change":"2024-09-11T11:01:05.343880+0000","last_active":"2024-09-11T11:02:42.113671+0000","last_peered":"2024-09-11T11:02:42.113671+0000","last_clean":"2024-09-11T11:02:42.113671+0000","last_became_active":"2024-09-11T11:01:05.343489+0000","last_became_peered":"2024-09-11T11:01:05.343489+0000","last_unstale":"2024-09-11T11:02:42.113671+0000","last_undegraded":"2024-09-11T11:02:42.113671+0000","last_fullsized":"2024-09-11T11:02:42.113671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:27:12.077223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121664+0000","last_change":"2024-09-11T11:01:03.338861+0000","last_active":"2024-09-11T11:02:42.121664+0000","last_peered":"2024-09-11T11:02:42.121664+0000","last_clean":"2024-09-11T11:02:42.121664+0000","last_became_active":"2024-09-11T11:01:03.337993+0000","last_became_peered":"2024-09-11T11:01:03.337993+0000","last_unstale":"2024-09-11T11:02:42.121664+0000","last_undegraded":"2024-09-11T11:02:42.121664+0000","last_fullsized":"2024-09-11T11:02:42.121664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:02.814616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116892+0000","last_change":"2024-09-11T11:01:07.364400+0000","last_active":"2024-09-11T11:02:42.116892+0000","last_peered":"2024-09-11T11:02:42.116892+0000","last_clean":"2024-09-11T11:02:42.116892+0000","last_became_active":"2024-09-11T11:01:07.363656+0000","last_became_peered":"2024-09-11T11:01:07.363656+0000","last_unstale":"2024-09-11T11:02:42.116892+0000","last_undegraded":"2024-09-11T11:02:42.116892+0000","last_fullsized":"2024-09-11T11:02:42.116892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:51.467819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.772825+0000","last_change":"2024-09-11T11:01:09.365976+0000","last_active":"2024-09-11T11:03:12.772825+0000","last_peered":"2024-09-11T11:03:12.772825+0000","last_clean":"2024-09-11T11:03:12.772825+0000","last_became_active":"2024-09-11T11:01:09.365291+0000","last_became_peered":"2024-09-11T11:01:09.365291+0000","last_unstale":"2024-09-11T11:03:12.772825+0000","last_undegraded":"2024-09-11T11:03:12.772825+0000","last_fullsized":"2024-09-11T11:03:12.772825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:26.467645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'282","reported_seq":386,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597318+0000","last_change":"2024-09-11T11:01:11.385545+0000","last_active":"2024-09-11T11:04:17.597318+0000","last_peered":"2024-09-11T11:04:17.597318+0000","last_clean":"2024-09-11T11:04:17.597318+0000","last_became_active":"2024-09-11T11:01:11.384635+0000","last_became_peered":"2024-09-11T11:01:11.384635+0000","last_unstale":"2024-09-11T11:04:17.597318+0000","last_undegraded":"2024-09-11T11:04:17.597318+0000","last_fullsized":"2024-09-11T11:04:17.597318+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:41.366917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498281+0000","last_change":"2024-09-11T11:01:13.420839+0000","last_active":"2024-09-11T11:02:42.498281+0000","last_peered":"2024-09-11T11:02:42.498281+0000","last_clean":"2024-09-11T11:02:42.498281+0000","last_became_active":"2024-09-11T11:01:13.413465+0000","last_became_peered":"2024-09-11T11:01:13.413465+0000","last_unstale":"2024-09-11T11:02:42.498281+0000","last_undegraded":"2024-09-11T11:02:42.498281+0000","last_fullsized":"2024-09-11T11:02:42.498281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:12.707001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'18","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770490+0000","last_change":"2024-09-11T11:01:05.347779+0000","last_active":"2024-09-11T11:04:17.770490+0000","last_peered":"2024-09-11T11:04:17.770490+0000","last_clean":"2024-09-11T11:04:17.770490+0000","last_became_active":"2024-09-11T11:01:05.347434+0000","last_became_peered":"2024-09-11T11:01:05.347434+0000","last_unstale":"2024-09-11T11:04:17.770490+0000","last_undegraded":"2024-09-11T11:04:17.770490+0000","last_fullsized":"2024-09-11T11:04:17.770490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:14.471785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.216896+0000","last_change":"2024-09-11T11:01:03.322006+0000","last_active":"2024-09-11T11:04:17.216896+0000","last_peered":"2024-09-11T11:04:17.216896+0000","last_clean":"2024-09-11T11:04:17.216896+0000","last_became_active":"2024-09-11T11:01:03.320684+0000","last_became_peered":"2024-09-11T11:01:03.320684+0000","last_unstale":"2024-09-11T11:04:17.216896+0000","last_undegraded":"2024-09-11T11:04:17.216896+0000","last_fullsized":"2024-09-11T11:04:17.216896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:11.801971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127569+0000","last_change":"2024-09-11T11:01:07.343287+0000","last_active":"2024-09-11T11:02:42.127569+0000","last_peered":"2024-09-11T11:02:42.127569+0000","last_clean":"2024-09-11T11:02:42.127569+0000","last_became_active":"2024-09-11T11:01:07.342607+0000","last_became_peered":"2024-09-11T11:01:07.342607+0000","last_unstale":"2024-09-11T11:02:42.127569+0000","last_undegraded":"2024-09-11T11:02:42.127569+0000","last_fullsized":"2024-09-11T11:02:42.127569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:33:47.987384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'30","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.883742+0000","last_change":"2024-09-11T11:01:09.367726+0000","last_active":"2024-09-11T11:03:14.883742+0000","last_peered":"2024-09-11T11:03:14.883742+0000","last_clean":"2024-09-11T11:03:14.883742+0000","last_became_active":"2024-09-11T11:01:09.366811+0000","last_became_peered":"2024-09-11T11:01:09.366811+0000","last_unstale":"2024-09-11T11:03:14.883742+0000","last_undegraded":"2024-09-11T11:03:14.883742+0000","last_fullsized":"2024-09-11T11:03:14.883742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:56:57.446929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.928557+0000","last_change":"2024-09-11T11:01:11.399976+0000","last_active":"2024-09-11T11:04:17.928557+0000","last_peered":"2024-09-11T11:04:17.928557+0000","last_clean":"2024-09-11T11:04:17.928557+0000","last_became_active":"2024-09-11T11:01:11.399213+0000","last_became_peered":"2024-09-11T11:01:11.399213+0000","last_unstale":"2024-09-11T11:04:17.928557+0000","last_undegraded":"2024-09-11T11:04:17.928557+0000","last_fullsized":"2024-09-11T11:04:17.928557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:38.273109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573835+0000","last_change":"2024-09-11T11:01:05.330488+0000","last_active":"2024-09-11T11:04:17.573835+0000","last_peered":"2024-09-11T11:04:17.573835+0000","last_clean":"2024-09-11T11:04:17.573835+0000","last_became_active":"2024-09-11T11:01:05.330091+0000","last_became_peered":"2024-09-11T11:01:05.330091+0000","last_unstale":"2024-09-11T11:04:17.573835+0000","last_undegraded":"2024-09-11T11:04:17.573835+0000","last_fullsized":"2024-09-11T11:04:17.573835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:03.072232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127186+0000","last_change":"2024-09-11T11:01:03.338267+0000","last_active":"2024-09-11T11:02:42.127186+0000","last_peered":"2024-09-11T11:02:42.127186+0000","last_clean":"2024-09-11T11:02:42.127186+0000","last_became_active":"2024-09-11T11:01:03.337496+0000","last_became_peered":"2024-09-11T11:01:03.337496+0000","last_unstale":"2024-09-11T11:02:42.127186+0000","last_undegraded":"2024-09-11T11:02:42.127186+0000","last_fullsized":"2024-09-11T11:02:42.127186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:32:02.436613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843554+0000","last_change":"2024-09-11T11:01:07.366981+0000","last_active":"2024-09-11T11:02:42.843554+0000","last_peered":"2024-09-11T11:02:42.843554+0000","last_clean":"2024-09-11T11:02:42.843554+0000","last_became_active":"2024-09-11T11:01:07.366115+0000","last_became_peered":"2024-09-11T11:01:07.366115+0000","last_unstale":"2024-09-11T11:02:42.843554+0000","last_undegraded":"2024-09-11T11:02:42.843554+0000","last_fullsized":"2024-09-11T11:02:42.843554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:28:41.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'40","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.901157+0000","last_change":"2024-09-11T11:01:09.377146+0000","last_active":"2024-09-11T11:03:14.901157+0000","last_peered":"2024-09-11T11:03:14.901157+0000","last_clean":"2024-09-11T11:03:14.901157+0000","last_became_active":"2024-09-11T11:01:09.376242+0000","last_became_peered":"2024-09-11T11:01:09.376242+0000","last_unstale":"2024-09-11T11:03:14.901157+0000","last_undegraded":"2024-09-11T11:03:14.901157+0000","last_fullsized":"2024-09-11T11:03:14.901157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:27.367457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842086+0000","last_change":"2024-09-11T11:01:11.378387+0000","last_active":"2024-09-11T11:02:42.842086+0000","last_peered":"2024-09-11T11:02:42.842086+0000","last_clean":"2024-09-11T11:02:42.842086+0000","last_became_active":"2024-09-11T11:01:11.377655+0000","last_became_peered":"2024-09-11T11:01:11.377655+0000","last_unstale":"2024-09-11T11:02:42.842086+0000","last_undegraded":"2024-09-11T11:02:42.842086+0000","last_fullsized":"2024-09-11T11:02:42.842086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:45.529658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499873+0000","last_change":"2024-09-11T11:01:13.421261+0000","last_active":"2024-09-11T11:02:42.499873+0000","last_peered":"2024-09-11T11:02:42.499873+0000","last_clean":"2024-09-11T11:02:42.499873+0000","last_became_active":"2024-09-11T11:01:13.420299+0000","last_became_peered":"2024-09-11T11:01:13.420299+0000","last_unstale":"2024-09-11T11:02:42.499873+0000","last_undegraded":"2024-09-11T11:02:42.499873+0000","last_fullsized":"2024-09-11T11:02:42.499873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:06:26.945332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842409+0000","last_change":"2024-09-11T11:01:05.355473+0000","last_active":"2024-09-11T11:02:42.842409+0000","last_peered":"2024-09-11T11:02:42.842409+0000","last_clean":"2024-09-11T11:02:42.842409+0000","last_became_active":"2024-09-11T11:01:05.355135+0000","last_became_peered":"2024-09-11T11:01:05.355135+0000","last_unstale":"2024-09-11T11:02:42.842409+0000","last_undegraded":"2024-09-11T11:02:42.842409+0000","last_fullsized":"2024-09-11T11:02:42.842409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:47.491766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126834+0000","last_change":"2024-09-11T11:01:03.322857+0000","last_active":"2024-09-11T11:02:42.126834+0000","last_peered":"2024-09-11T11:02:42.126834+0000","last_clean":"2024-09-11T11:02:42.126834+0000","last_became_active":"2024-09-11T11:01:03.320605+0000","last_became_peered":"2024-09-11T11:01:03.320605+0000","last_unstale":"2024-09-11T11:02:42.126834+0000","last_undegraded":"2024-09-11T11:02:42.126834+0000","last_fullsized":"2024-09-11T11:02:42.126834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:02.081735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497680+0000","last_change":"2024-09-11T11:01:07.349262+0000","last_active":"2024-09-11T11:02:42.497680+0000","last_peered":"2024-09-11T11:02:42.497680+0000","last_clean":"2024-09-11T11:02:42.497680+0000","last_became_active":"2024-09-11T11:01:07.348627+0000","last_became_peered":"2024-09-11T11:01:07.348627+0000","last_unstale":"2024-09-11T11:02:42.497680+0000","last_undegraded":"2024-09-11T11:02:42.497680+0000","last_fullsized":"2024-09-11T11:02:42.497680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:14:29.786650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.841432+0000","last_change":"2024-09-11T11:01:09.385906+0000","last_active":"2024-09-11T11:03:16.841432+0000","last_peered":"2024-09-11T11:03:16.841432+0000","last_clean":"2024-09-11T11:03:16.841432+0000","last_became_active":"2024-09-11T11:01:09.384478+0000","last_became_peered":"2024-09-11T11:01:09.384478+0000","last_unstale":"2024-09-11T11:03:16.841432+0000","last_undegraded":"2024-09-11T11:03:16.841432+0000","last_fullsized":"2024-09-11T11:03:16.841432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:10.751059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112388+0000","last_change":"2024-09-11T11:01:11.402062+0000","last_active":"2024-09-11T11:02:42.112388+0000","last_peered":"2024-09-11T11:02:42.112388+0000","last_clean":"2024-09-11T11:02:42.112388+0000","last_became_active":"2024-09-11T11:01:11.401382+0000","last_became_peered":"2024-09-11T11:01:11.401382+0000","last_unstale":"2024-09-11T11:02:42.112388+0000","last_undegraded":"2024-09-11T11:02:42.112388+0000","last_fullsized":"2024-09-11T11:02:42.112388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:09.834093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844778+0000","last_change":"2024-09-11T11:01:13.419597+0000","last_active":"2024-09-11T11:02:42.844778+0000","last_peered":"2024-09-11T11:02:42.844778+0000","last_clean":"2024-09-11T11:02:42.844778+0000","last_became_active":"2024-09-11T11:01:13.415041+0000","last_became_peered":"2024-09-11T11:01:13.415041+0000","last_unstale":"2024-09-11T11:02:42.844778+0000","last_undegraded":"2024-09-11T11:02:42.844778+0000","last_fullsized":"2024-09-11T11:02:42.844778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:25.378088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'8","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921023+0000","last_change":"2024-09-11T11:01:05.347855+0000","last_active":"2024-09-11T11:04:17.921023+0000","last_peered":"2024-09-11T11:04:17.921023+0000","last_clean":"2024-09-11T11:04:17.921023+0000","last_became_active":"2024-09-11T11:01:05.347137+0000","last_became_peered":"2024-09-11T11:01:05.347137+0000","last_unstale":"2024-09-11T11:04:17.921023+0000","last_undegraded":"2024-09-11T11:04:17.921023+0000","last_fullsized":"2024-09-11T11:04:17.921023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:31:24.806914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127018+0000","last_change":"2024-09-11T11:01:42.098396+0000","last_active":"2024-09-11T11:02:42.127018+0000","last_peered":"2024-09-11T11:02:42.127018+0000","last_clean":"2024-09-11T11:02:42.127018+0000","last_became_active":"2024-09-11T11:01:42.065732+0000","last_became_peered":"2024-09-11T11:01:42.065732+0000","last_unstale":"2024-09-11T11:02:42.127018+0000","last_undegraded":"2024-09-11T11:02:42.127018+0000","last_fullsized":"2024-09-11T11:02:42.127018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:11:20.458955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498082+0000","last_change":"2024-09-11T11:01:42.064065+0000","last_active":"2024-09-11T11:02:42.498082+0000","last_peered":"2024-09-11T11:02:42.498082+0000","last_clean":"2024-09-11T11:02:42.498082+0000","last_became_active":"2024-09-11T11:01:42.062781+0000","last_became_peered":"2024-09-11T11:01:42.062781+0000","last_unstale":"2024-09-11T11:02:42.498082+0000","last_undegraded":"2024-09-11T11:02:42.498082+0000","last_fullsized":"2024-09-11T11:02:42.498082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:38:04.790112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.904313+0000","last_change":"2024-09-11T11:01:09.362905+0000","last_active":"2024-09-11T11:03:14.904313+0000","last_peered":"2024-09-11T11:03:14.904313+0000","last_clean":"2024-09-11T11:03:14.904313+0000","last_became_active":"2024-09-11T11:01:09.362260+0000","last_became_peered":"2024-09-11T11:01:09.362260+0000","last_unstale":"2024-09-11T11:03:14.904313+0000","last_undegraded":"2024-09-11T11:03:14.904313+0000","last_fullsized":"2024-09-11T11:03:14.904313+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:49:20.880526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":380,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.121670+0000","last_change":"2024-09-11T11:01:11.392542+0000","last_active":"2024-09-11T11:04:18.121670+0000","last_peered":"2024-09-11T11:04:18.121670+0000","last_clean":"2024-09-11T11:04:18.121670+0000","last_became_active":"2024-09-11T11:01:11.391826+0000","last_became_peered":"2024-09-11T11:01:11.391826+0000","last_unstale":"2024-09-11T11:04:18.121670+0000","last_undegraded":"2024-09-11T11:04:18.121670+0000","last_fullsized":"2024-09-11T11:04:18.121670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:38:29.310699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844769+0000","last_change":"2024-09-11T11:01:13.429296+0000","last_active":"2024-09-11T11:02:42.844769+0000","last_peered":"2024-09-11T11:02:42.844769+0000","last_clean":"2024-09-11T11:02:42.844769+0000","last_became_active":"2024-09-11T11:01:13.428914+0000","last_became_peered":"2024-09-11T11:01:13.428914+0000","last_unstale":"2024-09-11T11:02:42.844769+0000","last_undegraded":"2024-09-11T11:02:42.844769+0000","last_fullsized":"2024-09-11T11:02:42.844769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:03.330930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921462+0000","last_change":"2024-09-11T11:01:05.340468+0000","last_active":"2024-09-11T11:04:17.921462+0000","last_peered":"2024-09-11T11:04:17.921462+0000","last_clean":"2024-09-11T11:04:17.921462+0000","last_became_active":"2024-09-11T11:01:05.340069+0000","last_became_peered":"2024-09-11T11:01:05.340069+0000","last_unstale":"2024-09-11T11:04:17.921462+0000","last_undegraded":"2024-09-11T11:04:17.921462+0000","last_fullsized":"2024-09-11T11:04:17.921462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:10.394106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.390386+0000","last_change":"2024-09-11T11:01:03.334480+0000","last_active":"2024-09-11T11:04:17.390386+0000","last_peered":"2024-09-11T11:04:17.390386+0000","last_clean":"2024-09-11T11:04:17.390386+0000","last_became_active":"2024-09-11T11:01:03.333740+0000","last_became_peered":"2024-09-11T11:01:03.333740+0000","last_unstale":"2024-09-11T11:04:17.390386+0000","last_undegraded":"2024-09-11T11:04:17.390386+0000","last_fullsized":"2024-09-11T11:04:17.390386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:50:26.785068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498170+0000","last_change":"2024-09-11T11:01:07.355314+0000","last_active":"2024-09-11T11:02:42.498170+0000","last_peered":"2024-09-11T11:02:42.498170+0000","last_clean":"2024-09-11T11:02:42.498170+0000","last_became_active":"2024-09-11T11:01:07.354827+0000","last_became_peered":"2024-09-11T11:01:07.354827+0000","last_unstale":"2024-09-11T11:02:42.498170+0000","last_undegraded":"2024-09-11T11:02:42.498170+0000","last_fullsized":"2024-09-11T11:02:42.498170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:19:54.907620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'54","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.906396+0000","last_change":"2024-09-11T11:01:09.378757+0000","last_active":"2024-09-11T11:03:14.906396+0000","last_peered":"2024-09-11T11:03:14.906396+0000","last_clean":"2024-09-11T11:03:14.906396+0000","last_became_active":"2024-09-11T11:01:09.374320+0000","last_became_peered":"2024-09-11T11:01:09.374320+0000","last_unstale":"2024-09-11T11:03:14.906396+0000","last_undegraded":"2024-09-11T11:03:14.906396+0000","last_fullsized":"2024-09-11T11:03:14.906396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:24:56.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497933+0000","last_change":"2024-09-11T11:01:11.399906+0000","last_active":"2024-09-11T11:02:42.497933+0000","last_peered":"2024-09-11T11:02:42.497933+0000","last_clean":"2024-09-11T11:02:42.497933+0000","last_became_active":"2024-09-11T11:01:11.399118+0000","last_became_peered":"2024-09-11T11:01:11.399118+0000","last_unstale":"2024-09-11T11:02:42.497933+0000","last_undegraded":"2024-09-11T11:02:42.497933+0000","last_fullsized":"2024-09-11T11:02:42.497933+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:55:10.905238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.082661+0000","last_change":"2024-09-11T11:01:13.419418+0000","last_active":"2024-09-11T11:04:18.082661+0000","last_peered":"2024-09-11T11:04:18.082661+0000","last_clean":"2024-09-11T11:04:18.082661+0000","last_became_active":"2024-09-11T11:01:13.415242+0000","last_became_peered":"2024-09-11T11:01:13.415242+0000","last_unstale":"2024-09-11T11:04:18.082661+0000","last_undegraded":"2024-09-11T11:04:18.082661+0000","last_fullsized":"2024-09-11T11:04:18.082661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:11.846013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845729+0000","last_change":"2024-09-11T11:01:05.348021+0000","last_active":"2024-09-11T11:02:42.845729+0000","last_peered":"2024-09-11T11:02:42.845729+0000","last_clean":"2024-09-11T11:02:42.845729+0000","last_became_active":"2024-09-11T11:01:05.347367+0000","last_became_peered":"2024-09-11T11:01:05.347367+0000","last_unstale":"2024-09-11T11:02:42.845729+0000","last_undegraded":"2024-09-11T11:02:42.845729+0000","last_fullsized":"2024-09-11T11:02:42.845729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:39:58.017666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113078+0000","last_change":"2024-09-11T11:01:03.349349+0000","last_active":"2024-09-11T11:02:42.113078+0000","last_peered":"2024-09-11T11:02:42.113078+0000","last_clean":"2024-09-11T11:02:42.113078+0000","last_became_active":"2024-09-11T11:01:03.349051+0000","last_became_peered":"2024-09-11T11:01:03.349051+0000","last_unstale":"2024-09-11T11:02:42.113078+0000","last_undegraded":"2024-09-11T11:02:42.113078+0000","last_fullsized":"2024-09-11T11:02:42.113078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:55.170368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499811+0000","last_change":"2024-09-11T11:01:07.345118+0000","last_active":"2024-09-11T11:02:42.499811+0000","last_peered":"2024-09-11T11:02:42.499811+0000","last_clean":"2024-09-11T11:02:42.499811+0000","last_became_active":"2024-09-11T11:01:07.344509+0000","last_became_peered":"2024-09-11T11:01:07.344509+0000","last_unstale":"2024-09-11T11:02:42.499811+0000","last_undegraded":"2024-09-11T11:02:42.499811+0000","last_fullsized":"2024-09-11T11:02:42.499811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:59:57.440549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'32","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.872442+0000","last_change":"2024-09-11T11:01:09.377401+0000","last_active":"2024-09-11T11:03:14.872442+0000","last_peered":"2024-09-11T11:03:14.872442+0000","last_clean":"2024-09-11T11:03:14.872442+0000","last_became_active":"2024-09-11T11:01:09.376576+0000","last_became_peered":"2024-09-11T11:01:09.376576+0000","last_unstale":"2024-09-11T11:03:14.872442+0000","last_undegraded":"2024-09-11T11:03:14.872442+0000","last_fullsized":"2024-09-11T11:03:14.872442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:35.979322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114062+0000","last_change":"2024-09-11T11:01:11.394988+0000","last_active":"2024-09-11T11:02:42.114062+0000","last_peered":"2024-09-11T11:02:42.114062+0000","last_clean":"2024-09-11T11:02:42.114062+0000","last_became_active":"2024-09-11T11:01:11.394215+0000","last_became_peered":"2024-09-11T11:01:11.394215+0000","last_unstale":"2024-09-11T11:02:42.114062+0000","last_undegraded":"2024-09-11T11:02:42.114062+0000","last_fullsized":"2024-09-11T11:02:42.114062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:01.319010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.482720+0000","last_change":"2024-09-11T11:01:13.391142+0000","last_active":"2024-09-11T11:03:14.482720+0000","last_peered":"2024-09-11T11:03:14.482720+0000","last_clean":"2024-09-11T11:03:14.482720+0000","last_became_active":"2024-09-11T11:01:13.390538+0000","last_became_peered":"2024-09-11T11:01:13.390538+0000","last_unstale":"2024-09-11T11:03:14.482720+0000","last_undegraded":"2024-09-11T11:03:14.482720+0000","last_fullsized":"2024-09-11T11:03:14.482720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:22.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836912+0000","last_change":"2024-09-11T11:01:05.332887+0000","last_active":"2024-09-11T11:03:16.836912+0000","last_peered":"2024-09-11T11:03:16.836912+0000","last_clean":"2024-09-11T11:03:16.836912+0000","last_became_active":"2024-09-11T11:01:05.332138+0000","last_became_peered":"2024-09-11T11:01:05.332138+0000","last_unstale":"2024-09-11T11:03:16.836912+0000","last_undegraded":"2024-09-11T11:03:16.836912+0000","last_fullsized":"2024-09-11T11:03:16.836912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:58.679274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123858+0000","last_change":"2024-09-11T11:01:03.321735+0000","last_active":"2024-09-11T11:02:42.123858+0000","last_peered":"2024-09-11T11:02:42.123858+0000","last_clean":"2024-09-11T11:02:42.123858+0000","last_became_active":"2024-09-11T11:01:03.320906+0000","last_became_peered":"2024-09-11T11:01:03.320906+0000","last_unstale":"2024-09-11T11:02:42.123858+0000","last_undegraded":"2024-09-11T11:02:42.123858+0000","last_fullsized":"2024-09-11T11:02:42.123858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:36.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843009+0000","last_change":"2024-09-11T11:01:07.367900+0000","last_active":"2024-09-11T11:02:42.843009+0000","last_peered":"2024-09-11T11:02:42.843009+0000","last_clean":"2024-09-11T11:02:42.843009+0000","last_became_active":"2024-09-11T11:01:07.367554+0000","last_became_peered":"2024-09-11T11:01:07.367554+0000","last_unstale":"2024-09-11T11:02:42.843009+0000","last_undegraded":"2024-09-11T11:02:42.843009+0000","last_fullsized":"2024-09-11T11:02:42.843009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:52.335084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'38","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.916885+0000","last_change":"2024-09-11T11:01:09.367972+0000","last_active":"2024-09-11T11:03:14.916885+0000","last_peered":"2024-09-11T11:03:14.916885+0000","last_clean":"2024-09-11T11:03:14.916885+0000","last_became_active":"2024-09-11T11:01:09.367246+0000","last_became_peered":"2024-09-11T11:01:09.367246+0000","last_unstale":"2024-09-11T11:03:14.916885+0000","last_undegraded":"2024-09-11T11:03:14.916885+0000","last_fullsized":"2024-09-11T11:03:14.916885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:32.334281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":414,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.093944+0000","last_change":"2024-09-11T11:01:11.393113+0000","last_active":"2024-09-11T11:04:18.093944+0000","last_peered":"2024-09-11T11:04:18.093944+0000","last_clean":"2024-09-11T11:04:18.093944+0000","last_became_active":"2024-09-11T11:01:11.392359+0000","last_became_peered":"2024-09-11T11:01:11.392359+0000","last_unstale":"2024-09-11T11:04:18.093944+0000","last_undegraded":"2024-09-11T11:04:18.093944+0000","last_fullsized":"2024-09-11T11:04:18.093944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:39.923836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'16","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.875398+0000","last_change":"2024-09-11T11:01:13.418955+0000","last_active":"2024-09-11T11:04:17.875398+0000","last_peered":"2024-09-11T11:04:17.875398+0000","last_clean":"2024-09-11T11:04:17.875398+0000","last_became_active":"2024-09-11T11:01:13.415115+0000","last_became_peered":"2024-09-11T11:01:13.415115+0000","last_unstale":"2024-09-11T11:04:17.875398+0000","last_undegraded":"2024-09-11T11:04:17.875398+0000","last_fullsized":"2024-09-11T11:04:17.875398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:40.005800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770486+0000","last_change":"2024-09-11T11:01:05.337583+0000","last_active":"2024-09-11T11:04:17.770486+0000","last_peered":"2024-09-11T11:04:17.770486+0000","last_clean":"2024-09-11T11:04:17.770486+0000","last_became_active":"2024-09-11T11:01:05.337055+0000","last_became_peered":"2024-09-11T11:01:05.337055+0000","last_unstale":"2024-09-11T11:04:17.770486+0000","last_undegraded":"2024-09-11T11:04:17.770486+0000","last_fullsized":"2024-09-11T11:04:17.770486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:52.604892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.743722+0000","last_change":"2024-09-11T11:01:03.336594+0000","last_active":"2024-09-11T11:04:17.743722+0000","last_peered":"2024-09-11T11:04:17.743722+0000","last_clean":"2024-09-11T11:04:17.743722+0000","last_became_active":"2024-09-11T11:01:03.334392+0000","last_became_peered":"2024-09-11T11:01:03.334392+0000","last_unstale":"2024-09-11T11:04:17.743722+0000","last_undegraded":"2024-09-11T11:04:17.743722+0000","last_fullsized":"2024-09-11T11:04:17.743722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:14.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":417,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.333038+0000","last_change":"2024-09-11T11:01:07.360933+0000","last_active":"2024-09-11T11:03:16.333038+0000","last_peered":"2024-09-11T11:03:16.333038+0000","last_clean":"2024-09-11T11:03:16.333038+0000","last_became_active":"2024-09-11T11:01:07.360348+0000","last_became_peered":"2024-09-11T11:01:07.360348+0000","last_unstale":"2024-09-11T11:03:16.333038+0000","last_undegraded":"2024-09-11T11:03:16.333038+0000","last_fullsized":"2024-09-11T11:03:16.333038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:05.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.519176+0000","last_change":"2024-09-11T11:02:42.518145+0000","last_active":"2024-09-11T11:02:42.519176+0000","last_peered":"2024-09-11T11:02:42.519176+0000","last_clean":"2024-09-11T11:02:42.519176+0000","last_became_active":"2024-09-11T11:02:42.501712+0000","last_became_peered":"2024-09-11T11:02:42.501712+0000","last_unstale":"2024-09-11T11:02:42.519176+0000","last_undegraded":"2024-09-11T11:02:42.519176+0000","last_fullsized":"2024-09-11T11:02:42.519176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:53.342864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'282","reported_seq":504,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.034092+0000","last_change":"2024-09-11T11:01:11.386158+0000","last_active":"2024-09-11T11:04:18.034092+0000","last_peered":"2024-09-11T11:04:18.034092+0000","last_clean":"2024-09-11T11:04:18.034092+0000","last_became_active":"2024-09-11T11:01:11.384776+0000","last_became_peered":"2024-09-11T11:01:11.384776+0000","last_unstale":"2024-09-11T11:04:18.034092+0000","last_undegraded":"2024-09-11T11:04:18.034092+0000","last_fullsized":"2024-09-11T11:04:18.034092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:00.643395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.829302+0000","last_change":"2024-09-11T11:01:13.419039+0000","last_active":"2024-09-11T11:03:16.829302+0000","last_peered":"2024-09-11T11:03:16.829302+0000","last_clean":"2024-09-11T11:03:16.829302+0000","last_became_active":"2024-09-11T11:01:13.418296+0000","last_became_peered":"2024-09-11T11:01:13.418296+0000","last_unstale":"2024-09-11T11:03:16.829302+0000","last_undegraded":"2024-09-11T11:03:16.829302+0000","last_fullsized":"2024-09-11T11:03:16.829302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:38:59.936533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.920553+0000","last_change":"2024-09-11T11:01:05.348048+0000","last_active":"2024-09-11T11:04:17.920553+0000","last_peered":"2024-09-11T11:04:17.920553+0000","last_clean":"2024-09-11T11:04:17.920553+0000","last_became_active":"2024-09-11T11:01:05.347644+0000","last_became_peered":"2024-09-11T11:01:05.347644+0000","last_unstale":"2024-09-11T11:04:17.920553+0000","last_undegraded":"2024-09-11T11:04:17.920553+0000","last_fullsized":"2024-09-11T11:04:17.920553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:28.667270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109195+0000","last_change":"2024-09-11T11:01:03.349954+0000","last_active":"2024-09-11T11:02:42.109195+0000","last_peered":"2024-09-11T11:02:42.109195+0000","last_clean":"2024-09-11T11:02:42.109195+0000","last_became_active":"2024-09-11T11:01:03.349605+0000","last_became_peered":"2024-09-11T11:01:03.349605+0000","last_unstale":"2024-09-11T11:02:42.109195+0000","last_undegraded":"2024-09-11T11:02:42.109195+0000","last_fullsized":"2024-09-11T11:02:42.109195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:42.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113995+0000","last_change":"2024-09-11T11:01:07.355413+0000","last_active":"2024-09-11T11:02:42.113995+0000","last_peered":"2024-09-11T11:02:42.113995+0000","last_clean":"2024-09-11T11:02:42.113995+0000","last_became_active":"2024-09-11T11:01:07.351403+0000","last_became_peered":"2024-09-11T11:01:07.351403+0000","last_unstale":"2024-09-11T11:02:42.113995+0000","last_undegraded":"2024-09-11T11:02:42.113995+0000","last_fullsized":"2024-09-11T11:02:42.113995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:36:28.171191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'38","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.894816+0000","last_change":"2024-09-11T11:01:09.377243+0000","last_active":"2024-09-11T11:03:14.894816+0000","last_peered":"2024-09-11T11:03:14.894816+0000","last_clean":"2024-09-11T11:03:14.894816+0000","last_became_active":"2024-09-11T11:01:09.376340+0000","last_became_peered":"2024-09-11T11:01:09.376340+0000","last_unstale":"2024-09-11T11:03:14.894816+0000","last_undegraded":"2024-09-11T11:03:14.894816+0000","last_fullsized":"2024-09-11T11:03:14.894816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:34:10.669607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126520+0000","last_change":"2024-09-11T11:01:11.386915+0000","last_active":"2024-09-11T11:02:42.126520+0000","last_peered":"2024-09-11T11:02:42.126520+0000","last_clean":"2024-09-11T11:02:42.126520+0000","last_became_active":"2024-09-11T11:01:11.385523+0000","last_became_peered":"2024-09-11T11:01:11.385523+0000","last_unstale":"2024-09-11T11:02:42.126520+0000","last_undegraded":"2024-09-11T11:02:42.126520+0000","last_fullsized":"2024-09-11T11:02:42.126520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:46:58.221514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'6","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.989822+0000","last_change":"2024-09-11T11:01:13.408216+0000","last_active":"2024-09-11T11:04:17.989822+0000","last_peered":"2024-09-11T11:04:17.989822+0000","last_clean":"2024-09-11T11:04:17.989822+0000","last_became_active":"2024-09-11T11:01:13.403125+0000","last_became_peered":"2024-09-11T11:01:13.403125+0000","last_unstale":"2024-09-11T11:04:17.989822+0000","last_undegraded":"2024-09-11T11:04:17.989822+0000","last_fullsized":"2024-09-11T11:04:17.989822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:20.557182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'22","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.856373+0000","last_change":"2024-09-11T11:01:05.346169+0000","last_active":"2024-09-11T11:04:17.856373+0000","last_peered":"2024-09-11T11:04:17.856373+0000","last_clean":"2024-09-11T11:04:17.856373+0000","last_became_active":"2024-09-11T11:01:05.345474+0000","last_became_peered":"2024-09-11T11:01:05.345474+0000","last_unstale":"2024-09-11T11:04:17.856373+0000","last_undegraded":"2024-09-11T11:04:17.856373+0000","last_fullsized":"2024-09-11T11:04:17.856373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:50.321614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":206,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.841643+0000","last_change":"2024-09-11T11:00:51.371382+0000","last_active":"2024-09-11T11:02:42.841643+0000","last_peered":"2024-09-11T11:02:42.841643+0000","last_clean":"2024-09-11T11:02:42.841643+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:02:42.841643+0000","last_undegraded":"2024-09-11T11:02:42.841643+0000","last_fullsized":"2024-09-11T11:02:42.841643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_clean_scrub_stamp":"2024-09-11T11:00:49.442581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:56.798705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124201+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:02:42.124201+0000","last_peered":"2024-09-11T11:02:42.124201+0000","last_clean":"2024-09-11T11:02:42.124201+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:02:42.124201+0000","last_undegraded":"2024-09-11T11:02:42.124201+0000","last_fullsized":"2024-09-11T11:02:42.124201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:29.398076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110553+0000","last_change":"2024-09-11T11:01:03.345152+0000","last_active":"2024-09-11T11:02:42.110553+0000","last_peered":"2024-09-11T11:02:42.110553+0000","last_clean":"2024-09-11T11:02:42.110553+0000","last_became_active":"2024-09-11T11:01:03.334611+0000","last_became_peered":"2024-09-11T11:01:03.334611+0000","last_unstale":"2024-09-11T11:02:42.110553+0000","last_undegraded":"2024-09-11T11:02:42.110553+0000","last_fullsized":"2024-09-11T11:02:42.110553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:26:54.046187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843252+0000","last_change":"2024-09-11T11:01:07.352085+0000","last_active":"2024-09-11T11:02:42.843252+0000","last_peered":"2024-09-11T11:02:42.843252+0000","last_clean":"2024-09-11T11:02:42.843252+0000","last_became_active":"2024-09-11T11:01:07.348530+0000","last_became_peered":"2024-09-11T11:01:07.348530+0000","last_unstale":"2024-09-11T11:02:42.843252+0000","last_undegraded":"2024-09-11T11:02:42.843252+0000","last_fullsized":"2024-09-11T11:02:42.843252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:05.458479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'76","reported_seq":149,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.915190+0000","last_change":"2024-09-11T11:01:09.370703+0000","last_active":"2024-09-11T11:03:14.915190+0000","last_peered":"2024-09-11T11:03:14.915190+0000","last_clean":"2024-09-11T11:03:14.915190+0000","last_became_active":"2024-09-11T11:01:09.369066+0000","last_became_peered":"2024-09-11T11:01:09.369066+0000","last_unstale":"2024-09-11T11:03:14.915190+0000","last_undegraded":"2024-09-11T11:03:14.915190+0000","last_fullsized":"2024-09-11T11:03:14.915190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:36.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113047+0000","last_change":"2024-09-11T11:01:11.396326+0000","last_active":"2024-09-11T11:02:42.113047+0000","last_peered":"2024-09-11T11:02:42.113047+0000","last_clean":"2024-09-11T11:02:42.113047+0000","last_became_active":"2024-09-11T11:01:11.394277+0000","last_became_peered":"2024-09-11T11:01:11.394277+0000","last_unstale":"2024-09-11T11:02:42.113047+0000","last_undegraded":"2024-09-11T11:02:42.113047+0000","last_fullsized":"2024-09-11T11:02:42.113047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:23.366168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.947140+0000","last_change":"2024-09-11T11:01:13.413493+0000","last_active":"2024-09-11T11:04:17.947140+0000","last_peered":"2024-09-11T11:04:17.947140+0000","last_clean":"2024-09-11T11:04:17.947140+0000","last_became_active":"2024-09-11T11:01:13.412615+0000","last_became_peered":"2024-09-11T11:01:13.412615+0000","last_unstale":"2024-09-11T11:04:17.947140+0000","last_undegraded":"2024-09-11T11:04:17.947140+0000","last_fullsized":"2024-09-11T11:04:17.947140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:01.417923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.856351+0000","last_change":"2024-09-11T11:01:05.348037+0000","last_active":"2024-09-11T11:04:17.856351+0000","last_peered":"2024-09-11T11:04:17.856351+0000","last_clean":"2024-09-11T11:04:17.856351+0000","last_became_active":"2024-09-11T11:01:05.346710+0000","last_became_peered":"2024-09-11T11:01:05.346710+0000","last_unstale":"2024-09-11T11:04:17.856351+0000","last_undegraded":"2024-09-11T11:04:17.856351+0000","last_fullsized":"2024-09-11T11:04:17.856351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:08.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122859+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:02:42.122859+0000","last_peered":"2024-09-11T11:02:42.122859+0000","last_clean":"2024-09-11T11:02:42.122859+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:02:42.122859+0000","last_undegraded":"2024-09-11T11:02:42.122859+0000","last_fullsized":"2024-09-11T11:02:42.122859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:31:53.046144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844373+0000","last_change":"2024-09-11T11:01:03.326592+0000","last_active":"2024-09-11T11:02:42.844373+0000","last_peered":"2024-09-11T11:02:42.844373+0000","last_clean":"2024-09-11T11:02:42.844373+0000","last_became_active":"2024-09-11T11:01:03.325795+0000","last_became_peered":"2024-09-11T11:01:03.325795+0000","last_unstale":"2024-09-11T11:02:42.844373+0000","last_undegraded":"2024-09-11T11:02:42.844373+0000","last_fullsized":"2024-09-11T11:02:42.844373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:12:21.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129384+0000","last_change":"2024-09-11T11:01:07.361191+0000","last_active":"2024-09-11T11:02:42.129384+0000","last_peered":"2024-09-11T11:02:42.129384+0000","last_clean":"2024-09-11T11:02:42.129384+0000","last_became_active":"2024-09-11T11:01:07.360718+0000","last_became_peered":"2024-09-11T11:01:07.360718+0000","last_unstale":"2024-09-11T11:02:42.129384+0000","last_undegraded":"2024-09-11T11:02:42.129384+0000","last_fullsized":"2024-09-11T11:02:42.129384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:36:44.262635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'273","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597426+0000","last_change":"2024-09-11T11:01:09.377670+0000","last_active":"2024-09-11T11:04:17.597426+0000","last_peered":"2024-09-11T11:04:17.597426+0000","last_clean":"2024-09-11T11:04:17.597426+0000","last_became_active":"2024-09-11T11:01:09.376555+0000","last_became_peered":"2024-09-11T11:01:09.376555+0000","last_unstale":"2024-09-11T11:04:17.597426+0000","last_undegraded":"2024-09-11T11:04:17.597426+0000","last_fullsized":"2024-09-11T11:04:17.597426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:13.150085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112535+0000","last_change":"2024-09-11T11:01:11.400937+0000","last_active":"2024-09-11T11:02:42.112535+0000","last_peered":"2024-09-11T11:02:42.112535+0000","last_clean":"2024-09-11T11:02:42.112535+0000","last_became_active":"2024-09-11T11:01:11.400253+0000","last_became_peered":"2024-09-11T11:01:11.400253+0000","last_unstale":"2024-09-11T11:02:42.112535+0000","last_undegraded":"2024-09-11T11:02:42.112535+0000","last_fullsized":"2024-09-11T11:02:42.112535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:56.090713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'11","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843512+0000","last_change":"2024-09-11T11:01:13.422211+0000","last_active":"2024-09-11T11:02:42.843512+0000","last_peered":"2024-09-11T11:02:42.843512+0000","last_clean":"2024-09-11T11:02:42.843512+0000","last_became_active":"2024-09-11T11:01:13.421491+0000","last_became_peered":"2024-09-11T11:01:13.421491+0000","last_unstale":"2024-09-11T11:02:42.843512+0000","last_undegraded":"2024-09-11T11:02:42.843512+0000","last_fullsized":"2024-09-11T11:02:42.843512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:09:11.421051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.442243+0000","last_change":"2024-09-11T11:01:05.347801+0000","last_active":"2024-09-11T11:04:17.442243+0000","last_peered":"2024-09-11T11:04:17.442243+0000","last_clean":"2024-09-11T11:04:17.442243+0000","last_became_active":"2024-09-11T11:01:05.347359+0000","last_became_peered":"2024-09-11T11:01:05.347359+0000","last_unstale":"2024-09-11T11:04:17.442243+0000","last_undegraded":"2024-09-11T11:04:17.442243+0000","last_fullsized":"2024-09-11T11:04:17.442243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:17:27.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.496965+0000","last_change":"2024-09-11T11:00:56.127438+0000","last_active":"2024-09-11T11:02:42.496965+0000","last_peered":"2024-09-11T11:02:42.496965+0000","last_clean":"2024-09-11T11:02:42.496965+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:02:42.496965+0000","last_undegraded":"2024-09-11T11:02:42.496965+0000","last_fullsized":"2024-09-11T11:02:42.496965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:21.503625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842035+0000","last_change":"2024-09-11T11:01:03.325786+0000","last_active":"2024-09-11T11:02:42.842035+0000","last_peered":"2024-09-11T11:02:42.842035+0000","last_clean":"2024-09-11T11:02:42.842035+0000","last_became_active":"2024-09-11T11:01:03.325168+0000","last_became_peered":"2024-09-11T11:01:03.325168+0000","last_unstale":"2024-09-11T11:02:42.842035+0000","last_undegraded":"2024-09-11T11:02:42.842035+0000","last_fullsized":"2024-09-11T11:02:42.842035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:26.401311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":223,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.332529+0000","last_change":"2024-09-11T11:01:07.348097+0000","last_active":"2024-09-11T11:03:16.332529+0000","last_peered":"2024-09-11T11:03:16.332529+0000","last_clean":"2024-09-11T11:03:16.332529+0000","last_became_active":"2024-09-11T11:01:07.345998+0000","last_became_peered":"2024-09-11T11:01:07.345998+0000","last_unstale":"2024-09-11T11:03:16.332529+0000","last_undegraded":"2024-09-11T11:03:16.332529+0000","last_fullsized":"2024-09-11T11:03:16.332529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:01:22.783881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'17","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.944373+0000","last_change":"2024-09-11T11:01:09.372579+0000","last_active":"2024-09-11T11:04:17.944373+0000","last_peered":"2024-09-11T11:04:17.944373+0000","last_clean":"2024-09-11T11:04:17.944373+0000","last_became_active":"2024-09-11T11:01:09.371816+0000","last_became_peered":"2024-09-11T11:01:09.371816+0000","last_unstale":"2024-09-11T11:04:17.944373+0000","last_undegraded":"2024-09-11T11:04:17.944373+0000","last_fullsized":"2024-09-11T11:04:17.944373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:35.245802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843529+0000","last_change":"2024-09-11T11:01:11.392823+0000","last_active":"2024-09-11T11:02:42.843529+0000","last_peered":"2024-09-11T11:02:42.843529+0000","last_clean":"2024-09-11T11:02:42.843529+0000","last_became_active":"2024-09-11T11:01:11.392208+0000","last_became_peered":"2024-09-11T11:01:11.392208+0000","last_unstale":"2024-09-11T11:02:42.843529+0000","last_undegraded":"2024-09-11T11:02:42.843529+0000","last_fullsized":"2024-09-11T11:02:42.843529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:42:29.363507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114046+0000","last_change":"2024-09-11T11:01:13.408511+0000","last_active":"2024-09-11T11:02:42.114046+0000","last_peered":"2024-09-11T11:02:42.114046+0000","last_clean":"2024-09-11T11:02:42.114046+0000","last_became_active":"2024-09-11T11:01:13.406863+0000","last_became_peered":"2024-09-11T11:01:13.406863+0000","last_unstale":"2024-09-11T11:02:42.114046+0000","last_undegraded":"2024-09-11T11:02:42.114046+0000","last_fullsized":"2024-09-11T11:02:42.114046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:54.284696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845057+0000","last_change":"2024-09-11T11:01:05.333748+0000","last_active":"2024-09-11T11:02:42.845057+0000","last_peered":"2024-09-11T11:02:42.845057+0000","last_clean":"2024-09-11T11:02:42.845057+0000","last_became_active":"2024-09-11T11:01:05.332361+0000","last_became_peered":"2024-09-11T11:01:05.332361+0000","last_unstale":"2024-09-11T11:02:42.845057+0000","last_undegraded":"2024-09-11T11:02:42.845057+0000","last_fullsized":"2024-09-11T11:02:42.845057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:40:25.995301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123553+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:02:42.123553+0000","last_peered":"2024-09-11T11:02:42.123553+0000","last_clean":"2024-09-11T11:02:42.123553+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:02:42.123553+0000","last_undegraded":"2024-09-11T11:02:42.123553+0000","last_fullsized":"2024-09-11T11:02:42.123553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:00.420708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123842+0000","last_change":"2024-09-11T11:01:03.328169+0000","last_active":"2024-09-11T11:02:42.123842+0000","last_peered":"2024-09-11T11:02:42.123842+0000","last_clean":"2024-09-11T11:02:42.123842+0000","last_became_active":"2024-09-11T11:01:03.327456+0000","last_became_peered":"2024-09-11T11:01:03.327456+0000","last_unstale":"2024-09-11T11:02:42.123842+0000","last_undegraded":"2024-09-11T11:02:42.123842+0000","last_fullsized":"2024-09-11T11:02:42.123842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:11.883100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845875+0000","last_change":"2024-09-11T11:01:07.369393+0000","last_active":"2024-09-11T11:02:42.845875+0000","last_peered":"2024-09-11T11:02:42.845875+0000","last_clean":"2024-09-11T11:02:42.845875+0000","last_became_active":"2024-09-11T11:01:07.367962+0000","last_became_peered":"2024-09-11T11:01:07.367962+0000","last_unstale":"2024-09-11T11:02:42.845875+0000","last_undegraded":"2024-09-11T11:02:42.845875+0000","last_fullsized":"2024-09-11T11:02:42.845875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:35:29.768861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.859766+0000","last_change":"2024-09-11T11:01:09.390513+0000","last_active":"2024-09-11T11:04:16.859766+0000","last_peered":"2024-09-11T11:04:16.859766+0000","last_clean":"2024-09-11T11:04:16.859766+0000","last_became_active":"2024-09-11T11:01:09.389732+0000","last_became_peered":"2024-09-11T11:01:09.389732+0000","last_unstale":"2024-09-11T11:04:16.859766+0000","last_undegraded":"2024-09-11T11:04:16.859766+0000","last_fullsized":"2024-09-11T11:04:16.859766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:21.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116921+0000","last_change":"2024-09-11T11:01:11.398218+0000","last_active":"2024-09-11T11:02:42.116921+0000","last_peered":"2024-09-11T11:02:42.116921+0000","last_clean":"2024-09-11T11:02:42.116921+0000","last_became_active":"2024-09-11T11:01:11.397467+0000","last_became_peered":"2024-09-11T11:01:11.397467+0000","last_unstale":"2024-09-11T11:02:42.116921+0000","last_undegraded":"2024-09-11T11:02:42.116921+0000","last_fullsized":"2024-09-11T11:02:42.116921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:09:09.409131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.026023+0000","last_change":"2024-09-11T11:01:13.418703+0000","last_active":"2024-09-11T11:04:18.026023+0000","last_peered":"2024-09-11T11:04:18.026023+0000","last_clean":"2024-09-11T11:04:18.026023+0000","last_became_active":"2024-09-11T11:01:13.414898+0000","last_became_peered":"2024-09-11T11:01:13.414898+0000","last_unstale":"2024-09-11T11:04:18.026023+0000","last_undegraded":"2024-09-11T11:04:18.026023+0000","last_fullsized":"2024-09-11T11:04:18.026023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:40.285029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.769897+0000","last_change":"2024-09-11T11:01:05.343143+0000","last_active":"2024-09-11T11:04:17.769897+0000","last_peered":"2024-09-11T11:04:17.769897+0000","last_clean":"2024-09-11T11:04:17.769897+0000","last_became_active":"2024-09-11T11:01:05.342651+0000","last_became_peered":"2024-09-11T11:01:05.342651+0000","last_unstale":"2024-09-11T11:04:17.769897+0000","last_undegraded":"2024-09-11T11:04:17.769897+0000","last_fullsized":"2024-09-11T11:04:17.769897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:48:14.974986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126841+0000","last_change":"2024-09-11T11:01:03.338569+0000","last_active":"2024-09-11T11:02:42.126841+0000","last_peered":"2024-09-11T11:02:42.126841+0000","last_clean":"2024-09-11T11:02:42.126841+0000","last_became_active":"2024-09-11T11:01:03.336412+0000","last_became_peered":"2024-09-11T11:01:03.336412+0000","last_unstale":"2024-09-11T11:02:42.126841+0000","last_undegraded":"2024-09-11T11:02:42.126841+0000","last_fullsized":"2024-09-11T11:02:42.126841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:54:35.346732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843492+0000","last_change":"2024-09-11T11:00:55.878837+0000","last_active":"2024-09-11T11:02:42.843492+0000","last_peered":"2024-09-11T11:02:42.843492+0000","last_clean":"2024-09-11T11:02:42.843492+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:02:42.843492+0000","last_undegraded":"2024-09-11T11:02:42.843492+0000","last_fullsized":"2024-09-11T11:02:42.843492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.033101+0000","last_change":"2024-09-11T11:01:07.359762+0000","last_active":"2024-09-11T11:03:13.033101+0000","last_peered":"2024-09-11T11:03:13.033101+0000","last_clean":"2024-09-11T11:03:13.033101+0000","last_became_active":"2024-09-11T11:01:07.359228+0000","last_became_peered":"2024-09-11T11:01:07.359228+0000","last_unstale":"2024-09-11T11:03:13.033101+0000","last_undegraded":"2024-09-11T11:03:13.033101+0000","last_fullsized":"2024-09-11T11:03:13.033101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:33:49.649502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'62","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.915603+0000","last_change":"2024-09-11T11:01:09.361376+0000","last_active":"2024-09-11T11:03:14.915603+0000","last_peered":"2024-09-11T11:03:14.915603+0000","last_clean":"2024-09-11T11:03:14.915603+0000","last_became_active":"2024-09-11T11:01:09.360676+0000","last_became_peered":"2024-09-11T11:01:09.360676+0000","last_unstale":"2024-09-11T11:03:14.915603+0000","last_undegraded":"2024-09-11T11:03:14.915603+0000","last_fullsized":"2024-09-11T11:03:14.915603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:50.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123302+0000","last_change":"2024-09-11T11:01:11.386663+0000","last_active":"2024-09-11T11:02:42.123302+0000","last_peered":"2024-09-11T11:02:42.123302+0000","last_clean":"2024-09-11T11:02:42.123302+0000","last_became_active":"2024-09-11T11:01:11.384826+0000","last_became_peered":"2024-09-11T11:01:11.384826+0000","last_unstale":"2024-09-11T11:02:42.123302+0000","last_undegraded":"2024-09-11T11:02:42.123302+0000","last_fullsized":"2024-09-11T11:02:42.123302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:19.464704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.703110+0000","last_change":"2024-09-11T11:01:13.422273+0000","last_active":"2024-09-11T11:03:16.703110+0000","last_peered":"2024-09-11T11:03:16.703110+0000","last_clean":"2024-09-11T11:03:16.703110+0000","last_became_active":"2024-09-11T11:01:13.421181+0000","last_became_peered":"2024-09-11T11:01:13.421181+0000","last_unstale":"2024-09-11T11:03:16.703110+0000","last_undegraded":"2024-09-11T11:03:16.703110+0000","last_fullsized":"2024-09-11T11:03:16.703110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:34.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855771+0000","last_change":"2024-09-11T11:01:05.354294+0000","last_active":"2024-09-11T11:04:17.855771+0000","last_peered":"2024-09-11T11:04:17.855771+0000","last_clean":"2024-09-11T11:04:17.855771+0000","last_became_active":"2024-09-11T11:01:05.353896+0000","last_became_peered":"2024-09-11T11:01:05.353896+0000","last_unstale":"2024-09-11T11:04:17.855771+0000","last_undegraded":"2024-09-11T11:04:17.855771+0000","last_fullsized":"2024-09-11T11:04:17.855771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:59.773137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843845+0000","last_change":"2024-09-11T11:01:03.325763+0000","last_active":"2024-09-11T11:02:42.843845+0000","last_peered":"2024-09-11T11:02:42.843845+0000","last_clean":"2024-09-11T11:02:42.843845+0000","last_became_active":"2024-09-11T11:01:03.324923+0000","last_became_peered":"2024-09-11T11:01:03.324923+0000","last_unstale":"2024-09-11T11:02:42.843845+0000","last_undegraded":"2024-09-11T11:02:42.843845+0000","last_fullsized":"2024-09-11T11:02:42.843845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:14.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126572+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:02:42.126572+0000","last_peered":"2024-09-11T11:02:42.126572+0000","last_clean":"2024-09-11T11:02:42.126572+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:02:42.126572+0000","last_undegraded":"2024-09-11T11:02:42.126572+0000","last_fullsized":"2024-09-11T11:02:42.126572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122843+0000","last_change":"2024-09-11T11:01:07.360915+0000","last_active":"2024-09-11T11:02:42.122843+0000","last_peered":"2024-09-11T11:02:42.122843+0000","last_clean":"2024-09-11T11:02:42.122843+0000","last_became_active":"2024-09-11T11:01:07.360208+0000","last_became_peered":"2024-09-11T11:01:07.360208+0000","last_unstale":"2024-09-11T11:02:42.122843+0000","last_undegraded":"2024-09-11T11:02:42.122843+0000","last_fullsized":"2024-09-11T11:02:42.122843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:39.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843864+0000","last_change":"2024-09-11T11:01:09.383166+0000","last_active":"2024-09-11T11:02:42.843864+0000","last_peered":"2024-09-11T11:02:42.843864+0000","last_clean":"2024-09-11T11:02:42.843864+0000","last_became_active":"2024-09-11T11:01:09.382364+0000","last_became_peered":"2024-09-11T11:01:09.382364+0000","last_unstale":"2024-09-11T11:02:42.843864+0000","last_undegraded":"2024-09-11T11:02:42.843864+0000","last_fullsized":"2024-09-11T11:02:42.843864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:41.311952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":351,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.596675+0000","last_change":"2024-09-11T11:01:11.395761+0000","last_active":"2024-09-11T11:04:17.596675+0000","last_peered":"2024-09-11T11:04:17.596675+0000","last_clean":"2024-09-11T11:04:17.596675+0000","last_became_active":"2024-09-11T11:01:11.395016+0000","last_became_peered":"2024-09-11T11:01:11.395016+0000","last_unstale":"2024-09-11T11:04:17.596675+0000","last_undegraded":"2024-09-11T11:04:17.596675+0000","last_fullsized":"2024-09-11T11:04:17.596675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:12.765617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.831484+0000","last_change":"2024-09-11T11:01:13.423655+0000","last_active":"2024-09-11T11:04:17.831484+0000","last_peered":"2024-09-11T11:04:17.831484+0000","last_clean":"2024-09-11T11:04:17.831484+0000","last_became_active":"2024-09-11T11:01:13.422825+0000","last_became_peered":"2024-09-11T11:01:13.422825+0000","last_unstale":"2024-09-11T11:04:17.831484+0000","last_undegraded":"2024-09-11T11:04:17.831484+0000","last_fullsized":"2024-09-11T11:04:17.831484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:56.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'12","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.767965+0000","last_change":"2024-09-11T11:01:42.069205+0000","last_active":"2024-09-11T11:03:12.767965+0000","last_peered":"2024-09-11T11:03:12.767965+0000","last_clean":"2024-09-11T11:03:12.767965+0000","last_became_active":"2024-09-11T11:01:42.049256+0000","last_became_peered":"2024-09-11T11:01:42.049256+0000","last_unstale":"2024-09-11T11:03:12.767965+0000","last_undegraded":"2024-09-11T11:03:12.767965+0000","last_fullsized":"2024-09-11T11:03:12.767965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:18:53.891454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.750448+0000","last_change":"2024-09-11T11:01:03.351057+0000","last_active":"2024-09-11T11:04:17.750448+0000","last_peered":"2024-09-11T11:04:17.750448+0000","last_clean":"2024-09-11T11:04:17.750448+0000","last_became_active":"2024-09-11T11:01:03.349487+0000","last_became_peered":"2024-09-11T11:01:03.349487+0000","last_unstale":"2024-09-11T11:04:17.750448+0000","last_undegraded":"2024-09-11T11:04:17.750448+0000","last_fullsized":"2024-09-11T11:04:17.750448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:03.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845075+0000","last_change":"2024-09-11T11:00:55.878899+0000","last_active":"2024-09-11T11:02:42.845075+0000","last_peered":"2024-09-11T11:02:42.845075+0000","last_clean":"2024-09-11T11:02:42.845075+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:02:42.845075+0000","last_undegraded":"2024-09-11T11:02:42.845075+0000","last_fullsized":"2024-09-11T11:02:42.845075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:24.156776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122524+0000","last_change":"2024-09-11T11:01:07.344789+0000","last_active":"2024-09-11T11:02:42.122524+0000","last_peered":"2024-09-11T11:02:42.122524+0000","last_clean":"2024-09-11T11:02:42.122524+0000","last_became_active":"2024-09-11T11:01:07.344021+0000","last_became_peered":"2024-09-11T11:01:07.344021+0000","last_unstale":"2024-09-11T11:02:42.122524+0000","last_undegraded":"2024-09-11T11:02:42.122524+0000","last_fullsized":"2024-09-11T11:02:42.122524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:48:47.594716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111150+0000","last_change":"2024-09-11T11:01:09.380595+0000","last_active":"2024-09-11T11:02:42.111150+0000","last_peered":"2024-09-11T11:02:42.111150+0000","last_clean":"2024-09-11T11:02:42.111150+0000","last_became_active":"2024-09-11T11:01:09.379372+0000","last_became_peered":"2024-09-11T11:01:09.379372+0000","last_unstale":"2024-09-11T11:02:42.111150+0000","last_undegraded":"2024-09-11T11:02:42.111150+0000","last_fullsized":"2024-09-11T11:02:42.111150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:43.515100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.084413+0000","last_change":"2024-09-11T11:01:11.404411+0000","last_active":"2024-09-11T11:04:18.084413+0000","last_peered":"2024-09-11T11:04:18.084413+0000","last_clean":"2024-09-11T11:04:18.084413+0000","last_became_active":"2024-09-11T11:01:11.403355+0000","last_became_peered":"2024-09-11T11:01:11.403355+0000","last_unstale":"2024-09-11T11:04:18.084413+0000","last_undegraded":"2024-09-11T11:04:18.084413+0000","last_fullsized":"2024-09-11T11:04:18.084413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:37.993880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843018+0000","last_change":"2024-09-11T11:01:13.420938+0000","last_active":"2024-09-11T11:02:42.843018+0000","last_peered":"2024-09-11T11:02:42.843018+0000","last_clean":"2024-09-11T11:02:42.843018+0000","last_became_active":"2024-09-11T11:01:13.415413+0000","last_became_peered":"2024-09-11T11:01:13.415413+0000","last_unstale":"2024-09-11T11:02:42.843018+0000","last_undegraded":"2024-09-11T11:02:42.843018+0000","last_fullsized":"2024-09-11T11:02:42.843018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:06:12.988613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'13","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938421+0000","last_change":"2024-09-11T11:01:05.339012+0000","last_active":"2024-09-11T11:04:17.938421+0000","last_peered":"2024-09-11T11:04:17.938421+0000","last_clean":"2024-09-11T11:04:17.938421+0000","last_became_active":"2024-09-11T11:01:05.338465+0000","last_became_peered":"2024-09-11T11:01:05.338465+0000","last_unstale":"2024-09-11T11:04:17.938421+0000","last_undegraded":"2024-09-11T11:04:17.938421+0000","last_fullsized":"2024-09-11T11:04:17.938421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:07:59.232948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.736226+0000","last_change":"2024-09-11T11:01:03.327083+0000","last_active":"2024-09-11T11:04:17.736226+0000","last_peered":"2024-09-11T11:04:17.736226+0000","last_clean":"2024-09-11T11:04:17.736226+0000","last_became_active":"2024-09-11T11:01:03.325009+0000","last_became_peered":"2024-09-11T11:01:03.325009+0000","last_unstale":"2024-09-11T11:04:17.736226+0000","last_undegraded":"2024-09-11T11:04:17.736226+0000","last_fullsized":"2024-09-11T11:04:17.736226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:07.534323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127143+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:02:42.127143+0000","last_peered":"2024-09-11T11:02:42.127143+0000","last_clean":"2024-09-11T11:02:42.127143+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:02:42.127143+0000","last_undegraded":"2024-09-11T11:02:42.127143+0000","last_fullsized":"2024-09-11T11:02:42.127143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:52:42.400043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110145+0000","last_change":"2024-09-11T11:01:07.364237+0000","last_active":"2024-09-11T11:02:42.110145+0000","last_peered":"2024-09-11T11:02:42.110145+0000","last_clean":"2024-09-11T11:02:42.110145+0000","last_became_active":"2024-09-11T11:01:07.363499+0000","last_became_peered":"2024-09-11T11:01:07.363499+0000","last_unstale":"2024-09-11T11:02:42.110145+0000","last_undegraded":"2024-09-11T11:02:42.110145+0000","last_fullsized":"2024-09-11T11:02:42.110145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:05.458479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'82","reported_seq":158,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.890359+0000","last_change":"2024-09-11T11:01:09.372054+0000","last_active":"2024-09-11T11:03:14.890359+0000","last_peered":"2024-09-11T11:03:14.890359+0000","last_clean":"2024-09-11T11:03:14.890359+0000","last_became_active":"2024-09-11T11:01:09.371312+0000","last_became_peered":"2024-09-11T11:01:09.371312+0000","last_unstale":"2024-09-11T11:03:14.890359+0000","last_undegraded":"2024-09-11T11:03:14.890359+0000","last_fullsized":"2024-09-11T11:03:14.890359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:16.530704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111457+0000","last_change":"2024-09-11T11:01:11.384314+0000","last_active":"2024-09-11T11:02:42.111457+0000","last_peered":"2024-09-11T11:02:42.111457+0000","last_clean":"2024-09-11T11:02:42.111457+0000","last_became_active":"2024-09-11T11:01:11.383342+0000","last_became_peered":"2024-09-11T11:01:11.383342+0000","last_unstale":"2024-09-11T11:02:42.111457+0000","last_undegraded":"2024-09-11T11:02:42.111457+0000","last_fullsized":"2024-09-11T11:02:42.111457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:19.950700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500048+0000","last_change":"2024-09-11T11:01:13.418374+0000","last_active":"2024-09-11T11:02:42.500048+0000","last_peered":"2024-09-11T11:02:42.500048+0000","last_clean":"2024-09-11T11:02:42.500048+0000","last_became_active":"2024-09-11T11:01:13.413156+0000","last_became_peered":"2024-09-11T11:01:13.413156+0000","last_unstale":"2024-09-11T11:02:42.500048+0000","last_undegraded":"2024-09-11T11:02:42.500048+0000","last_fullsized":"2024-09-11T11:02:42.500048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:07:28.142970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500143+0000","last_change":"2024-09-11T11:01:13.418594+0000","last_active":"2024-09-11T11:02:42.500143+0000","last_peered":"2024-09-11T11:02:42.500143+0000","last_clean":"2024-09-11T11:02:42.500143+0000","last_became_active":"2024-09-11T11:01:13.413535+0000","last_became_peered":"2024-09-11T11:01:13.413535+0000","last_unstale":"2024-09-11T11:02:42.500143+0000","last_undegraded":"2024-09-11T11:02:42.500143+0000","last_fullsized":"2024-09-11T11:02:42.500143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:31:24.015178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'9","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036251+0000","last_change":"2024-09-11T11:01:05.338098+0000","last_active":"2024-09-11T11:03:28.036251+0000","last_peered":"2024-09-11T11:03:28.036251+0000","last_clean":"2024-09-11T11:03:28.036251+0000","last_became_active":"2024-09-11T11:01:05.337509+0000","last_became_peered":"2024-09-11T11:01:05.337509+0000","last_unstale":"2024-09-11T11:03:28.036251+0000","last_undegraded":"2024-09-11T11:03:28.036251+0000","last_fullsized":"2024-09-11T11:03:28.036251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:26.300276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124980+0000","last_change":"2024-09-11T11:01:03.321762+0000","last_active":"2024-09-11T11:02:42.124980+0000","last_peered":"2024-09-11T11:02:42.124980+0000","last_clean":"2024-09-11T11:02:42.124980+0000","last_became_active":"2024-09-11T11:01:03.320981+0000","last_became_peered":"2024-09-11T11:01:03.320981+0000","last_unstale":"2024-09-11T11:02:42.124980+0000","last_undegraded":"2024-09-11T11:02:42.124980+0000","last_fullsized":"2024-09-11T11:02:42.124980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:03.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842801+0000","last_change":"2024-09-11T11:01:07.369265+0000","last_active":"2024-09-11T11:02:42.842801+0000","last_peered":"2024-09-11T11:02:42.842801+0000","last_clean":"2024-09-11T11:02:42.842801+0000","last_became_active":"2024-09-11T11:01:07.367778+0000","last_became_peered":"2024-09-11T11:01:07.367778+0000","last_unstale":"2024-09-11T11:02:42.842801+0000","last_undegraded":"2024-09-11T11:02:42.842801+0000","last_fullsized":"2024-09-11T11:02:42.842801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:13.316958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.901680+0000","last_change":"2024-09-11T11:01:09.372426+0000","last_active":"2024-09-11T11:03:14.901680+0000","last_peered":"2024-09-11T11:03:14.901680+0000","last_clean":"2024-09-11T11:03:14.901680+0000","last_became_active":"2024-09-11T11:01:09.369318+0000","last_became_peered":"2024-09-11T11:01:09.369318+0000","last_unstale":"2024-09-11T11:03:14.901680+0000","last_undegraded":"2024-09-11T11:03:14.901680+0000","last_fullsized":"2024-09-11T11:03:14.901680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:11.108714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111320+0000","last_change":"2024-09-11T11:01:11.397868+0000","last_active":"2024-09-11T11:02:42.111320+0000","last_peered":"2024-09-11T11:02:42.111320+0000","last_clean":"2024-09-11T11:02:42.111320+0000","last_became_active":"2024-09-11T11:01:11.396833+0000","last_became_peered":"2024-09-11T11:01:11.396833+0000","last_unstale":"2024-09-11T11:02:42.111320+0000","last_undegraded":"2024-09-11T11:02:42.111320+0000","last_fullsized":"2024-09-11T11:02:42.111320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:06:10.976693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.485342+0000","last_change":"2024-09-11T11:01:13.408361+0000","last_active":"2024-09-11T11:03:14.485342+0000","last_peered":"2024-09-11T11:03:14.485342+0000","last_clean":"2024-09-11T11:03:14.485342+0000","last_became_active":"2024-09-11T11:01:13.407663+0000","last_became_peered":"2024-09-11T11:01:13.407663+0000","last_unstale":"2024-09-11T11:03:14.485342+0000","last_undegraded":"2024-09-11T11:03:14.485342+0000","last_fullsized":"2024-09-11T11:03:14.485342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:55:13.024275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.572787+0000","last_change":"2024-09-11T11:01:05.340874+0000","last_active":"2024-09-11T11:04:17.572787+0000","last_peered":"2024-09-11T11:04:17.572787+0000","last_clean":"2024-09-11T11:04:17.572787+0000","last_became_active":"2024-09-11T11:01:05.340457+0000","last_became_peered":"2024-09-11T11:01:05.340457+0000","last_unstale":"2024-09-11T11:04:17.572787+0000","last_undegraded":"2024-09-11T11:04:17.572787+0000","last_fullsized":"2024-09-11T11:04:17.572787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:13:20.748246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498765+0000","last_change":"2024-09-11T11:01:03.336186+0000","last_active":"2024-09-11T11:02:42.498765+0000","last_peered":"2024-09-11T11:02:42.498765+0000","last_clean":"2024-09-11T11:02:42.498765+0000","last_became_active":"2024-09-11T11:01:03.335235+0000","last_became_peered":"2024-09-11T11:01:03.335235+0000","last_unstale":"2024-09-11T11:02:42.498765+0000","last_undegraded":"2024-09-11T11:02:42.498765+0000","last_fullsized":"2024-09-11T11:02:42.498765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:32:59.574503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.504244+0000","last_change":"2024-09-11T11:02:42.502850+0000","last_active":"2024-09-11T11:02:42.504244+0000","last_peered":"2024-09-11T11:02:42.504244+0000","last_clean":"2024-09-11T11:02:42.504244+0000","last_became_active":"2024-09-11T11:02:42.501867+0000","last_became_peered":"2024-09-11T11:02:42.501867+0000","last_unstale":"2024-09-11T11:02:42.504244+0000","last_undegraded":"2024-09-11T11:02:42.504244+0000","last_fullsized":"2024-09-11T11:02:42.504244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:44:22.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.868748+0000","last_change":"2024-09-11T11:01:09.363815+0000","last_active":"2024-09-11T11:04:16.868748+0000","last_peered":"2024-09-11T11:04:16.868748+0000","last_clean":"2024-09-11T11:04:16.868748+0000","last_became_active":"2024-09-11T11:01:09.362975+0000","last_became_peered":"2024-09-11T11:01:09.362975+0000","last_unstale":"2024-09-11T11:04:16.868748+0000","last_undegraded":"2024-09-11T11:04:16.868748+0000","last_fullsized":"2024-09-11T11:04:16.868748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:48:49.614061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497830+0000","last_change":"2024-09-11T11:01:11.393863+0000","last_active":"2024-09-11T11:02:42.497830+0000","last_peered":"2024-09-11T11:02:42.497830+0000","last_clean":"2024-09-11T11:02:42.497830+0000","last_became_active":"2024-09-11T11:01:11.393181+0000","last_became_peered":"2024-09-11T11:01:11.393181+0000","last_unstale":"2024-09-11T11:02:42.497830+0000","last_undegraded":"2024-09-11T11:02:42.497830+0000","last_fullsized":"2024-09-11T11:02:42.497830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:48.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.983086+0000","last_change":"2024-09-11T11:01:13.419907+0000","last_active":"2024-09-11T11:04:16.983086+0000","last_peered":"2024-09-11T11:04:16.983086+0000","last_clean":"2024-09-11T11:04:16.983086+0000","last_became_active":"2024-09-11T11:01:13.419238+0000","last_became_peered":"2024-09-11T11:01:13.419238+0000","last_unstale":"2024-09-11T11:04:16.983086+0000","last_undegraded":"2024-09-11T11:04:16.983086+0000","last_fullsized":"2024-09-11T11:04:16.983086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:21.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921392+0000","last_change":"2024-09-11T11:01:42.073807+0000","last_active":"2024-09-11T11:04:17.921392+0000","last_peered":"2024-09-11T11:04:17.921392+0000","last_clean":"2024-09-11T11:04:17.921392+0000","last_became_active":"2024-09-11T11:01:42.058258+0000","last_became_peered":"2024-09-11T11:01:42.058258+0000","last_unstale":"2024-09-11T11:04:17.921392+0000","last_undegraded":"2024-09-11T11:04:17.921392+0000","last_fullsized":"2024-09-11T11:04:17.921392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:23:48.191355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127148+0000","last_change":"2024-09-11T11:01:03.339928+0000","last_active":"2024-09-11T11:02:42.127148+0000","last_peered":"2024-09-11T11:02:42.127148+0000","last_clean":"2024-09-11T11:02:42.127148+0000","last_became_active":"2024-09-11T11:01:03.337144+0000","last_became_peered":"2024-09-11T11:01:03.337144+0000","last_unstale":"2024-09-11T11:02:42.127148+0000","last_undegraded":"2024-09-11T11:02:42.127148+0000","last_fullsized":"2024-09-11T11:02:42.127148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:53:40.334818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"36'4","reported_seq":230,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.319107+0000","last_change":"2024-09-11T11:01:07.358746+0000","last_active":"2024-09-11T11:03:16.319107+0000","last_peered":"2024-09-11T11:03:16.319107+0000","last_clean":"2024-09-11T11:03:16.319107+0000","last_became_active":"2024-09-11T11:01:07.358156+0000","last_became_peered":"2024-09-11T11:01:07.358156+0000","last_unstale":"2024-09-11T11:03:16.319107+0000","last_undegraded":"2024-09-11T11:03:16.319107+0000","last_fullsized":"2024-09-11T11:03:16.319107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:14.921699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'41","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.362531+0000","last_change":"2024-09-11T11:01:09.385303+0000","last_active":"2024-09-11T11:04:17.362531+0000","last_peered":"2024-09-11T11:04:17.362531+0000","last_clean":"2024-09-11T11:04:17.362531+0000","last_became_active":"2024-09-11T11:01:09.380595+0000","last_became_peered":"2024-09-11T11:01:09.380595+0000","last_unstale":"2024-09-11T11:04:17.362531+0000","last_undegraded":"2024-09-11T11:04:17.362531+0000","last_fullsized":"2024-09-11T11:04:17.362531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:12:15.180214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":63,"num_read_kb":66,"num_write":48,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.841780+0000","last_change":"2024-09-11T11:01:11.402562+0000","last_active":"2024-09-11T11:02:42.841780+0000","last_peered":"2024-09-11T11:02:42.841780+0000","last_clean":"2024-09-11T11:02:42.841780+0000","last_became_active":"2024-09-11T11:01:11.401847+0000","last_became_peered":"2024-09-11T11:01:11.401847+0000","last_unstale":"2024-09-11T11:02:42.841780+0000","last_undegraded":"2024-09-11T11:02:42.841780+0000","last_fullsized":"2024-09-11T11:02:42.841780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:24:37.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110992+0000","last_change":"2024-09-11T11:01:13.397280+0000","last_active":"2024-09-11T11:02:42.110992+0000","last_peered":"2024-09-11T11:02:42.110992+0000","last_clean":"2024-09-11T11:02:42.110992+0000","last_became_active":"2024-09-11T11:01:13.395231+0000","last_became_peered":"2024-09-11T11:01:13.395231+0000","last_unstale":"2024-09-11T11:02:42.110992+0000","last_undegraded":"2024-09-11T11:02:42.110992+0000","last_fullsized":"2024-09-11T11:02:42.110992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:00:32.324647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.940026+0000","last_change":"2024-09-11T11:01:05.348465+0000","last_active":"2024-09-11T11:04:17.940026+0000","last_peered":"2024-09-11T11:04:17.940026+0000","last_clean":"2024-09-11T11:04:17.940026+0000","last_became_active":"2024-09-11T11:01:05.348002+0000","last_became_peered":"2024-09-11T11:01:05.348002+0000","last_unstale":"2024-09-11T11:04:17.940026+0000","last_undegraded":"2024-09-11T11:04:17.940026+0000","last_fullsized":"2024-09-11T11:04:17.940026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:27:41.532168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847625+0000","last_change":"2024-09-11T11:01:03.338184+0000","last_active":"2024-09-11T11:02:42.847625+0000","last_peered":"2024-09-11T11:02:42.847625+0000","last_clean":"2024-09-11T11:02:42.847625+0000","last_became_active":"2024-09-11T11:01:03.330782+0000","last_became_peered":"2024-09-11T11:01:03.330782+0000","last_unstale":"2024-09-11T11:02:42.847625+0000","last_undegraded":"2024-09-11T11:02:42.847625+0000","last_fullsized":"2024-09-11T11:02:42.847625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:42.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111231+0000","last_change":"2024-09-11T11:01:07.351359+0000","last_active":"2024-09-11T11:02:42.111231+0000","last_peered":"2024-09-11T11:02:42.111231+0000","last_clean":"2024-09-11T11:02:42.111231+0000","last_became_active":"2024-09-11T11:01:07.350685+0000","last_became_peered":"2024-09-11T11:01:07.350685+0000","last_unstale":"2024-09-11T11:02:42.111231+0000","last_undegraded":"2024-09-11T11:02:42.111231+0000","last_fullsized":"2024-09-11T11:02:42.111231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:39.784471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.876511+0000","last_change":"2024-09-11T11:01:09.363365+0000","last_active":"2024-09-11T11:03:14.876511+0000","last_peered":"2024-09-11T11:03:14.876511+0000","last_clean":"2024-09-11T11:03:14.876511+0000","last_became_active":"2024-09-11T11:01:09.362483+0000","last_became_peered":"2024-09-11T11:01:09.362483+0000","last_unstale":"2024-09-11T11:03:14.876511+0000","last_undegraded":"2024-09-11T11:03:14.876511+0000","last_fullsized":"2024-09-11T11:03:14.876511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:30.250968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500588+0000","last_change":"2024-09-11T11:01:11.399469+0000","last_active":"2024-09-11T11:02:42.500588+0000","last_peered":"2024-09-11T11:02:42.500588+0000","last_clean":"2024-09-11T11:02:42.500588+0000","last_became_active":"2024-09-11T11:01:11.398843+0000","last_became_peered":"2024-09-11T11:01:11.398843+0000","last_unstale":"2024-09-11T11:02:42.500588+0000","last_undegraded":"2024-09-11T11:02:42.500588+0000","last_fullsized":"2024-09-11T11:02:42.500588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:44:43.419308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770552+0000","last_change":"2024-09-11T11:01:05.348376+0000","last_active":"2024-09-11T11:04:17.770552+0000","last_peered":"2024-09-11T11:04:17.770552+0000","last_clean":"2024-09-11T11:04:17.770552+0000","last_became_active":"2024-09-11T11:01:05.347496+0000","last_became_peered":"2024-09-11T11:01:05.347496+0000","last_unstale":"2024-09-11T11:04:17.770552+0000","last_undegraded":"2024-09-11T11:04:17.770552+0000","last_fullsized":"2024-09-11T11:04:17.770552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:32.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109337+0000","last_change":"2024-09-11T11:01:03.349185+0000","last_active":"2024-09-11T11:02:42.109337+0000","last_peered":"2024-09-11T11:02:42.109337+0000","last_clean":"2024-09-11T11:02:42.109337+0000","last_became_active":"2024-09-11T11:01:03.348849+0000","last_became_peered":"2024-09-11T11:01:03.348849+0000","last_unstale":"2024-09-11T11:02:42.109337+0000","last_undegraded":"2024-09-11T11:02:42.109337+0000","last_fullsized":"2024-09-11T11:02:42.109337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:33.180623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847481+0000","last_change":"2024-09-11T11:01:07.366791+0000","last_active":"2024-09-11T11:02:42.847481+0000","last_peered":"2024-09-11T11:02:42.847481+0000","last_clean":"2024-09-11T11:02:42.847481+0000","last_became_active":"2024-09-11T11:01:07.365953+0000","last_became_peered":"2024-09-11T11:01:07.365953+0000","last_unstale":"2024-09-11T11:02:42.847481+0000","last_undegraded":"2024-09-11T11:02:42.847481+0000","last_fullsized":"2024-09-11T11:02:42.847481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:09:50.935366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.912449+0000","last_change":"2024-09-11T11:01:09.375348+0000","last_active":"2024-09-11T11:03:14.912449+0000","last_peered":"2024-09-11T11:03:14.912449+0000","last_clean":"2024-09-11T11:03:14.912449+0000","last_became_active":"2024-09-11T11:01:09.374937+0000","last_became_peered":"2024-09-11T11:01:09.374937+0000","last_unstale":"2024-09-11T11:03:14.912449+0000","last_undegraded":"2024-09-11T11:03:14.912449+0000","last_fullsized":"2024-09-11T11:03:14.912449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:33:50.006729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499366+0000","last_change":"2024-09-11T11:01:11.395444+0000","last_active":"2024-09-11T11:02:42.499366+0000","last_peered":"2024-09-11T11:02:42.499366+0000","last_clean":"2024-09-11T11:02:42.499366+0000","last_became_active":"2024-09-11T11:01:11.394849+0000","last_became_peered":"2024-09-11T11:01:11.394849+0000","last_unstale":"2024-09-11T11:02:42.499366+0000","last_undegraded":"2024-09-11T11:02:42.499366+0000","last_fullsized":"2024-09-11T11:02:42.499366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:14:10.559226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.693746+0000","last_change":"2024-09-11T11:01:13.416940+0000","last_active":"2024-09-11T11:03:16.693746+0000","last_peered":"2024-09-11T11:03:16.693746+0000","last_clean":"2024-09-11T11:03:16.693746+0000","last_became_active":"2024-09-11T11:01:13.416414+0000","last_became_peered":"2024-09-11T11:01:13.416414+0000","last_unstale":"2024-09-11T11:03:16.693746+0000","last_undegraded":"2024-09-11T11:03:16.693746+0000","last_fullsized":"2024-09-11T11:03:16.693746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:02:37.102253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845863+0000","last_change":"2024-09-11T11:01:05.340233+0000","last_active":"2024-09-11T11:02:42.845863+0000","last_peered":"2024-09-11T11:02:42.845863+0000","last_clean":"2024-09-11T11:02:42.845863+0000","last_became_active":"2024-09-11T11:01:05.339898+0000","last_became_peered":"2024-09-11T11:01:05.339898+0000","last_unstale":"2024-09-11T11:02:42.845863+0000","last_undegraded":"2024-09-11T11:02:42.845863+0000","last_fullsized":"2024-09-11T11:02:42.845863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:51.046871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'3","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.039656+0000","last_change":"2024-09-11T11:01:42.094568+0000","last_active":"2024-09-11T11:03:28.039656+0000","last_peered":"2024-09-11T11:03:28.039656+0000","last_clean":"2024-09-11T11:03:28.039656+0000","last_became_active":"2024-09-11T11:01:42.058648+0000","last_became_peered":"2024-09-11T11:01:42.058648+0000","last_unstale":"2024-09-11T11:03:28.039656+0000","last_undegraded":"2024-09-11T11:03:28.039656+0000","last_fullsized":"2024-09-11T11:03:28.039656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:41.034099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129527+0000","last_change":"2024-09-11T11:01:07.340610+0000","last_active":"2024-09-11T11:02:42.129527+0000","last_peered":"2024-09-11T11:02:42.129527+0000","last_clean":"2024-09-11T11:02:42.129527+0000","last_became_active":"2024-09-11T11:01:07.340147+0000","last_became_peered":"2024-09-11T11:01:07.340147+0000","last_unstale":"2024-09-11T11:02:42.129527+0000","last_undegraded":"2024-09-11T11:02:42.129527+0000","last_fullsized":"2024-09-11T11:02:42.129527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:59:55.768264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.878428+0000","last_change":"2024-09-11T11:01:09.372272+0000","last_active":"2024-09-11T11:03:14.878428+0000","last_peered":"2024-09-11T11:03:14.878428+0000","last_clean":"2024-09-11T11:03:14.878428+0000","last_became_active":"2024-09-11T11:01:09.371522+0000","last_became_peered":"2024-09-11T11:01:09.371522+0000","last_unstale":"2024-09-11T11:03:14.878428+0000","last_undegraded":"2024-09-11T11:03:14.878428+0000","last_fullsized":"2024-09-11T11:03:14.878428+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:58:05.506059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847450+0000","last_change":"2024-09-11T11:01:11.393543+0000","last_active":"2024-09-11T11:02:42.847450+0000","last_peered":"2024-09-11T11:02:42.847450+0000","last_clean":"2024-09-11T11:02:42.847450+0000","last_became_active":"2024-09-11T11:01:11.392489+0000","last_became_peered":"2024-09-11T11:01:11.392489+0000","last_unstale":"2024-09-11T11:02:42.847450+0000","last_undegraded":"2024-09-11T11:02:42.847450+0000","last_fullsized":"2024-09-11T11:02:42.847450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:57.060008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121990+0000","last_change":"2024-09-11T11:01:13.405032+0000","last_active":"2024-09-11T11:02:42.121990+0000","last_peered":"2024-09-11T11:02:42.121990+0000","last_clean":"2024-09-11T11:02:42.121990+0000","last_became_active":"2024-09-11T11:01:13.404341+0000","last_became_peered":"2024-09-11T11:01:13.404341+0000","last_unstale":"2024-09-11T11:02:42.121990+0000","last_undegraded":"2024-09-11T11:02:42.121990+0000","last_fullsized":"2024-09-11T11:02:42.121990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:41:29.058689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'18","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836712+0000","last_change":"2024-09-11T11:01:05.348158+0000","last_active":"2024-09-11T11:03:16.836712+0000","last_peered":"2024-09-11T11:03:16.836712+0000","last_clean":"2024-09-11T11:03:16.836712+0000","last_became_active":"2024-09-11T11:01:05.347745+0000","last_became_peered":"2024-09-11T11:01:05.347745+0000","last_unstale":"2024-09-11T11:03:16.836712+0000","last_undegraded":"2024-09-11T11:03:16.836712+0000","last_fullsized":"2024-09-11T11:03:16.836712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:16:36.575022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124170+0000","last_change":"2024-09-11T11:01:03.322039+0000","last_active":"2024-09-11T11:02:42.124170+0000","last_peered":"2024-09-11T11:02:42.124170+0000","last_clean":"2024-09-11T11:02:42.124170+0000","last_became_active":"2024-09-11T11:01:03.321106+0000","last_became_peered":"2024-09-11T11:01:03.321106+0000","last_unstale":"2024-09-11T11:02:42.124170+0000","last_undegraded":"2024-09-11T11:02:42.124170+0000","last_fullsized":"2024-09-11T11:02:42.124170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.482692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124610+0000","last_change":"2024-09-11T11:01:07.343664+0000","last_active":"2024-09-11T11:02:42.124610+0000","last_peered":"2024-09-11T11:02:42.124610+0000","last_clean":"2024-09-11T11:02:42.124610+0000","last_became_active":"2024-09-11T11:01:07.342760+0000","last_became_peered":"2024-09-11T11:01:07.342760+0000","last_unstale":"2024-09-11T11:02:42.124610+0000","last_undegraded":"2024-09-11T11:02:42.124610+0000","last_fullsized":"2024-09-11T11:02:42.124610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:48.492230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'34","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.465133+0000","last_change":"2024-09-11T11:01:09.390274+0000","last_active":"2024-09-11T11:04:17.465133+0000","last_peered":"2024-09-11T11:04:17.465133+0000","last_clean":"2024-09-11T11:04:17.465133+0000","last_became_active":"2024-09-11T11:01:09.389548+0000","last_became_peered":"2024-09-11T11:01:09.389548+0000","last_unstale":"2024-09-11T11:04:17.465133+0000","last_undegraded":"2024-09-11T11:04:17.465133+0000","last_fullsized":"2024-09-11T11:04:17.465133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:55.045450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847493+0000","last_change":"2024-09-11T11:01:11.391754+0000","last_active":"2024-09-11T11:02:42.847493+0000","last_peered":"2024-09-11T11:02:42.847493+0000","last_clean":"2024-09-11T11:02:42.847493+0000","last_became_active":"2024-09-11T11:01:11.391080+0000","last_became_peered":"2024-09-11T11:01:11.391080+0000","last_unstale":"2024-09-11T11:02:42.847493+0000","last_undegraded":"2024-09-11T11:02:42.847493+0000","last_fullsized":"2024-09-11T11:02:42.847493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:23.746419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.825662+0000","last_change":"2024-09-11T11:01:13.421751+0000","last_active":"2024-09-11T11:03:16.825662+0000","last_peered":"2024-09-11T11:03:16.825662+0000","last_clean":"2024-09-11T11:03:16.825662+0000","last_became_active":"2024-09-11T11:01:13.420844+0000","last_became_peered":"2024-09-11T11:01:13.420844+0000","last_unstale":"2024-09-11T11:03:16.825662+0000","last_undegraded":"2024-09-11T11:03:16.825662+0000","last_fullsized":"2024-09-11T11:03:16.825662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:01:42.372122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.443118+0000","last_change":"2024-09-11T11:01:05.339320+0000","last_active":"2024-09-11T11:04:17.443118+0000","last_peered":"2024-09-11T11:04:17.443118+0000","last_clean":"2024-09-11T11:04:17.443118+0000","last_became_active":"2024-09-11T11:01:05.338036+0000","last_became_peered":"2024-09-11T11:01:05.338036+0000","last_unstale":"2024-09-11T11:04:17.443118+0000","last_undegraded":"2024-09-11T11:04:17.443118+0000","last_fullsized":"2024-09-11T11:04:17.443118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:32.889486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.908157+0000","last_change":"2024-09-11T11:01:03.336252+0000","last_active":"2024-09-11T11:04:17.908157+0000","last_peered":"2024-09-11T11:04:17.908157+0000","last_clean":"2024-09-11T11:04:17.908157+0000","last_became_active":"2024-09-11T11:01:03.335959+0000","last_became_peered":"2024-09-11T11:01:03.335959+0000","last_unstale":"2024-09-11T11:04:17.908157+0000","last_undegraded":"2024-09-11T11:04:17.908157+0000","last_fullsized":"2024-09-11T11:04:17.908157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:07.534323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847461+0000","last_change":"2024-09-11T11:01:07.370087+0000","last_active":"2024-09-11T11:02:42.847461+0000","last_peered":"2024-09-11T11:02:42.847461+0000","last_clean":"2024-09-11T11:02:42.847461+0000","last_became_active":"2024-09-11T11:01:07.368853+0000","last_became_peered":"2024-09-11T11:01:07.368853+0000","last_unstale":"2024-09-11T11:02:42.847461+0000","last_undegraded":"2024-09-11T11:02:42.847461+0000","last_fullsized":"2024-09-11T11:02:42.847461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:39.784471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115820+0000","last_change":"2024-09-11T11:01:09.391884+0000","last_active":"2024-09-11T11:02:42.115820+0000","last_peered":"2024-09-11T11:02:42.115820+0000","last_clean":"2024-09-11T11:02:42.115820+0000","last_became_active":"2024-09-11T11:01:09.391249+0000","last_became_peered":"2024-09-11T11:01:09.391249+0000","last_unstale":"2024-09-11T11:02:42.115820+0000","last_undegraded":"2024-09-11T11:02:42.115820+0000","last_fullsized":"2024-09-11T11:02:42.115820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:42:27.348949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'282","reported_seq":371,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597039+0000","last_change":"2024-09-11T11:01:11.403073+0000","last_active":"2024-09-11T11:04:17.597039+0000","last_peered":"2024-09-11T11:04:17.597039+0000","last_clean":"2024-09-11T11:04:17.597039+0000","last_became_active":"2024-09-11T11:01:11.401400+0000","last_became_peered":"2024-09-11T11:01:11.401400+0000","last_unstale":"2024-09-11T11:04:17.597039+0000","last_undegraded":"2024-09-11T11:04:17.597039+0000","last_fullsized":"2024-09-11T11:04:17.597039+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:49.090546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121310+0000","last_change":"2024-09-11T11:01:13.403086+0000","last_active":"2024-09-11T11:02:42.121310+0000","last_peered":"2024-09-11T11:02:42.121310+0000","last_clean":"2024-09-11T11:02:42.121310+0000","last_became_active":"2024-09-11T11:01:13.402406+0000","last_became_peered":"2024-09-11T11:01:13.402406+0000","last_unstale":"2024-09-11T11:02:42.121310+0000","last_undegraded":"2024-09-11T11:02:42.121310+0000","last_fullsized":"2024-09-11T11:02:42.121310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:56.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'5","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.038763+0000","last_change":"2024-09-11T11:01:05.353823+0000","last_active":"2024-09-11T11:03:38.038763+0000","last_peered":"2024-09-11T11:03:38.038763+0000","last_clean":"2024-09-11T11:03:38.038763+0000","last_became_active":"2024-09-11T11:01:05.353214+0000","last_became_peered":"2024-09-11T11:01:05.353214+0000","last_unstale":"2024-09-11T11:03:38.038763+0000","last_undegraded":"2024-09-11T11:03:38.038763+0000","last_fullsized":"2024-09-11T11:03:38.038763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:59:11.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844327+0000","last_change":"2024-09-11T11:01:03.346782+0000","last_active":"2024-09-11T11:02:42.844327+0000","last_peered":"2024-09-11T11:02:42.844327+0000","last_clean":"2024-09-11T11:02:42.844327+0000","last_became_active":"2024-09-11T11:01:03.346318+0000","last_became_peered":"2024-09-11T11:01:03.346318+0000","last_unstale":"2024-09-11T11:02:42.844327+0000","last_undegraded":"2024-09-11T11:02:42.844327+0000","last_fullsized":"2024-09-11T11:02:42.844327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:08.559205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843531+0000","last_change":"2024-09-11T11:01:07.369704+0000","last_active":"2024-09-11T11:02:42.843531+0000","last_peered":"2024-09-11T11:02:42.843531+0000","last_clean":"2024-09-11T11:02:42.843531+0000","last_became_active":"2024-09-11T11:01:07.368713+0000","last_became_peered":"2024-09-11T11:01:07.368713+0000","last_unstale":"2024-09-11T11:02:42.843531+0000","last_undegraded":"2024-09-11T11:02:42.843531+0000","last_fullsized":"2024-09-11T11:02:42.843531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:00:00.692745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'36","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.862353+0000","last_change":"2024-09-11T11:01:09.364363+0000","last_active":"2024-09-11T11:03:14.862353+0000","last_peered":"2024-09-11T11:03:14.862353+0000","last_clean":"2024-09-11T11:03:14.862353+0000","last_became_active":"2024-09-11T11:01:09.363530+0000","last_became_peered":"2024-09-11T11:01:09.363530+0000","last_unstale":"2024-09-11T11:03:14.862353+0000","last_undegraded":"2024-09-11T11:03:14.862353+0000","last_fullsized":"2024-09-11T11:03:14.862353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:20:25.511602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109273+0000","last_change":"2024-09-11T11:01:11.373298+0000","last_active":"2024-09-11T11:02:42.109273+0000","last_peered":"2024-09-11T11:02:42.109273+0000","last_clean":"2024-09-11T11:02:42.109273+0000","last_became_active":"2024-09-11T11:01:11.371526+0000","last_became_peered":"2024-09-11T11:01:11.371526+0000","last_unstale":"2024-09-11T11:02:42.109273+0000","last_undegraded":"2024-09-11T11:02:42.109273+0000","last_fullsized":"2024-09-11T11:02:42.109273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:18.545262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129245+0000","last_change":"2024-09-11T11:01:13.421954+0000","last_active":"2024-09-11T11:02:42.129245+0000","last_peered":"2024-09-11T11:02:42.129245+0000","last_clean":"2024-09-11T11:02:42.129245+0000","last_became_active":"2024-09-11T11:01:13.421220+0000","last_became_peered":"2024-09-11T11:01:13.421220+0000","last_unstale":"2024-09-11T11:02:42.129245+0000","last_undegraded":"2024-09-11T11:02:42.129245+0000","last_fullsized":"2024-09-11T11:02:42.129245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:37.260215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.769226+0000","last_change":"2024-09-11T11:01:05.348922+0000","last_active":"2024-09-11T11:03:12.769226+0000","last_peered":"2024-09-11T11:03:12.769226+0000","last_clean":"2024-09-11T11:03:12.769226+0000","last_became_active":"2024-09-11T11:01:05.348256+0000","last_became_peered":"2024-09-11T11:01:05.348256+0000","last_unstale":"2024-09-11T11:03:12.769226+0000","last_undegraded":"2024-09-11T11:03:12.769226+0000","last_fullsized":"2024-09-11T11:03:12.769226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:10:09.634465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127285+0000","last_change":"2024-09-11T11:01:03.323843+0000","last_active":"2024-09-11T11:02:42.127285+0000","last_peered":"2024-09-11T11:02:42.127285+0000","last_clean":"2024-09-11T11:02:42.127285+0000","last_became_active":"2024-09-11T11:01:03.323106+0000","last_became_peered":"2024-09-11T11:01:03.323106+0000","last_unstale":"2024-09-11T11:02:42.127285+0000","last_undegraded":"2024-09-11T11:02:42.127285+0000","last_fullsized":"2024-09-11T11:02:42.127285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:24:10.573016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124332+0000","last_change":"2024-09-11T11:01:07.347165+0000","last_active":"2024-09-11T11:02:42.124332+0000","last_peered":"2024-09-11T11:02:42.124332+0000","last_clean":"2024-09-11T11:02:42.124332+0000","last_became_active":"2024-09-11T11:01:07.346507+0000","last_became_peered":"2024-09-11T11:01:07.346507+0000","last_unstale":"2024-09-11T11:02:42.124332+0000","last_undegraded":"2024-09-11T11:02:42.124332+0000","last_fullsized":"2024-09-11T11:02:42.124332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:11.130739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.862649+0000","last_change":"2024-09-11T11:01:09.370064+0000","last_active":"2024-09-11T11:03:14.862649+0000","last_peered":"2024-09-11T11:03:14.862649+0000","last_clean":"2024-09-11T11:03:14.862649+0000","last_became_active":"2024-09-11T11:01:09.367104+0000","last_became_peered":"2024-09-11T11:01:09.367104+0000","last_unstale":"2024-09-11T11:03:14.862649+0000","last_undegraded":"2024-09-11T11:03:14.862649+0000","last_fullsized":"2024-09-11T11:03:14.862649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:42.885042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122669+0000","last_change":"2024-09-11T11:01:11.400983+0000","last_active":"2024-09-11T11:02:42.122669+0000","last_peered":"2024-09-11T11:02:42.122669+0000","last_clean":"2024-09-11T11:02:42.122669+0000","last_became_active":"2024-09-11T11:01:11.400269+0000","last_became_peered":"2024-09-11T11:01:11.400269+0000","last_unstale":"2024-09-11T11:02:42.122669+0000","last_undegraded":"2024-09-11T11:02:42.122669+0000","last_fullsized":"2024-09-11T11:02:42.122669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:48.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112745+0000","last_change":"2024-09-11T11:01:13.424386+0000","last_active":"2024-09-11T11:02:42.112745+0000","last_peered":"2024-09-11T11:02:42.112745+0000","last_clean":"2024-09-11T11:02:42.112745+0000","last_became_active":"2024-09-11T11:01:13.423466+0000","last_became_peered":"2024-09-11T11:01:13.423466+0000","last_unstale":"2024-09-11T11:02:42.112745+0000","last_undegraded":"2024-09-11T11:02:42.112745+0000","last_fullsized":"2024-09-11T11:02:42.112745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:51:02.142046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.574272+0000","last_change":"2024-09-11T11:01:05.334600+0000","last_active":"2024-09-11T11:04:17.574272+0000","last_peered":"2024-09-11T11:04:17.574272+0000","last_clean":"2024-09-11T11:04:17.574272+0000","last_became_active":"2024-09-11T11:01:05.334141+0000","last_became_peered":"2024-09-11T11:01:05.334141+0000","last_unstale":"2024-09-11T11:04:17.574272+0000","last_undegraded":"2024-09-11T11:04:17.574272+0000","last_fullsized":"2024-09-11T11:04:17.574272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:40:25.995301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115947+0000","last_change":"2024-09-11T11:01:03.340441+0000","last_active":"2024-09-11T11:02:42.115947+0000","last_peered":"2024-09-11T11:02:42.115947+0000","last_clean":"2024-09-11T11:02:42.115947+0000","last_became_active":"2024-09-11T11:01:03.337584+0000","last_became_peered":"2024-09-11T11:01:03.337584+0000","last_unstale":"2024-09-11T11:02:42.115947+0000","last_undegraded":"2024-09-11T11:02:42.115947+0000","last_fullsized":"2024-09-11T11:02:42.115947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:11.801971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842557+0000","last_change":"2024-09-11T11:01:07.366290+0000","last_active":"2024-09-11T11:02:42.842557+0000","last_peered":"2024-09-11T11:02:42.842557+0000","last_clean":"2024-09-11T11:02:42.842557+0000","last_became_active":"2024-09-11T11:01:07.365791+0000","last_became_peered":"2024-09-11T11:01:07.365791+0000","last_unstale":"2024-09-11T11:02:42.842557+0000","last_undegraded":"2024-09-11T11:02:42.842557+0000","last_fullsized":"2024-09-11T11:02:42.842557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:31:26.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.905215+0000","last_change":"2024-09-11T11:01:09.385201+0000","last_active":"2024-09-11T11:03:14.905215+0000","last_peered":"2024-09-11T11:03:14.905215+0000","last_clean":"2024-09-11T11:03:14.905215+0000","last_became_active":"2024-09-11T11:01:09.380531+0000","last_became_peered":"2024-09-11T11:01:09.380531+0000","last_unstale":"2024-09-11T11:03:14.905215+0000","last_undegraded":"2024-09-11T11:03:14.905215+0000","last_fullsized":"2024-09-11T11:03:14.905215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:30.066289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123409+0000","last_change":"2024-09-11T11:01:11.387269+0000","last_active":"2024-09-11T11:02:42.123409+0000","last_peered":"2024-09-11T11:02:42.123409+0000","last_clean":"2024-09-11T11:02:42.123409+0000","last_became_active":"2024-09-11T11:01:11.386302+0000","last_became_peered":"2024-09-11T11:01:11.386302+0000","last_unstale":"2024-09-11T11:02:42.123409+0000","last_undegraded":"2024-09-11T11:02:42.123409+0000","last_fullsized":"2024-09-11T11:02:42.123409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:54:54.650646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.580984+0000","last_change":"2024-09-11T11:01:13.423002+0000","last_active":"2024-09-11T11:04:17.580984+0000","last_peered":"2024-09-11T11:04:17.580984+0000","last_clean":"2024-09-11T11:04:17.580984+0000","last_became_active":"2024-09-11T11:01:13.422285+0000","last_became_peered":"2024-09-11T11:01:13.422285+0000","last_unstale":"2024-09-11T11:04:17.580984+0000","last_undegraded":"2024-09-11T11:04:17.580984+0000","last_fullsized":"2024-09-11T11:04:17.580984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:03:35.147747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.440090+0000","last_change":"2024-09-11T11:01:05.337161+0000","last_active":"2024-09-11T11:04:17.440090+0000","last_peered":"2024-09-11T11:04:17.440090+0000","last_clean":"2024-09-11T11:04:17.440090+0000","last_became_active":"2024-09-11T11:01:05.336680+0000","last_became_peered":"2024-09-11T11:01:05.336680+0000","last_unstale":"2024-09-11T11:04:17.440090+0000","last_undegraded":"2024-09-11T11:04:17.440090+0000","last_fullsized":"2024-09-11T11:04:17.440090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:14.471785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847754+0000","last_change":"2024-09-11T11:01:03.336607+0000","last_active":"2024-09-11T11:02:42.847754+0000","last_peered":"2024-09-11T11:02:42.847754+0000","last_clean":"2024-09-11T11:02:42.847754+0000","last_became_active":"2024-09-11T11:01:03.331816+0000","last_became_peered":"2024-09-11T11:01:03.331816+0000","last_unstale":"2024-09-11T11:02:42.847754+0000","last_undegraded":"2024-09-11T11:02:42.847754+0000","last_fullsized":"2024-09-11T11:02:42.847754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:04:39.058034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.277728+0000","last_change":"2024-09-11T11:01:07.364299+0000","last_active":"2024-09-11T11:03:13.277728+0000","last_peered":"2024-09-11T11:03:13.277728+0000","last_clean":"2024-09-11T11:03:13.277728+0000","last_became_active":"2024-09-11T11:01:07.363545+0000","last_became_peered":"2024-09-11T11:01:07.363545+0000","last_unstale":"2024-09-11T11:03:13.277728+0000","last_undegraded":"2024-09-11T11:03:13.277728+0000","last_fullsized":"2024-09-11T11:03:13.277728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:17.840143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'32","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.871444+0000","last_change":"2024-09-11T11:01:09.378071+0000","last_active":"2024-09-11T11:04:16.871444+0000","last_peered":"2024-09-11T11:04:16.871444+0000","last_clean":"2024-09-11T11:04:16.871444+0000","last_became_active":"2024-09-11T11:01:09.377586+0000","last_became_peered":"2024-09-11T11:01:09.377586+0000","last_unstale":"2024-09-11T11:04:16.871444+0000","last_undegraded":"2024-09-11T11:04:16.871444+0000","last_fullsized":"2024-09-11T11:04:16.871444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:54.076155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499591+0000","last_change":"2024-09-11T11:01:11.401725+0000","last_active":"2024-09-11T11:02:42.499591+0000","last_peered":"2024-09-11T11:02:42.499591+0000","last_clean":"2024-09-11T11:02:42.499591+0000","last_became_active":"2024-09-11T11:01:11.401078+0000","last_became_peered":"2024-09-11T11:01:11.401078+0000","last_unstale":"2024-09-11T11:02:42.499591+0000","last_undegraded":"2024-09-11T11:02:42.499591+0000","last_fullsized":"2024-09-11T11:02:42.499591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:58:17.003022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.925565+0000","last_change":"2024-09-11T11:01:13.422050+0000","last_active":"2024-09-11T11:03:14.925565+0000","last_peered":"2024-09-11T11:03:14.925565+0000","last_clean":"2024-09-11T11:03:14.925565+0000","last_became_active":"2024-09-11T11:01:13.421231+0000","last_became_peered":"2024-09-11T11:01:13.421231+0000","last_unstale":"2024-09-11T11:03:14.925565+0000","last_undegraded":"2024-09-11T11:03:14.925565+0000","last_fullsized":"2024-09-11T11:03:14.925565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:19.013089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'12","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855598+0000","last_change":"2024-09-11T11:01:05.340309+0000","last_active":"2024-09-11T11:04:17.855598+0000","last_peered":"2024-09-11T11:04:17.855598+0000","last_clean":"2024-09-11T11:04:17.855598+0000","last_became_active":"2024-09-11T11:01:05.339760+0000","last_became_peered":"2024-09-11T11:01:05.339760+0000","last_unstale":"2024-09-11T11:04:17.855598+0000","last_undegraded":"2024-09-11T11:04:17.855598+0000","last_fullsized":"2024-09-11T11:04:17.855598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:03.072232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.496287+0000","last_change":"2024-09-11T11:01:03.338307+0000","last_active":"2024-09-11T11:02:42.496287+0000","last_peered":"2024-09-11T11:02:42.496287+0000","last_clean":"2024-09-11T11:02:42.496287+0000","last_became_active":"2024-09-11T11:01:03.338039+0000","last_became_peered":"2024-09-11T11:01:03.338039+0000","last_unstale":"2024-09-11T11:02:42.496287+0000","last_undegraded":"2024-09-11T11:02:42.496287+0000","last_fullsized":"2024-09-11T11:02:42.496287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:25:25.632777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845571+0000","last_change":"2024-09-11T11:01:05.333022+0000","last_active":"2024-09-11T11:02:42.845571+0000","last_peered":"2024-09-11T11:02:42.845571+0000","last_clean":"2024-09-11T11:02:42.845571+0000","last_became_active":"2024-09-11T11:01:05.332632+0000","last_became_peered":"2024-09-11T11:01:05.332632+0000","last_unstale":"2024-09-11T11:02:42.845571+0000","last_undegraded":"2024-09-11T11:02:42.845571+0000","last_fullsized":"2024-09-11T11:02:42.845571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:54:07.782353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497427+0000","last_change":"2024-09-11T11:01:03.327803+0000","last_active":"2024-09-11T11:02:42.497427+0000","last_peered":"2024-09-11T11:02:42.497427+0000","last_clean":"2024-09-11T11:02:42.497427+0000","last_became_active":"2024-09-11T11:01:03.327428+0000","last_became_peered":"2024-09-11T11:01:03.327428+0000","last_unstale":"2024-09-11T11:02:42.497427+0000","last_undegraded":"2024-09-11T11:02:42.497427+0000","last_fullsized":"2024-09-11T11:02:42.497427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:27:21.561913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.037418+0000","last_change":"2024-09-11T11:01:05.349740+0000","last_active":"2024-09-11T11:03:16.037418+0000","last_peered":"2024-09-11T11:03:16.037418+0000","last_clean":"2024-09-11T11:03:16.037418+0000","last_became_active":"2024-09-11T11:01:05.348827+0000","last_became_peered":"2024-09-11T11:01:05.348827+0000","last_unstale":"2024-09-11T11:03:16.037418+0000","last_undegraded":"2024-09-11T11:03:16.037418+0000","last_fullsized":"2024-09-11T11:03:16.037418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:11.303487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'3","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110919+0000","last_change":"2024-09-11T11:01:03.333973+0000","last_active":"2024-09-11T11:02:42.110919+0000","last_peered":"2024-09-11T11:02:42.110919+0000","last_clean":"2024-09-11T11:02:42.110919+0000","last_became_active":"2024-09-11T11:01:03.333729+0000","last_became_peered":"2024-09-11T11:01:03.333729+0000","last_unstale":"2024-09-11T11:02:42.110919+0000","last_undegraded":"2024-09-11T11:02:42.110919+0000","last_fullsized":"2024-09-11T11:02:42.110919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:23.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.853794+0000","last_change":"2024-09-11T11:01:05.333462+0000","last_active":"2024-09-11T11:04:17.853794+0000","last_peered":"2024-09-11T11:04:17.853794+0000","last_clean":"2024-09-11T11:04:17.853794+0000","last_became_active":"2024-09-11T11:01:05.332274+0000","last_became_peered":"2024-09-11T11:01:05.332274+0000","last_unstale":"2024-09-11T11:04:17.853794+0000","last_undegraded":"2024-09-11T11:04:17.853794+0000","last_fullsized":"2024-09-11T11:04:17.853794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:09.062077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498350+0000","last_change":"2024-09-11T11:01:03.335348+0000","last_active":"2024-09-11T11:02:42.498350+0000","last_peered":"2024-09-11T11:02:42.498350+0000","last_clean":"2024-09-11T11:02:42.498350+0000","last_became_active":"2024-09-11T11:01:03.335054+0000","last_became_peered":"2024-09-11T11:01:03.335054+0000","last_unstale":"2024-09-11T11:02:42.498350+0000","last_undegraded":"2024-09-11T11:02:42.498350+0000","last_fullsized":"2024-09-11T11:02:42.498350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:12.676263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115911+0000","last_change":"2024-09-11T11:01:05.343162+0000","last_active":"2024-09-11T11:02:42.115911+0000","last_peered":"2024-09-11T11:02:42.115911+0000","last_clean":"2024-09-11T11:02:42.115911+0000","last_became_active":"2024-09-11T11:01:05.330065+0000","last_became_peered":"2024-09-11T11:01:05.330065+0000","last_unstale":"2024-09-11T11:02:42.115911+0000","last_undegraded":"2024-09-11T11:02:42.115911+0000","last_fullsized":"2024-09-11T11:02:42.115911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:28.667270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114035+0000","last_change":"2024-09-11T11:01:03.351261+0000","last_active":"2024-09-11T11:02:42.114035+0000","last_peered":"2024-09-11T11:02:42.114035+0000","last_clean":"2024-09-11T11:02:42.114035+0000","last_became_active":"2024-09-11T11:01:03.349971+0000","last_became_peered":"2024-09-11T11:01:03.349971+0000","last_unstale":"2024-09-11T11:02:42.114035+0000","last_undegraded":"2024-09-11T11:02:42.114035+0000","last_fullsized":"2024-09-11T11:02:42.114035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:03.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842469+0000","last_change":"2024-09-11T11:01:05.342800+0000","last_active":"2024-09-11T11:02:42.842469+0000","last_peered":"2024-09-11T11:02:42.842469+0000","last_clean":"2024-09-11T11:02:42.842469+0000","last_became_active":"2024-09-11T11:01:05.342092+0000","last_became_peered":"2024-09-11T11:01:05.342092+0000","last_unstale":"2024-09-11T11:02:42.842469+0000","last_undegraded":"2024-09-11T11:02:42.842469+0000","last_fullsized":"2024-09-11T11:02:42.842469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:51.745730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844893+0000","last_change":"2024-09-11T11:01:42.061260+0000","last_active":"2024-09-11T11:02:42.844893+0000","last_peered":"2024-09-11T11:02:42.844893+0000","last_clean":"2024-09-11T11:02:42.844893+0000","last_became_active":"2024-09-11T11:01:42.060500+0000","last_became_peered":"2024-09-11T11:01:42.060500+0000","last_unstale":"2024-09-11T11:02:42.844893+0000","last_undegraded":"2024-09-11T11:02:42.844893+0000","last_fullsized":"2024-09-11T11:02:42.844893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:12.528032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.769675+0000","last_change":"2024-09-11T11:01:05.346623+0000","last_active":"2024-09-11T11:04:17.769675+0000","last_peered":"2024-09-11T11:04:17.769675+0000","last_clean":"2024-09-11T11:04:17.769675+0000","last_became_active":"2024-09-11T11:01:05.346179+0000","last_became_peered":"2024-09-11T11:01:05.346179+0000","last_unstale":"2024-09-11T11:04:17.769675+0000","last_undegraded":"2024-09-11T11:04:17.769675+0000","last_fullsized":"2024-09-11T11:04:17.769675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:30.170950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.348790+0000","last_change":"2024-09-11T11:01:03.317928+0000","last_active":"2024-09-11T11:04:17.348790+0000","last_peered":"2024-09-11T11:04:17.348790+0000","last_clean":"2024-09-11T11:04:17.348790+0000","last_became_active":"2024-09-11T11:01:03.315737+0000","last_became_peered":"2024-09-11T11:01:03.315737+0000","last_unstale":"2024-09-11T11:04:17.348790+0000","last_undegraded":"2024-09-11T11:04:17.348790+0000","last_fullsized":"2024-09-11T11:04:17.348790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:47.506757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:11.035873+0000","last_change":"2024-09-11T11:01:05.333619+0000","last_active":"2024-09-11T11:03:11.035873+0000","last_peered":"2024-09-11T11:03:11.035873+0000","last_clean":"2024-09-11T11:03:11.035873+0000","last_became_active":"2024-09-11T11:01:05.331901+0000","last_became_peered":"2024-09-11T11:01:05.331901+0000","last_unstale":"2024-09-11T11:03:11.035873+0000","last_undegraded":"2024-09-11T11:03:11.035873+0000","last_fullsized":"2024-09-11T11:03:11.035873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:08.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116431+0000","last_change":"2024-09-11T11:01:03.351395+0000","last_active":"2024-09-11T11:02:42.116431+0000","last_peered":"2024-09-11T11:02:42.116431+0000","last_clean":"2024-09-11T11:02:42.116431+0000","last_became_active":"2024-09-11T11:01:03.351125+0000","last_became_peered":"2024-09-11T11:01:03.351125+0000","last_unstale":"2024-09-11T11:02:42.116431+0000","last_undegraded":"2024-09-11T11:02:42.116431+0000","last_fullsized":"2024-09-11T11:02:42.116431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:02.814616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.040093+0000","last_change":"2024-09-11T11:01:05.333352+0000","last_active":"2024-09-11T11:03:28.040093+0000","last_peered":"2024-09-11T11:03:28.040093+0000","last_clean":"2024-09-11T11:03:28.040093+0000","last_became_active":"2024-09-11T11:01:05.332203+0000","last_became_peered":"2024-09-11T11:01:05.332203+0000","last_unstale":"2024-09-11T11:03:28.040093+0000","last_undegraded":"2024-09-11T11:03:28.040093+0000","last_fullsized":"2024-09-11T11:03:28.040093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:03.791497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109549+0000","last_change":"2024-09-11T11:01:03.337164+0000","last_active":"2024-09-11T11:02:42.109549+0000","last_peered":"2024-09-11T11:02:42.109549+0000","last_clean":"2024-09-11T11:02:42.109549+0000","last_became_active":"2024-09-11T11:01:03.336786+0000","last_became_peered":"2024-09-11T11:01:03.336786+0000","last_unstale":"2024-09-11T11:02:42.109549+0000","last_undegraded":"2024-09-11T11:02:42.109549+0000","last_fullsized":"2024-09-11T11:02:42.109549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:42.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.920771+0000","last_change":"2024-09-11T11:01:05.333095+0000","last_active":"2024-09-11T11:04:17.920771+0000","last_peered":"2024-09-11T11:04:17.920771+0000","last_clean":"2024-09-11T11:04:17.920771+0000","last_became_active":"2024-09-11T11:01:05.332747+0000","last_became_peered":"2024-09-11T11:01:05.332747+0000","last_unstale":"2024-09-11T11:04:17.920771+0000","last_undegraded":"2024-09-11T11:04:17.920771+0000","last_fullsized":"2024-09-11T11:04:17.920771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:41:08.367843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.571216+0000","last_change":"2024-09-11T11:01:03.336167+0000","last_active":"2024-09-11T11:03:16.571216+0000","last_peered":"2024-09-11T11:03:16.571216+0000","last_clean":"2024-09-11T11:03:16.571216+0000","last_became_active":"2024-09-11T11:01:03.335854+0000","last_became_peered":"2024-09-11T11:01:03.335854+0000","last_unstale":"2024-09-11T11:03:16.571216+0000","last_undegraded":"2024-09-11T11:03:16.571216+0000","last_fullsized":"2024-09-11T11:03:16.571216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:04:39.058034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499524+0000","last_change":"2024-09-11T11:01:05.344244+0000","last_active":"2024-09-11T11:02:42.499524+0000","last_peered":"2024-09-11T11:02:42.499524+0000","last_clean":"2024-09-11T11:02:42.499524+0000","last_became_active":"2024-09-11T11:01:05.343590+0000","last_became_peered":"2024-09-11T11:01:05.343590+0000","last_unstale":"2024-09-11T11:02:42.499524+0000","last_undegraded":"2024-09-11T11:02:42.499524+0000","last_fullsized":"2024-09-11T11:02:42.499524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:30.774404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124182+0000","last_change":"2024-09-11T11:01:03.339537+0000","last_active":"2024-09-11T11:02:42.124182+0000","last_peered":"2024-09-11T11:02:42.124182+0000","last_clean":"2024-09-11T11:02:42.124182+0000","last_became_active":"2024-09-11T11:01:03.336224+0000","last_became_peered":"2024-09-11T11:01:03.336224+0000","last_unstale":"2024-09-11T11:02:42.124182+0000","last_undegraded":"2024-09-11T11:02:42.124182+0000","last_fullsized":"2024-09-11T11:02:42.124182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:32.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845373+0000","last_change":"2024-09-11T11:01:05.342088+0000","last_active":"2024-09-11T11:02:42.845373+0000","last_peered":"2024-09-11T11:02:42.845373+0000","last_clean":"2024-09-11T11:02:42.845373+0000","last_became_active":"2024-09-11T11:01:05.341761+0000","last_became_peered":"2024-09-11T11:01:05.341761+0000","last_unstale":"2024-09-11T11:02:42.845373+0000","last_undegraded":"2024-09-11T11:02:42.845373+0000","last_fullsized":"2024-09-11T11:02:42.845373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:27:41.532168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843144+0000","last_change":"2024-09-11T11:01:03.320022+0000","last_active":"2024-09-11T11:02:42.843144+0000","last_peered":"2024-09-11T11:02:42.843144+0000","last_clean":"2024-09-11T11:02:42.843144+0000","last_became_active":"2024-09-11T11:01:03.318984+0000","last_became_peered":"2024-09-11T11:01:03.318984+0000","last_unstale":"2024-09-11T11:02:42.843144+0000","last_undegraded":"2024-09-11T11:02:42.843144+0000","last_fullsized":"2024-09-11T11:02:42.843144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:12.827913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770617+0000","last_change":"2024-09-11T11:01:42.059933+0000","last_active":"2024-09-11T11:04:17.770617+0000","last_peered":"2024-09-11T11:04:17.770617+0000","last_clean":"2024-09-11T11:04:17.770617+0000","last_became_active":"2024-09-11T11:01:42.059147+0000","last_became_peered":"2024-09-11T11:01:42.059147+0000","last_unstale":"2024-09-11T11:04:17.770617+0000","last_undegraded":"2024-09-11T11:04:17.770617+0000","last_fullsized":"2024-09-11T11:04:17.770617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:38.857591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112605+0000","last_change":"2024-09-11T11:01:03.350789+0000","last_active":"2024-09-11T11:02:42.112605+0000","last_peered":"2024-09-11T11:02:42.112605+0000","last_clean":"2024-09-11T11:02:42.112605+0000","last_became_active":"2024-09-11T11:01:03.349120+0000","last_became_peered":"2024-09-11T11:01:03.349120+0000","last_unstale":"2024-09-11T11:02:42.112605+0000","last_undegraded":"2024-09-11T11:02:42.112605+0000","last_fullsized":"2024-09-11T11:02:42.112605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:22.337303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938385+0000","last_change":"2024-09-11T11:01:05.343458+0000","last_active":"2024-09-11T11:04:17.938385+0000","last_peered":"2024-09-11T11:04:17.938385+0000","last_clean":"2024-09-11T11:04:17.938385+0000","last_became_active":"2024-09-11T11:01:05.343121+0000","last_became_peered":"2024-09-11T11:01:05.343121+0000","last_unstale":"2024-09-11T11:04:17.938385+0000","last_undegraded":"2024-09-11T11:04:17.938385+0000","last_fullsized":"2024-09-11T11:04:17.938385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:38.168723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844476+0000","last_change":"2024-09-11T11:01:42.056195+0000","last_active":"2024-09-11T11:02:42.844476+0000","last_peered":"2024-09-11T11:02:42.844476+0000","last_clean":"2024-09-11T11:02:42.844476+0000","last_became_active":"2024-09-11T11:01:42.055356+0000","last_became_peered":"2024-09-11T11:01:42.055356+0000","last_unstale":"2024-09-11T11:02:42.844476+0000","last_undegraded":"2024-09-11T11:02:42.844476+0000","last_fullsized":"2024-09-11T11:02:42.844476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:33.310470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110479+0000","last_change":"2024-09-11T11:01:05.346901+0000","last_active":"2024-09-11T11:02:42.110479+0000","last_peered":"2024-09-11T11:02:42.110479+0000","last_clean":"2024-09-11T11:02:42.110479+0000","last_became_active":"2024-09-11T11:01:05.346563+0000","last_became_peered":"2024-09-11T11:01:05.346563+0000","last_unstale":"2024-09-11T11:02:42.110479+0000","last_undegraded":"2024-09-11T11:02:42.110479+0000","last_fullsized":"2024-09-11T11:02:42.110479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:02.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499542+0000","last_change":"2024-09-11T11:01:03.316299+0000","last_active":"2024-09-11T11:02:42.499542+0000","last_peered":"2024-09-11T11:02:42.499542+0000","last_clean":"2024-09-11T11:02:42.499542+0000","last_became_active":"2024-09-11T11:01:03.315651+0000","last_became_peered":"2024-09-11T11:01:03.315651+0000","last_unstale":"2024-09-11T11:02:42.499542+0000","last_undegraded":"2024-09-11T11:02:42.499542+0000","last_fullsized":"2024-09-11T11:02:42.499542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:12:09.647986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.818259+0000","last_change":"2024-09-11T11:01:05.348683+0000","last_active":"2024-09-11T11:03:16.818259+0000","last_peered":"2024-09-11T11:03:16.818259+0000","last_clean":"2024-09-11T11:03:16.818259+0000","last_became_active":"2024-09-11T11:01:05.347760+0000","last_became_peered":"2024-09-11T11:01:05.347760+0000","last_unstale":"2024-09-11T11:03:16.818259+0000","last_undegraded":"2024-09-11T11:03:16.818259+0000","last_fullsized":"2024-09-11T11:03:16.818259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:28:39.642991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116664+0000","last_change":"2024-09-11T11:01:03.340726+0000","last_active":"2024-09-11T11:02:42.116664+0000","last_peered":"2024-09-11T11:02:42.116664+0000","last_clean":"2024-09-11T11:02:42.116664+0000","last_became_active":"2024-09-11T11:01:03.337667+0000","last_became_peered":"2024-09-11T11:01:03.337667+0000","last_unstale":"2024-09-11T11:02:42.116664+0000","last_undegraded":"2024-09-11T11:02:42.116664+0000","last_fullsized":"2024-09-11T11:02:42.116664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:41:38.836874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121715+0000","last_change":"2024-09-11T11:01:03.322086+0000","last_active":"2024-09-11T11:02:42.121715+0000","last_peered":"2024-09-11T11:02:42.121715+0000","last_clean":"2024-09-11T11:02:42.121715+0000","last_became_active":"2024-09-11T11:01:03.321242+0000","last_became_peered":"2024-09-11T11:01:03.321242+0000","last_unstale":"2024-09-11T11:02:42.121715+0000","last_undegraded":"2024-09-11T11:02:42.121715+0000","last_fullsized":"2024-09-11T11:02:42.121715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:55.170368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.437700+0000","last_change":"2024-09-11T11:01:05.344698+0000","last_active":"2024-09-11T11:04:17.437700+0000","last_peered":"2024-09-11T11:04:17.437700+0000","last_clean":"2024-09-11T11:04:17.437700+0000","last_became_active":"2024-09-11T11:01:05.344285+0000","last_became_peered":"2024-09-11T11:01:05.344285+0000","last_unstale":"2024-09-11T11:04:17.437700+0000","last_undegraded":"2024-09-11T11:04:17.437700+0000","last_fullsized":"2024-09-11T11:04:17.437700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:08:02.954788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842659+0000","last_change":"2024-09-11T11:01:03.325391+0000","last_active":"2024-09-11T11:02:42.842659+0000","last_peered":"2024-09-11T11:02:42.842659+0000","last_clean":"2024-09-11T11:02:42.842659+0000","last_became_active":"2024-09-11T11:01:03.320391+0000","last_became_peered":"2024-09-11T11:01:03.320391+0000","last_unstale":"2024-09-11T11:02:42.842659+0000","last_undegraded":"2024-09-11T11:02:42.842659+0000","last_fullsized":"2024-09-11T11:02:42.842659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:25:59.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498432+0000","last_change":"2024-09-11T11:01:42.076222+0000","last_active":"2024-09-11T11:02:42.498432+0000","last_peered":"2024-09-11T11:02:42.498432+0000","last_clean":"2024-09-11T11:02:42.498432+0000","last_became_active":"2024-09-11T11:01:42.069954+0000","last_became_peered":"2024-09-11T11:01:42.069954+0000","last_unstale":"2024-09-11T11:02:42.498432+0000","last_undegraded":"2024-09-11T11:02:42.498432+0000","last_fullsized":"2024-09-11T11:02:42.498432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:10:17.552581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1608,"num_read_kb":1498,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25805696,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":130,"num_read_kb":83,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":51617792,"data_stored":51611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":5172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":5296128,"data_stored":4991137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48684,"kb_used_data":9180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323156,"statfs":{"total":96636764160,"available":96586911744,"internally_reserved":0,"allocated":9400320,"data_stored":9132733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61668,"kb_used_data":22164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94310172,"statfs":{"total":96636764160,"available":96573616128,"internally_reserved":0,"allocated":22695936,"data_stored":22359925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705714,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56380,"kb_used_data":16876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94315460,"statfs":{"total":96636764160,"available":96579031040,"internally_reserved":0,"allocated":17281024,"data_stored":16933829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:04:50.641 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T11:04:50.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a43a5640 1 Processor -- start 2024-09-11T11:04:50.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a43a5640 1 -- start start 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a43a5640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff39c073290 0x7ff39c095600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a43a5640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39c096880 con 0x7ff39c095b40 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a43a5640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff39c09df00 con 0x7ff39c073290 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a2141640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff39c073290 0x7ff39c095600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a1940640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff39c095b40 0x7ff39c131280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50610/0 (socket says 172.21.15.102:50610) 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a2141640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff39c073290 0x7ff39c095600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48596/0 (socket says 172.21.15.102:48596) 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a2141640 1 -- 172.21.15.102:0/1364122125 learned_addr learned my addr 172.21.15.102:0/1364122125 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a2141640 1 -- 172.21.15.102:0/1364122125 >> v1:172.21.15.102:6789/0 conn(0x7ff39c095b40 legacy=0x7ff39c131280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a2141640 1 -- 172.21.15.102:0/1364122125 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c096ca0 con 0x7ff39c073290 2024-09-11T11:04:50.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.795+0000 7ff3a113f640 1 -- 172.21.15.102:0/1364122125 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086869246 0 0) 0x7ff39c096880 con 0x7ff39c095b40 2024-09-11T11:04:50.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a2141640 1 --2- 172.21.15.102:0/1364122125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c095600 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff3980097f0 tx=0x7ff39801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d4799dbda9795e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:50.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a113f640 1 -- 172.21.15.102:0/1364122125 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3980ab580 con 0x7ff39c073290 2024-09-11T11:04:50.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a113f640 1 -- 172.21.15.102:0/1364122125 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3980b0070 con 0x7ff39c073290 2024-09-11T11:04:50.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a113f640 1 -- 172.21.15.102:0/1364122125 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3980ab870 con 0x7ff39c073290 2024-09-11T11:04:50.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- 172.21.15.102:0/1364122125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 msgr2=0x7ff39c095600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 --2- 172.21.15.102:0/1364122125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c095600 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7ff3980097f0 tx=0x7ff39801c430 comp rx=0 tx=0).stop 2024-09-11T11:04:50.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- 172.21.15.102:0/1364122125 shutdown_connections 2024-09-11T11:04:50.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 --2- 172.21.15.102:0/1364122125 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c095600 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- 172.21.15.102:0/1364122125 >> 172.21.15.102:0/1364122125 conn(0x7ff39c09d6f0 msgr2=0x7ff39c099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:50.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- 172.21.15.102:0/1364122125 shutdown_connections 2024-09-11T11:04:50.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- 172.21.15.102:0/1364122125 wait complete. 2024-09-11T11:04:50.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 Processor -- start 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- start start 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c1c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c074fe0 con 0x7ff39c073290 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a2141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c1c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a2141640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c1c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48612/0 (socket says 172.21.15.102:48612) 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a2141640 1 -- 172.21.15.102:0/3092201558 learned_addr learned my addr 172.21.15.102:0/3092201558 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a2141640 1 -- 172.21.15.102:0/3092201558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c0973f0 con 0x7ff39c073290 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a2141640 1 --2- 172.21.15.102:0/3092201558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c1c68b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff39801aae0 tx=0x7ff39801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff392ffd640 1 -- 172.21.15.102:0/3092201558 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3980ba070 con 0x7ff39c073290 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff392ffd640 1 -- 172.21.15.102:0/3092201558 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3980abb80 con 0x7ff39c073290 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c1256b0 con 0x7ff39c073290 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff392ffd640 1 -- 172.21.15.102:0/3092201558 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3980abe60 con 0x7ff39c073290 2024-09-11T11:04:50.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.799+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c125d40 con 0x7ff39c073290 2024-09-11T11:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.803+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff39c095600 con 0x7ff39c073290 2024-09-11T11:04:50.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.803+0000 7ff392ffd640 1 -- 172.21.15.102:0/3092201558 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ff3980be450 con 0x7ff39c073290 2024-09-11T11:04:50.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.803+0000 7ff392ffd640 1 --2- 172.21.15.102:0/3092201558 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff380035d60 0x7ff380038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:50.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.803+0000 7ff392ffd640 1 -- 172.21.15.102:0/3092201558 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7ff3980e3400 con 0x7ff39c073290 2024-09-11T11:04:50.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.803+0000 7ff3a1940640 1 --2- 172.21.15.102:0/3092201558 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff380035d60 0x7ff380038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:50.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.803+0000 7ff3a1940640 1 --2- 172.21.15.102:0/3092201558 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff380035d60 0x7ff380038220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff38c007fd0 tx=0x7ff38c007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:50.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.807+0000 7ff392ffd640 1 -- 172.21.15.102:0/3092201558 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff3980160b0 con 0x7ff39c073290 2024-09-11T11:04:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.959+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff39c09a300 con 0x7ff39c073290 2024-09-11T11:04:50.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff392ffd640 1 -- 172.21.15.102:0/3092201558 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+21381 (secure 0 0 0) 0x7ff3980b3540 con 0x7ff39c073290 2024-09-11T11:04:50.967 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:04:50.967 INFO:teuthology.orchestra.run.smithi102.stdout:{"epoch":36,"fsid":"2f203b3f-97d8-4a3b-bc37-33833403bb89","created":"2024-09-11T11:00:36.331917+0000","modified":"2024-09-11T11:02:42.093203+0000","last_up_change":"2024-09-11T11:00:47.426191+0000","last_in_change":"2024-09-11T11:00:37.468939+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T11:00:49.009964+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T11:00:52.107760+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-11T11:01:01.452309+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-11T11:01:03.680456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-11T11:01:05.601707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-11T11:01:07.516513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-11T11:01:09.426077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-11T11:01:11.567257+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c9cea281-6c68-455d-84fe-43662e932c43","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6801","nonce":3035634142}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6803","nonce":3035634142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6807","nonce":3035634142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3035634142},{"type":"v1","addr":"172.21.15.102:6805","nonce":3035634142}]},"public_addr":"172.21.15.102:6801/3035634142","cluster_addr":"172.21.15.102:6803/3035634142","heartbeat_back_addr":"172.21.15.102:6807/3035634142","heartbeat_front_addr":"172.21.15.102:6805/3035634142","state":["exists","up"]},{"osd":1,"uuid":"cde5215c-172e-4c43-9180-9619ea7bfc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6808","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6809","nonce":1879781812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6810","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6811","nonce":1879781812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6814","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6815","nonce":1879781812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6812","nonce":1879781812},{"type":"v1","addr":"172.21.15.145:6813","nonce":1879781812}]},"public_addr":"172.21.15.145:6809/1879781812","cluster_addr":"172.21.15.145:6811/1879781812","heartbeat_back_addr":"172.21.15.145:6815/1879781812","heartbeat_front_addr":"172.21.15.145:6813/1879781812","state":["exists","up"]},{"osd":2,"uuid":"1d00ec9b-54e3-4e8f-9c74-1deeb015da2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6816","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6817","nonce":446921044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6818","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6819","nonce":446921044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6822","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6823","nonce":446921044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6820","nonce":446921044},{"type":"v1","addr":"172.21.15.145:6821","nonce":446921044}]},"public_addr":"172.21.15.145:6817/446921044","cluster_addr":"172.21.15.145:6819/446921044","heartbeat_back_addr":"172.21.15.145:6823/446921044","heartbeat_front_addr":"172.21.15.145:6821/446921044","state":["exists","up"]},{"osd":3,"uuid":"8c84c992-dc47-43d3-9cfb-f83d4052d9a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6800","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6801","nonce":493661776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6802","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6803","nonce":493661776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6806","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6807","nonce":493661776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.145:6804","nonce":493661776},{"type":"v1","addr":"172.21.15.145:6805","nonce":493661776}]},"public_addr":"172.21.15.145:6801/493661776","cluster_addr":"172.21.15.145:6803/493661776","heartbeat_back_addr":"172.21.15.145:6807/493661776","heartbeat_front_addr":"172.21.15.145:6805/493661776","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.674297+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.654148+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:45.317003+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T11:00:44.920650+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":3,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"3.2d","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.11","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":0,"to":2}]},{"pgid":"4.31","mappings":[{"from":0,"to":2}]},{"pgid":"4.36","mappings":[{"from":1,"to":2}]},{"pgid":"5.b","mappings":[{"from":1,"to":3}]},{"pgid":"5.13","mappings":[{"from":1,"to":2}]},{"pgid":"6.c","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T11:04:50.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff380035d60 msgr2=0x7ff380038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 --2- 172.21.15.102:0/3092201558 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff380035d60 0x7ff380038220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff38c007fd0 tx=0x7ff38c007940 comp rx=0 tx=0).stop 2024-09-11T11:04:50.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 msgr2=0x7ff39c1c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:50.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 --2- 172.21.15.102:0/3092201558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c1c68b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff39801aae0 tx=0x7ff39801ac70 comp rx=0 tx=0).stop 2024-09-11T11:04:50.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 shutdown_connections 2024-09-11T11:04:50.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 --2- 172.21.15.102:0/3092201558 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ff380035d60 0x7ff380038220 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 --2- 172.21.15.102:0/3092201558 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff39c073290 0x7ff39c1c68b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:50.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 >> 172.21.15.102:0/3092201558 conn(0x7ff39c09d6f0 msgr2=0x7ff39c093070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:50.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 shutdown_connections 2024-09-11T11:04:50.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:50.967+0000 7ff3a43a5640 1 -- 172.21.15.102:0/3092201558 wait complete. 2024-09-11T11:04:51.985 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T11:04:51.985 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T11:04:52.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.115+0000 7f479a6fd640 1 Processor -- start 2024-09-11T11:04:52.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.115+0000 7f479a6fd640 1 -- start start 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f479a6fd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f479406dc60 0x7f4794131b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f479a6fd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4794098840 con 0x7f479406d170 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f479a6fd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f47940709c0 con 0x7f479406dc60 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f47937fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f479406dc60 0x7f4794131b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f47937fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f479406dc60 0x7f4794131b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48624/0 (socket says 172.21.15.102:48624) 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f4793fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f479406d170 0x7f479406d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50620/0 (socket says 172.21.15.102:50620) 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f47937fe640 1 -- 172.21.15.102:0/370245261 learned_addr learned my addr 172.21.15.102:0/370245261 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f47937fe640 1 -- 172.21.15.102:0/370245261 >> v1:172.21.15.102:6789/0 conn(0x7f479406d170 legacy=0x7f479406d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f47937fe640 1 -- 172.21.15.102:0/370245261 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4794071e20 con 0x7f479406dc60 2024-09-11T11:04:52.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f4792ffd640 1 -- 172.21.15.102:0/370245261 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327232293 0 0) 0x7f4794098840 con 0x7f479406d170 2024-09-11T11:04:52.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f47937fe640 1 --2- 172.21.15.102:0/370245261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406dc60 0x7f4794131b40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f47840097f0 tx=0x7f478401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21472e370b6641e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f4792ffd640 1 -- 172.21.15.102:0/370245261 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47840b0070 con 0x7f479406dc60 2024-09-11T11:04:52.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f4792ffd640 1 -- 172.21.15.102:0/370245261 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47840ab530 con 0x7f479406dc60 2024-09-11T11:04:52.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f4792ffd640 1 -- 172.21.15.102:0/370245261 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47840ab830 con 0x7f479406dc60 2024-09-11T11:04:52.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f479a6fd640 1 -- 172.21.15.102:0/370245261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406dc60 msgr2=0x7f4794131b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f479a6fd640 1 --2- 172.21.15.102:0/370245261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406dc60 0x7f4794131b40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f47840097f0 tx=0x7f478401c430 comp rx=0 tx=0).stop 2024-09-11T11:04:52.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f479a6fd640 1 -- 172.21.15.102:0/370245261 shutdown_connections 2024-09-11T11:04:52.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f479a6fd640 1 --2- 172.21.15.102:0/370245261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406dc60 0x7f4794131b40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.119+0000 7f479a6fd640 1 -- 172.21.15.102:0/370245261 >> 172.21.15.102:0/370245261 conn(0x7f47940998a0 msgr2=0x7f4794099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:52.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 -- 172.21.15.102:0/370245261 shutdown_connections 2024-09-11T11:04:52.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 -- 172.21.15.102:0/370245261 wait complete. 2024-09-11T11:04:52.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 Processor -- start 2024-09-11T11:04:52.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 -- start start 2024-09-11T11:04:52.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406d170 0x7f479412e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4794134c30 con 0x7f479406d170 2024-09-11T11:04:52.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4793fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406d170 0x7f479412e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4793fff640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406d170 0x7f479412e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48628/0 (socket says 172.21.15.102:48628) 2024-09-11T11:04:52.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4793fff640 1 -- 172.21.15.102:0/419741221 learned_addr learned my addr 172.21.15.102:0/419741221 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:52.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4793fff640 1 -- 172.21.15.102:0/419741221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47940723e0 con 0x7f479406d170 2024-09-11T11:04:52.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4793fff640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406d170 0x7f479412e680 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c420 tx=0x7f477c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c018070 con 0x7f479406d170 2024-09-11T11:04:52.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477c0074d0 con 0x7f479406d170 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4794096640 con 0x7f479406d170 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f477c004960 con 0x7f479406d170 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f479412ebc0 con 0x7f479406d170 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4794096180 con 0x7f479406d170 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f477c01b070 con 0x7f479406d170 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4774035db0 0x7f4774038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f477c0483e0 con 0x7f479406d170 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7f4774041d90 0x7f4774044230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4774044900 con 0x7f4774041d90 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f477c04f050 con 0x7f479406d170 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4798c9a640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7f4774041d90 0x7f4774044230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f47937fe640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4774035db0 0x7f4774038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.123+0000 7f4798c9a640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7f4774041d90 0x7f4774044230 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.127+0000 7f47937fe640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4774035db0 0x7f4774038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4794075310 tx=0x7f47840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.127+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 <== osd.0 v2:172.21.15.102:6800/3035634142 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4774044900 con 0x7f4774041d90 2024-09-11T11:04:52.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 --> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f479406d550 con 0x7f4774041d90 2024-09-11T11:04:52.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f4790ff9640 1 -- 172.21.15.102:0/419741221 <== osd.0 v2:172.21.15.102:6800/3035634142 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f479406d550 con 0x7f4774041d90 2024-09-11T11:04:52.141 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-11T11:04:52.141 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T11:04:52.141 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-11T11:04:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7f4774041d90 msgr2=0x7f4774044230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7f4774041d90 0x7f4774044230 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4774035db0 msgr2=0x7f4774038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4774035db0 0x7f4774038270 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4794075310 tx=0x7f47840a6000 comp rx=0 tx=0).stop 2024-09-11T11:04:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406d170 msgr2=0x7f479412e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406d170 0x7f479412e680 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f477c00c420 tx=0x7f477c00c8e0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 shutdown_connections 2024-09-11T11:04:52.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:6800/3035634142,v1:172.21.15.102:6801/3035634142] conn(0x7f4774041d90 0x7f4774044230 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4774035db0 0x7f4774038270 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 --2- 172.21.15.102:0/419741221 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f479406d170 0x7f479412e680 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 >> 172.21.15.102:0/419741221 conn(0x7f47940998a0 msgr2=0x7f479408ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 shutdown_connections 2024-09-11T11:04:52.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.139+0000 7f479a6fd640 1 -- 172.21.15.102:0/419741221 wait complete. 2024-09-11T11:04:52.156 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T11:04:52.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.267+0000 7f0350661640 1 Processor -- start 2024-09-11T11:04:52.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.267+0000 7f0350661640 1 -- start start 2024-09-11T11:04:52.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f0350661640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f034812cd50 0x7f034812d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f0350661640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034809e860 con 0x7f0348071c60 2024-09-11T11:04:52.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f0350661640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f034812d670 con 0x7f034812cd50 2024-09-11T11:04:52.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f034e3fd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f034812cd50 0x7f034812d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f034dbfc640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0348071c60 0x7f034806f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:50624/0 (socket says 172.21.15.102:50624) 2024-09-11T11:04:52.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f034dbfc640 1 -- 172.21.15.102:0/2391852950 learned_addr learned my addr 172.21.15.102:0/2391852950 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:52.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f034e3fd640 1 -- 172.21.15.102:0/2391852950 >> v1:172.21.15.102:6789/0 conn(0x7f0348071c60 legacy=0x7f034806f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f034e3fd640 1 -- 172.21.15.102:0/2391852950 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034812d820 con 0x7f034812cd50 2024-09-11T11:04:52.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.271+0000 7f034d3fb640 1 -- 172.21.15.102:0/2391852950 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3136723896 0 0) 0x7f034809e860 con 0x7f0348071c60 2024-09-11T11:04:52.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034e3fd640 1 --2- 172.21.15.102:0/2391852950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f034812cd50 0x7f034812d130 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0344009740 tx=0x7f034401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f53840caab7e914 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034d3fb640 1 -- 172.21.15.102:0/2391852950 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03440ab550 con 0x7f034812cd50 2024-09-11T11:04:52.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034d3fb640 1 -- 172.21.15.102:0/2391852950 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03440b0070 con 0x7f034812cd50 2024-09-11T11:04:52.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034d3fb640 1 -- 172.21.15.102:0/2391852950 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03440ab840 con 0x7f034812cd50 2024-09-11T11:04:52.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- 172.21.15.102:0/2391852950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f034812cd50 msgr2=0x7f034812d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 --2- 172.21.15.102:0/2391852950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f034812cd50 0x7f034812d130 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0344009740 tx=0x7f034401c400 comp rx=0 tx=0).stop 2024-09-11T11:04:52.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- 172.21.15.102:0/2391852950 shutdown_connections 2024-09-11T11:04:52.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 --2- 172.21.15.102:0/2391852950 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f034812cd50 0x7f034812d130 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- 172.21.15.102:0/2391852950 >> 172.21.15.102:0/2391852950 conn(0x7f034809cd30 msgr2=0x7f034809d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:52.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- 172.21.15.102:0/2391852950 shutdown_connections 2024-09-11T11:04:52.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- 172.21.15.102:0/2391852950 wait complete. 2024-09-11T11:04:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 Processor -- start 2024-09-11T11:04:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- start start 2024-09-11T11:04:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0348071c60 0x7f03480979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0348070b10 con 0x7f0348071c60 2024-09-11T11:04:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034e3fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0348071c60 0x7f03480979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034e3fd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0348071c60 0x7f03480979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:48644/0 (socket says 172.21.15.102:48644) 2024-09-11T11:04:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034e3fd640 1 -- 172.21.15.102:0/2729545983 learned_addr learned my addr 172.21.15.102:0/2729545983 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:52.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034e3fd640 1 -- 172.21.15.102:0/2729545983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034808b380 con 0x7f0348071c60 2024-09-11T11:04:52.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f034e3fd640 1 --2- 172.21.15.102:0/2729545983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0348071c60 0x7f03480979b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0344019010 tx=0x7f034401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f033effd640 1 -- 172.21.15.102:0/2729545983 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03440abe30 con 0x7f0348071c60 2024-09-11T11:04:52.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f033effd640 1 -- 172.21.15.102:0/2729545983 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0344004020 con 0x7f0348071c60 2024-09-11T11:04:52.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034812c4b0 con 0x7f0348071c60 2024-09-11T11:04:52.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f033effd640 1 -- 172.21.15.102:0/2729545983 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0344004300 con 0x7f0348071c60 2024-09-11T11:04:52.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.275+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03480980c0 con 0x7f0348071c60 2024-09-11T11:04:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.279+0000 7f033effd640 1 -- 172.21.15.102:0/2729545983 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0344003620 con 0x7f0348071c60 2024-09-11T11:04:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.279+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f034812b1d0 con 0x7f0348071c60 2024-09-11T11:04:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.279+0000 7f033effd640 1 --2- 172.21.15.102:0/2729545983 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f032c035db0 0x7f032c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.279+0000 7f033effd640 1 -- 172.21.15.102:0/2729545983 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f03440e3900 con 0x7f0348071c60 2024-09-11T11:04:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.279+0000 7f034dbfc640 1 --2- 172.21.15.102:0/2729545983 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f032c035db0 0x7f032c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.279+0000 7f034dbfc640 1 --2- 172.21.15.102:0/2729545983 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f032c035db0 0x7f032c038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0338007fd0 tx=0x7f0338007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.283+0000 7f033effd640 1 -- 172.21.15.102:0/2729545983 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0344015ff0 con 0x7f0348071c60 2024-09-11T11:04:52.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.431+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f0348072cd0 con 0x7f032c035db0 2024-09-11T11:04:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f033effd640 1 -- 172.21.15.102:0/2729545983 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f03380070d0 con 0x7f032c035db0 2024-09-11T11:04:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f032c035db0 msgr2=0x7f032c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 --2- 172.21.15.102:0/2729545983 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f032c035db0 0x7f032c038270 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0338007fd0 tx=0x7f0338007920 comp rx=0 tx=0).stop 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0348071c60 msgr2=0x7f03480979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 --2- 172.21.15.102:0/2729545983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0348071c60 0x7f03480979b0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0344019010 tx=0x7f034401ac40 comp rx=0 tx=0).stop 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 shutdown_connections 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 --2- 172.21.15.102:0/2729545983 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f032c035db0 0x7f032c038270 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 --2- 172.21.15.102:0/2729545983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0348071c60 0x7f03480979b0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 >> 172.21.15.102:0/2729545983 conn(0x7f034809cd30 msgr2=0x7f0348099600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 shutdown_connections 2024-09-11T11:04:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.435+0000 7f0350661640 1 -- 172.21.15.102:0/2729545983 wait complete. 2024-09-11T11:04:52.453 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T11:04:52.453 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T11:04:52.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdfcd6640 1 Processor -- start 2024-09-11T11:04:52.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdfcd6640 1 -- start start 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdfcd6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7bd806dc60 0x7f7bd8130200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdfcd6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd806ec90 con 0x7f7bd806d170 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdfcd6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd806f620 con 0x7f7bd806dc60 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdd271640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7bd806dc60 0x7f7bd8130200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdda72640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7bd806d170 0x7f7bd806d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40656/0 (socket says 172.21.15.102:40656) 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdda72640 1 -- 172.21.15.102:0/3413151609 learned_addr learned my addr 172.21.15.102:0/3413151609 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdd271640 1 -- 172.21.15.102:0/3413151609 >> v1:172.21.15.102:6789/0 conn(0x7f7bd806d170 legacy=0x7f7bd806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdca70640 1 -- 172.21.15.102:0/3413151609 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184329193 0 0) 0x7f7bd806ec90 con 0x7f7bd806d170 2024-09-11T11:04:52.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.571+0000 7f7bdd271640 1 -- 172.21.15.102:0/3413151609 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd80990d0 con 0x7f7bd806dc60 2024-09-11T11:04:52.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdd271640 1 --2- 172.21.15.102:0/3413151609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806dc60 0x7f7bd8130200 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009740 tx=0x7f7bc801c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78c9c6422afbe15 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdca70640 1 -- 172.21.15.102:0/3413151609 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc80b0070 con 0x7f7bd806dc60 2024-09-11T11:04:52.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdca70640 1 -- 172.21.15.102:0/3413151609 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc80ab530 con 0x7f7bd806dc60 2024-09-11T11:04:52.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdca70640 1 -- 172.21.15.102:0/3413151609 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bc80ab830 con 0x7f7bd806dc60 2024-09-11T11:04:52.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/3413151609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806dc60 msgr2=0x7f7bd8130200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 --2- 172.21.15.102:0/3413151609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806dc60 0x7f7bd8130200 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009740 tx=0x7f7bc801c310 comp rx=0 tx=0).stop 2024-09-11T11:04:52.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/3413151609 shutdown_connections 2024-09-11T11:04:52.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 --2- 172.21.15.102:0/3413151609 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806dc60 0x7f7bd8130200 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/3413151609 >> 172.21.15.102:0/3413151609 conn(0x7f7bd80998a0 msgr2=0x7f7bd8099cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:52.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/3413151609 shutdown_connections 2024-09-11T11:04:52.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/3413151609 wait complete. 2024-09-11T11:04:52.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 Processor -- start 2024-09-11T11:04:52.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- start start 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806d170 0x7f7bd812aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd81330e0 con 0x7f7bd806d170 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdda72640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806d170 0x7f7bd812aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdda72640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806d170 0x7f7bd812aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57774/0 (socket says 172.21.15.102:57774) 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdda72640 1 -- 172.21.15.102:0/2044673103 learned_addr learned my addr 172.21.15.102:0/2044673103 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdda72640 1 -- 172.21.15.102:0/2044673103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd809c070 con 0x7f7bd806d170 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdda72640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806d170 0x7f7bd812aef0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c420 tx=0x7f7bd400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bd4018070 con 0x7f7bd806d170 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd40074d0 con 0x7f7bd806d170 2024-09-11T11:04:52.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd809b990 con 0x7f7bd806d170 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7bd4004960 con 0x7f7bd806d170 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.575+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd8128f80 con 0x7f7bd806d170 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7bd8128930 con 0x7f7bd806d170 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f7bd401b070 con 0x7f7bd806d170 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bce7fc640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7bbc035db0 0x7f7bbc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f7bd40483b0 con 0x7f7bd806d170 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bce7fc640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f7bbc041d90 0x7f7bbc044230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7bbc044900 con 0x7f7bbc041d90 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7bd404f050 con 0x7f7bd806d170 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bdd271640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7bbc035db0 0x7f7bbc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bde273640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f7bbc041d90 0x7f7bbc044230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bdd271640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7bbc035db0 0x7f7bbc038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80ad000 tx=0x7f7bc8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bde273640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f7bbc041d90 0x7f7bbc044230 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.579+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 <== osd.1 v2:172.21.15.145:6808/1879781812 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7bbc044900 con 0x7f7bbc041d90 2024-09-11T11:04:52.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 --> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7bd8096ed0 con 0x7f7bbc041d90 2024-09-11T11:04:52.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bce7fc640 1 -- 172.21.15.102:0/2044673103 <== osd.1 v2:172.21.15.145:6808/1879781812 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7bd000ad10 con 0x7f7bbc041d90 2024-09-11T11:04:52.596 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-11T11:04:52.596 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T11:04:52.596 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-11T11:04:52.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f7bbc041d90 msgr2=0x7f7bbc044230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f7bbc041d90 0x7f7bbc044230 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7bbc035db0 msgr2=0x7f7bbc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7bbc035db0 0x7f7bbc038270 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7bc80ad000 tx=0x7f7bc8008040 comp rx=0 tx=0).stop 2024-09-11T11:04:52.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806d170 msgr2=0x7f7bd812aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806d170 0x7f7bd812aef0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c420 tx=0x7f7bd400c8e0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 shutdown_connections 2024-09-11T11:04:52.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6808/1879781812,v1:172.21.15.145:6809/1879781812] conn(0x7f7bbc041d90 0x7f7bbc044230 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7bbc035db0 0x7f7bbc038270 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 --2- 172.21.15.102:0/2044673103 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7bd806d170 0x7f7bd812aef0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 >> 172.21.15.102:0/2044673103 conn(0x7f7bd80998a0 msgr2=0x7f7bd812eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:52.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 shutdown_connections 2024-09-11T11:04:52.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.595+0000 7f7bdfcd6640 1 -- 172.21.15.102:0/2044673103 wait complete. 2024-09-11T11:04:52.611 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T11:04:52.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9e0d0bd640 1 Processor -- start 2024-09-11T11:04:52.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9e0d0bd640 1 -- start start 2024-09-11T11:04:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9e0d0bd640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9e0812e760 0x7f9e0812ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9e0d0bd640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e080984f0 con 0x7f9e0812f1c0 2024-09-11T11:04:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9e0d0bd640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9e08098dc0 con 0x7f9e0812e760 2024-09-11T11:04:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9dfe59c640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9e0812f1c0 0x7f9e0812b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40660/0 (socket says 172.21.15.102:40660) 2024-09-11T11:04:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9dfe59c640 1 -- 172.21.15.102:0/963780034 learned_addr learned my addr 172.21.15.102:0/963780034 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9e06d9d640 1 --2- 172.21.15.102:0/963780034 >> v2:172.21.15.102:3300/0 conn(0x7f9e0812e760 0x7f9e0812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9e0659c640 1 -- 172.21.15.102:0/963780034 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564991402 0 0) 0x7f9e080984f0 con 0x7f9e0812f1c0 2024-09-11T11:04:52.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.715+0000 7f9e0659c640 1 -- 172.21.15.102:0/963780034 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9df4003530 con 0x7f9e0812f1c0 2024-09-11T11:04:52.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0659c640 1 -- 172.21.15.102:0/963780034 <== mon.0 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2716943167 0 0) 0x7f9df4003530 con 0x7f9e0812f1c0 2024-09-11T11:04:52.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e06d9d640 1 -- 172.21.15.102:0/963780034 >> v1:172.21.15.102:6789/0 conn(0x7f9e0812f1c0 legacy=0x7f9e0812b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e06d9d640 1 -- 172.21.15.102:0/963780034 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0812f5a0 con 0x7f9e0812e760 2024-09-11T11:04:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e06d9d640 1 --2- 172.21.15.102:0/963780034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e0812ec80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009740 tx=0x7f9df801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193ba5dc511e22c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0659c640 1 -- 172.21.15.102:0/963780034 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df80b0070 con 0x7f9e0812e760 2024-09-11T11:04:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0659c640 1 -- 172.21.15.102:0/963780034 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80ab400 con 0x7f9e0812e760 2024-09-11T11:04:52.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0659c640 1 -- 172.21.15.102:0/963780034 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df00015b0 con 0x7f9e0812e760 2024-09-11T11:04:52.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/963780034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 msgr2=0x7f9e0812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 --2- 172.21.15.102:0/963780034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e0812ec80 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009740 tx=0x7f9df801c320 comp rx=0 tx=0).stop 2024-09-11T11:04:52.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/963780034 shutdown_connections 2024-09-11T11:04:52.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 --2- 172.21.15.102:0/963780034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e0812ec80 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/963780034 >> 172.21.15.102:0/963780034 conn(0x7f9e080a10a0 msgr2=0x7f9e080a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:52.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/963780034 shutdown_connections 2024-09-11T11:04:52.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/963780034 wait complete. 2024-09-11T11:04:52.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 Processor -- start 2024-09-11T11:04:52.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.719+0000 7f9e0d0bd640 1 -- start start 2024-09-11T11:04:52.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e0d0bd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e080972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e0d0bd640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e08136e30 con 0x7f9e0812e760 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e06d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e080972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e06d9d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e080972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57782/0 (socket says 172.21.15.102:57782) 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e06d9d640 1 -- 172.21.15.102:0/1250003312 learned_addr learned my addr 172.21.15.102:0/1250003312 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e06d9d640 1 -- 172.21.15.102:0/1250003312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e081332d0 con 0x7f9e0812e760 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e06d9d640 1 --2- 172.21.15.102:0/1250003312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e080972f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ae040 tx=0x7f9df801ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9dfffff640 1 -- 172.21.15.102:0/1250003312 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df80b0050 con 0x7f9e0812e760 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9dfffff640 1 -- 172.21.15.102:0/1250003312 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df80b1040 con 0x7f9e0812e760 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e08097830 con 0x7f9e0812e760 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9dfffff640 1 -- 172.21.15.102:0/1250003312 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df80b7580 con 0x7f9e0812e760 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e08097cf0 con 0x7f9e0812e760 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9dfffff640 1 -- 172.21.15.102:0/1250003312 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9df80be030 con 0x7f9e0812e760 2024-09-11T11:04:52.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e0812ec80 con 0x7f9e0812e760 2024-09-11T11:04:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9dfffff640 1 --2- 172.21.15.102:0/1250003312 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9de8035db0 0x7f9de8038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9dfffff640 1 -- 172.21.15.102:0/1250003312 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f9df80bc070 con 0x7f9e0812e760 2024-09-11T11:04:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9dfe59c640 1 --2- 172.21.15.102:0/1250003312 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9de8035db0 0x7f9de8038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:52.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.723+0000 7f9dfe59c640 1 --2- 172.21.15.102:0/1250003312 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9de8035db0 0x7f9de8038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9df0000c10 tx=0x7f9df0001240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:52.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.727+0000 7f9dfffff640 1 -- 172.21.15.102:0/1250003312 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9df80c5020 con 0x7f9e0812e760 2024-09-11T11:04:52.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.875+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f9e08128f50 con 0x7f9de8035db0 2024-09-11T11:04:52.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.875+0000 7f9dfffff640 1 -- 172.21.15.102:0/1250003312 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9df0001aa0 con 0x7f9de8035db0 2024-09-11T11:04:52.878 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9de8035db0 msgr2=0x7f9de8038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 --2- 172.21.15.102:0/1250003312 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9de8035db0 0x7f9de8038270 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9df0000c10 tx=0x7f9df0001240 comp rx=0 tx=0).stop 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 msgr2=0x7f9e080972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 --2- 172.21.15.102:0/1250003312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e080972f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9df80ae040 tx=0x7f9df801ab60 comp rx=0 tx=0).stop 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 shutdown_connections 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 --2- 172.21.15.102:0/1250003312 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9de8035db0 0x7f9de8038270 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 --2- 172.21.15.102:0/1250003312 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e0812e760 0x7f9e080972f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 >> 172.21.15.102:0/1250003312 conn(0x7f9e080a10a0 msgr2=0x7f9e0812c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 shutdown_connections 2024-09-11T11:04:52.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:52.879+0000 7f9e0d0bd640 1 -- 172.21.15.102:0/1250003312 wait complete. 2024-09-11T11:04:52.894 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T11:04:52.895 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T11:04:53.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e5b854640 1 Processor -- start 2024-09-11T11:04:53.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e5b854640 1 -- start start 2024-09-11T11:04:53.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e5b854640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9e5412b5e0 0x7f9e5412b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e5b854640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e5412b3e0 con 0x7f9e5409b7b0 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e5b854640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9e5412b1b0 con 0x7f9e5412b5e0 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e58def640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9e5409b7b0 0x7f9e5409bbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40674/0 (socket says 172.21.15.102:40674) 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e58def640 1 -- 172.21.15.102:0/2846248214 learned_addr learned my addr 172.21.15.102:0/2846248214 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e595f0640 1 --2- 172.21.15.102:0/2846248214 >> v2:172.21.15.102:3300/0 conn(0x7f9e5412b5e0 0x7f9e5412b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e4bfff640 1 -- 172.21.15.102:0/2846248214 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776168244 0 0) 0x7f9e5412b3e0 con 0x7f9e5409b7b0 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e4bfff640 1 -- 172.21.15.102:0/2846248214 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e40003530 con 0x7f9e5409b7b0 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e595f0640 1 -- 172.21.15.102:0/2846248214 >> v1:172.21.15.102:6789/0 conn(0x7f9e5409b7b0 legacy=0x7f9e5409bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.007+0000 7f9e595f0640 1 -- 172.21.15.102:0/2846248214 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e540a0260 con 0x7f9e5412b5e0 2024-09-11T11:04:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e595f0640 1 --2- 172.21.15.102:0/2846248214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5412b5e0 0x7f9e5412b9c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009740 tx=0x7f9e5001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9f38eb542a6b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e4bfff640 1 -- 172.21.15.102:0/2846248214 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e500b0070 con 0x7f9e5412b5e0 2024-09-11T11:04:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e4bfff640 1 -- 172.21.15.102:0/2846248214 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e500ab530 con 0x7f9e5412b5e0 2024-09-11T11:04:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e4bfff640 1 -- 172.21.15.102:0/2846248214 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e500ab830 con 0x7f9e5412b5e0 2024-09-11T11:04:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- 172.21.15.102:0/2846248214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5412b5e0 msgr2=0x7f9e5412b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 --2- 172.21.15.102:0/2846248214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5412b5e0 0x7f9e5412b9c0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009740 tx=0x7f9e5001c310 comp rx=0 tx=0).stop 2024-09-11T11:04:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- 172.21.15.102:0/2846248214 shutdown_connections 2024-09-11T11:04:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 --2- 172.21.15.102:0/2846248214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5412b5e0 0x7f9e5412b9c0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- 172.21.15.102:0/2846248214 >> 172.21.15.102:0/2846248214 conn(0x7f9e5409dcb0 msgr2=0x7f9e5409e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- 172.21.15.102:0/2846248214 shutdown_connections 2024-09-11T11:04:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- 172.21.15.102:0/2846248214 wait complete. 2024-09-11T11:04:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 Processor -- start 2024-09-11T11:04:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- start start 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5409b7b0 0x7f9e540972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5412c080 con 0x7f9e5409b7b0 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e595f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5409b7b0 0x7f9e540972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e595f0640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5409b7b0 0x7f9e540972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57788/0 (socket says 172.21.15.102:57788) 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e595f0640 1 -- 172.21.15.102:0/3167214851 learned_addr learned my addr 172.21.15.102:0/3167214851 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e595f0640 1 -- 172.21.15.102:0/3167214851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e541324d0 con 0x7f9e5409b7b0 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e595f0640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5409b7b0 0x7f9e540972f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9e500ae040 tx=0x7f9e50019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e500b8070 con 0x7f9e5409b7b0 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e500abdb0 con 0x7f9e5409b7b0 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e54134020 con 0x7f9e5409b7b0 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e500b0040 con 0x7f9e5409b7b0 2024-09-11T11:04:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.011+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e54097830 con 0x7f9e5409b7b0 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e54128ea0 con 0x7f9e5409b7b0 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f9e500bb070 con 0x7f9e5409b7b0 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e49ffb640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9e38035db0 0x7f9e38038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f9e500e2ce0 con 0x7f9e5409b7b0 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e49ffb640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9e38041d30 0x7f9e380441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e5000af30 con 0x7f9e38041d30 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9e500e5390 con 0x7f9e5409b7b0 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e58def640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9e38035db0 0x7f9e38038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e59df1640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9e38041d30 0x7f9e380441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e58def640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9e38035db0 0x7f9e38038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e44007fd0 tx=0x7f9e44007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e59df1640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9e38041d30 0x7f9e380441d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.015+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 <== osd.2 v2:172.21.15.145:6816/446921044 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e5000af30 con 0x7f9e38041d30 2024-09-11T11:04:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 --> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9e54074a40 con 0x7f9e38041d30 2024-09-11T11:04:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e49ffb640 1 -- 172.21.15.102:0/3167214851 <== osd.2 v2:172.21.15.145:6816/446921044 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9e54074a40 con 0x7f9e38041d30 2024-09-11T11:04:53.032 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-11T11:04:53.032 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T11:04:53.032 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-11T11:04:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9e38041d30 msgr2=0x7f9e380441d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9e38041d30 0x7f9e380441d0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9e38035db0 msgr2=0x7f9e38038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9e38035db0 0x7f9e38038270 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e44007fd0 tx=0x7f9e44007980 comp rx=0 tx=0).stop 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5409b7b0 msgr2=0x7f9e540972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5409b7b0 0x7f9e540972f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9e500ae040 tx=0x7f9e50019110 comp rx=0 tx=0).stop 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 shutdown_connections 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6816/446921044,v1:172.21.15.145:6817/446921044] conn(0x7f9e38041d30 0x7f9e380441d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f9e38035db0 0x7f9e38038270 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 --2- 172.21.15.102:0/3167214851 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e5409b7b0 0x7f9e540972f0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 >> 172.21.15.102:0/3167214851 conn(0x7f9e5409dcb0 msgr2=0x7f9e54125e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 shutdown_connections 2024-09-11T11:04:53.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.031+0000 7f9e5b854640 1 -- 172.21.15.102:0/3167214851 wait complete. 2024-09-11T11:04:53.047 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T11:04:53.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef3742d640 1 Processor -- start 2024-09-11T11:04:53.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef3742d640 1 -- start start 2024-09-11T11:04:53.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef3742d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fef3012e760 0x7fef3012ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef3742d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef300984f0 con 0x7fef3012f1c0 2024-09-11T11:04:53.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef3742d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fef30098dc0 con 0x7fef3012e760 2024-09-11T11:04:53.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef351c9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fef3012e760 0x7fef3012ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef349c8640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fef3012f1c0 0x7fef3012b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40686/0 (socket says 172.21.15.102:40686) 2024-09-11T11:04:53.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef349c8640 1 -- 172.21.15.102:0/2966922720 learned_addr learned my addr 172.21.15.102:0/2966922720 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:53.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef351c9640 1 -- 172.21.15.102:0/2966922720 >> v1:172.21.15.102:6789/0 conn(0x7fef3012f1c0 legacy=0x7fef3012b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef351c9640 1 -- 172.21.15.102:0/2966922720 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef3012f5a0 con 0x7fef3012e760 2024-09-11T11:04:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef351c9640 1 --2- 172.21.15.102:0/2966922720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3012ec80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009740 tx=0x7fef2c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eae1a3c95c244c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.159+0000 7fef27fff640 1 -- 172.21.15.102:0/2966922720 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c0b0070 con 0x7fef3012e760 2024-09-11T11:04:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef27fff640 1 -- 172.21.15.102:0/2966922720 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c0ab530 con 0x7fef3012e760 2024-09-11T11:04:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef27fff640 1 -- 172.21.15.102:0/2966922720 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c0ab830 con 0x7fef3012e760 2024-09-11T11:04:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- 172.21.15.102:0/2966922720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 msgr2=0x7fef3012ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 --2- 172.21.15.102:0/2966922720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3012ec80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009740 tx=0x7fef2c01c400 comp rx=0 tx=0).stop 2024-09-11T11:04:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- 172.21.15.102:0/2966922720 shutdown_connections 2024-09-11T11:04:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 --2- 172.21.15.102:0/2966922720 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3012ec80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- 172.21.15.102:0/2966922720 >> 172.21.15.102:0/2966922720 conn(0x7fef300a10a0 msgr2=0x7fef300a14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- 172.21.15.102:0/2966922720 shutdown_connections 2024-09-11T11:04:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- 172.21.15.102:0/2966922720 wait complete. 2024-09-11T11:04:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 Processor -- start 2024-09-11T11:04:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- start start 2024-09-11T11:04:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3009c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fef30136e30 con 0x7fef3012e760 2024-09-11T11:04:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef351c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3009c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef351c9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3009c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57812/0 (socket says 172.21.15.102:57812) 2024-09-11T11:04:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef351c9640 1 -- 172.21.15.102:0/2710454451 learned_addr learned my addr 172.21.15.102:0/2710454451 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef351c9640 1 -- 172.21.15.102:0/2710454451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef30130510 con 0x7fef3012e760 2024-09-11T11:04:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef351c9640 1 --2- 172.21.15.102:0/2710454451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3009c920 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fef2c01a030 tx=0x7fef2c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef25ffb640 1 -- 172.21.15.102:0/2710454451 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c0b0050 con 0x7fef3012e760 2024-09-11T11:04:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef25ffb640 1 -- 172.21.15.102:0/2710454451 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef2c0b1040 con 0x7fef3012e760 2024-09-11T11:04:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef30130c10 con 0x7fef3012e760 2024-09-11T11:04:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef25ffb640 1 -- 172.21.15.102:0/2710454451 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef2c0b5740 con 0x7fef3012e760 2024-09-11T11:04:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.163+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef3009ce60 con 0x7fef3012e760 2024-09-11T11:04:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.167+0000 7fef25ffb640 1 -- 172.21.15.102:0/2710454451 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7fef2c0be030 con 0x7fef3012e760 2024-09-11T11:04:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.167+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef3009e3a0 con 0x7fef3012e760 2024-09-11T11:04:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.167+0000 7fef25ffb640 1 --2- 172.21.15.102:0/2710454451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fef14035db0 0x7fef14038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.167+0000 7fef25ffb640 1 -- 172.21.15.102:0/2710454451 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7fef2c0bc070 con 0x7fef3012e760 2024-09-11T11:04:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.167+0000 7fef349c8640 1 --2- 172.21.15.102:0/2710454451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fef14035db0 0x7fef14038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.167+0000 7fef349c8640 1 --2- 172.21.15.102:0/2710454451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fef14035db0 0x7fef14038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef20005890 tx=0x7fef20007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.171+0000 7fef25ffb640 1 -- 172.21.15.102:0/2710454451 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fef2c0c5020 con 0x7fef3012e760 2024-09-11T11:04:53.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.319+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fef30130780 con 0x7fef14035db0 2024-09-11T11:04:53.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.319+0000 7fef25ffb640 1 -- 172.21.15.102:0/2710454451 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fef20001c00 con 0x7fef14035db0 2024-09-11T11:04:53.323 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fef14035db0 msgr2=0x7fef14038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 --2- 172.21.15.102:0/2710454451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fef14035db0 0x7fef14038270 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fef20005890 tx=0x7fef20007a90 comp rx=0 tx=0).stop 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 msgr2=0x7fef3009c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 --2- 172.21.15.102:0/2710454451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3009c920 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fef2c01a030 tx=0x7fef2c01ac40 comp rx=0 tx=0).stop 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 shutdown_connections 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 --2- 172.21.15.102:0/2710454451 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7fef14035db0 0x7fef14038270 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 --2- 172.21.15.102:0/2710454451 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fef3012e760 0x7fef3009c920 secure :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fef2c01a030 tx=0x7fef2c01ac40 comp rx=0 tx=0).stop 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 >> 172.21.15.102:0/2710454451 conn(0x7fef300a10a0 msgr2=0x7fef30095280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 shutdown_connections 2024-09-11T11:04:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.323+0000 7fef3742d640 1 -- 172.21.15.102:0/2710454451 wait complete. 2024-09-11T11:04:53.340 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T11:04:53.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T11:04:53.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7217dd2640 1 Processor -- start 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7217dd2640 1 -- start start 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7217dd2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7210094960 0x7f7210094d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7217dd2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7210096600 con 0x7f7210095280 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7217dd2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7210073fe0 con 0x7f7210094960 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7215b6e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7210094960 0x7f7210094d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f721536d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7210095280 0x7f721012c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40688/0 (socket says 172.21.15.102:40688) 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f721536d640 1 -- 172.21.15.102:0/2815803779 learned_addr learned my addr 172.21.15.102:0/2815803779 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7215b6e640 1 -- 172.21.15.102:0/2815803779 >> v1:172.21.15.102:6789/0 conn(0x7f7210095280 legacy=0x7f721012c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7214b6c640 1 -- 172.21.15.102:0/2815803779 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3659499384 0 0) 0x7f7210096600 con 0x7f7210095280 2024-09-11T11:04:53.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.459+0000 7f7215b6e640 1 -- 172.21.15.102:0/2815803779 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72100972f0 con 0x7f7210094960 2024-09-11T11:04:53.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7215b6e640 1 --2- 172.21.15.102:0/2815803779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f7210094d40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7208009740 tx=0x7f720801c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426b6c472b76ec40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7214b6c640 1 -- 172.21.15.102:0/2815803779 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72080b0070 con 0x7f7210094960 2024-09-11T11:04:53.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7214b6c640 1 -- 172.21.15.102:0/2815803779 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72080ab530 con 0x7f7210094960 2024-09-11T11:04:53.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7214b6c640 1 -- 172.21.15.102:0/2815803779 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72080ab830 con 0x7f7210094960 2024-09-11T11:04:53.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- 172.21.15.102:0/2815803779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 msgr2=0x7f7210094d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 --2- 172.21.15.102:0/2815803779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f7210094d40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7208009740 tx=0x7f720801c370 comp rx=0 tx=0).stop 2024-09-11T11:04:53.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- 172.21.15.102:0/2815803779 shutdown_connections 2024-09-11T11:04:53.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 --2- 172.21.15.102:0/2815803779 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f7210094d40 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- 172.21.15.102:0/2815803779 >> 172.21.15.102:0/2815803779 conn(0x7f721009d2e0 msgr2=0x7f721009d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- 172.21.15.102:0/2815803779 shutdown_connections 2024-09-11T11:04:53.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- 172.21.15.102:0/2815803779 wait complete. 2024-09-11T11:04:53.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 Processor -- start 2024-09-11T11:04:53.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- start start 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f72101c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7210135480 con 0x7f7210094960 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7215b6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f72101c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7215b6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f72101c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57842/0 (socket says 172.21.15.102:57842) 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7215b6e640 1 -- 172.21.15.102:0/2915485206 learned_addr learned my addr 172.21.15.102:0/2915485206 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7215b6e640 1 -- 172.21.15.102:0/2915485206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721012dd70 con 0x7f7210094960 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7215b6e640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f72101c4b60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7208019fa0 tx=0x7f7208019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72080b8020 con 0x7f7210094960 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72080b4540 con 0x7f7210094960 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7210125cb0 con 0x7f7210094960 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72080b0040 con 0x7f7210094960 2024-09-11T11:04:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.463+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72101c50a0 con 0x7f7210094960 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7210094d40 con 0x7f7210094960 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f72080bb020 con 0x7f7210094960 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f72067fc640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71fc035db0 0x7f71fc038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f72080e2e20 con 0x7f7210094960 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f72067fc640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f71fc041d30 0x7f71fc0441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72080bfe50 con 0x7f71fc041d30 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f72080e5550 con 0x7f7210094960 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f721536d640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71fc035db0 0x7f71fc038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f721636f640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f71fc041d30 0x7f71fc0441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f721636f640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f71fc041d30 0x7f71fc0441d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f721536d640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71fc035db0 0x7f71fc038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f720c001570 tx=0x7f720c007cc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.467+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 <== osd.3 v2:172.21.15.145:6800/493661776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f72080bfe50 con 0x7f71fc041d30 2024-09-11T11:04:53.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 --> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7210126f70 con 0x7f71fc041d30 2024-09-11T11:04:53.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f72067fc640 1 -- 172.21.15.102:0/2915485206 <== osd.3 v2:172.21.15.145:6800/493661776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7210126f70 con 0x7f71fc041d30 2024-09-11T11:04:53.484 INFO:teuthology.orchestra.run.smithi102.stdout:{ 2024-09-11T11:04:53.485 INFO:teuthology.orchestra.run.smithi102.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T11:04:53.485 INFO:teuthology.orchestra.run.smithi102.stdout:} 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f71fc041d30 msgr2=0x7f71fc0441d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f71fc041d30 0x7f71fc0441d0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71fc035db0 msgr2=0x7f71fc038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71fc035db0 0x7f71fc038270 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f720c001570 tx=0x7f720c007cc0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 msgr2=0x7f72101c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f72101c4b60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7208019fa0 tx=0x7f7208019110 comp rx=0 tx=0).stop 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 shutdown_connections 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6800/493661776,v1:172.21.15.145:6801/493661776] conn(0x7f71fc041d30 0x7f71fc0441d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f71fc035db0 0x7f71fc038270 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 --2- 172.21.15.102:0/2915485206 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7210094960 0x7f72101c4b60 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 >> 172.21.15.102:0/2915485206 conn(0x7f721009d2e0 msgr2=0x7f7210129210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 shutdown_connections 2024-09-11T11:04:53.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.483+0000 7f7217dd2640 1 -- 172.21.15.102:0/2915485206 wait complete. 2024-09-11T11:04:53.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T11:04:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4afda6e640 1 Processor -- start 2024-09-11T11:04:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4afda6e640 1 -- start start 2024-09-11T11:04:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4afda6e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4af806d0e0 0x7f4af806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4afda6e640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4af8071c10 con 0x7f4af806da00 2024-09-11T11:04:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4afda6e640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4af8072230 con 0x7f4af806d0e0 2024-09-11T11:04:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4af77fe640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4af806d0e0 0x7f4af806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4af6ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4af806da00 0x7f4af812ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40702/0 (socket says 172.21.15.102:40702) 2024-09-11T11:04:53.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4af6ffd640 1 -- 172.21.15.102:0/2065502628 learned_addr learned my addr 172.21.15.102:0/2065502628 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:53.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4af77fe640 1 -- 172.21.15.102:0/2065502628 >> v1:172.21.15.102:6789/0 conn(0x7f4af806da00 legacy=0x7f4af812ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4af67fc640 1 -- 172.21.15.102:0/2065502628 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1631800927 0 0) 0x7f4af8071c10 con 0x7f4af806da00 2024-09-11T11:04:53.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.607+0000 7f4af77fe640 1 -- 172.21.15.102:0/2065502628 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af80709e0 con 0x7f4af806d0e0 2024-09-11T11:04:53.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4af77fe640 1 --2- 172.21.15.102:0/2065502628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806d4c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009d90 tx=0x7f4af001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7fe7433c506aae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4af67fc640 1 -- 172.21.15.102:0/2065502628 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af00a6560 con 0x7f4af806d0e0 2024-09-11T11:04:53.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4af67fc640 1 -- 172.21.15.102:0/2065502628 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af00a6700 con 0x7f4af806d0e0 2024-09-11T11:04:53.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4af67fc640 1 -- 172.21.15.102:0/2065502628 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af00a6a00 con 0x7f4af806d0e0 2024-09-11T11:04:53.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 -- 172.21.15.102:0/2065502628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 msgr2=0x7f4af806d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 --2- 172.21.15.102:0/2065502628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806d4c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009d90 tx=0x7f4af001c8c0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 -- 172.21.15.102:0/2065502628 shutdown_connections 2024-09-11T11:04:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 --2- 172.21.15.102:0/2065502628 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806d4c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 -- 172.21.15.102:0/2065502628 >> 172.21.15.102:0/2065502628 conn(0x7f4af8099a50 msgr2=0x7f4af80972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 -- 172.21.15.102:0/2065502628 shutdown_connections 2024-09-11T11:04:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 -- 172.21.15.102:0/2065502628 wait complete. 2024-09-11T11:04:53.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 Processor -- start 2024-09-11T11:04:53.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 -- start start 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4afda6e640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4af8134e80 con 0x7f4af806d0e0 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4af77fe640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57850/0 (socket says 172.21.15.102:57850) 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.611+0000 7f4af77fe640 1 -- 172.21.15.102:0/886844866 learned_addr learned my addr 172.21.15.102:0/886844866 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4af77fe640 1 -- 172.21.15.102:0/886844866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af812bd70 con 0x7f4af806d0e0 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4af77fe640 1 --2- 172.21.15.102:0/886844866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806e1f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009d90 tx=0x7f4af0019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4adffff640 1 -- 172.21.15.102:0/886844866 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af00bb570 con 0x7f4af806d0e0 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4adffff640 1 -- 172.21.15.102:0/886844866 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af00c0070 con 0x7f4af806d0e0 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af806fa10 con 0x7f4af806d0e0 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4adffff640 1 -- 172.21.15.102:0/886844866 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4af00bb840 con 0x7f4af806d0e0 2024-09-11T11:04:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af806fed0 con 0x7f4af806d0e0 2024-09-11T11:04:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af806d4c0 con 0x7f4af806d0e0 2024-09-11T11:04:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4adffff640 1 -- 172.21.15.102:0/886844866 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f4af00bb9e0 con 0x7f4af806d0e0 2024-09-11T11:04:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4adffff640 1 --2- 172.21.15.102:0/886844866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ae4035db0 0x7f4ae4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4adffff640 1 -- 172.21.15.102:0/886844866 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f4af00e42f0 con 0x7f4af806d0e0 2024-09-11T11:04:53.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4af6ffd640 1 --2- 172.21.15.102:0/886844866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ae4035db0 0x7f4ae4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.615+0000 7f4af6ffd640 1 --2- 172.21.15.102:0/886844866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ae4035db0 0x7f4ae4038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4aec007fd0 tx=0x7f4aec007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.619+0000 7f4adffff640 1 -- 172.21.15.102:0/886844866 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4af00ca020 con 0x7f4af806d0e0 2024-09-11T11:04:53.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.779+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f4af8073790 con 0x7f4ae4035db0 2024-09-11T11:04:53.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4adffff640 1 -- 172.21.15.102:0/886844866 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4af8073790 con 0x7f4ae4035db0 2024-09-11T11:04:53.784 INFO:teuthology.orchestra.run.smithi102.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T11:04:53.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ae4035db0 msgr2=0x7f4ae4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 --2- 172.21.15.102:0/886844866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ae4035db0 0x7f4ae4038270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4aec007fd0 tx=0x7f4aec007980 comp rx=0 tx=0).stop 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 msgr2=0x7f4af806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 --2- 172.21.15.102:0/886844866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806e1f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009d90 tx=0x7f4af0019660 comp rx=0 tx=0).stop 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 shutdown_connections 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 --2- 172.21.15.102:0/886844866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f4ae4035db0 0x7f4ae4038270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 --2- 172.21.15.102:0/886844866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4af806d0e0 0x7f4af806e1f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 >> 172.21.15.102:0/886844866 conn(0x7f4af8099a50 msgr2=0x7f4af809b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 shutdown_connections 2024-09-11T11:04:53.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.783+0000 7f4afda6e640 1 -- 172.21.15.102:0/886844866 wait complete. 2024-09-11T11:04:53.803 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:04:53.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a7ab0d640 1 Processor -- start 2024-09-11T11:04:53.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a7ab0d640 1 -- start start 2024-09-11T11:04:53.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a7ab0d640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0a74074d20 0x7f0a74095600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a7ab0d640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7409a740 con 0x7f0a74095b40 2024-09-11T11:04:53.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a7ab0d640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0a74096d40 con 0x7f0a74074d20 2024-09-11T11:04:53.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a788a9640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0a74074d20 0x7f0a74095600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a73fff640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0a74095b40 0x7f0a741332a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:40712/0 (socket says 172.21.15.102:40712) 2024-09-11T11:04:53.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a73fff640 1 -- 172.21.15.102:0/626114273 learned_addr learned my addr 172.21.15.102:0/626114273 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:04:53.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a788a9640 1 -- 172.21.15.102:0/626114273 >> v1:172.21.15.102:6789/0 conn(0x7f0a74095b40 legacy=0x7f0a741332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a737fe640 1 -- 172.21.15.102:0/626114273 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219656748 0 0) 0x7f0a7409a740 con 0x7f0a74095b40 2024-09-11T11:04:53.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.911+0000 7f0a788a9640 1 -- 172.21.15.102:0/626114273 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a74093fa0 con 0x7f0a74074d20 2024-09-11T11:04:53.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a788a9640 1 --2- 172.21.15.102:0/626114273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a74095600 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009740 tx=0x7f0a6801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a15e300ed7d40267 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a737fe640 1 -- 172.21.15.102:0/626114273 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a680b1070 con 0x7f0a74074d20 2024-09-11T11:04:53.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a737fe640 1 -- 172.21.15.102:0/626114273 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a680ac570 con 0x7f0a74074d20 2024-09-11T11:04:53.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a737fe640 1 -- 172.21.15.102:0/626114273 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a680ac870 con 0x7f0a74074d20 2024-09-11T11:04:53.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/626114273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 msgr2=0x7f0a74095600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:53.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 --2- 172.21.15.102:0/626114273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a74095600 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009740 tx=0x7f0a6801c400 comp rx=0 tx=0).stop 2024-09-11T11:04:53.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/626114273 shutdown_connections 2024-09-11T11:04:53.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 --2- 172.21.15.102:0/626114273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a74095600 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:53.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/626114273 >> 172.21.15.102:0/626114273 conn(0x7f0a7409d6f0 msgr2=0x7f0a74099bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:53.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/626114273 shutdown_connections 2024-09-11T11:04:53.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/626114273 wait complete. 2024-09-11T11:04:53.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 Processor -- start 2024-09-11T11:04:53.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- start start 2024-09-11T11:04:53.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a741c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0a74137570 con 0x7f0a74074d20 2024-09-11T11:04:53.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a788a9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a741c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a788a9640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a741c6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:57866/0 (socket says 172.21.15.102:57866) 2024-09-11T11:04:53.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a788a9640 1 -- 172.21.15.102:0/3012059464 learned_addr learned my addr 172.21.15.102:0/3012059464 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:04:53.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a788a9640 1 -- 172.21.15.102:0/3012059464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a74097520 con 0x7f0a74074d20 2024-09-11T11:04:53.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a788a9640 1 --2- 172.21.15.102:0/3012059464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a741c6880 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0a6801a030 tx=0x7f0a6801ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a717fa640 1 -- 172.21.15.102:0/3012059464 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a680b1050 con 0x7f0a74074d20 2024-09-11T11:04:53.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a717fa640 1 -- 172.21.15.102:0/3012059464 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a680b2040 con 0x7f0a74074d20 2024-09-11T11:04:53.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a74073570 con 0x7f0a74074d20 2024-09-11T11:04:53.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a717fa640 1 -- 172.21.15.102:0/3012059464 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68004170 con 0x7f0a74074d20 2024-09-11T11:04:53.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a74122a40 con 0x7f0a74074d20 2024-09-11T11:04:53.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a717fa640 1 -- 172.21.15.102:0/3012059464 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f0a680bf060 con 0x7f0a74074d20 2024-09-11T11:04:53.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.915+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a74095600 con 0x7f0a74074d20 2024-09-11T11:04:53.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.919+0000 7f0a717fa640 1 --2- 172.21.15.102:0/3012059464 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0a60035d60 0x7f0a60038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:04:53.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.919+0000 7f0a717fa640 1 -- 172.21.15.102:0/3012059464 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f0a680e2f40 con 0x7f0a74074d20 2024-09-11T11:04:53.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.919+0000 7f0a73fff640 1 --2- 172.21.15.102:0/3012059464 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0a60035d60 0x7f0a60038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:04:53.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.919+0000 7f0a73fff640 1 --2- 172.21.15.102:0/3012059464 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0a60035d60 0x7f0a60038220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0a64007fd0 tx=0x7f0a64007920 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:04:53.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:53.923+0000 7f0a717fa640 1 -- 172.21.15.102:0/3012059464 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0a68015ff0 con 0x7f0a74074d20 2024-09-11T11:04:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.067+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a741223b0 con 0x7f0a60035d60 2024-09-11T11:04:54.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.115+0000 7f0a717fa640 1 -- 172.21.15.102:0/3012059464 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665551 (secure 0 0 0) 0x7f0a741223b0 con 0x7f0a60035d60 2024-09-11T11:04:54.122 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:04:54.128 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:04:54.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0a60035d60 msgr2=0x7f0a60038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 --2- 172.21.15.102:0/3012059464 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0a60035d60 0x7f0a60038220 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0a64007fd0 tx=0x7f0a64007920 comp rx=0 tx=0).stop 2024-09-11T11:04:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 msgr2=0x7f0a741c6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:04:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 --2- 172.21.15.102:0/3012059464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a741c6880 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f0a6801a030 tx=0x7f0a6801ac40 comp rx=0 tx=0).stop 2024-09-11T11:04:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 shutdown_connections 2024-09-11T11:04:54.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 --2- 172.21.15.102:0/3012059464 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f0a60035d60 0x7f0a60038220 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:54.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 --2- 172.21.15.102:0/3012059464 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0a74074d20 0x7f0a741c6880 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:04:54.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 >> 172.21.15.102:0/3012059464 conn(0x7f0a7409d6f0 msgr2=0x7f0a74097af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:04:54.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 shutdown_connections 2024-09-11T11:04:54.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:04:54.119+0000 7f0a7ab0d640 1 -- 172.21.15.102:0/3012059464 wait complete. 2024-09-11T11:04:54.137 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-11T11:04:53.049600+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18024200,"num_objects":227,"num_object_clones":0,"num_object_copies":454,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4973,"num_read_kb":4552,"num_write":2140,"num_write_kb":61375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4536,"ondisk_log_size":4536,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":190864,"kb_used_data":37008,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377296496,"statfs":{"total":386547056640,"available":386351611904,"internally_reserved":0,"allocated":37896192,"data_stored":36640408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388608,"num_objects":-2,"num_object_clones":0,"num_object_copies":-4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005753"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129252+0000","last_change":"2024-09-11T11:01:03.337877+0000","last_active":"2024-09-11T11:02:42.129252+0000","last_peered":"2024-09-11T11:02:42.129252+0000","last_clean":"2024-09-11T11:02:42.129252+0000","last_became_active":"2024-09-11T11:01:03.336333+0000","last_became_peered":"2024-09-11T11:01:03.336333+0000","last_unstale":"2024-09-11T11:02:42.129252+0000","last_undegraded":"2024-09-11T11:02:42.129252+0000","last_fullsized":"2024-09-11T11:02:42.129252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:39.536350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573739+0000","last_change":"2024-09-11T11:01:05.334117+0000","last_active":"2024-09-11T11:04:17.573739+0000","last_peered":"2024-09-11T11:04:17.573739+0000","last_clean":"2024-09-11T11:04:17.573739+0000","last_became_active":"2024-09-11T11:01:05.332897+0000","last_became_peered":"2024-09-11T11:01:05.332897+0000","last_unstale":"2024-09-11T11:04:17.573739+0000","last_undegraded":"2024-09-11T11:04:17.573739+0000","last_fullsized":"2024-09-11T11:04:17.573739+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:30.170950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845264+0000","last_change":"2024-09-11T11:01:03.346417+0000","last_active":"2024-09-11T11:02:42.845264+0000","last_peered":"2024-09-11T11:02:42.845264+0000","last_clean":"2024-09-11T11:02:42.845264+0000","last_became_active":"2024-09-11T11:01:03.346113+0000","last_became_peered":"2024-09-11T11:01:03.346113+0000","last_unstale":"2024-09-11T11:02:42.845264+0000","last_undegraded":"2024-09-11T11:02:42.845264+0000","last_fullsized":"2024-09-11T11:02:42.845264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:42.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836745+0000","last_change":"2024-09-11T11:01:05.333693+0000","last_active":"2024-09-11T11:03:16.836745+0000","last_peered":"2024-09-11T11:03:16.836745+0000","last_clean":"2024-09-11T11:03:16.836745+0000","last_became_active":"2024-09-11T11:01:05.330885+0000","last_became_peered":"2024-09-11T11:01:05.330885+0000","last_unstale":"2024-09-11T11:03:16.836745+0000","last_undegraded":"2024-09-11T11:03:16.836745+0000","last_fullsized":"2024-09-11T11:03:16.836745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:17:27.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112814+0000","last_change":"2024-09-11T11:01:03.346111+0000","last_active":"2024-09-11T11:02:42.112814+0000","last_peered":"2024-09-11T11:02:42.112814+0000","last_clean":"2024-09-11T11:02:42.112814+0000","last_became_active":"2024-09-11T11:01:03.345673+0000","last_became_peered":"2024-09-11T11:01:03.345673+0000","last_unstale":"2024-09-11T11:02:42.112814+0000","last_undegraded":"2024-09-11T11:02:42.112814+0000","last_fullsized":"2024-09-11T11:02:42.112814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:11.883100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.436815+0000","last_change":"2024-09-11T11:01:05.331041+0000","last_active":"2024-09-11T11:04:17.436815+0000","last_peered":"2024-09-11T11:04:17.436815+0000","last_clean":"2024-09-11T11:04:17.436815+0000","last_became_active":"2024-09-11T11:01:05.330639+0000","last_became_peered":"2024-09-11T11:01:05.330639+0000","last_unstale":"2024-09-11T11:04:17.436815+0000","last_undegraded":"2024-09-11T11:04:17.436815+0000","last_fullsized":"2024-09-11T11:04:17.436815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:51.046871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.721051+0000","last_change":"2024-09-11T11:01:03.335434+0000","last_active":"2024-09-11T11:03:16.721051+0000","last_peered":"2024-09-11T11:03:16.721051+0000","last_clean":"2024-09-11T11:03:16.721051+0000","last_became_active":"2024-09-11T11:01:03.335132+0000","last_became_peered":"2024-09-11T11:01:03.335132+0000","last_unstale":"2024-09-11T11:03:16.721051+0000","last_undegraded":"2024-09-11T11:03:16.721051+0000","last_fullsized":"2024-09-11T11:03:16.721051+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:42:27.769400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573787+0000","last_change":"2024-09-11T11:01:05.344140+0000","last_active":"2024-09-11T11:04:17.573787+0000","last_peered":"2024-09-11T11:04:17.573787+0000","last_clean":"2024-09-11T11:04:17.573787+0000","last_became_active":"2024-09-11T11:01:05.339018+0000","last_became_peered":"2024-09-11T11:01:05.339018+0000","last_unstale":"2024-09-11T11:04:17.573787+0000","last_undegraded":"2024-09-11T11:04:17.573787+0000","last_fullsized":"2024-09-11T11:04:17.573787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:03.791497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124006+0000","last_change":"2024-09-11T11:01:03.324287+0000","last_active":"2024-09-11T11:02:42.124006+0000","last_peered":"2024-09-11T11:02:42.124006+0000","last_clean":"2024-09-11T11:02:42.124006+0000","last_became_active":"2024-09-11T11:01:03.322877+0000","last_became_peered":"2024-09-11T11:01:03.322877+0000","last_unstale":"2024-09-11T11:02:42.124006+0000","last_undegraded":"2024-09-11T11:02:42.124006+0000","last_fullsized":"2024-09-11T11:02:42.124006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:03.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'7","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.837597+0000","last_change":"2024-09-11T11:01:05.354323+0000","last_active":"2024-09-11T11:03:16.837597+0000","last_peered":"2024-09-11T11:03:16.837597+0000","last_clean":"2024-09-11T11:03:16.837597+0000","last_became_active":"2024-09-11T11:01:05.353908+0000","last_became_peered":"2024-09-11T11:01:05.353908+0000","last_unstale":"2024-09-11T11:03:16.837597+0000","last_undegraded":"2024-09-11T11:03:16.837597+0000","last_fullsized":"2024-09-11T11:03:16.837597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:11:14.899274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124871+0000","last_change":"2024-09-11T11:01:03.346652+0000","last_active":"2024-09-11T11:02:42.124871+0000","last_peered":"2024-09-11T11:02:42.124871+0000","last_clean":"2024-09-11T11:02:42.124871+0000","last_became_active":"2024-09-11T11:01:03.345964+0000","last_became_peered":"2024-09-11T11:01:03.345964+0000","last_unstale":"2024-09-11T11:02:42.124871+0000","last_undegraded":"2024-09-11T11:02:42.124871+0000","last_fullsized":"2024-09-11T11:02:42.124871+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:12.622399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'14","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921127+0000","last_change":"2024-09-11T11:01:05.346892+0000","last_active":"2024-09-11T11:04:17.921127+0000","last_peered":"2024-09-11T11:04:17.921127+0000","last_clean":"2024-09-11T11:04:17.921127+0000","last_became_active":"2024-09-11T11:01:05.345664+0000","last_became_peered":"2024-09-11T11:01:05.345664+0000","last_unstale":"2024-09-11T11:04:17.921127+0000","last_undegraded":"2024-09-11T11:04:17.921127+0000","last_fullsized":"2024-09-11T11:04:17.921127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:15.826673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110283+0000","last_change":"2024-09-11T11:01:03.349146+0000","last_active":"2024-09-11T11:02:42.110283+0000","last_peered":"2024-09-11T11:02:42.110283+0000","last_clean":"2024-09-11T11:02:42.110283+0000","last_became_active":"2024-09-11T11:01:03.348822+0000","last_became_peered":"2024-09-11T11:01:03.348822+0000","last_unstale":"2024-09-11T11:02:42.110283+0000","last_undegraded":"2024-09-11T11:02:42.110283+0000","last_fullsized":"2024-09-11T11:02:42.110283+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:46:25.824519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127393+0000","last_change":"2024-09-11T11:01:05.347306+0000","last_active":"2024-09-11T11:02:42.127393+0000","last_peered":"2024-09-11T11:02:42.127393+0000","last_clean":"2024-09-11T11:02:42.127393+0000","last_became_active":"2024-09-11T11:01:05.345698+0000","last_became_peered":"2024-09-11T11:01:05.345698+0000","last_unstale":"2024-09-11T11:02:42.127393+0000","last_undegraded":"2024-09-11T11:02:42.127393+0000","last_fullsized":"2024-09-11T11:02:42.127393+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:41:08.367843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.750645+0000","last_change":"2024-09-11T11:01:03.336343+0000","last_active":"2024-09-11T11:03:12.750645+0000","last_peered":"2024-09-11T11:03:12.750645+0000","last_clean":"2024-09-11T11:03:12.750645+0000","last_became_active":"2024-09-11T11:01:03.335830+0000","last_became_peered":"2024-09-11T11:01:03.335830+0000","last_unstale":"2024-09-11T11:03:12.750645+0000","last_undegraded":"2024-09-11T11:03:12.750645+0000","last_fullsized":"2024-09-11T11:03:12.750645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:12:21.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.021931+0000","last_change":"2024-09-11T11:01:05.344202+0000","last_active":"2024-09-11T11:04:18.021931+0000","last_peered":"2024-09-11T11:04:18.021931+0000","last_clean":"2024-09-11T11:04:18.021931+0000","last_became_active":"2024-09-11T11:01:05.343805+0000","last_became_peered":"2024-09-11T11:01:05.343805+0000","last_unstale":"2024-09-11T11:04:18.021931+0000","last_undegraded":"2024-09-11T11:04:18.021931+0000","last_fullsized":"2024-09-11T11:04:18.021931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:37:30.179996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122512+0000","last_change":"2024-09-11T11:01:05.333623+0000","last_active":"2024-09-11T11:02:42.122512+0000","last_peered":"2024-09-11T11:02:42.122512+0000","last_clean":"2024-09-11T11:02:42.122512+0000","last_became_active":"2024-09-11T11:01:05.332915+0000","last_became_peered":"2024-09-11T11:01:05.332915+0000","last_unstale":"2024-09-11T11:02:42.122512+0000","last_undegraded":"2024-09-11T11:02:42.122512+0000","last_fullsized":"2024-09-11T11:02:42.122512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:37.428238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847796+0000","last_change":"2024-09-11T11:01:03.347195+0000","last_active":"2024-09-11T11:02:42.847796+0000","last_peered":"2024-09-11T11:02:42.847796+0000","last_clean":"2024-09-11T11:02:42.847796+0000","last_became_active":"2024-09-11T11:01:03.346878+0000","last_became_peered":"2024-09-11T11:01:03.346878+0000","last_unstale":"2024-09-11T11:02:42.847796+0000","last_undegraded":"2024-09-11T11:02:42.847796+0000","last_fullsized":"2024-09-11T11:02:42.847796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:23.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.837531+0000","last_change":"2024-09-11T11:01:42.051383+0000","last_active":"2024-09-11T11:03:16.837531+0000","last_peered":"2024-09-11T11:03:16.837531+0000","last_clean":"2024-09-11T11:03:16.837531+0000","last_became_active":"2024-09-11T11:01:42.050609+0000","last_became_peered":"2024-09-11T11:01:42.050609+0000","last_unstale":"2024-09-11T11:03:16.837531+0000","last_undegraded":"2024-09-11T11:03:16.837531+0000","last_fullsized":"2024-09-11T11:03:16.837531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:02:47.432629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500359+0000","last_change":"2024-09-11T11:01:03.335675+0000","last_active":"2024-09-11T11:02:42.500359+0000","last_peered":"2024-09-11T11:02:42.500359+0000","last_clean":"2024-09-11T11:02:42.500359+0000","last_became_active":"2024-09-11T11:01:03.335121+0000","last_became_peered":"2024-09-11T11:01:03.335121+0000","last_unstale":"2024-09-11T11:02:42.500359+0000","last_undegraded":"2024-09-11T11:02:42.500359+0000","last_fullsized":"2024-09-11T11:02:42.500359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:09:08.817967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124476+0000","last_change":"2024-09-11T11:01:05.332966+0000","last_active":"2024-09-11T11:02:42.124476+0000","last_peered":"2024-09-11T11:02:42.124476+0000","last_clean":"2024-09-11T11:02:42.124476+0000","last_became_active":"2024-09-11T11:01:05.332299+0000","last_became_peered":"2024-09-11T11:01:05.332299+0000","last_unstale":"2024-09-11T11:02:42.124476+0000","last_undegraded":"2024-09-11T11:02:42.124476+0000","last_fullsized":"2024-09-11T11:02:42.124476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:16:36.575022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.128827+0000","last_change":"2024-09-11T11:01:03.346356+0000","last_active":"2024-09-11T11:02:42.128827+0000","last_peered":"2024-09-11T11:02:42.128827+0000","last_clean":"2024-09-11T11:02:42.128827+0000","last_became_active":"2024-09-11T11:01:03.345528+0000","last_became_peered":"2024-09-11T11:01:03.345528+0000","last_unstale":"2024-09-11T11:02:42.128827+0000","last_undegraded":"2024-09-11T11:02:42.128827+0000","last_fullsized":"2024-09-11T11:02:42.128827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:22.337303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855579+0000","last_change":"2024-09-11T11:01:05.353141+0000","last_active":"2024-09-11T11:04:17.855579+0000","last_peered":"2024-09-11T11:04:17.855579+0000","last_clean":"2024-09-11T11:04:17.855579+0000","last_became_active":"2024-09-11T11:01:05.352754+0000","last_became_peered":"2024-09-11T11:01:05.352754+0000","last_unstale":"2024-09-11T11:04:17.855579+0000","last_undegraded":"2024-09-11T11:04:17.855579+0000","last_fullsized":"2024-09-11T11:04:17.855579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:13.106892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.125934+0000","last_change":"2024-09-11T11:01:03.323543+0000","last_active":"2024-09-11T11:02:42.125934+0000","last_peered":"2024-09-11T11:02:42.125934+0000","last_clean":"2024-09-11T11:02:42.125934+0000","last_became_active":"2024-09-11T11:01:03.321411+0000","last_became_peered":"2024-09-11T11:01:03.321411+0000","last_unstale":"2024-09-11T11:02:42.125934+0000","last_undegraded":"2024-09-11T11:02:42.125934+0000","last_fullsized":"2024-09-11T11:02:42.125934+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:47:39.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'32","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.854585+0000","last_change":"2024-09-11T11:01:05.337548+0000","last_active":"2024-09-11T11:04:17.854585+0000","last_peered":"2024-09-11T11:04:17.854585+0000","last_clean":"2024-09-11T11:04:17.854585+0000","last_became_active":"2024-09-11T11:01:05.337040+0000","last_became_peered":"2024-09-11T11:01:05.337040+0000","last_unstale":"2024-09-11T11:04:17.854585+0000","last_undegraded":"2024-09-11T11:04:17.854585+0000","last_fullsized":"2024-09-11T11:04:17.854585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:05:06.158539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.757156+0000","last_change":"2024-09-11T11:01:03.334314+0000","last_active":"2024-09-11T11:04:17.757156+0000","last_peered":"2024-09-11T11:04:17.757156+0000","last_clean":"2024-09-11T11:04:17.757156+0000","last_became_active":"2024-09-11T11:01:03.333820+0000","last_became_peered":"2024-09-11T11:01:03.333820+0000","last_unstale":"2024-09-11T11:04:17.757156+0000","last_undegraded":"2024-09-11T11:04:17.757156+0000","last_fullsized":"2024-09-11T11:04:17.757156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:32:19.168897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.574261+0000","last_change":"2024-09-11T11:01:05.342829+0000","last_active":"2024-09-11T11:04:17.574261+0000","last_peered":"2024-09-11T11:04:17.574261+0000","last_clean":"2024-09-11T11:04:17.574261+0000","last_became_active":"2024-09-11T11:01:05.342461+0000","last_became_peered":"2024-09-11T11:01:05.342461+0000","last_unstale":"2024-09-11T11:04:17.574261+0000","last_undegraded":"2024-09-11T11:04:17.574261+0000","last_fullsized":"2024-09-11T11:04:17.574261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:01:49.773250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.267054+0000","last_change":"2024-09-11T11:01:03.346138+0000","last_active":"2024-09-11T11:04:17.267054+0000","last_peered":"2024-09-11T11:04:17.267054+0000","last_clean":"2024-09-11T11:04:17.267054+0000","last_became_active":"2024-09-11T11:01:03.345866+0000","last_became_peered":"2024-09-11T11:01:03.345866+0000","last_unstale":"2024-09-11T11:04:17.267054+0000","last_undegraded":"2024-09-11T11:04:17.267054+0000","last_fullsized":"2024-09-11T11:04:17.267054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:08.559205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4834176,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.814618+0000","last_change":"2024-09-11T11:01:13.415583+0000","last_active":"2024-09-11T11:04:17.814618+0000","last_peered":"2024-09-11T11:04:17.814618+0000","last_clean":"2024-09-11T11:04:17.814618+0000","last_became_active":"2024-09-11T11:01:13.410232+0000","last_became_peered":"2024-09-11T11:01:13.410232+0000","last_unstale":"2024-09-11T11:04:17.814618+0000","last_undegraded":"2024-09-11T11:04:17.814618+0000","last_fullsized":"2024-09-11T11:04:17.814618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:58.102633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'14","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.435955+0000","last_change":"2024-09-11T11:01:05.347684+0000","last_active":"2024-09-11T11:04:17.435955+0000","last_peered":"2024-09-11T11:04:17.435955+0000","last_clean":"2024-09-11T11:04:17.435955+0000","last_became_active":"2024-09-11T11:01:05.347254+0000","last_became_peered":"2024-09-11T11:01:05.347254+0000","last_unstale":"2024-09-11T11:04:17.435955+0000","last_undegraded":"2024-09-11T11:04:17.435955+0000","last_fullsized":"2024-09-11T11:04:17.435955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:37.428238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.729046+0000","last_change":"2024-09-11T11:01:03.341239+0000","last_active":"2024-09-11T11:04:17.729046+0000","last_peered":"2024-09-11T11:04:17.729046+0000","last_clean":"2024-09-11T11:04:17.729046+0000","last_became_active":"2024-09-11T11:01:03.340851+0000","last_became_peered":"2024-09-11T11:01:03.340851+0000","last_unstale":"2024-09-11T11:04:17.729046+0000","last_undegraded":"2024-09-11T11:04:17.729046+0000","last_fullsized":"2024-09-11T11:04:17.729046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:47:39.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113676+0000","last_change":"2024-09-11T11:01:07.364976+0000","last_active":"2024-09-11T11:02:42.113676+0000","last_peered":"2024-09-11T11:02:42.113676+0000","last_clean":"2024-09-11T11:02:42.113676+0000","last_became_active":"2024-09-11T11:01:07.363392+0000","last_became_peered":"2024-09-11T11:01:07.363392+0000","last_unstale":"2024-09-11T11:02:42.113676+0000","last_undegraded":"2024-09-11T11:02:42.113676+0000","last_fullsized":"2024-09-11T11:02:42.113676+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:33.505775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.891552+0000","last_change":"2024-09-11T11:01:09.392616+0000","last_active":"2024-09-11T11:03:14.891552+0000","last_peered":"2024-09-11T11:03:14.891552+0000","last_clean":"2024-09-11T11:03:14.891552+0000","last_became_active":"2024-09-11T11:01:09.392044+0000","last_became_peered":"2024-09-11T11:01:09.392044+0000","last_unstale":"2024-09-11T11:03:14.891552+0000","last_undegraded":"2024-09-11T11:03:14.891552+0000","last_fullsized":"2024-09-11T11:03:14.891552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:06.838378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129542+0000","last_change":"2024-09-11T11:01:11.400422+0000","last_active":"2024-09-11T11:02:42.129542+0000","last_peered":"2024-09-11T11:02:42.129542+0000","last_clean":"2024-09-11T11:02:42.129542+0000","last_became_active":"2024-09-11T11:01:11.399820+0000","last_became_peered":"2024-09-11T11:01:11.399820+0000","last_unstale":"2024-09-11T11:02:42.129542+0000","last_undegraded":"2024-09-11T11:02:42.129542+0000","last_fullsized":"2024-09-11T11:02:42.129542+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:20.584480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121749+0000","last_change":"2024-09-11T11:01:13.421600+0000","last_active":"2024-09-11T11:02:42.121749+0000","last_peered":"2024-09-11T11:02:42.121749+0000","last_clean":"2024-09-11T11:02:42.121749+0000","last_became_active":"2024-09-11T11:01:13.420843+0000","last_became_peered":"2024-09-11T11:01:13.420843+0000","last_unstale":"2024-09-11T11:02:42.121749+0000","last_undegraded":"2024-09-11T11:02:42.121749+0000","last_fullsized":"2024-09-11T11:02:42.121749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:32:51.362925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'17","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.870018+0000","last_change":"2024-09-11T11:01:05.335422+0000","last_active":"2024-09-11T11:04:17.870018+0000","last_peered":"2024-09-11T11:04:17.870018+0000","last_clean":"2024-09-11T11:04:17.870018+0000","last_became_active":"2024-09-11T11:01:05.334085+0000","last_became_peered":"2024-09-11T11:01:05.334085+0000","last_unstale":"2024-09-11T11:04:17.870018+0000","last_undegraded":"2024-09-11T11:04:17.870018+0000","last_fullsized":"2024-09-11T11:04:17.870018+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:49:14.677319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.775271+0000","last_change":"2024-09-11T11:01:03.335761+0000","last_active":"2024-09-11T11:03:16.775271+0000","last_peered":"2024-09-11T11:03:16.775271+0000","last_clean":"2024-09-11T11:03:16.775271+0000","last_became_active":"2024-09-11T11:01:03.335439+0000","last_became_peered":"2024-09-11T11:01:03.335439+0000","last_unstale":"2024-09-11T11:03:16.775271+0000","last_undegraded":"2024-09-11T11:03:16.775271+0000","last_fullsized":"2024-09-11T11:03:16.775271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:15:21.556672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113629+0000","last_change":"2024-09-11T11:01:07.354963+0000","last_active":"2024-09-11T11:02:42.113629+0000","last_peered":"2024-09-11T11:02:42.113629+0000","last_clean":"2024-09-11T11:02:42.113629+0000","last_became_active":"2024-09-11T11:01:07.350851+0000","last_became_peered":"2024-09-11T11:01:07.350851+0000","last_unstale":"2024-09-11T11:02:42.113629+0000","last_undegraded":"2024-09-11T11:02:42.113629+0000","last_fullsized":"2024-09-11T11:02:42.113629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:35:29.768861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845742+0000","last_change":"2024-09-11T11:01:09.383885+0000","last_active":"2024-09-11T11:02:42.845742+0000","last_peered":"2024-09-11T11:02:42.845742+0000","last_clean":"2024-09-11T11:02:42.845742+0000","last_became_active":"2024-09-11T11:01:09.382890+0000","last_became_peered":"2024-09-11T11:01:09.382890+0000","last_unstale":"2024-09-11T11:02:42.845742+0000","last_undegraded":"2024-09-11T11:02:42.845742+0000","last_fullsized":"2024-09-11T11:02:42.845742+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:07.186578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126516+0000","last_change":"2024-09-11T11:01:11.401654+0000","last_active":"2024-09-11T11:02:42.126516+0000","last_peered":"2024-09-11T11:02:42.126516+0000","last_clean":"2024-09-11T11:02:42.126516+0000","last_became_active":"2024-09-11T11:01:11.400881+0000","last_became_peered":"2024-09-11T11:01:11.400881+0000","last_unstale":"2024-09-11T11:02:42.126516+0000","last_undegraded":"2024-09-11T11:02:42.126516+0000","last_fullsized":"2024-09-11T11:02:42.126516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:35:07.181778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110054+0000","last_change":"2024-09-11T11:01:13.423960+0000","last_active":"2024-09-11T11:02:42.110054+0000","last_peered":"2024-09-11T11:02:42.110054+0000","last_clean":"2024-09-11T11:02:42.110054+0000","last_became_active":"2024-09-11T11:01:13.422439+0000","last_became_peered":"2024-09-11T11:01:13.422439+0000","last_unstale":"2024-09-11T11:02:42.110054+0000","last_undegraded":"2024-09-11T11:02:42.110054+0000","last_fullsized":"2024-09-11T11:02:42.110054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:51.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113671+0000","last_change":"2024-09-11T11:01:05.343880+0000","last_active":"2024-09-11T11:02:42.113671+0000","last_peered":"2024-09-11T11:02:42.113671+0000","last_clean":"2024-09-11T11:02:42.113671+0000","last_became_active":"2024-09-11T11:01:05.343489+0000","last_became_peered":"2024-09-11T11:01:05.343489+0000","last_unstale":"2024-09-11T11:02:42.113671+0000","last_undegraded":"2024-09-11T11:02:42.113671+0000","last_fullsized":"2024-09-11T11:02:42.113671+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:27:12.077223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121664+0000","last_change":"2024-09-11T11:01:03.338861+0000","last_active":"2024-09-11T11:02:42.121664+0000","last_peered":"2024-09-11T11:02:42.121664+0000","last_clean":"2024-09-11T11:02:42.121664+0000","last_became_active":"2024-09-11T11:01:03.337993+0000","last_became_peered":"2024-09-11T11:01:03.337993+0000","last_unstale":"2024-09-11T11:02:42.121664+0000","last_undegraded":"2024-09-11T11:02:42.121664+0000","last_fullsized":"2024-09-11T11:02:42.121664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:02.814616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116892+0000","last_change":"2024-09-11T11:01:07.364400+0000","last_active":"2024-09-11T11:02:42.116892+0000","last_peered":"2024-09-11T11:02:42.116892+0000","last_clean":"2024-09-11T11:02:42.116892+0000","last_became_active":"2024-09-11T11:01:07.363656+0000","last_became_peered":"2024-09-11T11:01:07.363656+0000","last_unstale":"2024-09-11T11:02:42.116892+0000","last_undegraded":"2024-09-11T11:02:42.116892+0000","last_fullsized":"2024-09-11T11:02:42.116892+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:51.467819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.772825+0000","last_change":"2024-09-11T11:01:09.365976+0000","last_active":"2024-09-11T11:03:12.772825+0000","last_peered":"2024-09-11T11:03:12.772825+0000","last_clean":"2024-09-11T11:03:12.772825+0000","last_became_active":"2024-09-11T11:01:09.365291+0000","last_became_peered":"2024-09-11T11:01:09.365291+0000","last_unstale":"2024-09-11T11:03:12.772825+0000","last_undegraded":"2024-09-11T11:03:12.772825+0000","last_fullsized":"2024-09-11T11:03:12.772825+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:26.467645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":389,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:48.915220+0000","last_change":"2024-09-11T11:01:11.385545+0000","last_active":"2024-09-11T11:04:48.915220+0000","last_peered":"2024-09-11T11:04:48.915220+0000","last_clean":"2024-09-11T11:04:48.915220+0000","last_became_active":"2024-09-11T11:01:11.384635+0000","last_became_peered":"2024-09-11T11:01:11.384635+0000","last_unstale":"2024-09-11T11:04:48.915220+0000","last_undegraded":"2024-09-11T11:04:48.915220+0000","last_fullsized":"2024-09-11T11:04:48.915220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:41.366917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498281+0000","last_change":"2024-09-11T11:01:13.420839+0000","last_active":"2024-09-11T11:02:42.498281+0000","last_peered":"2024-09-11T11:02:42.498281+0000","last_clean":"2024-09-11T11:02:42.498281+0000","last_became_active":"2024-09-11T11:01:13.413465+0000","last_became_peered":"2024-09-11T11:01:13.413465+0000","last_unstale":"2024-09-11T11:02:42.498281+0000","last_undegraded":"2024-09-11T11:02:42.498281+0000","last_fullsized":"2024-09-11T11:02:42.498281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:12.707001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'18","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770490+0000","last_change":"2024-09-11T11:01:05.347779+0000","last_active":"2024-09-11T11:04:17.770490+0000","last_peered":"2024-09-11T11:04:17.770490+0000","last_clean":"2024-09-11T11:04:17.770490+0000","last_became_active":"2024-09-11T11:01:05.347434+0000","last_became_peered":"2024-09-11T11:01:05.347434+0000","last_unstale":"2024-09-11T11:04:17.770490+0000","last_undegraded":"2024-09-11T11:04:17.770490+0000","last_fullsized":"2024-09-11T11:04:17.770490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:14.471785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"36'6","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.081235+0000","last_change":"2024-09-11T11:01:03.322006+0000","last_active":"2024-09-11T11:04:49.081235+0000","last_peered":"2024-09-11T11:04:49.081235+0000","last_clean":"2024-09-11T11:04:49.081235+0000","last_became_active":"2024-09-11T11:01:03.320684+0000","last_became_peered":"2024-09-11T11:01:03.320684+0000","last_unstale":"2024-09-11T11:04:49.081235+0000","last_undegraded":"2024-09-11T11:04:49.081235+0000","last_fullsized":"2024-09-11T11:04:49.081235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:11.801971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127569+0000","last_change":"2024-09-11T11:01:07.343287+0000","last_active":"2024-09-11T11:02:42.127569+0000","last_peered":"2024-09-11T11:02:42.127569+0000","last_clean":"2024-09-11T11:02:42.127569+0000","last_became_active":"2024-09-11T11:01:07.342607+0000","last_became_peered":"2024-09-11T11:01:07.342607+0000","last_unstale":"2024-09-11T11:02:42.127569+0000","last_undegraded":"2024-09-11T11:02:42.127569+0000","last_fullsized":"2024-09-11T11:02:42.127569+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:33:47.987384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'33","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.092077+0000","last_change":"2024-09-11T11:01:09.367726+0000","last_active":"2024-09-11T11:04:49.092077+0000","last_peered":"2024-09-11T11:04:49.092077+0000","last_clean":"2024-09-11T11:04:49.092077+0000","last_became_active":"2024-09-11T11:01:09.366811+0000","last_became_peered":"2024-09-11T11:01:09.366811+0000","last_unstale":"2024-09-11T11:04:49.092077+0000","last_undegraded":"2024-09-11T11:04:49.092077+0000","last_fullsized":"2024-09-11T11:04:49.092077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:56:57.446929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'282","reported_seq":415,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.928557+0000","last_change":"2024-09-11T11:01:11.399976+0000","last_active":"2024-09-11T11:04:17.928557+0000","last_peered":"2024-09-11T11:04:17.928557+0000","last_clean":"2024-09-11T11:04:17.928557+0000","last_became_active":"2024-09-11T11:01:11.399213+0000","last_became_peered":"2024-09-11T11:01:11.399213+0000","last_unstale":"2024-09-11T11:04:17.928557+0000","last_undegraded":"2024-09-11T11:04:17.928557+0000","last_fullsized":"2024-09-11T11:04:17.928557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:38.273109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.573835+0000","last_change":"2024-09-11T11:01:05.330488+0000","last_active":"2024-09-11T11:04:17.573835+0000","last_peered":"2024-09-11T11:04:17.573835+0000","last_clean":"2024-09-11T11:04:17.573835+0000","last_became_active":"2024-09-11T11:01:05.330091+0000","last_became_peered":"2024-09-11T11:01:05.330091+0000","last_unstale":"2024-09-11T11:04:17.573835+0000","last_undegraded":"2024-09-11T11:04:17.573835+0000","last_fullsized":"2024-09-11T11:04:17.573835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:03.072232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127186+0000","last_change":"2024-09-11T11:01:03.338267+0000","last_active":"2024-09-11T11:02:42.127186+0000","last_peered":"2024-09-11T11:02:42.127186+0000","last_clean":"2024-09-11T11:02:42.127186+0000","last_became_active":"2024-09-11T11:01:03.337496+0000","last_became_peered":"2024-09-11T11:01:03.337496+0000","last_unstale":"2024-09-11T11:02:42.127186+0000","last_undegraded":"2024-09-11T11:02:42.127186+0000","last_fullsized":"2024-09-11T11:02:42.127186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:32:02.436613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843554+0000","last_change":"2024-09-11T11:01:07.366981+0000","last_active":"2024-09-11T11:02:42.843554+0000","last_peered":"2024-09-11T11:02:42.843554+0000","last_clean":"2024-09-11T11:02:42.843554+0000","last_became_active":"2024-09-11T11:01:07.366115+0000","last_became_peered":"2024-09-11T11:01:07.366115+0000","last_unstale":"2024-09-11T11:02:42.843554+0000","last_undegraded":"2024-09-11T11:02:42.843554+0000","last_fullsized":"2024-09-11T11:02:42.843554+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:28:41.656461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'43","reported_seq":98,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.178485+0000","last_change":"2024-09-11T11:01:09.377146+0000","last_active":"2024-09-11T11:04:49.178485+0000","last_peered":"2024-09-11T11:04:49.178485+0000","last_clean":"2024-09-11T11:04:49.178485+0000","last_became_active":"2024-09-11T11:01:09.376242+0000","last_became_peered":"2024-09-11T11:01:09.376242+0000","last_unstale":"2024-09-11T11:04:49.178485+0000","last_undegraded":"2024-09-11T11:04:49.178485+0000","last_fullsized":"2024-09-11T11:04:49.178485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:33:27.367457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842086+0000","last_change":"2024-09-11T11:01:11.378387+0000","last_active":"2024-09-11T11:02:42.842086+0000","last_peered":"2024-09-11T11:02:42.842086+0000","last_clean":"2024-09-11T11:02:42.842086+0000","last_became_active":"2024-09-11T11:01:11.377655+0000","last_became_peered":"2024-09-11T11:01:11.377655+0000","last_unstale":"2024-09-11T11:02:42.842086+0000","last_undegraded":"2024-09-11T11:02:42.842086+0000","last_fullsized":"2024-09-11T11:02:42.842086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:45.529658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499873+0000","last_change":"2024-09-11T11:01:13.421261+0000","last_active":"2024-09-11T11:02:42.499873+0000","last_peered":"2024-09-11T11:02:42.499873+0000","last_clean":"2024-09-11T11:02:42.499873+0000","last_became_active":"2024-09-11T11:01:13.420299+0000","last_became_peered":"2024-09-11T11:01:13.420299+0000","last_unstale":"2024-09-11T11:02:42.499873+0000","last_undegraded":"2024-09-11T11:02:42.499873+0000","last_fullsized":"2024-09-11T11:02:42.499873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:06:26.945332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842409+0000","last_change":"2024-09-11T11:01:05.355473+0000","last_active":"2024-09-11T11:02:42.842409+0000","last_peered":"2024-09-11T11:02:42.842409+0000","last_clean":"2024-09-11T11:02:42.842409+0000","last_became_active":"2024-09-11T11:01:05.355135+0000","last_became_peered":"2024-09-11T11:01:05.355135+0000","last_unstale":"2024-09-11T11:02:42.842409+0000","last_undegraded":"2024-09-11T11:02:42.842409+0000","last_fullsized":"2024-09-11T11:02:42.842409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:47.491766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126834+0000","last_change":"2024-09-11T11:01:03.322857+0000","last_active":"2024-09-11T11:02:42.126834+0000","last_peered":"2024-09-11T11:02:42.126834+0000","last_clean":"2024-09-11T11:02:42.126834+0000","last_became_active":"2024-09-11T11:01:03.320605+0000","last_became_peered":"2024-09-11T11:01:03.320605+0000","last_unstale":"2024-09-11T11:02:42.126834+0000","last_undegraded":"2024-09-11T11:02:42.126834+0000","last_fullsized":"2024-09-11T11:02:42.126834+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:02.081735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497680+0000","last_change":"2024-09-11T11:01:07.349262+0000","last_active":"2024-09-11T11:02:42.497680+0000","last_peered":"2024-09-11T11:02:42.497680+0000","last_clean":"2024-09-11T11:02:42.497680+0000","last_became_active":"2024-09-11T11:01:07.348627+0000","last_became_peered":"2024-09-11T11:01:07.348627+0000","last_unstale":"2024-09-11T11:02:42.497680+0000","last_undegraded":"2024-09-11T11:02:42.497680+0000","last_fullsized":"2024-09-11T11:02:42.497680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:14:29.786650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'31","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.841432+0000","last_change":"2024-09-11T11:01:09.385906+0000","last_active":"2024-09-11T11:03:16.841432+0000","last_peered":"2024-09-11T11:03:16.841432+0000","last_clean":"2024-09-11T11:03:16.841432+0000","last_became_active":"2024-09-11T11:01:09.384478+0000","last_became_peered":"2024-09-11T11:01:09.384478+0000","last_unstale":"2024-09-11T11:03:16.841432+0000","last_undegraded":"2024-09-11T11:03:16.841432+0000","last_fullsized":"2024-09-11T11:03:16.841432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:10.751059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112388+0000","last_change":"2024-09-11T11:01:11.402062+0000","last_active":"2024-09-11T11:02:42.112388+0000","last_peered":"2024-09-11T11:02:42.112388+0000","last_clean":"2024-09-11T11:02:42.112388+0000","last_became_active":"2024-09-11T11:01:11.401382+0000","last_became_peered":"2024-09-11T11:01:11.401382+0000","last_unstale":"2024-09-11T11:02:42.112388+0000","last_undegraded":"2024-09-11T11:02:42.112388+0000","last_fullsized":"2024-09-11T11:02:42.112388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:09.834093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844778+0000","last_change":"2024-09-11T11:01:13.419597+0000","last_active":"2024-09-11T11:02:42.844778+0000","last_peered":"2024-09-11T11:02:42.844778+0000","last_clean":"2024-09-11T11:02:42.844778+0000","last_became_active":"2024-09-11T11:01:13.415041+0000","last_became_peered":"2024-09-11T11:01:13.415041+0000","last_unstale":"2024-09-11T11:02:42.844778+0000","last_undegraded":"2024-09-11T11:02:42.844778+0000","last_fullsized":"2024-09-11T11:02:42.844778+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:25.378088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'8","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921023+0000","last_change":"2024-09-11T11:01:05.347855+0000","last_active":"2024-09-11T11:04:17.921023+0000","last_peered":"2024-09-11T11:04:17.921023+0000","last_clean":"2024-09-11T11:04:17.921023+0000","last_became_active":"2024-09-11T11:01:05.347137+0000","last_became_peered":"2024-09-11T11:01:05.347137+0000","last_unstale":"2024-09-11T11:04:17.921023+0000","last_undegraded":"2024-09-11T11:04:17.921023+0000","last_fullsized":"2024-09-11T11:04:17.921023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:31:24.806914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127018+0000","last_change":"2024-09-11T11:01:42.098396+0000","last_active":"2024-09-11T11:02:42.127018+0000","last_peered":"2024-09-11T11:02:42.127018+0000","last_clean":"2024-09-11T11:02:42.127018+0000","last_became_active":"2024-09-11T11:01:42.065732+0000","last_became_peered":"2024-09-11T11:01:42.065732+0000","last_unstale":"2024-09-11T11:02:42.127018+0000","last_undegraded":"2024-09-11T11:02:42.127018+0000","last_fullsized":"2024-09-11T11:02:42.127018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:11:20.458955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498082+0000","last_change":"2024-09-11T11:01:42.064065+0000","last_active":"2024-09-11T11:02:42.498082+0000","last_peered":"2024-09-11T11:02:42.498082+0000","last_clean":"2024-09-11T11:02:42.498082+0000","last_became_active":"2024-09-11T11:01:42.062781+0000","last_became_peered":"2024-09-11T11:01:42.062781+0000","last_unstale":"2024-09-11T11:02:42.498082+0000","last_undegraded":"2024-09-11T11:02:42.498082+0000","last_fullsized":"2024-09-11T11:02:42.498082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:38:04.790112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'39","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.197038+0000","last_change":"2024-09-11T11:01:09.362905+0000","last_active":"2024-09-11T11:04:49.197038+0000","last_peered":"2024-09-11T11:04:49.197038+0000","last_clean":"2024-09-11T11:04:49.197038+0000","last_became_active":"2024-09-11T11:01:09.362260+0000","last_became_peered":"2024-09-11T11:01:09.362260+0000","last_unstale":"2024-09-11T11:04:49.197038+0000","last_undegraded":"2024-09-11T11:04:49.197038+0000","last_fullsized":"2024-09-11T11:04:49.197038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:49:20.880526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'282","reported_seq":380,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.121670+0000","last_change":"2024-09-11T11:01:11.392542+0000","last_active":"2024-09-11T11:04:18.121670+0000","last_peered":"2024-09-11T11:04:18.121670+0000","last_clean":"2024-09-11T11:04:18.121670+0000","last_became_active":"2024-09-11T11:01:11.391826+0000","last_became_peered":"2024-09-11T11:01:11.391826+0000","last_unstale":"2024-09-11T11:04:18.121670+0000","last_undegraded":"2024-09-11T11:04:18.121670+0000","last_fullsized":"2024-09-11T11:04:18.121670+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:38:29.310699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844769+0000","last_change":"2024-09-11T11:01:13.429296+0000","last_active":"2024-09-11T11:02:42.844769+0000","last_peered":"2024-09-11T11:02:42.844769+0000","last_clean":"2024-09-11T11:02:42.844769+0000","last_became_active":"2024-09-11T11:01:13.428914+0000","last_became_peered":"2024-09-11T11:01:13.428914+0000","last_unstale":"2024-09-11T11:02:42.844769+0000","last_undegraded":"2024-09-11T11:02:42.844769+0000","last_fullsized":"2024-09-11T11:02:42.844769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:03.330930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'6","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921462+0000","last_change":"2024-09-11T11:01:05.340468+0000","last_active":"2024-09-11T11:04:17.921462+0000","last_peered":"2024-09-11T11:04:17.921462+0000","last_clean":"2024-09-11T11:04:17.921462+0000","last_became_active":"2024-09-11T11:01:05.340069+0000","last_became_peered":"2024-09-11T11:01:05.340069+0000","last_unstale":"2024-09-11T11:04:17.921462+0000","last_undegraded":"2024-09-11T11:04:17.921462+0000","last_fullsized":"2024-09-11T11:04:17.921462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:04:10.394106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.390386+0000","last_change":"2024-09-11T11:01:03.334480+0000","last_active":"2024-09-11T11:04:17.390386+0000","last_peered":"2024-09-11T11:04:17.390386+0000","last_clean":"2024-09-11T11:04:17.390386+0000","last_became_active":"2024-09-11T11:01:03.333740+0000","last_became_peered":"2024-09-11T11:01:03.333740+0000","last_unstale":"2024-09-11T11:04:17.390386+0000","last_undegraded":"2024-09-11T11:04:17.390386+0000","last_fullsized":"2024-09-11T11:04:17.390386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:50:26.785068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498170+0000","last_change":"2024-09-11T11:01:07.355314+0000","last_active":"2024-09-11T11:02:42.498170+0000","last_peered":"2024-09-11T11:02:42.498170+0000","last_clean":"2024-09-11T11:02:42.498170+0000","last_became_active":"2024-09-11T11:01:07.354827+0000","last_became_peered":"2024-09-11T11:01:07.354827+0000","last_unstale":"2024-09-11T11:02:42.498170+0000","last_undegraded":"2024-09-11T11:02:42.498170+0000","last_fullsized":"2024-09-11T11:02:42.498170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:19:54.907620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'54","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.906396+0000","last_change":"2024-09-11T11:01:09.378757+0000","last_active":"2024-09-11T11:03:14.906396+0000","last_peered":"2024-09-11T11:03:14.906396+0000","last_clean":"2024-09-11T11:03:14.906396+0000","last_became_active":"2024-09-11T11:01:09.374320+0000","last_became_peered":"2024-09-11T11:01:09.374320+0000","last_unstale":"2024-09-11T11:03:14.906396+0000","last_undegraded":"2024-09-11T11:03:14.906396+0000","last_fullsized":"2024-09-11T11:03:14.906396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:24:56.662956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497933+0000","last_change":"2024-09-11T11:01:11.399906+0000","last_active":"2024-09-11T11:02:42.497933+0000","last_peered":"2024-09-11T11:02:42.497933+0000","last_clean":"2024-09-11T11:02:42.497933+0000","last_became_active":"2024-09-11T11:01:11.399118+0000","last_became_peered":"2024-09-11T11:01:11.399118+0000","last_unstale":"2024-09-11T11:02:42.497933+0000","last_undegraded":"2024-09-11T11:02:42.497933+0000","last_fullsized":"2024-09-11T11:02:42.497933+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:55:10.905238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.082661+0000","last_change":"2024-09-11T11:01:13.419418+0000","last_active":"2024-09-11T11:04:18.082661+0000","last_peered":"2024-09-11T11:04:18.082661+0000","last_clean":"2024-09-11T11:04:18.082661+0000","last_became_active":"2024-09-11T11:01:13.415242+0000","last_became_peered":"2024-09-11T11:01:13.415242+0000","last_unstale":"2024-09-11T11:04:18.082661+0000","last_undegraded":"2024-09-11T11:04:18.082661+0000","last_fullsized":"2024-09-11T11:04:18.082661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:11.846013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845729+0000","last_change":"2024-09-11T11:01:05.348021+0000","last_active":"2024-09-11T11:02:42.845729+0000","last_peered":"2024-09-11T11:02:42.845729+0000","last_clean":"2024-09-11T11:02:42.845729+0000","last_became_active":"2024-09-11T11:01:05.347367+0000","last_became_peered":"2024-09-11T11:01:05.347367+0000","last_unstale":"2024-09-11T11:02:42.845729+0000","last_undegraded":"2024-09-11T11:02:42.845729+0000","last_fullsized":"2024-09-11T11:02:42.845729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:39:58.017666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113078+0000","last_change":"2024-09-11T11:01:03.349349+0000","last_active":"2024-09-11T11:02:42.113078+0000","last_peered":"2024-09-11T11:02:42.113078+0000","last_clean":"2024-09-11T11:02:42.113078+0000","last_became_active":"2024-09-11T11:01:03.349051+0000","last_became_peered":"2024-09-11T11:01:03.349051+0000","last_unstale":"2024-09-11T11:02:42.113078+0000","last_undegraded":"2024-09-11T11:02:42.113078+0000","last_fullsized":"2024-09-11T11:02:42.113078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:55.170368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499811+0000","last_change":"2024-09-11T11:01:07.345118+0000","last_active":"2024-09-11T11:02:42.499811+0000","last_peered":"2024-09-11T11:02:42.499811+0000","last_clean":"2024-09-11T11:02:42.499811+0000","last_became_active":"2024-09-11T11:01:07.344509+0000","last_became_peered":"2024-09-11T11:01:07.344509+0000","last_unstale":"2024-09-11T11:02:42.499811+0000","last_undegraded":"2024-09-11T11:02:42.499811+0000","last_fullsized":"2024-09-11T11:02:42.499811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:59:57.440549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'35","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.028475+0000","last_change":"2024-09-11T11:01:09.377401+0000","last_active":"2024-09-11T11:04:49.028475+0000","last_peered":"2024-09-11T11:04:49.028475+0000","last_clean":"2024-09-11T11:04:49.028475+0000","last_became_active":"2024-09-11T11:01:09.376576+0000","last_became_peered":"2024-09-11T11:01:09.376576+0000","last_unstale":"2024-09-11T11:04:49.028475+0000","last_undegraded":"2024-09-11T11:04:49.028475+0000","last_fullsized":"2024-09-11T11:04:49.028475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:35.979322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114062+0000","last_change":"2024-09-11T11:01:11.394988+0000","last_active":"2024-09-11T11:02:42.114062+0000","last_peered":"2024-09-11T11:02:42.114062+0000","last_clean":"2024-09-11T11:02:42.114062+0000","last_became_active":"2024-09-11T11:01:11.394215+0000","last_became_peered":"2024-09-11T11:01:11.394215+0000","last_unstale":"2024-09-11T11:02:42.114062+0000","last_undegraded":"2024-09-11T11:02:42.114062+0000","last_fullsized":"2024-09-11T11:02:42.114062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:19:01.319010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.482720+0000","last_change":"2024-09-11T11:01:13.391142+0000","last_active":"2024-09-11T11:03:14.482720+0000","last_peered":"2024-09-11T11:03:14.482720+0000","last_clean":"2024-09-11T11:03:14.482720+0000","last_became_active":"2024-09-11T11:01:13.390538+0000","last_became_peered":"2024-09-11T11:01:13.390538+0000","last_unstale":"2024-09-11T11:03:14.482720+0000","last_undegraded":"2024-09-11T11:03:14.482720+0000","last_fullsized":"2024-09-11T11:03:14.482720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:22.596400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836912+0000","last_change":"2024-09-11T11:01:05.332887+0000","last_active":"2024-09-11T11:03:16.836912+0000","last_peered":"2024-09-11T11:03:16.836912+0000","last_clean":"2024-09-11T11:03:16.836912+0000","last_became_active":"2024-09-11T11:01:05.332138+0000","last_became_peered":"2024-09-11T11:01:05.332138+0000","last_unstale":"2024-09-11T11:03:16.836912+0000","last_undegraded":"2024-09-11T11:03:16.836912+0000","last_fullsized":"2024-09-11T11:03:16.836912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:58.679274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123858+0000","last_change":"2024-09-11T11:01:03.321735+0000","last_active":"2024-09-11T11:02:42.123858+0000","last_peered":"2024-09-11T11:02:42.123858+0000","last_clean":"2024-09-11T11:02:42.123858+0000","last_became_active":"2024-09-11T11:01:03.320906+0000","last_became_peered":"2024-09-11T11:01:03.320906+0000","last_unstale":"2024-09-11T11:02:42.123858+0000","last_undegraded":"2024-09-11T11:02:42.123858+0000","last_fullsized":"2024-09-11T11:02:42.123858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:36.159649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843009+0000","last_change":"2024-09-11T11:01:07.367900+0000","last_active":"2024-09-11T11:02:42.843009+0000","last_peered":"2024-09-11T11:02:42.843009+0000","last_clean":"2024-09-11T11:02:42.843009+0000","last_became_active":"2024-09-11T11:01:07.367554+0000","last_became_peered":"2024-09-11T11:01:07.367554+0000","last_unstale":"2024-09-11T11:02:42.843009+0000","last_undegraded":"2024-09-11T11:02:42.843009+0000","last_fullsized":"2024-09-11T11:02:42.843009+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:52.335084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'38","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.916885+0000","last_change":"2024-09-11T11:01:09.367972+0000","last_active":"2024-09-11T11:03:14.916885+0000","last_peered":"2024-09-11T11:03:14.916885+0000","last_clean":"2024-09-11T11:03:14.916885+0000","last_became_active":"2024-09-11T11:01:09.367246+0000","last_became_peered":"2024-09-11T11:01:09.367246+0000","last_unstale":"2024-09-11T11:03:14.916885+0000","last_undegraded":"2024-09-11T11:03:14.916885+0000","last_fullsized":"2024-09-11T11:03:14.916885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:32.334281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'282","reported_seq":414,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.093944+0000","last_change":"2024-09-11T11:01:11.393113+0000","last_active":"2024-09-11T11:04:18.093944+0000","last_peered":"2024-09-11T11:04:18.093944+0000","last_clean":"2024-09-11T11:04:18.093944+0000","last_became_active":"2024-09-11T11:01:11.392359+0000","last_became_peered":"2024-09-11T11:01:11.392359+0000","last_unstale":"2024-09-11T11:04:18.093944+0000","last_undegraded":"2024-09-11T11:04:18.093944+0000","last_fullsized":"2024-09-11T11:04:18.093944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:39.923836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'16","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.875398+0000","last_change":"2024-09-11T11:01:13.418955+0000","last_active":"2024-09-11T11:04:17.875398+0000","last_peered":"2024-09-11T11:04:17.875398+0000","last_clean":"2024-09-11T11:04:17.875398+0000","last_became_active":"2024-09-11T11:01:13.415115+0000","last_became_peered":"2024-09-11T11:01:13.415115+0000","last_unstale":"2024-09-11T11:04:17.875398+0000","last_undegraded":"2024-09-11T11:04:17.875398+0000","last_fullsized":"2024-09-11T11:04:17.875398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:40.005800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770486+0000","last_change":"2024-09-11T11:01:05.337583+0000","last_active":"2024-09-11T11:04:17.770486+0000","last_peered":"2024-09-11T11:04:17.770486+0000","last_clean":"2024-09-11T11:04:17.770486+0000","last_became_active":"2024-09-11T11:01:05.337055+0000","last_became_peered":"2024-09-11T11:01:05.337055+0000","last_unstale":"2024-09-11T11:04:17.770486+0000","last_undegraded":"2024-09-11T11:04:17.770486+0000","last_fullsized":"2024-09-11T11:04:17.770486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:44:52.604892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.743722+0000","last_change":"2024-09-11T11:01:03.336594+0000","last_active":"2024-09-11T11:04:17.743722+0000","last_peered":"2024-09-11T11:04:17.743722+0000","last_clean":"2024-09-11T11:04:17.743722+0000","last_became_active":"2024-09-11T11:01:03.334392+0000","last_became_peered":"2024-09-11T11:01:03.334392+0000","last_unstale":"2024-09-11T11:04:17.743722+0000","last_undegraded":"2024-09-11T11:04:17.743722+0000","last_fullsized":"2024-09-11T11:04:17.743722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:14.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'3","reported_seq":421,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:48.888699+0000","last_change":"2024-09-11T11:01:07.360933+0000","last_active":"2024-09-11T11:04:48.888699+0000","last_peered":"2024-09-11T11:04:48.888699+0000","last_clean":"2024-09-11T11:04:48.888699+0000","last_became_active":"2024-09-11T11:01:07.360348+0000","last_became_peered":"2024-09-11T11:01:07.360348+0000","last_unstale":"2024-09-11T11:04:48.888699+0000","last_undegraded":"2024-09-11T11:04:48.888699+0000","last_fullsized":"2024-09-11T11:04:48.888699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:05.167233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.519176+0000","last_change":"2024-09-11T11:02:42.518145+0000","last_active":"2024-09-11T11:02:42.519176+0000","last_peered":"2024-09-11T11:02:42.519176+0000","last_clean":"2024-09-11T11:02:42.519176+0000","last_became_active":"2024-09-11T11:02:42.501712+0000","last_became_peered":"2024-09-11T11:02:42.501712+0000","last_unstale":"2024-09-11T11:02:42.519176+0000","last_undegraded":"2024-09-11T11:02:42.519176+0000","last_fullsized":"2024-09-11T11:02:42.519176+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:53.342864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":507,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:48.918832+0000","last_change":"2024-09-11T11:01:11.386158+0000","last_active":"2024-09-11T11:04:48.918832+0000","last_peered":"2024-09-11T11:04:48.918832+0000","last_clean":"2024-09-11T11:04:48.918832+0000","last_became_active":"2024-09-11T11:01:11.384776+0000","last_became_peered":"2024-09-11T11:01:11.384776+0000","last_unstale":"2024-09-11T11:04:48.918832+0000","last_undegraded":"2024-09-11T11:04:48.918832+0000","last_fullsized":"2024-09-11T11:04:48.918832+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:00.643395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.829302+0000","last_change":"2024-09-11T11:01:13.419039+0000","last_active":"2024-09-11T11:03:16.829302+0000","last_peered":"2024-09-11T11:03:16.829302+0000","last_clean":"2024-09-11T11:03:16.829302+0000","last_became_active":"2024-09-11T11:01:13.418296+0000","last_became_peered":"2024-09-11T11:01:13.418296+0000","last_unstale":"2024-09-11T11:03:16.829302+0000","last_undegraded":"2024-09-11T11:03:16.829302+0000","last_fullsized":"2024-09-11T11:03:16.829302+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:38:59.936533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.920553+0000","last_change":"2024-09-11T11:01:05.348048+0000","last_active":"2024-09-11T11:04:17.920553+0000","last_peered":"2024-09-11T11:04:17.920553+0000","last_clean":"2024-09-11T11:04:17.920553+0000","last_became_active":"2024-09-11T11:01:05.347644+0000","last_became_peered":"2024-09-11T11:01:05.347644+0000","last_unstale":"2024-09-11T11:04:17.920553+0000","last_undegraded":"2024-09-11T11:04:17.920553+0000","last_fullsized":"2024-09-11T11:04:17.920553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:28.667270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109195+0000","last_change":"2024-09-11T11:01:03.349954+0000","last_active":"2024-09-11T11:02:42.109195+0000","last_peered":"2024-09-11T11:02:42.109195+0000","last_clean":"2024-09-11T11:02:42.109195+0000","last_became_active":"2024-09-11T11:01:03.349605+0000","last_became_peered":"2024-09-11T11:01:03.349605+0000","last_unstale":"2024-09-11T11:02:42.109195+0000","last_undegraded":"2024-09-11T11:02:42.109195+0000","last_fullsized":"2024-09-11T11:02:42.109195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:42.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113995+0000","last_change":"2024-09-11T11:01:07.355413+0000","last_active":"2024-09-11T11:02:42.113995+0000","last_peered":"2024-09-11T11:02:42.113995+0000","last_clean":"2024-09-11T11:02:42.113995+0000","last_became_active":"2024-09-11T11:01:07.351403+0000","last_became_peered":"2024-09-11T11:01:07.351403+0000","last_unstale":"2024-09-11T11:02:42.113995+0000","last_undegraded":"2024-09-11T11:02:42.113995+0000","last_fullsized":"2024-09-11T11:02:42.113995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:36:28.171191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'41","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.147707+0000","last_change":"2024-09-11T11:01:09.377243+0000","last_active":"2024-09-11T11:04:49.147707+0000","last_peered":"2024-09-11T11:04:49.147707+0000","last_clean":"2024-09-11T11:04:49.147707+0000","last_became_active":"2024-09-11T11:01:09.376340+0000","last_became_peered":"2024-09-11T11:01:09.376340+0000","last_unstale":"2024-09-11T11:04:49.147707+0000","last_undegraded":"2024-09-11T11:04:49.147707+0000","last_fullsized":"2024-09-11T11:04:49.147707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:34:10.669607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126520+0000","last_change":"2024-09-11T11:01:11.386915+0000","last_active":"2024-09-11T11:02:42.126520+0000","last_peered":"2024-09-11T11:02:42.126520+0000","last_clean":"2024-09-11T11:02:42.126520+0000","last_became_active":"2024-09-11T11:01:11.385523+0000","last_became_peered":"2024-09-11T11:01:11.385523+0000","last_unstale":"2024-09-11T11:02:42.126520+0000","last_undegraded":"2024-09-11T11:02:42.126520+0000","last_fullsized":"2024-09-11T11:02:42.126520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:46:58.221514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'6","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.989822+0000","last_change":"2024-09-11T11:01:13.408216+0000","last_active":"2024-09-11T11:04:17.989822+0000","last_peered":"2024-09-11T11:04:17.989822+0000","last_clean":"2024-09-11T11:04:17.989822+0000","last_became_active":"2024-09-11T11:01:13.403125+0000","last_became_peered":"2024-09-11T11:01:13.403125+0000","last_unstale":"2024-09-11T11:04:17.989822+0000","last_undegraded":"2024-09-11T11:04:17.989822+0000","last_fullsized":"2024-09-11T11:04:17.989822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:20.557182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'22","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.856373+0000","last_change":"2024-09-11T11:01:05.346169+0000","last_active":"2024-09-11T11:04:17.856373+0000","last_peered":"2024-09-11T11:04:17.856373+0000","last_clean":"2024-09-11T11:04:17.856373+0000","last_became_active":"2024-09-11T11:01:05.345474+0000","last_became_peered":"2024-09-11T11:01:05.345474+0000","last_unstale":"2024-09-11T11:04:17.856373+0000","last_undegraded":"2024-09-11T11:04:17.856373+0000","last_fullsized":"2024-09-11T11:04:17.856373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:50.321614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":206,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.841643+0000","last_change":"2024-09-11T11:00:51.371382+0000","last_active":"2024-09-11T11:02:42.841643+0000","last_peered":"2024-09-11T11:02:42.841643+0000","last_clean":"2024-09-11T11:02:42.841643+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:02:42.841643+0000","last_undegraded":"2024-09-11T11:02:42.841643+0000","last_fullsized":"2024-09-11T11:02:42.841643+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_clean_scrub_stamp":"2024-09-11T11:00:49.442581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:55:56.798705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124201+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:02:42.124201+0000","last_peered":"2024-09-11T11:02:42.124201+0000","last_clean":"2024-09-11T11:02:42.124201+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:02:42.124201+0000","last_undegraded":"2024-09-11T11:02:42.124201+0000","last_fullsized":"2024-09-11T11:02:42.124201+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:29.398076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110553+0000","last_change":"2024-09-11T11:01:03.345152+0000","last_active":"2024-09-11T11:02:42.110553+0000","last_peered":"2024-09-11T11:02:42.110553+0000","last_clean":"2024-09-11T11:02:42.110553+0000","last_became_active":"2024-09-11T11:01:03.334611+0000","last_became_peered":"2024-09-11T11:01:03.334611+0000","last_unstale":"2024-09-11T11:02:42.110553+0000","last_undegraded":"2024-09-11T11:02:42.110553+0000","last_fullsized":"2024-09-11T11:02:42.110553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:26:54.046187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843252+0000","last_change":"2024-09-11T11:01:07.352085+0000","last_active":"2024-09-11T11:02:42.843252+0000","last_peered":"2024-09-11T11:02:42.843252+0000","last_clean":"2024-09-11T11:02:42.843252+0000","last_became_active":"2024-09-11T11:01:07.348530+0000","last_became_peered":"2024-09-11T11:01:07.348530+0000","last_unstale":"2024-09-11T11:02:42.843252+0000","last_undegraded":"2024-09-11T11:02:42.843252+0000","last_fullsized":"2024-09-11T11:02:42.843252+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:05.458479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'85","reported_seq":170,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.254390+0000","last_change":"2024-09-11T11:01:09.370703+0000","last_active":"2024-09-11T11:04:49.254390+0000","last_peered":"2024-09-11T11:04:49.254390+0000","last_clean":"2024-09-11T11:04:49.254390+0000","last_became_active":"2024-09-11T11:01:09.369066+0000","last_became_peered":"2024-09-11T11:01:09.369066+0000","last_unstale":"2024-09-11T11:04:49.254390+0000","last_undegraded":"2024-09-11T11:04:49.254390+0000","last_fullsized":"2024-09-11T11:04:49.254390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:36.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.113047+0000","last_change":"2024-09-11T11:01:11.396326+0000","last_active":"2024-09-11T11:02:42.113047+0000","last_peered":"2024-09-11T11:02:42.113047+0000","last_clean":"2024-09-11T11:02:42.113047+0000","last_became_active":"2024-09-11T11:01:11.394277+0000","last_became_peered":"2024-09-11T11:01:11.394277+0000","last_unstale":"2024-09-11T11:02:42.113047+0000","last_undegraded":"2024-09-11T11:02:42.113047+0000","last_fullsized":"2024-09-11T11:02:42.113047+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:23.366168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":167,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.947140+0000","last_change":"2024-09-11T11:01:13.413493+0000","last_active":"2024-09-11T11:04:17.947140+0000","last_peered":"2024-09-11T11:04:17.947140+0000","last_clean":"2024-09-11T11:04:17.947140+0000","last_became_active":"2024-09-11T11:01:13.412615+0000","last_became_peered":"2024-09-11T11:01:13.412615+0000","last_unstale":"2024-09-11T11:04:17.947140+0000","last_undegraded":"2024-09-11T11:04:17.947140+0000","last_fullsized":"2024-09-11T11:04:17.947140+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:01.417923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.856351+0000","last_change":"2024-09-11T11:01:05.348037+0000","last_active":"2024-09-11T11:04:17.856351+0000","last_peered":"2024-09-11T11:04:17.856351+0000","last_clean":"2024-09-11T11:04:17.856351+0000","last_became_active":"2024-09-11T11:01:05.346710+0000","last_became_peered":"2024-09-11T11:01:05.346710+0000","last_unstale":"2024-09-11T11:04:17.856351+0000","last_undegraded":"2024-09-11T11:04:17.856351+0000","last_fullsized":"2024-09-11T11:04:17.856351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:08.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122859+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:02:42.122859+0000","last_peered":"2024-09-11T11:02:42.122859+0000","last_clean":"2024-09-11T11:02:42.122859+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:02:42.122859+0000","last_undegraded":"2024-09-11T11:02:42.122859+0000","last_fullsized":"2024-09-11T11:02:42.122859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:31:53.046144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844373+0000","last_change":"2024-09-11T11:01:03.326592+0000","last_active":"2024-09-11T11:02:42.844373+0000","last_peered":"2024-09-11T11:02:42.844373+0000","last_clean":"2024-09-11T11:02:42.844373+0000","last_became_active":"2024-09-11T11:01:03.325795+0000","last_became_peered":"2024-09-11T11:01:03.325795+0000","last_unstale":"2024-09-11T11:02:42.844373+0000","last_undegraded":"2024-09-11T11:02:42.844373+0000","last_fullsized":"2024-09-11T11:02:42.844373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:12:21.219306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129384+0000","last_change":"2024-09-11T11:01:07.361191+0000","last_active":"2024-09-11T11:02:42.129384+0000","last_peered":"2024-09-11T11:02:42.129384+0000","last_clean":"2024-09-11T11:02:42.129384+0000","last_became_active":"2024-09-11T11:01:07.360718+0000","last_became_peered":"2024-09-11T11:01:07.360718+0000","last_unstale":"2024-09-11T11:02:42.129384+0000","last_undegraded":"2024-09-11T11:02:42.129384+0000","last_fullsized":"2024-09-11T11:02:42.129384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:36:44.262635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'273","reported_seq":481,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.597426+0000","last_change":"2024-09-11T11:01:09.377670+0000","last_active":"2024-09-11T11:04:17.597426+0000","last_peered":"2024-09-11T11:04:17.597426+0000","last_clean":"2024-09-11T11:04:17.597426+0000","last_became_active":"2024-09-11T11:01:09.376555+0000","last_became_peered":"2024-09-11T11:01:09.376555+0000","last_unstale":"2024-09-11T11:04:17.597426+0000","last_undegraded":"2024-09-11T11:04:17.597426+0000","last_fullsized":"2024-09-11T11:04:17.597426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:13.150085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112535+0000","last_change":"2024-09-11T11:01:11.400937+0000","last_active":"2024-09-11T11:02:42.112535+0000","last_peered":"2024-09-11T11:02:42.112535+0000","last_clean":"2024-09-11T11:02:42.112535+0000","last_became_active":"2024-09-11T11:01:11.400253+0000","last_became_peered":"2024-09-11T11:01:11.400253+0000","last_unstale":"2024-09-11T11:02:42.112535+0000","last_undegraded":"2024-09-11T11:02:42.112535+0000","last_fullsized":"2024-09-11T11:02:42.112535+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:56.090713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'11","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843512+0000","last_change":"2024-09-11T11:01:13.422211+0000","last_active":"2024-09-11T11:02:42.843512+0000","last_peered":"2024-09-11T11:02:42.843512+0000","last_clean":"2024-09-11T11:02:42.843512+0000","last_became_active":"2024-09-11T11:01:13.421491+0000","last_became_peered":"2024-09-11T11:01:13.421491+0000","last_unstale":"2024-09-11T11:02:42.843512+0000","last_undegraded":"2024-09-11T11:02:42.843512+0000","last_fullsized":"2024-09-11T11:02:42.843512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:09:11.421051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.442243+0000","last_change":"2024-09-11T11:01:05.347801+0000","last_active":"2024-09-11T11:04:17.442243+0000","last_peered":"2024-09-11T11:04:17.442243+0000","last_clean":"2024-09-11T11:04:17.442243+0000","last_became_active":"2024-09-11T11:01:05.347359+0000","last_became_peered":"2024-09-11T11:01:05.347359+0000","last_unstale":"2024-09-11T11:04:17.442243+0000","last_undegraded":"2024-09-11T11:04:17.442243+0000","last_fullsized":"2024-09-11T11:04:17.442243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:17:27.832387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.496965+0000","last_change":"2024-09-11T11:00:56.127438+0000","last_active":"2024-09-11T11:02:42.496965+0000","last_peered":"2024-09-11T11:02:42.496965+0000","last_clean":"2024-09-11T11:02:42.496965+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:02:42.496965+0000","last_undegraded":"2024-09-11T11:02:42.496965+0000","last_fullsized":"2024-09-11T11:02:42.496965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:21.503625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842035+0000","last_change":"2024-09-11T11:01:03.325786+0000","last_active":"2024-09-11T11:02:42.842035+0000","last_peered":"2024-09-11T11:02:42.842035+0000","last_clean":"2024-09-11T11:02:42.842035+0000","last_became_active":"2024-09-11T11:01:03.325168+0000","last_became_peered":"2024-09-11T11:01:03.325168+0000","last_unstale":"2024-09-11T11:02:42.842035+0000","last_undegraded":"2024-09-11T11:02:42.842035+0000","last_fullsized":"2024-09-11T11:02:42.842035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:23:26.401311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":223,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.332529+0000","last_change":"2024-09-11T11:01:07.348097+0000","last_active":"2024-09-11T11:03:16.332529+0000","last_peered":"2024-09-11T11:03:16.332529+0000","last_clean":"2024-09-11T11:03:16.332529+0000","last_became_active":"2024-09-11T11:01:07.345998+0000","last_became_peered":"2024-09-11T11:01:07.345998+0000","last_unstale":"2024-09-11T11:03:16.332529+0000","last_undegraded":"2024-09-11T11:03:16.332529+0000","last_fullsized":"2024-09-11T11:03:16.332529+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:01:22.783881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'17","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.944373+0000","last_change":"2024-09-11T11:01:09.372579+0000","last_active":"2024-09-11T11:04:17.944373+0000","last_peered":"2024-09-11T11:04:17.944373+0000","last_clean":"2024-09-11T11:04:17.944373+0000","last_became_active":"2024-09-11T11:01:09.371816+0000","last_became_peered":"2024-09-11T11:01:09.371816+0000","last_unstale":"2024-09-11T11:04:17.944373+0000","last_undegraded":"2024-09-11T11:04:17.944373+0000","last_fullsized":"2024-09-11T11:04:17.944373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:35.245802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843529+0000","last_change":"2024-09-11T11:01:11.392823+0000","last_active":"2024-09-11T11:02:42.843529+0000","last_peered":"2024-09-11T11:02:42.843529+0000","last_clean":"2024-09-11T11:02:42.843529+0000","last_became_active":"2024-09-11T11:01:11.392208+0000","last_became_peered":"2024-09-11T11:01:11.392208+0000","last_unstale":"2024-09-11T11:02:42.843529+0000","last_undegraded":"2024-09-11T11:02:42.843529+0000","last_fullsized":"2024-09-11T11:02:42.843529+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:42:29.363507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114046+0000","last_change":"2024-09-11T11:01:13.408511+0000","last_active":"2024-09-11T11:02:42.114046+0000","last_peered":"2024-09-11T11:02:42.114046+0000","last_clean":"2024-09-11T11:02:42.114046+0000","last_became_active":"2024-09-11T11:01:13.406863+0000","last_became_peered":"2024-09-11T11:01:13.406863+0000","last_unstale":"2024-09-11T11:02:42.114046+0000","last_undegraded":"2024-09-11T11:02:42.114046+0000","last_fullsized":"2024-09-11T11:02:42.114046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:54.284696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845057+0000","last_change":"2024-09-11T11:01:05.333748+0000","last_active":"2024-09-11T11:02:42.845057+0000","last_peered":"2024-09-11T11:02:42.845057+0000","last_clean":"2024-09-11T11:02:42.845057+0000","last_became_active":"2024-09-11T11:01:05.332361+0000","last_became_peered":"2024-09-11T11:01:05.332361+0000","last_unstale":"2024-09-11T11:02:42.845057+0000","last_undegraded":"2024-09-11T11:02:42.845057+0000","last_fullsized":"2024-09-11T11:02:42.845057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:40:25.995301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123553+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:02:42.123553+0000","last_peered":"2024-09-11T11:02:42.123553+0000","last_clean":"2024-09-11T11:02:42.123553+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:02:42.123553+0000","last_undegraded":"2024-09-11T11:02:42.123553+0000","last_fullsized":"2024-09-11T11:02:42.123553+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:17:00.420708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123842+0000","last_change":"2024-09-11T11:01:03.328169+0000","last_active":"2024-09-11T11:02:42.123842+0000","last_peered":"2024-09-11T11:02:42.123842+0000","last_clean":"2024-09-11T11:02:42.123842+0000","last_became_active":"2024-09-11T11:01:03.327456+0000","last_became_peered":"2024-09-11T11:01:03.327456+0000","last_unstale":"2024-09-11T11:02:42.123842+0000","last_undegraded":"2024-09-11T11:02:42.123842+0000","last_fullsized":"2024-09-11T11:02:42.123842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:11.883100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845875+0000","last_change":"2024-09-11T11:01:07.369393+0000","last_active":"2024-09-11T11:02:42.845875+0000","last_peered":"2024-09-11T11:02:42.845875+0000","last_clean":"2024-09-11T11:02:42.845875+0000","last_became_active":"2024-09-11T11:01:07.367962+0000","last_became_peered":"2024-09-11T11:01:07.367962+0000","last_unstale":"2024-09-11T11:02:42.845875+0000","last_undegraded":"2024-09-11T11:02:42.845875+0000","last_fullsized":"2024-09-11T11:02:42.845875+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:35:29.768861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.859766+0000","last_change":"2024-09-11T11:01:09.390513+0000","last_active":"2024-09-11T11:04:16.859766+0000","last_peered":"2024-09-11T11:04:16.859766+0000","last_clean":"2024-09-11T11:04:16.859766+0000","last_became_active":"2024-09-11T11:01:09.389732+0000","last_became_peered":"2024-09-11T11:01:09.389732+0000","last_unstale":"2024-09-11T11:04:16.859766+0000","last_undegraded":"2024-09-11T11:04:16.859766+0000","last_fullsized":"2024-09-11T11:04:16.859766+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:21.731861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116921+0000","last_change":"2024-09-11T11:01:11.398218+0000","last_active":"2024-09-11T11:02:42.116921+0000","last_peered":"2024-09-11T11:02:42.116921+0000","last_clean":"2024-09-11T11:02:42.116921+0000","last_became_active":"2024-09-11T11:01:11.397467+0000","last_became_peered":"2024-09-11T11:01:11.397467+0000","last_unstale":"2024-09-11T11:02:42.116921+0000","last_undegraded":"2024-09-11T11:02:42.116921+0000","last_fullsized":"2024-09-11T11:02:42.116921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:09:09.409131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.026023+0000","last_change":"2024-09-11T11:01:13.418703+0000","last_active":"2024-09-11T11:04:18.026023+0000","last_peered":"2024-09-11T11:04:18.026023+0000","last_clean":"2024-09-11T11:04:18.026023+0000","last_became_active":"2024-09-11T11:01:13.414898+0000","last_became_peered":"2024-09-11T11:01:13.414898+0000","last_unstale":"2024-09-11T11:04:18.026023+0000","last_undegraded":"2024-09-11T11:04:18.026023+0000","last_fullsized":"2024-09-11T11:04:18.026023+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:40.285029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.769897+0000","last_change":"2024-09-11T11:01:05.343143+0000","last_active":"2024-09-11T11:04:17.769897+0000","last_peered":"2024-09-11T11:04:17.769897+0000","last_clean":"2024-09-11T11:04:17.769897+0000","last_became_active":"2024-09-11T11:01:05.342651+0000","last_became_peered":"2024-09-11T11:01:05.342651+0000","last_unstale":"2024-09-11T11:04:17.769897+0000","last_undegraded":"2024-09-11T11:04:17.769897+0000","last_fullsized":"2024-09-11T11:04:17.769897+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:48:14.974986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126841+0000","last_change":"2024-09-11T11:01:03.338569+0000","last_active":"2024-09-11T11:02:42.126841+0000","last_peered":"2024-09-11T11:02:42.126841+0000","last_clean":"2024-09-11T11:02:42.126841+0000","last_became_active":"2024-09-11T11:01:03.336412+0000","last_became_peered":"2024-09-11T11:01:03.336412+0000","last_unstale":"2024-09-11T11:02:42.126841+0000","last_undegraded":"2024-09-11T11:02:42.126841+0000","last_fullsized":"2024-09-11T11:02:42.126841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:54:35.346732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843492+0000","last_change":"2024-09-11T11:00:55.878837+0000","last_active":"2024-09-11T11:02:42.843492+0000","last_peered":"2024-09-11T11:02:42.843492+0000","last_clean":"2024-09-11T11:02:42.843492+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:02:42.843492+0000","last_undegraded":"2024-09-11T11:02:42.843492+0000","last_fullsized":"2024-09-11T11:02:42.843492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:44:03.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.033101+0000","last_change":"2024-09-11T11:01:07.359762+0000","last_active":"2024-09-11T11:03:13.033101+0000","last_peered":"2024-09-11T11:03:13.033101+0000","last_clean":"2024-09-11T11:03:13.033101+0000","last_became_active":"2024-09-11T11:01:07.359228+0000","last_became_peered":"2024-09-11T11:01:07.359228+0000","last_unstale":"2024-09-11T11:03:13.033101+0000","last_undegraded":"2024-09-11T11:03:13.033101+0000","last_fullsized":"2024-09-11T11:03:13.033101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:33:49.649502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'62","reported_seq":125,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.915603+0000","last_change":"2024-09-11T11:01:09.361376+0000","last_active":"2024-09-11T11:03:14.915603+0000","last_peered":"2024-09-11T11:03:14.915603+0000","last_clean":"2024-09-11T11:03:14.915603+0000","last_became_active":"2024-09-11T11:01:09.360676+0000","last_became_peered":"2024-09-11T11:01:09.360676+0000","last_unstale":"2024-09-11T11:03:14.915603+0000","last_undegraded":"2024-09-11T11:03:14.915603+0000","last_fullsized":"2024-09-11T11:03:14.915603+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:50.511575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123302+0000","last_change":"2024-09-11T11:01:11.386663+0000","last_active":"2024-09-11T11:02:42.123302+0000","last_peered":"2024-09-11T11:02:42.123302+0000","last_clean":"2024-09-11T11:02:42.123302+0000","last_became_active":"2024-09-11T11:01:11.384826+0000","last_became_peered":"2024-09-11T11:01:11.384826+0000","last_unstale":"2024-09-11T11:02:42.123302+0000","last_undegraded":"2024-09-11T11:02:42.123302+0000","last_fullsized":"2024-09-11T11:02:42.123302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:19.464704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.703110+0000","last_change":"2024-09-11T11:01:13.422273+0000","last_active":"2024-09-11T11:03:16.703110+0000","last_peered":"2024-09-11T11:03:16.703110+0000","last_clean":"2024-09-11T11:03:16.703110+0000","last_became_active":"2024-09-11T11:01:13.421181+0000","last_became_peered":"2024-09-11T11:01:13.421181+0000","last_unstale":"2024-09-11T11:03:16.703110+0000","last_undegraded":"2024-09-11T11:03:16.703110+0000","last_fullsized":"2024-09-11T11:03:16.703110+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:02:34.492397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'6","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855771+0000","last_change":"2024-09-11T11:01:05.354294+0000","last_active":"2024-09-11T11:04:17.855771+0000","last_peered":"2024-09-11T11:04:17.855771+0000","last_clean":"2024-09-11T11:04:17.855771+0000","last_became_active":"2024-09-11T11:01:05.353896+0000","last_became_peered":"2024-09-11T11:01:05.353896+0000","last_unstale":"2024-09-11T11:04:17.855771+0000","last_undegraded":"2024-09-11T11:04:17.855771+0000","last_fullsized":"2024-09-11T11:04:17.855771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:59.773137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843845+0000","last_change":"2024-09-11T11:01:03.325763+0000","last_active":"2024-09-11T11:02:42.843845+0000","last_peered":"2024-09-11T11:02:42.843845+0000","last_clean":"2024-09-11T11:02:42.843845+0000","last_became_active":"2024-09-11T11:01:03.324923+0000","last_became_peered":"2024-09-11T11:01:03.324923+0000","last_unstale":"2024-09-11T11:02:42.843845+0000","last_undegraded":"2024-09-11T11:02:42.843845+0000","last_fullsized":"2024-09-11T11:02:42.843845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:14.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.126572+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:02:42.126572+0000","last_peered":"2024-09-11T11:02:42.126572+0000","last_clean":"2024-09-11T11:02:42.126572+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:02:42.126572+0000","last_undegraded":"2024-09-11T11:02:42.126572+0000","last_fullsized":"2024-09-11T11:02:42.126572+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:16.737505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122843+0000","last_change":"2024-09-11T11:01:07.360915+0000","last_active":"2024-09-11T11:02:42.122843+0000","last_peered":"2024-09-11T11:02:42.122843+0000","last_clean":"2024-09-11T11:02:42.122843+0000","last_became_active":"2024-09-11T11:01:07.360208+0000","last_became_peered":"2024-09-11T11:01:07.360208+0000","last_unstale":"2024-09-11T11:02:42.122843+0000","last_undegraded":"2024-09-11T11:02:42.122843+0000","last_fullsized":"2024-09-11T11:02:42.122843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:39.292606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843864+0000","last_change":"2024-09-11T11:01:09.383166+0000","last_active":"2024-09-11T11:02:42.843864+0000","last_peered":"2024-09-11T11:02:42.843864+0000","last_clean":"2024-09-11T11:02:42.843864+0000","last_became_active":"2024-09-11T11:01:09.382364+0000","last_became_peered":"2024-09-11T11:01:09.382364+0000","last_unstale":"2024-09-11T11:02:42.843864+0000","last_undegraded":"2024-09-11T11:02:42.843864+0000","last_fullsized":"2024-09-11T11:02:42.843864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:41.311952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'282","reported_seq":351,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.596675+0000","last_change":"2024-09-11T11:01:11.395761+0000","last_active":"2024-09-11T11:04:17.596675+0000","last_peered":"2024-09-11T11:04:17.596675+0000","last_clean":"2024-09-11T11:04:17.596675+0000","last_became_active":"2024-09-11T11:01:11.395016+0000","last_became_peered":"2024-09-11T11:01:11.395016+0000","last_unstale":"2024-09-11T11:04:17.596675+0000","last_undegraded":"2024-09-11T11:04:17.596675+0000","last_fullsized":"2024-09-11T11:04:17.596675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:12.765617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.831484+0000","last_change":"2024-09-11T11:01:13.423655+0000","last_active":"2024-09-11T11:04:17.831484+0000","last_peered":"2024-09-11T11:04:17.831484+0000","last_clean":"2024-09-11T11:04:17.831484+0000","last_became_active":"2024-09-11T11:01:13.422825+0000","last_became_peered":"2024-09-11T11:01:13.422825+0000","last_unstale":"2024-09-11T11:04:17.831484+0000","last_undegraded":"2024-09-11T11:04:17.831484+0000","last_fullsized":"2024-09-11T11:04:17.831484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:56.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'12","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.767965+0000","last_change":"2024-09-11T11:01:42.069205+0000","last_active":"2024-09-11T11:03:12.767965+0000","last_peered":"2024-09-11T11:03:12.767965+0000","last_clean":"2024-09-11T11:03:12.767965+0000","last_became_active":"2024-09-11T11:01:42.049256+0000","last_became_peered":"2024-09-11T11:01:42.049256+0000","last_unstale":"2024-09-11T11:03:12.767965+0000","last_undegraded":"2024-09-11T11:03:12.767965+0000","last_fullsized":"2024-09-11T11:03:12.767965+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:18:53.891454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.750448+0000","last_change":"2024-09-11T11:01:03.351057+0000","last_active":"2024-09-11T11:04:17.750448+0000","last_peered":"2024-09-11T11:04:17.750448+0000","last_clean":"2024-09-11T11:04:17.750448+0000","last_became_active":"2024-09-11T11:01:03.349487+0000","last_became_peered":"2024-09-11T11:01:03.349487+0000","last_unstale":"2024-09-11T11:04:17.750448+0000","last_undegraded":"2024-09-11T11:04:17.750448+0000","last_fullsized":"2024-09-11T11:04:17.750448+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:03.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845075+0000","last_change":"2024-09-11T11:00:55.878899+0000","last_active":"2024-09-11T11:02:42.845075+0000","last_peered":"2024-09-11T11:02:42.845075+0000","last_clean":"2024-09-11T11:02:42.845075+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:02:42.845075+0000","last_undegraded":"2024-09-11T11:02:42.845075+0000","last_fullsized":"2024-09-11T11:02:42.845075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:24.156776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122524+0000","last_change":"2024-09-11T11:01:07.344789+0000","last_active":"2024-09-11T11:02:42.122524+0000","last_peered":"2024-09-11T11:02:42.122524+0000","last_clean":"2024-09-11T11:02:42.122524+0000","last_became_active":"2024-09-11T11:01:07.344021+0000","last_became_peered":"2024-09-11T11:01:07.344021+0000","last_unstale":"2024-09-11T11:02:42.122524+0000","last_undegraded":"2024-09-11T11:02:42.122524+0000","last_fullsized":"2024-09-11T11:02:42.122524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:48:47.594716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"34'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111150+0000","last_change":"2024-09-11T11:01:09.380595+0000","last_active":"2024-09-11T11:02:42.111150+0000","last_peered":"2024-09-11T11:02:42.111150+0000","last_clean":"2024-09-11T11:02:42.111150+0000","last_became_active":"2024-09-11T11:01:09.379372+0000","last_became_peered":"2024-09-11T11:01:09.379372+0000","last_unstale":"2024-09-11T11:02:42.111150+0000","last_undegraded":"2024-09-11T11:02:42.111150+0000","last_fullsized":"2024-09-11T11:02:42.111150+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:45:43.515100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'282","reported_seq":422,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.084413+0000","last_change":"2024-09-11T11:01:11.404411+0000","last_active":"2024-09-11T11:04:18.084413+0000","last_peered":"2024-09-11T11:04:18.084413+0000","last_clean":"2024-09-11T11:04:18.084413+0000","last_became_active":"2024-09-11T11:01:11.403355+0000","last_became_peered":"2024-09-11T11:01:11.403355+0000","last_unstale":"2024-09-11T11:04:18.084413+0000","last_undegraded":"2024-09-11T11:04:18.084413+0000","last_fullsized":"2024-09-11T11:04:18.084413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:00:37.993880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843018+0000","last_change":"2024-09-11T11:01:13.420938+0000","last_active":"2024-09-11T11:02:42.843018+0000","last_peered":"2024-09-11T11:02:42.843018+0000","last_clean":"2024-09-11T11:02:42.843018+0000","last_became_active":"2024-09-11T11:01:13.415413+0000","last_became_peered":"2024-09-11T11:01:13.415413+0000","last_unstale":"2024-09-11T11:02:42.843018+0000","last_undegraded":"2024-09-11T11:02:42.843018+0000","last_fullsized":"2024-09-11T11:02:42.843018+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:06:12.988613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'13","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938421+0000","last_change":"2024-09-11T11:01:05.339012+0000","last_active":"2024-09-11T11:04:17.938421+0000","last_peered":"2024-09-11T11:04:17.938421+0000","last_clean":"2024-09-11T11:04:17.938421+0000","last_became_active":"2024-09-11T11:01:05.338465+0000","last_became_peered":"2024-09-11T11:01:05.338465+0000","last_unstale":"2024-09-11T11:04:17.938421+0000","last_undegraded":"2024-09-11T11:04:17.938421+0000","last_fullsized":"2024-09-11T11:04:17.938421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:07:59.232948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.736226+0000","last_change":"2024-09-11T11:01:03.327083+0000","last_active":"2024-09-11T11:04:17.736226+0000","last_peered":"2024-09-11T11:04:17.736226+0000","last_clean":"2024-09-11T11:04:17.736226+0000","last_became_active":"2024-09-11T11:01:03.325009+0000","last_became_peered":"2024-09-11T11:01:03.325009+0000","last_unstale":"2024-09-11T11:04:17.736226+0000","last_undegraded":"2024-09-11T11:04:17.736226+0000","last_fullsized":"2024-09-11T11:04:17.736226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:07.534323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":11,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127143+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:02:42.127143+0000","last_peered":"2024-09-11T11:02:42.127143+0000","last_clean":"2024-09-11T11:02:42.127143+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:02:42.127143+0000","last_undegraded":"2024-09-11T11:02:42.127143+0000","last_fullsized":"2024-09-11T11:02:42.127143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:52:42.400043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110145+0000","last_change":"2024-09-11T11:01:07.364237+0000","last_active":"2024-09-11T11:02:42.110145+0000","last_peered":"2024-09-11T11:02:42.110145+0000","last_clean":"2024-09-11T11:02:42.110145+0000","last_became_active":"2024-09-11T11:01:07.363499+0000","last_became_peered":"2024-09-11T11:01:07.363499+0000","last_unstale":"2024-09-11T11:02:42.110145+0000","last_undegraded":"2024-09-11T11:02:42.110145+0000","last_fullsized":"2024-09-11T11:02:42.110145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:05.458479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'91","reported_seq":179,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.129658+0000","last_change":"2024-09-11T11:01:09.372054+0000","last_active":"2024-09-11T11:04:49.129658+0000","last_peered":"2024-09-11T11:04:49.129658+0000","last_clean":"2024-09-11T11:04:49.129658+0000","last_became_active":"2024-09-11T11:01:09.371312+0000","last_became_peered":"2024-09-11T11:01:09.371312+0000","last_unstale":"2024-09-11T11:04:49.129658+0000","last_undegraded":"2024-09-11T11:04:49.129658+0000","last_fullsized":"2024-09-11T11:04:49.129658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:16.530704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111457+0000","last_change":"2024-09-11T11:01:11.384314+0000","last_active":"2024-09-11T11:02:42.111457+0000","last_peered":"2024-09-11T11:02:42.111457+0000","last_clean":"2024-09-11T11:02:42.111457+0000","last_became_active":"2024-09-11T11:01:11.383342+0000","last_became_peered":"2024-09-11T11:01:11.383342+0000","last_unstale":"2024-09-11T11:02:42.111457+0000","last_undegraded":"2024-09-11T11:02:42.111457+0000","last_fullsized":"2024-09-11T11:02:42.111457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:19.950700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500048+0000","last_change":"2024-09-11T11:01:13.418374+0000","last_active":"2024-09-11T11:02:42.500048+0000","last_peered":"2024-09-11T11:02:42.500048+0000","last_clean":"2024-09-11T11:02:42.500048+0000","last_became_active":"2024-09-11T11:01:13.413156+0000","last_became_peered":"2024-09-11T11:01:13.413156+0000","last_unstale":"2024-09-11T11:02:42.500048+0000","last_undegraded":"2024-09-11T11:02:42.500048+0000","last_fullsized":"2024-09-11T11:02:42.500048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:07:28.142970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500143+0000","last_change":"2024-09-11T11:01:13.418594+0000","last_active":"2024-09-11T11:02:42.500143+0000","last_peered":"2024-09-11T11:02:42.500143+0000","last_clean":"2024-09-11T11:02:42.500143+0000","last_became_active":"2024-09-11T11:01:13.413535+0000","last_became_peered":"2024-09-11T11:01:13.413535+0000","last_unstale":"2024-09-11T11:02:42.500143+0000","last_undegraded":"2024-09-11T11:02:42.500143+0000","last_fullsized":"2024-09-11T11:02:42.500143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:31:24.015178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'9","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036251+0000","last_change":"2024-09-11T11:01:05.338098+0000","last_active":"2024-09-11T11:03:28.036251+0000","last_peered":"2024-09-11T11:03:28.036251+0000","last_clean":"2024-09-11T11:03:28.036251+0000","last_became_active":"2024-09-11T11:01:05.337509+0000","last_became_peered":"2024-09-11T11:01:05.337509+0000","last_unstale":"2024-09-11T11:03:28.036251+0000","last_undegraded":"2024-09-11T11:03:28.036251+0000","last_fullsized":"2024-09-11T11:03:28.036251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:26.300276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124980+0000","last_change":"2024-09-11T11:01:03.321762+0000","last_active":"2024-09-11T11:02:42.124980+0000","last_peered":"2024-09-11T11:02:42.124980+0000","last_clean":"2024-09-11T11:02:42.124980+0000","last_became_active":"2024-09-11T11:01:03.320981+0000","last_became_peered":"2024-09-11T11:01:03.320981+0000","last_unstale":"2024-09-11T11:02:42.124980+0000","last_undegraded":"2024-09-11T11:02:42.124980+0000","last_fullsized":"2024-09-11T11:02:42.124980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:08:03.006534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842801+0000","last_change":"2024-09-11T11:01:07.369265+0000","last_active":"2024-09-11T11:02:42.842801+0000","last_peered":"2024-09-11T11:02:42.842801+0000","last_clean":"2024-09-11T11:02:42.842801+0000","last_became_active":"2024-09-11T11:01:07.367778+0000","last_became_peered":"2024-09-11T11:01:07.367778+0000","last_unstale":"2024-09-11T11:02:42.842801+0000","last_undegraded":"2024-09-11T11:02:42.842801+0000","last_fullsized":"2024-09-11T11:02:42.842801+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:13.316958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'33","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.901680+0000","last_change":"2024-09-11T11:01:09.372426+0000","last_active":"2024-09-11T11:03:14.901680+0000","last_peered":"2024-09-11T11:03:14.901680+0000","last_clean":"2024-09-11T11:03:14.901680+0000","last_became_active":"2024-09-11T11:01:09.369318+0000","last_became_peered":"2024-09-11T11:01:09.369318+0000","last_unstale":"2024-09-11T11:03:14.901680+0000","last_undegraded":"2024-09-11T11:03:14.901680+0000","last_fullsized":"2024-09-11T11:03:14.901680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:11.108714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111320+0000","last_change":"2024-09-11T11:01:11.397868+0000","last_active":"2024-09-11T11:02:42.111320+0000","last_peered":"2024-09-11T11:02:42.111320+0000","last_clean":"2024-09-11T11:02:42.111320+0000","last_became_active":"2024-09-11T11:01:11.396833+0000","last_became_peered":"2024-09-11T11:01:11.396833+0000","last_unstale":"2024-09-11T11:02:42.111320+0000","last_undegraded":"2024-09-11T11:02:42.111320+0000","last_fullsized":"2024-09-11T11:02:42.111320+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:06:10.976693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.485342+0000","last_change":"2024-09-11T11:01:13.408361+0000","last_active":"2024-09-11T11:03:14.485342+0000","last_peered":"2024-09-11T11:03:14.485342+0000","last_clean":"2024-09-11T11:03:14.485342+0000","last_became_active":"2024-09-11T11:01:13.407663+0000","last_became_peered":"2024-09-11T11:01:13.407663+0000","last_unstale":"2024-09-11T11:03:14.485342+0000","last_undegraded":"2024-09-11T11:03:14.485342+0000","last_fullsized":"2024-09-11T11:03:14.485342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:55:13.024275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'8","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.572787+0000","last_change":"2024-09-11T11:01:05.340874+0000","last_active":"2024-09-11T11:04:17.572787+0000","last_peered":"2024-09-11T11:04:17.572787+0000","last_clean":"2024-09-11T11:04:17.572787+0000","last_became_active":"2024-09-11T11:01:05.340457+0000","last_became_peered":"2024-09-11T11:01:05.340457+0000","last_unstale":"2024-09-11T11:04:17.572787+0000","last_undegraded":"2024-09-11T11:04:17.572787+0000","last_fullsized":"2024-09-11T11:04:17.572787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:13:20.748246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498765+0000","last_change":"2024-09-11T11:01:03.336186+0000","last_active":"2024-09-11T11:02:42.498765+0000","last_peered":"2024-09-11T11:02:42.498765+0000","last_clean":"2024-09-11T11:02:42.498765+0000","last_became_active":"2024-09-11T11:01:03.335235+0000","last_became_peered":"2024-09-11T11:01:03.335235+0000","last_unstale":"2024-09-11T11:02:42.498765+0000","last_undegraded":"2024-09-11T11:02:42.498765+0000","last_fullsized":"2024-09-11T11:02:42.498765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:32:59.574503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.504244+0000","last_change":"2024-09-11T11:02:42.502850+0000","last_active":"2024-09-11T11:02:42.504244+0000","last_peered":"2024-09-11T11:02:42.504244+0000","last_clean":"2024-09-11T11:02:42.504244+0000","last_became_active":"2024-09-11T11:02:42.501867+0000","last_became_peered":"2024-09-11T11:02:42.501867+0000","last_unstale":"2024-09-11T11:02:42.504244+0000","last_undegraded":"2024-09-11T11:02:42.504244+0000","last_fullsized":"2024-09-11T11:02:42.504244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:44:22.210334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'5","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.868748+0000","last_change":"2024-09-11T11:01:09.363815+0000","last_active":"2024-09-11T11:04:16.868748+0000","last_peered":"2024-09-11T11:04:16.868748+0000","last_clean":"2024-09-11T11:04:16.868748+0000","last_became_active":"2024-09-11T11:01:09.362975+0000","last_became_peered":"2024-09-11T11:01:09.362975+0000","last_unstale":"2024-09-11T11:04:16.868748+0000","last_undegraded":"2024-09-11T11:04:16.868748+0000","last_fullsized":"2024-09-11T11:04:16.868748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:48:49.614061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497830+0000","last_change":"2024-09-11T11:01:11.393863+0000","last_active":"2024-09-11T11:02:42.497830+0000","last_peered":"2024-09-11T11:02:42.497830+0000","last_clean":"2024-09-11T11:02:42.497830+0000","last_became_active":"2024-09-11T11:01:11.393181+0000","last_became_peered":"2024-09-11T11:01:11.393181+0000","last_unstale":"2024-09-11T11:02:42.497830+0000","last_undegraded":"2024-09-11T11:02:42.497830+0000","last_fullsized":"2024-09-11T11:02:42.497830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:42:48.555293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'8","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.983086+0000","last_change":"2024-09-11T11:01:13.419907+0000","last_active":"2024-09-11T11:04:16.983086+0000","last_peered":"2024-09-11T11:04:16.983086+0000","last_clean":"2024-09-11T11:04:16.983086+0000","last_became_active":"2024-09-11T11:01:13.419238+0000","last_became_peered":"2024-09-11T11:01:13.419238+0000","last_unstale":"2024-09-11T11:04:16.983086+0000","last_undegraded":"2024-09-11T11:04:16.983086+0000","last_fullsized":"2024-09-11T11:04:16.983086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:10:21.962620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'10","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.921392+0000","last_change":"2024-09-11T11:01:42.073807+0000","last_active":"2024-09-11T11:04:17.921392+0000","last_peered":"2024-09-11T11:04:17.921392+0000","last_clean":"2024-09-11T11:04:17.921392+0000","last_became_active":"2024-09-11T11:01:42.058258+0000","last_became_peered":"2024-09-11T11:01:42.058258+0000","last_unstale":"2024-09-11T11:04:17.921392+0000","last_undegraded":"2024-09-11T11:04:17.921392+0000","last_fullsized":"2024-09-11T11:04:17.921392+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:23:48.191355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127148+0000","last_change":"2024-09-11T11:01:03.339928+0000","last_active":"2024-09-11T11:02:42.127148+0000","last_peered":"2024-09-11T11:02:42.127148+0000","last_clean":"2024-09-11T11:02:42.127148+0000","last_became_active":"2024-09-11T11:01:03.337144+0000","last_became_peered":"2024-09-11T11:01:03.337144+0000","last_unstale":"2024-09-11T11:02:42.127148+0000","last_undegraded":"2024-09-11T11:02:42.127148+0000","last_fullsized":"2024-09-11T11:02:42.127148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:53:40.334818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"36'4","reported_seq":232,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:48.873084+0000","last_change":"2024-09-11T11:01:07.358746+0000","last_active":"2024-09-11T11:04:48.873084+0000","last_peered":"2024-09-11T11:04:48.873084+0000","last_clean":"2024-09-11T11:04:48.873084+0000","last_became_active":"2024-09-11T11:01:07.358156+0000","last_became_peered":"2024-09-11T11:01:07.358156+0000","last_unstale":"2024-09-11T11:04:48.873084+0000","last_undegraded":"2024-09-11T11:04:48.873084+0000","last_fullsized":"2024-09-11T11:04:48.873084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:14.921699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'41","reported_seq":104,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.362531+0000","last_change":"2024-09-11T11:01:09.385303+0000","last_active":"2024-09-11T11:04:17.362531+0000","last_peered":"2024-09-11T11:04:17.362531+0000","last_clean":"2024-09-11T11:04:17.362531+0000","last_became_active":"2024-09-11T11:01:09.380595+0000","last_became_peered":"2024-09-11T11:01:09.380595+0000","last_unstale":"2024-09-11T11:04:17.362531+0000","last_undegraded":"2024-09-11T11:04:17.362531+0000","last_fullsized":"2024-09-11T11:04:17.362531+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:12:15.180214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5806,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":63,"num_read_kb":66,"num_write":48,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.841780+0000","last_change":"2024-09-11T11:01:11.402562+0000","last_active":"2024-09-11T11:02:42.841780+0000","last_peered":"2024-09-11T11:02:42.841780+0000","last_clean":"2024-09-11T11:02:42.841780+0000","last_became_active":"2024-09-11T11:01:11.401847+0000","last_became_peered":"2024-09-11T11:01:11.401847+0000","last_unstale":"2024-09-11T11:02:42.841780+0000","last_undegraded":"2024-09-11T11:02:42.841780+0000","last_fullsized":"2024-09-11T11:02:42.841780+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:24:37.418969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110992+0000","last_change":"2024-09-11T11:01:13.397280+0000","last_active":"2024-09-11T11:02:42.110992+0000","last_peered":"2024-09-11T11:02:42.110992+0000","last_clean":"2024-09-11T11:02:42.110992+0000","last_became_active":"2024-09-11T11:01:13.395231+0000","last_became_peered":"2024-09-11T11:01:13.395231+0000","last_unstale":"2024-09-11T11:02:42.110992+0000","last_undegraded":"2024-09-11T11:02:42.110992+0000","last_fullsized":"2024-09-11T11:02:42.110992+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:00:32.324647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.940026+0000","last_change":"2024-09-11T11:01:05.348465+0000","last_active":"2024-09-11T11:04:17.940026+0000","last_peered":"2024-09-11T11:04:17.940026+0000","last_clean":"2024-09-11T11:04:17.940026+0000","last_became_active":"2024-09-11T11:01:05.348002+0000","last_became_peered":"2024-09-11T11:01:05.348002+0000","last_unstale":"2024-09-11T11:04:17.940026+0000","last_undegraded":"2024-09-11T11:04:17.940026+0000","last_fullsized":"2024-09-11T11:04:17.940026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:27:41.532168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847625+0000","last_change":"2024-09-11T11:01:03.338184+0000","last_active":"2024-09-11T11:02:42.847625+0000","last_peered":"2024-09-11T11:02:42.847625+0000","last_clean":"2024-09-11T11:02:42.847625+0000","last_became_active":"2024-09-11T11:01:03.330782+0000","last_became_peered":"2024-09-11T11:01:03.330782+0000","last_unstale":"2024-09-11T11:02:42.847625+0000","last_undegraded":"2024-09-11T11:02:42.847625+0000","last_fullsized":"2024-09-11T11:02:42.847625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:52:42.998443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.111231+0000","last_change":"2024-09-11T11:01:07.351359+0000","last_active":"2024-09-11T11:02:42.111231+0000","last_peered":"2024-09-11T11:02:42.111231+0000","last_clean":"2024-09-11T11:02:42.111231+0000","last_became_active":"2024-09-11T11:01:07.350685+0000","last_became_peered":"2024-09-11T11:01:07.350685+0000","last_unstale":"2024-09-11T11:02:42.111231+0000","last_undegraded":"2024-09-11T11:02:42.111231+0000","last_fullsized":"2024-09-11T11:02:42.111231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:39.784471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'34","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.045814+0000","last_change":"2024-09-11T11:01:09.363365+0000","last_active":"2024-09-11T11:04:49.045814+0000","last_peered":"2024-09-11T11:04:49.045814+0000","last_clean":"2024-09-11T11:04:49.045814+0000","last_became_active":"2024-09-11T11:01:09.362483+0000","last_became_peered":"2024-09-11T11:01:09.362483+0000","last_unstale":"2024-09-11T11:04:49.045814+0000","last_undegraded":"2024-09-11T11:04:49.045814+0000","last_fullsized":"2024-09-11T11:04:49.045814+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:12:30.250968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.500588+0000","last_change":"2024-09-11T11:01:11.399469+0000","last_active":"2024-09-11T11:02:42.500588+0000","last_peered":"2024-09-11T11:02:42.500588+0000","last_clean":"2024-09-11T11:02:42.500588+0000","last_became_active":"2024-09-11T11:01:11.398843+0000","last_became_peered":"2024-09-11T11:01:11.398843+0000","last_unstale":"2024-09-11T11:02:42.500588+0000","last_undegraded":"2024-09-11T11:02:42.500588+0000","last_fullsized":"2024-09-11T11:02:42.500588+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:44:43.419308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'8","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770552+0000","last_change":"2024-09-11T11:01:05.348376+0000","last_active":"2024-09-11T11:04:17.770552+0000","last_peered":"2024-09-11T11:04:17.770552+0000","last_clean":"2024-09-11T11:04:17.770552+0000","last_became_active":"2024-09-11T11:01:05.347496+0000","last_became_peered":"2024-09-11T11:01:05.347496+0000","last_unstale":"2024-09-11T11:04:17.770552+0000","last_undegraded":"2024-09-11T11:04:17.770552+0000","last_fullsized":"2024-09-11T11:04:17.770552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:34:32.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109337+0000","last_change":"2024-09-11T11:01:03.349185+0000","last_active":"2024-09-11T11:02:42.109337+0000","last_peered":"2024-09-11T11:02:42.109337+0000","last_clean":"2024-09-11T11:02:42.109337+0000","last_became_active":"2024-09-11T11:01:03.348849+0000","last_became_peered":"2024-09-11T11:01:03.348849+0000","last_unstale":"2024-09-11T11:02:42.109337+0000","last_undegraded":"2024-09-11T11:02:42.109337+0000","last_fullsized":"2024-09-11T11:02:42.109337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:33.180623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847481+0000","last_change":"2024-09-11T11:01:07.366791+0000","last_active":"2024-09-11T11:02:42.847481+0000","last_peered":"2024-09-11T11:02:42.847481+0000","last_clean":"2024-09-11T11:02:42.847481+0000","last_became_active":"2024-09-11T11:01:07.365953+0000","last_became_peered":"2024-09-11T11:01:07.365953+0000","last_unstale":"2024-09-11T11:02:42.847481+0000","last_undegraded":"2024-09-11T11:02:42.847481+0000","last_fullsized":"2024-09-11T11:02:42.847481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:09:50.935366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'54","reported_seq":114,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.912449+0000","last_change":"2024-09-11T11:01:09.375348+0000","last_active":"2024-09-11T11:03:14.912449+0000","last_peered":"2024-09-11T11:03:14.912449+0000","last_clean":"2024-09-11T11:03:14.912449+0000","last_became_active":"2024-09-11T11:01:09.374937+0000","last_became_peered":"2024-09-11T11:01:09.374937+0000","last_unstale":"2024-09-11T11:03:14.912449+0000","last_undegraded":"2024-09-11T11:03:14.912449+0000","last_fullsized":"2024-09-11T11:03:14.912449+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:33:50.006729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499366+0000","last_change":"2024-09-11T11:01:11.395444+0000","last_active":"2024-09-11T11:02:42.499366+0000","last_peered":"2024-09-11T11:02:42.499366+0000","last_clean":"2024-09-11T11:02:42.499366+0000","last_became_active":"2024-09-11T11:01:11.394849+0000","last_became_peered":"2024-09-11T11:01:11.394849+0000","last_unstale":"2024-09-11T11:02:42.499366+0000","last_undegraded":"2024-09-11T11:02:42.499366+0000","last_fullsized":"2024-09-11T11:02:42.499366+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:14:10.559226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.693746+0000","last_change":"2024-09-11T11:01:13.416940+0000","last_active":"2024-09-11T11:03:16.693746+0000","last_peered":"2024-09-11T11:03:16.693746+0000","last_clean":"2024-09-11T11:03:16.693746+0000","last_became_active":"2024-09-11T11:01:13.416414+0000","last_became_peered":"2024-09-11T11:01:13.416414+0000","last_unstale":"2024-09-11T11:03:16.693746+0000","last_undegraded":"2024-09-11T11:03:16.693746+0000","last_fullsized":"2024-09-11T11:03:16.693746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:02:37.102253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845863+0000","last_change":"2024-09-11T11:01:05.340233+0000","last_active":"2024-09-11T11:02:42.845863+0000","last_peered":"2024-09-11T11:02:42.845863+0000","last_clean":"2024-09-11T11:02:42.845863+0000","last_became_active":"2024-09-11T11:01:05.339898+0000","last_became_peered":"2024-09-11T11:01:05.339898+0000","last_unstale":"2024-09-11T11:02:42.845863+0000","last_undegraded":"2024-09-11T11:02:42.845863+0000","last_fullsized":"2024-09-11T11:02:42.845863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:52:51.046871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'3","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.039656+0000","last_change":"2024-09-11T11:01:42.094568+0000","last_active":"2024-09-11T11:03:28.039656+0000","last_peered":"2024-09-11T11:03:28.039656+0000","last_clean":"2024-09-11T11:03:28.039656+0000","last_became_active":"2024-09-11T11:01:42.058648+0000","last_became_peered":"2024-09-11T11:01:42.058648+0000","last_unstale":"2024-09-11T11:03:28.039656+0000","last_undegraded":"2024-09-11T11:03:28.039656+0000","last_fullsized":"2024-09-11T11:03:28.039656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:41.034099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129527+0000","last_change":"2024-09-11T11:01:07.340610+0000","last_active":"2024-09-11T11:02:42.129527+0000","last_peered":"2024-09-11T11:02:42.129527+0000","last_clean":"2024-09-11T11:02:42.129527+0000","last_became_active":"2024-09-11T11:01:07.340147+0000","last_became_peered":"2024-09-11T11:01:07.340147+0000","last_unstale":"2024-09-11T11:02:42.129527+0000","last_undegraded":"2024-09-11T11:02:42.129527+0000","last_fullsized":"2024-09-11T11:02:42.129527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:59:55.768264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.055878+0000","last_change":"2024-09-11T11:01:09.372272+0000","last_active":"2024-09-11T11:04:49.055878+0000","last_peered":"2024-09-11T11:04:49.055878+0000","last_clean":"2024-09-11T11:04:49.055878+0000","last_became_active":"2024-09-11T11:01:09.371522+0000","last_became_peered":"2024-09-11T11:01:09.371522+0000","last_unstale":"2024-09-11T11:04:49.055878+0000","last_undegraded":"2024-09-11T11:04:49.055878+0000","last_fullsized":"2024-09-11T11:04:49.055878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:58:05.506059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847450+0000","last_change":"2024-09-11T11:01:11.393543+0000","last_active":"2024-09-11T11:02:42.847450+0000","last_peered":"2024-09-11T11:02:42.847450+0000","last_clean":"2024-09-11T11:02:42.847450+0000","last_became_active":"2024-09-11T11:01:11.392489+0000","last_became_peered":"2024-09-11T11:01:11.392489+0000","last_unstale":"2024-09-11T11:02:42.847450+0000","last_undegraded":"2024-09-11T11:02:42.847450+0000","last_fullsized":"2024-09-11T11:02:42.847450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:57.060008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121990+0000","last_change":"2024-09-11T11:01:13.405032+0000","last_active":"2024-09-11T11:02:42.121990+0000","last_peered":"2024-09-11T11:02:42.121990+0000","last_clean":"2024-09-11T11:02:42.121990+0000","last_became_active":"2024-09-11T11:01:13.404341+0000","last_became_peered":"2024-09-11T11:01:13.404341+0000","last_unstale":"2024-09-11T11:02:42.121990+0000","last_undegraded":"2024-09-11T11:02:42.121990+0000","last_fullsized":"2024-09-11T11:02:42.121990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:41:29.058689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'18","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.836712+0000","last_change":"2024-09-11T11:01:05.348158+0000","last_active":"2024-09-11T11:03:16.836712+0000","last_peered":"2024-09-11T11:03:16.836712+0000","last_clean":"2024-09-11T11:03:16.836712+0000","last_became_active":"2024-09-11T11:01:05.347745+0000","last_became_peered":"2024-09-11T11:01:05.347745+0000","last_unstale":"2024-09-11T11:03:16.836712+0000","last_undegraded":"2024-09-11T11:03:16.836712+0000","last_fullsized":"2024-09-11T11:03:16.836712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:16:36.575022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124170+0000","last_change":"2024-09-11T11:01:03.322039+0000","last_active":"2024-09-11T11:02:42.124170+0000","last_peered":"2024-09-11T11:02:42.124170+0000","last_clean":"2024-09-11T11:02:42.124170+0000","last_became_active":"2024-09-11T11:01:03.321106+0000","last_became_peered":"2024-09-11T11:01:03.321106+0000","last_unstale":"2024-09-11T11:02:42.124170+0000","last_undegraded":"2024-09-11T11:02:42.124170+0000","last_fullsized":"2024-09-11T11:02:42.124170+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:45.482692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124610+0000","last_change":"2024-09-11T11:01:07.343664+0000","last_active":"2024-09-11T11:02:42.124610+0000","last_peered":"2024-09-11T11:02:42.124610+0000","last_clean":"2024-09-11T11:02:42.124610+0000","last_became_active":"2024-09-11T11:01:07.342760+0000","last_became_peered":"2024-09-11T11:01:07.342760+0000","last_unstale":"2024-09-11T11:02:42.124610+0000","last_undegraded":"2024-09-11T11:02:42.124610+0000","last_fullsized":"2024-09-11T11:02:42.124610+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:48.492230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'34","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.465133+0000","last_change":"2024-09-11T11:01:09.390274+0000","last_active":"2024-09-11T11:04:17.465133+0000","last_peered":"2024-09-11T11:04:17.465133+0000","last_clean":"2024-09-11T11:04:17.465133+0000","last_became_active":"2024-09-11T11:01:09.389548+0000","last_became_peered":"2024-09-11T11:01:09.389548+0000","last_unstale":"2024-09-11T11:04:17.465133+0000","last_undegraded":"2024-09-11T11:04:17.465133+0000","last_fullsized":"2024-09-11T11:04:17.465133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:23:55.045450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847493+0000","last_change":"2024-09-11T11:01:11.391754+0000","last_active":"2024-09-11T11:02:42.847493+0000","last_peered":"2024-09-11T11:02:42.847493+0000","last_clean":"2024-09-11T11:02:42.847493+0000","last_became_active":"2024-09-11T11:01:11.391080+0000","last_became_peered":"2024-09-11T11:01:11.391080+0000","last_unstale":"2024-09-11T11:02:42.847493+0000","last_undegraded":"2024-09-11T11:02:42.847493+0000","last_fullsized":"2024-09-11T11:02:42.847493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:23.746419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.825662+0000","last_change":"2024-09-11T11:01:13.421751+0000","last_active":"2024-09-11T11:03:16.825662+0000","last_peered":"2024-09-11T11:03:16.825662+0000","last_clean":"2024-09-11T11:03:16.825662+0000","last_became_active":"2024-09-11T11:01:13.420844+0000","last_became_peered":"2024-09-11T11:01:13.420844+0000","last_unstale":"2024-09-11T11:03:16.825662+0000","last_undegraded":"2024-09-11T11:03:16.825662+0000","last_fullsized":"2024-09-11T11:03:16.825662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:01:42.372122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.443118+0000","last_change":"2024-09-11T11:01:05.339320+0000","last_active":"2024-09-11T11:04:17.443118+0000","last_peered":"2024-09-11T11:04:17.443118+0000","last_clean":"2024-09-11T11:04:17.443118+0000","last_became_active":"2024-09-11T11:01:05.338036+0000","last_became_peered":"2024-09-11T11:01:05.338036+0000","last_unstale":"2024-09-11T11:04:17.443118+0000","last_undegraded":"2024-09-11T11:04:17.443118+0000","last_fullsized":"2024-09-11T11:04:17.443118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:32.889486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.908157+0000","last_change":"2024-09-11T11:01:03.336252+0000","last_active":"2024-09-11T11:04:17.908157+0000","last_peered":"2024-09-11T11:04:17.908157+0000","last_clean":"2024-09-11T11:04:17.908157+0000","last_became_active":"2024-09-11T11:01:03.335959+0000","last_became_peered":"2024-09-11T11:01:03.335959+0000","last_unstale":"2024-09-11T11:04:17.908157+0000","last_undegraded":"2024-09-11T11:04:17.908157+0000","last_fullsized":"2024-09-11T11:04:17.908157+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:07.534323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847461+0000","last_change":"2024-09-11T11:01:07.370087+0000","last_active":"2024-09-11T11:02:42.847461+0000","last_peered":"2024-09-11T11:02:42.847461+0000","last_clean":"2024-09-11T11:02:42.847461+0000","last_became_active":"2024-09-11T11:01:07.368853+0000","last_became_peered":"2024-09-11T11:01:07.368853+0000","last_unstale":"2024-09-11T11:02:42.847461+0000","last_undegraded":"2024-09-11T11:02:42.847461+0000","last_fullsized":"2024-09-11T11:02:42.847461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:39.784471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115820+0000","last_change":"2024-09-11T11:01:09.391884+0000","last_active":"2024-09-11T11:02:42.115820+0000","last_peered":"2024-09-11T11:02:42.115820+0000","last_clean":"2024-09-11T11:02:42.115820+0000","last_became_active":"2024-09-11T11:01:09.391249+0000","last_became_peered":"2024-09-11T11:01:09.391249+0000","last_unstale":"2024-09-11T11:02:42.115820+0000","last_undegraded":"2024-09-11T11:02:42.115820+0000","last_fullsized":"2024-09-11T11:02:42.115820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:42:27.348949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":374,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:48.912022+0000","last_change":"2024-09-11T11:01:11.403073+0000","last_active":"2024-09-11T11:04:48.912022+0000","last_peered":"2024-09-11T11:04:48.912022+0000","last_clean":"2024-09-11T11:04:48.912022+0000","last_became_active":"2024-09-11T11:01:11.401400+0000","last_became_peered":"2024-09-11T11:01:11.401400+0000","last_unstale":"2024-09-11T11:04:48.912022+0000","last_undegraded":"2024-09-11T11:04:48.912022+0000","last_fullsized":"2024-09-11T11:04:48.912022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:43:49.090546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121310+0000","last_change":"2024-09-11T11:01:13.403086+0000","last_active":"2024-09-11T11:02:42.121310+0000","last_peered":"2024-09-11T11:02:42.121310+0000","last_clean":"2024-09-11T11:02:42.121310+0000","last_became_active":"2024-09-11T11:01:13.402406+0000","last_became_peered":"2024-09-11T11:01:13.402406+0000","last_unstale":"2024-09-11T11:02:42.121310+0000","last_undegraded":"2024-09-11T11:02:42.121310+0000","last_fullsized":"2024-09-11T11:02:42.121310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:54:56.625145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'5","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.038763+0000","last_change":"2024-09-11T11:01:05.353823+0000","last_active":"2024-09-11T11:03:38.038763+0000","last_peered":"2024-09-11T11:03:38.038763+0000","last_clean":"2024-09-11T11:03:38.038763+0000","last_became_active":"2024-09-11T11:01:05.353214+0000","last_became_peered":"2024-09-11T11:01:05.353214+0000","last_unstale":"2024-09-11T11:03:38.038763+0000","last_undegraded":"2024-09-11T11:03:38.038763+0000","last_fullsized":"2024-09-11T11:03:38.038763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:59:11.874274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844327+0000","last_change":"2024-09-11T11:01:03.346782+0000","last_active":"2024-09-11T11:02:42.844327+0000","last_peered":"2024-09-11T11:02:42.844327+0000","last_clean":"2024-09-11T11:02:42.844327+0000","last_became_active":"2024-09-11T11:01:03.346318+0000","last_became_peered":"2024-09-11T11:01:03.346318+0000","last_unstale":"2024-09-11T11:02:42.844327+0000","last_undegraded":"2024-09-11T11:02:42.844327+0000","last_fullsized":"2024-09-11T11:02:42.844327+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:08.559205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843531+0000","last_change":"2024-09-11T11:01:07.369704+0000","last_active":"2024-09-11T11:02:42.843531+0000","last_peered":"2024-09-11T11:02:42.843531+0000","last_clean":"2024-09-11T11:02:42.843531+0000","last_became_active":"2024-09-11T11:01:07.368713+0000","last_became_peered":"2024-09-11T11:01:07.368713+0000","last_unstale":"2024-09-11T11:02:42.843531+0000","last_undegraded":"2024-09-11T11:02:42.843531+0000","last_fullsized":"2024-09-11T11:02:42.843531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:00:00.692745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'39","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.281822+0000","last_change":"2024-09-11T11:01:09.364363+0000","last_active":"2024-09-11T11:04:49.281822+0000","last_peered":"2024-09-11T11:04:49.281822+0000","last_clean":"2024-09-11T11:04:49.281822+0000","last_became_active":"2024-09-11T11:01:09.363530+0000","last_became_peered":"2024-09-11T11:01:09.363530+0000","last_unstale":"2024-09-11T11:04:49.281822+0000","last_undegraded":"2024-09-11T11:04:49.281822+0000","last_fullsized":"2024-09-11T11:04:49.281822+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:20:25.511602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109273+0000","last_change":"2024-09-11T11:01:11.373298+0000","last_active":"2024-09-11T11:02:42.109273+0000","last_peered":"2024-09-11T11:02:42.109273+0000","last_clean":"2024-09-11T11:02:42.109273+0000","last_became_active":"2024-09-11T11:01:11.371526+0000","last_became_peered":"2024-09-11T11:01:11.371526+0000","last_unstale":"2024-09-11T11:02:42.109273+0000","last_undegraded":"2024-09-11T11:02:42.109273+0000","last_fullsized":"2024-09-11T11:02:42.109273+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:39:18.545262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.129245+0000","last_change":"2024-09-11T11:01:13.421954+0000","last_active":"2024-09-11T11:02:42.129245+0000","last_peered":"2024-09-11T11:02:42.129245+0000","last_clean":"2024-09-11T11:02:42.129245+0000","last_became_active":"2024-09-11T11:01:13.421220+0000","last_became_peered":"2024-09-11T11:01:13.421220+0000","last_unstale":"2024-09-11T11:02:42.129245+0000","last_undegraded":"2024-09-11T11:02:42.129245+0000","last_fullsized":"2024-09-11T11:02:42.129245+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:37.260215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:12.769226+0000","last_change":"2024-09-11T11:01:05.348922+0000","last_active":"2024-09-11T11:03:12.769226+0000","last_peered":"2024-09-11T11:03:12.769226+0000","last_clean":"2024-09-11T11:03:12.769226+0000","last_became_active":"2024-09-11T11:01:05.348256+0000","last_became_peered":"2024-09-11T11:01:05.348256+0000","last_unstale":"2024-09-11T11:03:12.769226+0000","last_undegraded":"2024-09-11T11:03:12.769226+0000","last_fullsized":"2024-09-11T11:03:12.769226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:10:09.634465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.127285+0000","last_change":"2024-09-11T11:01:03.323843+0000","last_active":"2024-09-11T11:02:42.127285+0000","last_peered":"2024-09-11T11:02:42.127285+0000","last_clean":"2024-09-11T11:02:42.127285+0000","last_became_active":"2024-09-11T11:01:03.323106+0000","last_became_peered":"2024-09-11T11:01:03.323106+0000","last_unstale":"2024-09-11T11:02:42.127285+0000","last_undegraded":"2024-09-11T11:02:42.127285+0000","last_fullsized":"2024-09-11T11:02:42.127285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:24:10.573016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124332+0000","last_change":"2024-09-11T11:01:07.347165+0000","last_active":"2024-09-11T11:02:42.124332+0000","last_peered":"2024-09-11T11:02:42.124332+0000","last_clean":"2024-09-11T11:02:42.124332+0000","last_became_active":"2024-09-11T11:01:07.346507+0000","last_became_peered":"2024-09-11T11:01:07.346507+0000","last_unstale":"2024-09-11T11:02:42.124332+0000","last_undegraded":"2024-09-11T11:02:42.124332+0000","last_fullsized":"2024-09-11T11:02:42.124332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:11.130739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'30","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.862649+0000","last_change":"2024-09-11T11:01:09.370064+0000","last_active":"2024-09-11T11:03:14.862649+0000","last_peered":"2024-09-11T11:03:14.862649+0000","last_clean":"2024-09-11T11:03:14.862649+0000","last_became_active":"2024-09-11T11:01:09.367104+0000","last_became_peered":"2024-09-11T11:01:09.367104+0000","last_unstale":"2024-09-11T11:03:14.862649+0000","last_undegraded":"2024-09-11T11:03:14.862649+0000","last_fullsized":"2024-09-11T11:03:14.862649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:42.885042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.122669+0000","last_change":"2024-09-11T11:01:11.400983+0000","last_active":"2024-09-11T11:02:42.122669+0000","last_peered":"2024-09-11T11:02:42.122669+0000","last_clean":"2024-09-11T11:02:42.122669+0000","last_became_active":"2024-09-11T11:01:11.400269+0000","last_became_peered":"2024-09-11T11:01:11.400269+0000","last_unstale":"2024-09-11T11:02:42.122669+0000","last_undegraded":"2024-09-11T11:02:42.122669+0000","last_fullsized":"2024-09-11T11:02:42.122669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:53:48.162007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112745+0000","last_change":"2024-09-11T11:01:13.424386+0000","last_active":"2024-09-11T11:02:42.112745+0000","last_peered":"2024-09-11T11:02:42.112745+0000","last_clean":"2024-09-11T11:02:42.112745+0000","last_became_active":"2024-09-11T11:01:13.423466+0000","last_became_peered":"2024-09-11T11:01:13.423466+0000","last_unstale":"2024-09-11T11:02:42.112745+0000","last_undegraded":"2024-09-11T11:02:42.112745+0000","last_fullsized":"2024-09-11T11:02:42.112745+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:51:02.142046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.574272+0000","last_change":"2024-09-11T11:01:05.334600+0000","last_active":"2024-09-11T11:04:17.574272+0000","last_peered":"2024-09-11T11:04:17.574272+0000","last_clean":"2024-09-11T11:04:17.574272+0000","last_became_active":"2024-09-11T11:01:05.334141+0000","last_became_peered":"2024-09-11T11:01:05.334141+0000","last_unstale":"2024-09-11T11:04:17.574272+0000","last_undegraded":"2024-09-11T11:04:17.574272+0000","last_fullsized":"2024-09-11T11:04:17.574272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:40:25.995301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115947+0000","last_change":"2024-09-11T11:01:03.340441+0000","last_active":"2024-09-11T11:02:42.115947+0000","last_peered":"2024-09-11T11:02:42.115947+0000","last_clean":"2024-09-11T11:02:42.115947+0000","last_became_active":"2024-09-11T11:01:03.337584+0000","last_became_peered":"2024-09-11T11:01:03.337584+0000","last_unstale":"2024-09-11T11:02:42.115947+0000","last_undegraded":"2024-09-11T11:02:42.115947+0000","last_fullsized":"2024-09-11T11:02:42.115947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:26:11.801971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842557+0000","last_change":"2024-09-11T11:01:07.366290+0000","last_active":"2024-09-11T11:02:42.842557+0000","last_peered":"2024-09-11T11:02:42.842557+0000","last_clean":"2024-09-11T11:02:42.842557+0000","last_became_active":"2024-09-11T11:01:07.365791+0000","last_became_peered":"2024-09-11T11:01:07.365791+0000","last_unstale":"2024-09-11T11:02:42.842557+0000","last_undegraded":"2024-09-11T11:02:42.842557+0000","last_fullsized":"2024-09-11T11:02:42.842557+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:31:26.820385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'26","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.905215+0000","last_change":"2024-09-11T11:01:09.385201+0000","last_active":"2024-09-11T11:03:14.905215+0000","last_peered":"2024-09-11T11:03:14.905215+0000","last_clean":"2024-09-11T11:03:14.905215+0000","last_became_active":"2024-09-11T11:01:09.380531+0000","last_became_peered":"2024-09-11T11:01:09.380531+0000","last_unstale":"2024-09-11T11:03:14.905215+0000","last_undegraded":"2024-09-11T11:03:14.905215+0000","last_fullsized":"2024-09-11T11:03:14.905215+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:30.066289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.123409+0000","last_change":"2024-09-11T11:01:11.387269+0000","last_active":"2024-09-11T11:02:42.123409+0000","last_peered":"2024-09-11T11:02:42.123409+0000","last_clean":"2024-09-11T11:02:42.123409+0000","last_became_active":"2024-09-11T11:01:11.386302+0000","last_became_peered":"2024-09-11T11:01:11.386302+0000","last_unstale":"2024-09-11T11:02:42.123409+0000","last_undegraded":"2024-09-11T11:02:42.123409+0000","last_fullsized":"2024-09-11T11:02:42.123409+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:54:54.650646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.580984+0000","last_change":"2024-09-11T11:01:13.423002+0000","last_active":"2024-09-11T11:04:17.580984+0000","last_peered":"2024-09-11T11:04:17.580984+0000","last_clean":"2024-09-11T11:04:17.580984+0000","last_became_active":"2024-09-11T11:01:13.422285+0000","last_became_peered":"2024-09-11T11:01:13.422285+0000","last_unstale":"2024-09-11T11:04:17.580984+0000","last_undegraded":"2024-09-11T11:04:17.580984+0000","last_fullsized":"2024-09-11T11:04:17.580984+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:03:35.147747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.440090+0000","last_change":"2024-09-11T11:01:05.337161+0000","last_active":"2024-09-11T11:04:17.440090+0000","last_peered":"2024-09-11T11:04:17.440090+0000","last_clean":"2024-09-11T11:04:17.440090+0000","last_became_active":"2024-09-11T11:01:05.336680+0000","last_became_peered":"2024-09-11T11:01:05.336680+0000","last_unstale":"2024-09-11T11:04:17.440090+0000","last_undegraded":"2024-09-11T11:04:17.440090+0000","last_fullsized":"2024-09-11T11:04:17.440090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:14.471785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.847754+0000","last_change":"2024-09-11T11:01:03.336607+0000","last_active":"2024-09-11T11:02:42.847754+0000","last_peered":"2024-09-11T11:02:42.847754+0000","last_clean":"2024-09-11T11:02:42.847754+0000","last_became_active":"2024-09-11T11:01:03.331816+0000","last_became_peered":"2024-09-11T11:01:03.331816+0000","last_unstale":"2024-09-11T11:02:42.847754+0000","last_undegraded":"2024-09-11T11:02:42.847754+0000","last_fullsized":"2024-09-11T11:02:42.847754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:04:39.058034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.277728+0000","last_change":"2024-09-11T11:01:07.364299+0000","last_active":"2024-09-11T11:03:13.277728+0000","last_peered":"2024-09-11T11:03:13.277728+0000","last_clean":"2024-09-11T11:03:13.277728+0000","last_became_active":"2024-09-11T11:01:07.363545+0000","last_became_peered":"2024-09-11T11:01:07.363545+0000","last_unstale":"2024-09-11T11:03:13.277728+0000","last_undegraded":"2024-09-11T11:03:13.277728+0000","last_fullsized":"2024-09-11T11:03:13.277728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:39:17.840143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'35","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.232789+0000","last_change":"2024-09-11T11:01:09.378071+0000","last_active":"2024-09-11T11:04:49.232789+0000","last_peered":"2024-09-11T11:04:49.232789+0000","last_clean":"2024-09-11T11:04:49.232789+0000","last_became_active":"2024-09-11T11:01:09.377586+0000","last_became_peered":"2024-09-11T11:01:09.377586+0000","last_unstale":"2024-09-11T11:04:49.232789+0000","last_undegraded":"2024-09-11T11:04:49.232789+0000","last_fullsized":"2024-09-11T11:04:49.232789+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:07:54.076155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499591+0000","last_change":"2024-09-11T11:01:11.401725+0000","last_active":"2024-09-11T11:02:42.499591+0000","last_peered":"2024-09-11T11:02:42.499591+0000","last_clean":"2024-09-11T11:02:42.499591+0000","last_became_active":"2024-09-11T11:01:11.401078+0000","last_became_peered":"2024-09-11T11:01:11.401078+0000","last_unstale":"2024-09-11T11:02:42.499591+0000","last_undegraded":"2024-09-11T11:02:42.499591+0000","last_fullsized":"2024-09-11T11:02:42.499591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:58:17.003022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.925565+0000","last_change":"2024-09-11T11:01:13.422050+0000","last_active":"2024-09-11T11:03:14.925565+0000","last_peered":"2024-09-11T11:03:14.925565+0000","last_clean":"2024-09-11T11:03:14.925565+0000","last_became_active":"2024-09-11T11:01:13.421231+0000","last_became_peered":"2024-09-11T11:01:13.421231+0000","last_unstale":"2024-09-11T11:03:14.925565+0000","last_undegraded":"2024-09-11T11:03:14.925565+0000","last_fullsized":"2024-09-11T11:03:14.925565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:19.013089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'12","reported_seq":69,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.855598+0000","last_change":"2024-09-11T11:01:05.340309+0000","last_active":"2024-09-11T11:04:17.855598+0000","last_peered":"2024-09-11T11:04:17.855598+0000","last_clean":"2024-09-11T11:04:17.855598+0000","last_became_active":"2024-09-11T11:01:05.339760+0000","last_became_peered":"2024-09-11T11:01:05.339760+0000","last_unstale":"2024-09-11T11:04:17.855598+0000","last_undegraded":"2024-09-11T11:04:17.855598+0000","last_fullsized":"2024-09-11T11:04:17.855598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:03.072232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.496287+0000","last_change":"2024-09-11T11:01:03.338307+0000","last_active":"2024-09-11T11:02:42.496287+0000","last_peered":"2024-09-11T11:02:42.496287+0000","last_clean":"2024-09-11T11:02:42.496287+0000","last_became_active":"2024-09-11T11:01:03.338039+0000","last_became_peered":"2024-09-11T11:01:03.338039+0000","last_unstale":"2024-09-11T11:02:42.496287+0000","last_undegraded":"2024-09-11T11:02:42.496287+0000","last_fullsized":"2024-09-11T11:02:42.496287+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:25:25.632777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845571+0000","last_change":"2024-09-11T11:01:05.333022+0000","last_active":"2024-09-11T11:02:42.845571+0000","last_peered":"2024-09-11T11:02:42.845571+0000","last_clean":"2024-09-11T11:02:42.845571+0000","last_became_active":"2024-09-11T11:01:05.332632+0000","last_became_peered":"2024-09-11T11:01:05.332632+0000","last_unstale":"2024-09-11T11:02:42.845571+0000","last_undegraded":"2024-09-11T11:02:42.845571+0000","last_fullsized":"2024-09-11T11:02:42.845571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:54:07.782353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.497427+0000","last_change":"2024-09-11T11:01:03.327803+0000","last_active":"2024-09-11T11:02:42.497427+0000","last_peered":"2024-09-11T11:02:42.497427+0000","last_clean":"2024-09-11T11:02:42.497427+0000","last_became_active":"2024-09-11T11:01:03.327428+0000","last_became_peered":"2024-09-11T11:01:03.327428+0000","last_unstale":"2024-09-11T11:02:42.497427+0000","last_undegraded":"2024-09-11T11:02:42.497427+0000","last_fullsized":"2024-09-11T11:02:42.497427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:27:21.561913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.037418+0000","last_change":"2024-09-11T11:01:05.349740+0000","last_active":"2024-09-11T11:03:16.037418+0000","last_peered":"2024-09-11T11:03:16.037418+0000","last_clean":"2024-09-11T11:03:16.037418+0000","last_became_active":"2024-09-11T11:01:05.348827+0000","last_became_peered":"2024-09-11T11:01:05.348827+0000","last_unstale":"2024-09-11T11:03:16.037418+0000","last_undegraded":"2024-09-11T11:03:16.037418+0000","last_fullsized":"2024-09-11T11:03:16.037418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:23:11.303487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'3","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110919+0000","last_change":"2024-09-11T11:01:03.333973+0000","last_active":"2024-09-11T11:02:42.110919+0000","last_peered":"2024-09-11T11:02:42.110919+0000","last_clean":"2024-09-11T11:02:42.110919+0000","last_became_active":"2024-09-11T11:01:03.333729+0000","last_became_peered":"2024-09-11T11:01:03.333729+0000","last_unstale":"2024-09-11T11:02:42.110919+0000","last_undegraded":"2024-09-11T11:02:42.110919+0000","last_fullsized":"2024-09-11T11:02:42.110919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:23.262378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.853794+0000","last_change":"2024-09-11T11:01:05.333462+0000","last_active":"2024-09-11T11:04:17.853794+0000","last_peered":"2024-09-11T11:04:17.853794+0000","last_clean":"2024-09-11T11:04:17.853794+0000","last_became_active":"2024-09-11T11:01:05.332274+0000","last_became_peered":"2024-09-11T11:01:05.332274+0000","last_unstale":"2024-09-11T11:04:17.853794+0000","last_undegraded":"2024-09-11T11:04:17.853794+0000","last_fullsized":"2024-09-11T11:04:17.853794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:10:09.062077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498350+0000","last_change":"2024-09-11T11:01:03.335348+0000","last_active":"2024-09-11T11:02:42.498350+0000","last_peered":"2024-09-11T11:02:42.498350+0000","last_clean":"2024-09-11T11:02:42.498350+0000","last_became_active":"2024-09-11T11:01:03.335054+0000","last_became_peered":"2024-09-11T11:01:03.335054+0000","last_unstale":"2024-09-11T11:02:42.498350+0000","last_undegraded":"2024-09-11T11:02:42.498350+0000","last_fullsized":"2024-09-11T11:02:42.498350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:23:12.676263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.115911+0000","last_change":"2024-09-11T11:01:05.343162+0000","last_active":"2024-09-11T11:02:42.115911+0000","last_peered":"2024-09-11T11:02:42.115911+0000","last_clean":"2024-09-11T11:02:42.115911+0000","last_became_active":"2024-09-11T11:01:05.330065+0000","last_became_peered":"2024-09-11T11:01:05.330065+0000","last_unstale":"2024-09-11T11:02:42.115911+0000","last_undegraded":"2024-09-11T11:02:42.115911+0000","last_fullsized":"2024-09-11T11:02:42.115911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:39:28.667270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.114035+0000","last_change":"2024-09-11T11:01:03.351261+0000","last_active":"2024-09-11T11:02:42.114035+0000","last_peered":"2024-09-11T11:02:42.114035+0000","last_clean":"2024-09-11T11:02:42.114035+0000","last_became_active":"2024-09-11T11:01:03.349971+0000","last_became_peered":"2024-09-11T11:01:03.349971+0000","last_unstale":"2024-09-11T11:02:42.114035+0000","last_undegraded":"2024-09-11T11:02:42.114035+0000","last_fullsized":"2024-09-11T11:02:42.114035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:39:03.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842469+0000","last_change":"2024-09-11T11:01:05.342800+0000","last_active":"2024-09-11T11:02:42.842469+0000","last_peered":"2024-09-11T11:02:42.842469+0000","last_clean":"2024-09-11T11:02:42.842469+0000","last_became_active":"2024-09-11T11:01:05.342092+0000","last_became_peered":"2024-09-11T11:01:05.342092+0000","last_unstale":"2024-09-11T11:02:42.842469+0000","last_undegraded":"2024-09-11T11:02:42.842469+0000","last_fullsized":"2024-09-11T11:02:42.842469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:51:51.745730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844893+0000","last_change":"2024-09-11T11:01:42.061260+0000","last_active":"2024-09-11T11:02:42.844893+0000","last_peered":"2024-09-11T11:02:42.844893+0000","last_clean":"2024-09-11T11:02:42.844893+0000","last_became_active":"2024-09-11T11:01:42.060500+0000","last_became_peered":"2024-09-11T11:01:42.060500+0000","last_unstale":"2024-09-11T11:02:42.844893+0000","last_undegraded":"2024-09-11T11:02:42.844893+0000","last_fullsized":"2024-09-11T11:02:42.844893+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:12.528032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'2","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.769675+0000","last_change":"2024-09-11T11:01:05.346623+0000","last_active":"2024-09-11T11:04:17.769675+0000","last_peered":"2024-09-11T11:04:17.769675+0000","last_clean":"2024-09-11T11:04:17.769675+0000","last_became_active":"2024-09-11T11:01:05.346179+0000","last_became_peered":"2024-09-11T11:01:05.346179+0000","last_unstale":"2024-09-11T11:04:17.769675+0000","last_undegraded":"2024-09-11T11:04:17.769675+0000","last_fullsized":"2024-09-11T11:04:17.769675+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:30.170950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.348790+0000","last_change":"2024-09-11T11:01:03.317928+0000","last_active":"2024-09-11T11:04:17.348790+0000","last_peered":"2024-09-11T11:04:17.348790+0000","last_clean":"2024-09-11T11:04:17.348790+0000","last_became_active":"2024-09-11T11:01:03.315737+0000","last_became_peered":"2024-09-11T11:01:03.315737+0000","last_unstale":"2024-09-11T11:04:17.348790+0000","last_undegraded":"2024-09-11T11:04:17.348790+0000","last_fullsized":"2024-09-11T11:04:17.348790+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:24:47.506757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:11.035873+0000","last_change":"2024-09-11T11:01:05.333619+0000","last_active":"2024-09-11T11:03:11.035873+0000","last_peered":"2024-09-11T11:03:11.035873+0000","last_clean":"2024-09-11T11:03:11.035873+0000","last_became_active":"2024-09-11T11:01:05.331901+0000","last_became_peered":"2024-09-11T11:01:05.331901+0000","last_unstale":"2024-09-11T11:03:11.035873+0000","last_undegraded":"2024-09-11T11:03:11.035873+0000","last_fullsized":"2024-09-11T11:03:11.035873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:08.218478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116431+0000","last_change":"2024-09-11T11:01:03.351395+0000","last_active":"2024-09-11T11:02:42.116431+0000","last_peered":"2024-09-11T11:02:42.116431+0000","last_clean":"2024-09-11T11:02:42.116431+0000","last_became_active":"2024-09-11T11:01:03.351125+0000","last_became_peered":"2024-09-11T11:01:03.351125+0000","last_unstale":"2024-09-11T11:02:42.116431+0000","last_undegraded":"2024-09-11T11:02:42.116431+0000","last_fullsized":"2024-09-11T11:02:42.116431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:02.814616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'1","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.040093+0000","last_change":"2024-09-11T11:01:05.333352+0000","last_active":"2024-09-11T11:03:28.040093+0000","last_peered":"2024-09-11T11:03:28.040093+0000","last_clean":"2024-09-11T11:03:28.040093+0000","last_became_active":"2024-09-11T11:01:05.332203+0000","last_became_peered":"2024-09-11T11:01:05.332203+0000","last_unstale":"2024-09-11T11:03:28.040093+0000","last_undegraded":"2024-09-11T11:03:28.040093+0000","last_fullsized":"2024-09-11T11:03:28.040093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:03.791497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.109549+0000","last_change":"2024-09-11T11:01:03.337164+0000","last_active":"2024-09-11T11:02:42.109549+0000","last_peered":"2024-09-11T11:02:42.109549+0000","last_clean":"2024-09-11T11:02:42.109549+0000","last_became_active":"2024-09-11T11:01:03.336786+0000","last_became_peered":"2024-09-11T11:01:03.336786+0000","last_unstale":"2024-09-11T11:02:42.109549+0000","last_undegraded":"2024-09-11T11:02:42.109549+0000","last_fullsized":"2024-09-11T11:02:42.109549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:42.957386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.920771+0000","last_change":"2024-09-11T11:01:05.333095+0000","last_active":"2024-09-11T11:04:17.920771+0000","last_peered":"2024-09-11T11:04:17.920771+0000","last_clean":"2024-09-11T11:04:17.920771+0000","last_became_active":"2024-09-11T11:01:05.332747+0000","last_became_peered":"2024-09-11T11:01:05.332747+0000","last_unstale":"2024-09-11T11:04:17.920771+0000","last_undegraded":"2024-09-11T11:04:17.920771+0000","last_fullsized":"2024-09-11T11:04:17.920771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:41:08.367843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.571216+0000","last_change":"2024-09-11T11:01:03.336167+0000","last_active":"2024-09-11T11:03:16.571216+0000","last_peered":"2024-09-11T11:03:16.571216+0000","last_clean":"2024-09-11T11:03:16.571216+0000","last_became_active":"2024-09-11T11:01:03.335854+0000","last_became_peered":"2024-09-11T11:01:03.335854+0000","last_unstale":"2024-09-11T11:03:16.571216+0000","last_undegraded":"2024-09-11T11:03:16.571216+0000","last_fullsized":"2024-09-11T11:03:16.571216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:04:39.058034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499524+0000","last_change":"2024-09-11T11:01:05.344244+0000","last_active":"2024-09-11T11:02:42.499524+0000","last_peered":"2024-09-11T11:02:42.499524+0000","last_clean":"2024-09-11T11:02:42.499524+0000","last_became_active":"2024-09-11T11:01:05.343590+0000","last_became_peered":"2024-09-11T11:01:05.343590+0000","last_unstale":"2024-09-11T11:02:42.499524+0000","last_undegraded":"2024-09-11T11:02:42.499524+0000","last_fullsized":"2024-09-11T11:02:42.499524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:30.774404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.124182+0000","last_change":"2024-09-11T11:01:03.339537+0000","last_active":"2024-09-11T11:02:42.124182+0000","last_peered":"2024-09-11T11:02:42.124182+0000","last_clean":"2024-09-11T11:02:42.124182+0000","last_became_active":"2024-09-11T11:01:03.336224+0000","last_became_peered":"2024-09-11T11:01:03.336224+0000","last_unstale":"2024-09-11T11:02:42.124182+0000","last_undegraded":"2024-09-11T11:02:42.124182+0000","last_fullsized":"2024-09-11T11:02:42.124182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:32.295795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.845373+0000","last_change":"2024-09-11T11:01:05.342088+0000","last_active":"2024-09-11T11:02:42.845373+0000","last_peered":"2024-09-11T11:02:42.845373+0000","last_clean":"2024-09-11T11:02:42.845373+0000","last_became_active":"2024-09-11T11:01:05.341761+0000","last_became_peered":"2024-09-11T11:01:05.341761+0000","last_unstale":"2024-09-11T11:02:42.845373+0000","last_undegraded":"2024-09-11T11:02:42.845373+0000","last_fullsized":"2024-09-11T11:02:42.845373+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:27:41.532168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.843144+0000","last_change":"2024-09-11T11:01:03.320022+0000","last_active":"2024-09-11T11:02:42.843144+0000","last_peered":"2024-09-11T11:02:42.843144+0000","last_clean":"2024-09-11T11:02:42.843144+0000","last_became_active":"2024-09-11T11:01:03.318984+0000","last_became_peered":"2024-09-11T11:01:03.318984+0000","last_unstale":"2024-09-11T11:02:42.843144+0000","last_undegraded":"2024-09-11T11:02:42.843144+0000","last_fullsized":"2024-09-11T11:02:42.843144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:12.827913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'6","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.770617+0000","last_change":"2024-09-11T11:01:42.059933+0000","last_active":"2024-09-11T11:04:17.770617+0000","last_peered":"2024-09-11T11:04:17.770617+0000","last_clean":"2024-09-11T11:04:17.770617+0000","last_became_active":"2024-09-11T11:01:42.059147+0000","last_became_peered":"2024-09-11T11:01:42.059147+0000","last_unstale":"2024-09-11T11:04:17.770617+0000","last_undegraded":"2024-09-11T11:04:17.770617+0000","last_fullsized":"2024-09-11T11:04:17.770617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:38.857591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.112605+0000","last_change":"2024-09-11T11:01:03.350789+0000","last_active":"2024-09-11T11:02:42.112605+0000","last_peered":"2024-09-11T11:02:42.112605+0000","last_clean":"2024-09-11T11:02:42.112605+0000","last_became_active":"2024-09-11T11:01:03.349120+0000","last_became_peered":"2024-09-11T11:01:03.349120+0000","last_unstale":"2024-09-11T11:02:42.112605+0000","last_undegraded":"2024-09-11T11:02:42.112605+0000","last_fullsized":"2024-09-11T11:02:42.112605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:24:22.337303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'7","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938385+0000","last_change":"2024-09-11T11:01:05.343458+0000","last_active":"2024-09-11T11:04:17.938385+0000","last_peered":"2024-09-11T11:04:17.938385+0000","last_clean":"2024-09-11T11:04:17.938385+0000","last_became_active":"2024-09-11T11:01:05.343121+0000","last_became_peered":"2024-09-11T11:01:05.343121+0000","last_unstale":"2024-09-11T11:04:17.938385+0000","last_undegraded":"2024-09-11T11:04:17.938385+0000","last_fullsized":"2024-09-11T11:04:17.938385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:29:38.168723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.844476+0000","last_change":"2024-09-11T11:01:42.056195+0000","last_active":"2024-09-11T11:02:42.844476+0000","last_peered":"2024-09-11T11:02:42.844476+0000","last_clean":"2024-09-11T11:02:42.844476+0000","last_became_active":"2024-09-11T11:01:42.055356+0000","last_became_peered":"2024-09-11T11:01:42.055356+0000","last_unstale":"2024-09-11T11:02:42.844476+0000","last_undegraded":"2024-09-11T11:02:42.844476+0000","last_fullsized":"2024-09-11T11:02:42.844476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:17:33.310470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.110479+0000","last_change":"2024-09-11T11:01:05.346901+0000","last_active":"2024-09-11T11:02:42.110479+0000","last_peered":"2024-09-11T11:02:42.110479+0000","last_clean":"2024-09-11T11:02:42.110479+0000","last_became_active":"2024-09-11T11:01:05.346563+0000","last_became_peered":"2024-09-11T11:01:05.346563+0000","last_unstale":"2024-09-11T11:02:42.110479+0000","last_undegraded":"2024-09-11T11:02:42.110479+0000","last_fullsized":"2024-09-11T11:02:42.110479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:21:02.544885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.499542+0000","last_change":"2024-09-11T11:01:03.316299+0000","last_active":"2024-09-11T11:02:42.499542+0000","last_peered":"2024-09-11T11:02:42.499542+0000","last_clean":"2024-09-11T11:02:42.499542+0000","last_became_active":"2024-09-11T11:01:03.315651+0000","last_became_peered":"2024-09-11T11:01:03.315651+0000","last_unstale":"2024-09-11T11:02:42.499542+0000","last_undegraded":"2024-09-11T11:02:42.499542+0000","last_fullsized":"2024-09-11T11:02:42.499542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:12:09.647986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'8","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.818259+0000","last_change":"2024-09-11T11:01:05.348683+0000","last_active":"2024-09-11T11:03:16.818259+0000","last_peered":"2024-09-11T11:03:16.818259+0000","last_clean":"2024-09-11T11:03:16.818259+0000","last_became_active":"2024-09-11T11:01:05.347760+0000","last_became_peered":"2024-09-11T11:01:05.347760+0000","last_unstale":"2024-09-11T11:03:16.818259+0000","last_undegraded":"2024-09-11T11:03:16.818259+0000","last_fullsized":"2024-09-11T11:03:16.818259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:28:39.642991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.116664+0000","last_change":"2024-09-11T11:01:03.340726+0000","last_active":"2024-09-11T11:02:42.116664+0000","last_peered":"2024-09-11T11:02:42.116664+0000","last_clean":"2024-09-11T11:02:42.116664+0000","last_became_active":"2024-09-11T11:01:03.337667+0000","last_became_peered":"2024-09-11T11:01:03.337667+0000","last_unstale":"2024-09-11T11:02:42.116664+0000","last_undegraded":"2024-09-11T11:02:42.116664+0000","last_fullsized":"2024-09-11T11:02:42.116664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:41:38.836874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.121715+0000","last_change":"2024-09-11T11:01:03.322086+0000","last_active":"2024-09-11T11:02:42.121715+0000","last_peered":"2024-09-11T11:02:42.121715+0000","last_clean":"2024-09-11T11:02:42.121715+0000","last_became_active":"2024-09-11T11:01:03.321242+0000","last_became_peered":"2024-09-11T11:01:03.321242+0000","last_unstale":"2024-09-11T11:02:42.121715+0000","last_undegraded":"2024-09-11T11:02:42.121715+0000","last_fullsized":"2024-09-11T11:02:42.121715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:55.170368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'12","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.437700+0000","last_change":"2024-09-11T11:01:05.344698+0000","last_active":"2024-09-11T11:04:17.437700+0000","last_peered":"2024-09-11T11:04:17.437700+0000","last_clean":"2024-09-11T11:04:17.437700+0000","last_became_active":"2024-09-11T11:01:05.344285+0000","last_became_peered":"2024-09-11T11:01:05.344285+0000","last_unstale":"2024-09-11T11:04:17.437700+0000","last_undegraded":"2024-09-11T11:04:17.437700+0000","last_fullsized":"2024-09-11T11:04:17.437700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:08:02.954788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.842659+0000","last_change":"2024-09-11T11:01:03.325391+0000","last_active":"2024-09-11T11:02:42.842659+0000","last_peered":"2024-09-11T11:02:42.842659+0000","last_clean":"2024-09-11T11:02:42.842659+0000","last_became_active":"2024-09-11T11:01:03.320391+0000","last_became_peered":"2024-09-11T11:01:03.320391+0000","last_unstale":"2024-09-11T11:02:42.842659+0000","last_undegraded":"2024-09-11T11:02:42.842659+0000","last_fullsized":"2024-09-11T11:02:42.842659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:25:59.236352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:02:42.498432+0000","last_change":"2024-09-11T11:01:42.076222+0000","last_active":"2024-09-11T11:02:42.498432+0000","last_peered":"2024-09-11T11:02:42.498432+0000","last_clean":"2024-09-11T11:02:42.498432+0000","last_became_active":"2024-09-11T11:01:42.069954+0000","last_became_peered":"2024-09-11T11:01:42.069954+0000","last_unstale":"2024-09-11T11:02:42.498432+0000","last_undegraded":"2024-09-11T11:02:42.498432+0000","last_fullsized":"2024-09-11T11:02:42.498432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:10:17.552581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13384,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1492,"num_read_kb":1278,"num_write":561,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1320,"ondisk_log_size":1320,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":968,"num_read_kb":968,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1608,"num_read_kb":1498,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":17417088,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":132,"num_read_kb":83,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34840576,"data_stored":34834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673011,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40516,"kb_used_data":5172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331324,"statfs":{"total":96636764160,"available":96595275776,"internally_reserved":0,"allocated":5296128,"data_stored":4991137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48684,"kb_used_data":9180,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323156,"statfs":{"total":96636764160,"available":96586911744,"internally_reserved":0,"allocated":9400320,"data_stored":9132733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673012,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61668,"kb_used_data":22164,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94310172,"statfs":{"total":96636764160,"available":96573616128,"internally_reserved":0,"allocated":22695936,"data_stored":22359925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":156613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21614592,"data_stored":21611392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4837376,"data_stored":4834176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:04:54.197 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.197 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.197 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.197 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.197 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.198 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.198 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.198 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.198 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.198 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.198 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.198 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.198 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.199 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.200 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.201 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.201 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.201 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.201 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.201 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.201 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.201 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.201 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.202 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.202 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.202 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.202 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.202 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.202 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.202 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.203 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.203 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.203 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.203 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.203 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.203 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.203 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.204 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.205 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.206 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.207 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.208 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.209 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.209 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.209 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T11:00:49.442581+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.209 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.209 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.209 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.209 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.210 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.210 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.211 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.211 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.211 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.211 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.211 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.212 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.212 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.212 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.212 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.212 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.213 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.213 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.213 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.213 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.214 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.214 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.214 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.214 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.215 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.215 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.215 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.215 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.216 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.216 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.216 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.216 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.216 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.217 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.217 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.217 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.217 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.218 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.218 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.218 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.218 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.219 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.219 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.219 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.219 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.220 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.220 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.220 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.220 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.221 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.221 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.221 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.221 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.221 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.222 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.222 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.222 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.222 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.223 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.223 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.223 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.223 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.224 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.224 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.224 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.224 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.225 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.225 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.225 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.225 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.226 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.226 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.226 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.226 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.226 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.227 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.227 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.227 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.227 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.228 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.228 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.228 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.228 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.229 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.229 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.229 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.229 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.230 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.230 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.230 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.230 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.231 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.231 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.231 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.231 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.231 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.232 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.232 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.232 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.233 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.233 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.233 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.233 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.234 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.234 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.234 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.234 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.234 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.235 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.235 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.235 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.236 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.236 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.236 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.236 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.236 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.237 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.237 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.237 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.238 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.238 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.238 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.238 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.239 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.239 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.239 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.239 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.240 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.240 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.240 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.240 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.241 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.241 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.241 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.241 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.242 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.242 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.242 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.242 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.243 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.243 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.243 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.243 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.244 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.244 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.244 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.244 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.245 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.245 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.245 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.245 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.246 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.246 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.246 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.246 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.247 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.247 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.247 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.247 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.248 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.248 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.248 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.249 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:04:54.249 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T11:05:14.250 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:05:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.379+0000 7f072fab2640 1 Processor -- start 2024-09-11T11:05:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.379+0000 7f072fab2640 1 -- start start 2024-09-11T11:05:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.379+0000 7f072fab2640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f072806d0e0 0x7f072806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0728071c10 con 0x7f072806da00 2024-09-11T11:05:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0728072230 con 0x7f072806d0e0 2024-09-11T11:05:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072d84e640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f072806d0e0 0x7f072806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:14.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072d04d640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f072806da00 0x7f072812ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47684/0 (socket says 172.21.15.102:47684) 2024-09-11T11:05:14.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072d04d640 1 -- 172.21.15.102:0/3420133619 learned_addr learned my addr 172.21.15.102:0/3420133619 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:05:14.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072d84e640 1 -- 172.21.15.102:0/3420133619 >> v1:172.21.15.102:6789/0 conn(0x7f072806da00 legacy=0x7f072812ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:14.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072d84e640 1 -- 172.21.15.102:0/3420133619 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07280709e0 con 0x7f072806d0e0 2024-09-11T11:05:14.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072c84c640 1 -- 172.21.15.102:0/3420133619 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970549607 0 0) 0x7f0728071c10 con 0x7f072806da00 2024-09-11T11:05:14.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072d84e640 1 --2- 172.21.15.102:0/3420133619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f072806d4c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0724009d90 tx=0x7f072401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346237b866e83ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:14.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072c84c640 1 -- 172.21.15.102:0/3420133619 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07240a6560 con 0x7f072806d0e0 2024-09-11T11:05:14.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072c84c640 1 -- 172.21.15.102:0/3420133619 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07240a6700 con 0x7f072806d0e0 2024-09-11T11:05:14.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072c84c640 1 -- 172.21.15.102:0/3420133619 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07240a6a00 con 0x7f072806d0e0 2024-09-11T11:05:14.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 -- 172.21.15.102:0/3420133619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 msgr2=0x7f072806d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:14.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 --2- 172.21.15.102:0/3420133619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f072806d4c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0724009d90 tx=0x7f072401c8c0 comp rx=0 tx=0).stop 2024-09-11T11:05:14.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 -- 172.21.15.102:0/3420133619 shutdown_connections 2024-09-11T11:05:14.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 --2- 172.21.15.102:0/3420133619 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f072806d4c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:14.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 -- 172.21.15.102:0/3420133619 >> 172.21.15.102:0/3420133619 conn(0x7f0728099a50 msgr2=0x7f07280972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:05:14.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 -- 172.21.15.102:0/3420133619 shutdown_connections 2024-09-11T11:05:14.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.383+0000 7f072fab2640 1 -- 172.21.15.102:0/3420133619 wait complete. 2024-09-11T11:05:14.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072fab2640 1 Processor -- start 2024-09-11T11:05:14.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072fab2640 1 -- start start 2024-09-11T11:05:14.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072fab2640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f0728129ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:14.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072fab2640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0728134e80 con 0x7f072806d0e0 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072d84e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f0728129ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072d84e640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f0728129ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:39582/0 (socket says 172.21.15.102:39582) 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072d84e640 1 -- 172.21.15.102:0/4010949804 learned_addr learned my addr 172.21.15.102:0/4010949804 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072d84e640 1 -- 172.21.15.102:0/4010949804 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072808b7a0 con 0x7f072806d0e0 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072d84e640 1 --2- 172.21.15.102:0/4010949804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f0728129ad0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0724009d90 tx=0x7f0724019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f071e7fc640 1 -- 172.21.15.102:0/4010949804 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07240bb570 con 0x7f072806d0e0 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f071e7fc640 1 -- 172.21.15.102:0/4010949804 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07240c0070 con 0x7f072806d0e0 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f072812be70 con 0x7f072806d0e0 2024-09-11T11:05:14.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f071e7fc640 1 -- 172.21.15.102:0/4010949804 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07240bb840 con 0x7f072806d0e0 2024-09-11T11:05:14.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0728096cd0 con 0x7f072806d0e0 2024-09-11T11:05:14.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072806d4c0 con 0x7f072806d0e0 2024-09-11T11:05:14.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f071e7fc640 1 -- 172.21.15.102:0/4010949804 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f07240bb9e0 con 0x7f072806d0e0 2024-09-11T11:05:14.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f071e7fc640 1 --2- 172.21.15.102:0/4010949804 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f070c035db0 0x7f070c038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:14.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f071e7fc640 1 -- 172.21.15.102:0/4010949804 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f07240e42f0 con 0x7f072806d0e0 2024-09-11T11:05:14.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.387+0000 7f072d04d640 1 --2- 172.21.15.102:0/4010949804 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f070c035db0 0x7f070c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:14.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.391+0000 7f072d04d640 1 --2- 172.21.15.102:0/4010949804 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f070c035db0 0x7f070c038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0718007fd0 tx=0x7f0718007980 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:14.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.391+0000 7f071e7fc640 1 -- 172.21.15.102:0/4010949804 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f07240ca020 con 0x7f072806d0e0 2024-09-11T11:05:14.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.551+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f072812c660 con 0x7f070c035db0 2024-09-11T11:05:14.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.595+0000 7f071e7fc640 1 -- 172.21.15.102:0/4010949804 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658151 (secure 0 0 0) 0x7f07180058e0 con 0x7f070c035db0 2024-09-11T11:05:14.602 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:05:14.609 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f070c035db0 msgr2=0x7f070c038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 --2- 172.21.15.102:0/4010949804 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f070c035db0 0x7f070c038270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0718007fd0 tx=0x7f0718007980 comp rx=0 tx=0).stop 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 msgr2=0x7f0728129ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 --2- 172.21.15.102:0/4010949804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f0728129ad0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0724009d90 tx=0x7f0724019660 comp rx=0 tx=0).stop 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 shutdown_connections 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 --2- 172.21.15.102:0/4010949804 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f070c035db0 0x7f070c038270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 --2- 172.21.15.102:0/4010949804 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072806d0e0 0x7f0728129ad0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 >> 172.21.15.102:0/4010949804 conn(0x7f0728099a50 msgr2=0x7f072806e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 shutdown_connections 2024-09-11T11:05:14.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:14.603+0000 7f072fab2640 1 -- 172.21.15.102:0/4010949804 wait complete. 2024-09-11T11:05:14.622 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-11T11:05:13.060033+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5090,"num_read_kb":4675,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4729,"ondisk_log_size":4729,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":156832,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":153785,"kb_avail":377330528,"statfs":{"total":386547056640,"available":386386460672,"internally_reserved":0,"allocated":3047424,"data_stored":1802812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":157476630},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2050,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005794"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:11.036237+0000","last_change":"2024-09-11T11:01:03.337877+0000","last_active":"2024-09-11T11:03:11.036237+0000","last_peered":"2024-09-11T11:03:11.036237+0000","last_clean":"2024-09-11T11:03:11.036237+0000","last_became_active":"2024-09-11T11:01:03.336333+0000","last_became_peered":"2024-09-11T11:01:03.336333+0000","last_unstale":"2024-09-11T11:03:11.036237+0000","last_undegraded":"2024-09-11T11:03:11.036237+0000","last_fullsized":"2024-09-11T11:03:11.036237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.590788+0000","last_change":"2024-09-11T11:01:05.334117+0000","last_active":"2024-09-11T11:04:17.590788+0000","last_peered":"2024-09-11T11:04:17.590788+0000","last_clean":"2024-09-11T11:04:17.590788+0000","last_became_active":"2024-09-11T11:01:05.332897+0000","last_became_peered":"2024-09-11T11:01:05.332897+0000","last_unstale":"2024-09-11T11:04:17.590788+0000","last_undegraded":"2024-09-11T11:04:17.590788+0000","last_fullsized":"2024-09-11T11:04:17.590788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.035426+0000","last_change":"2024-09-11T11:01:03.346417+0000","last_active":"2024-09-11T11:03:08.035426+0000","last_peered":"2024-09-11T11:03:08.035426+0000","last_clean":"2024-09-11T11:03:08.035426+0000","last_became_active":"2024-09-11T11:01:03.346113+0000","last_became_peered":"2024-09-11T11:01:03.346113+0000","last_unstale":"2024-09-11T11:03:08.035426+0000","last_undegraded":"2024-09-11T11:03:08.035426+0000","last_fullsized":"2024-09-11T11:03:08.035426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.041104+0000","last_change":"2024-09-11T11:01:05.333693+0000","last_active":"2024-09-11T11:03:38.041104+0000","last_peered":"2024-09-11T11:03:38.041104+0000","last_clean":"2024-09-11T11:03:38.041104+0000","last_became_active":"2024-09-11T11:01:05.330885+0000","last_became_peered":"2024-09-11T11:01:05.330885+0000","last_unstale":"2024-09-11T11:03:38.041104+0000","last_undegraded":"2024-09-11T11:03:38.041104+0000","last_fullsized":"2024-09-11T11:03:38.041104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.034100+0000","last_change":"2024-09-11T11:01:03.346111+0000","last_active":"2024-09-11T11:03:08.034100+0000","last_peered":"2024-09-11T11:03:08.034100+0000","last_clean":"2024-09-11T11:03:08.034100+0000","last_became_active":"2024-09-11T11:01:03.345673+0000","last_became_peered":"2024-09-11T11:01:03.345673+0000","last_unstale":"2024-09-11T11:03:08.034100+0000","last_undegraded":"2024-09-11T11:03:08.034100+0000","last_fullsized":"2024-09-11T11:03:08.034100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'12","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.457605+0000","last_change":"2024-09-11T11:01:05.331041+0000","last_active":"2024-09-11T11:04:17.457605+0000","last_peered":"2024-09-11T11:04:17.457605+0000","last_clean":"2024-09-11T11:04:17.457605+0000","last_became_active":"2024-09-11T11:01:05.330639+0000","last_became_peered":"2024-09-11T11:01:05.330639+0000","last_unstale":"2024-09-11T11:04:17.457605+0000","last_undegraded":"2024-09-11T11:04:17.457605+0000","last_fullsized":"2024-09-11T11:04:17.457605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.326169+0000","last_change":"2024-09-11T11:01:03.335434+0000","last_active":"2024-09-11T11:04:53.326169+0000","last_peered":"2024-09-11T11:04:53.326169+0000","last_clean":"2024-09-11T11:04:53.326169+0000","last_became_active":"2024-09-11T11:01:03.335132+0000","last_became_peered":"2024-09-11T11:01:03.335132+0000","last_unstale":"2024-09-11T11:04:53.326169+0000","last_undegraded":"2024-09-11T11:04:53.326169+0000","last_fullsized":"2024-09-11T11:04:53.326169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.591073+0000","last_change":"2024-09-11T11:01:05.344140+0000","last_active":"2024-09-11T11:04:17.591073+0000","last_peered":"2024-09-11T11:04:17.591073+0000","last_clean":"2024-09-11T11:04:17.591073+0000","last_became_active":"2024-09-11T11:01:05.339018+0000","last_became_peered":"2024-09-11T11:01:05.339018+0000","last_unstale":"2024-09-11T11:04:17.591073+0000","last_undegraded":"2024-09-11T11:04:17.591073+0000","last_fullsized":"2024-09-11T11:04:17.591073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042259+0000","last_change":"2024-09-11T11:01:03.324287+0000","last_active":"2024-09-11T11:03:36.042259+0000","last_peered":"2024-09-11T11:03:36.042259+0000","last_clean":"2024-09-11T11:03:36.042259+0000","last_became_active":"2024-09-11T11:01:03.322877+0000","last_became_peered":"2024-09-11T11:01:03.322877+0000","last_unstale":"2024-09-11T11:03:36.042259+0000","last_undegraded":"2024-09-11T11:03:36.042259+0000","last_fullsized":"2024-09-11T11:03:36.042259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'7","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.882243+0000","last_change":"2024-09-11T11:01:05.354323+0000","last_active":"2024-09-11T11:04:52.882243+0000","last_peered":"2024-09-11T11:04:52.882243+0000","last_clean":"2024-09-11T11:04:52.882243+0000","last_became_active":"2024-09-11T11:01:05.353908+0000","last_became_peered":"2024-09-11T11:01:05.353908+0000","last_unstale":"2024-09-11T11:04:52.882243+0000","last_undegraded":"2024-09-11T11:04:52.882243+0000","last_fullsized":"2024-09-11T11:04:52.882243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042217+0000","last_change":"2024-09-11T11:01:03.346652+0000","last_active":"2024-09-11T11:03:36.042217+0000","last_peered":"2024-09-11T11:03:36.042217+0000","last_clean":"2024-09-11T11:03:36.042217+0000","last_became_active":"2024-09-11T11:01:03.345964+0000","last_became_peered":"2024-09-11T11:01:03.345964+0000","last_unstale":"2024-09-11T11:03:36.042217+0000","last_undegraded":"2024-09-11T11:03:36.042217+0000","last_fullsized":"2024-09-11T11:03:36.042217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'14","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.939794+0000","last_change":"2024-09-11T11:01:05.346892+0000","last_active":"2024-09-11T11:04:17.939794+0000","last_peered":"2024-09-11T11:04:17.939794+0000","last_clean":"2024-09-11T11:04:17.939794+0000","last_became_active":"2024-09-11T11:01:05.345664+0000","last_became_peered":"2024-09-11T11:01:05.345664+0000","last_unstale":"2024-09-11T11:04:17.939794+0000","last_undegraded":"2024-09-11T11:04:17.939794+0000","last_fullsized":"2024-09-11T11:04:17.939794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.039856+0000","last_change":"2024-09-11T11:01:03.349146+0000","last_active":"2024-09-11T11:03:33.039856+0000","last_peered":"2024-09-11T11:03:33.039856+0000","last_clean":"2024-09-11T11:03:33.039856+0000","last_became_active":"2024-09-11T11:01:03.348822+0000","last_became_peered":"2024-09-11T11:01:03.348822+0000","last_unstale":"2024-09-11T11:03:33.039856+0000","last_undegraded":"2024-09-11T11:03:33.039856+0000","last_fullsized":"2024-09-11T11:03:33.039856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:11.036181+0000","last_change":"2024-09-11T11:01:05.347306+0000","last_active":"2024-09-11T11:03:11.036181+0000","last_peered":"2024-09-11T11:03:11.036181+0000","last_clean":"2024-09-11T11:03:11.036181+0000","last_became_active":"2024-09-11T11:01:05.345698+0000","last_became_peered":"2024-09-11T11:01:05.345698+0000","last_unstale":"2024-09-11T11:03:11.036181+0000","last_undegraded":"2024-09-11T11:03:11.036181+0000","last_fullsized":"2024-09-11T11:03:11.036181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.039729+0000","last_change":"2024-09-11T11:01:03.336343+0000","last_active":"2024-09-11T11:03:33.039729+0000","last_peered":"2024-09-11T11:03:33.039729+0000","last_clean":"2024-09-11T11:03:33.039729+0000","last_became_active":"2024-09-11T11:01:03.335830+0000","last_became_peered":"2024-09-11T11:01:03.335830+0000","last_unstale":"2024-09-11T11:03:33.039729+0000","last_undegraded":"2024-09-11T11:03:33.039729+0000","last_fullsized":"2024-09-11T11:03:33.039729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'4","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.022717+0000","last_change":"2024-09-11T11:01:05.344202+0000","last_active":"2024-09-11T11:04:18.022717+0000","last_peered":"2024-09-11T11:04:18.022717+0000","last_clean":"2024-09-11T11:04:18.022717+0000","last_became_active":"2024-09-11T11:01:05.343805+0000","last_became_peered":"2024-09-11T11:01:05.343805+0000","last_unstale":"2024-09-11T11:04:18.022717+0000","last_undegraded":"2024-09-11T11:04:18.022717+0000","last_fullsized":"2024-09-11T11:04:18.022717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039672+0000","last_change":"2024-09-11T11:01:05.333623+0000","last_active":"2024-09-11T11:03:26.039672+0000","last_peered":"2024-09-11T11:03:26.039672+0000","last_clean":"2024-09-11T11:03:26.039672+0000","last_became_active":"2024-09-11T11:01:05.332915+0000","last_became_peered":"2024-09-11T11:01:05.332915+0000","last_unstale":"2024-09-11T11:03:26.039672+0000","last_undegraded":"2024-09-11T11:03:26.039672+0000","last_fullsized":"2024-09-11T11:03:26.039672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.040050+0000","last_change":"2024-09-11T11:01:03.347195+0000","last_active":"2024-09-11T11:03:28.040050+0000","last_peered":"2024-09-11T11:03:28.040050+0000","last_clean":"2024-09-11T11:03:28.040050+0000","last_became_active":"2024-09-11T11:01:03.346878+0000","last_became_peered":"2024-09-11T11:01:03.346878+0000","last_unstale":"2024-09-11T11:03:28.040050+0000","last_undegraded":"2024-09-11T11:03:28.040050+0000","last_fullsized":"2024-09-11T11:03:28.040050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:03.044062+0000","last_change":"2024-09-11T11:01:42.051383+0000","last_active":"2024-09-11T11:04:03.044062+0000","last_peered":"2024-09-11T11:04:03.044062+0000","last_clean":"2024-09-11T11:04:03.044062+0000","last_became_active":"2024-09-11T11:01:42.050609+0000","last_became_peered":"2024-09-11T11:01:42.050609+0000","last_unstale":"2024-09-11T11:04:03.044062+0000","last_undegraded":"2024-09-11T11:04:03.044062+0000","last_fullsized":"2024-09-11T11:04:03.044062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036400+0000","last_change":"2024-09-11T11:01:03.335675+0000","last_active":"2024-09-11T11:03:28.036400+0000","last_peered":"2024-09-11T11:03:28.036400+0000","last_clean":"2024-09-11T11:03:28.036400+0000","last_became_active":"2024-09-11T11:01:03.335121+0000","last_became_peered":"2024-09-11T11:01:03.335121+0000","last_unstale":"2024-09-11T11:03:28.036400+0000","last_undegraded":"2024-09-11T11:03:28.036400+0000","last_fullsized":"2024-09-11T11:03:28.036400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039782+0000","last_change":"2024-09-11T11:01:05.332966+0000","last_active":"2024-09-11T11:03:26.039782+0000","last_peered":"2024-09-11T11:03:26.039782+0000","last_clean":"2024-09-11T11:03:26.039782+0000","last_became_active":"2024-09-11T11:01:05.332299+0000","last_became_peered":"2024-09-11T11:01:05.332299+0000","last_unstale":"2024-09-11T11:03:26.039782+0000","last_undegraded":"2024-09-11T11:03:26.039782+0000","last_fullsized":"2024-09-11T11:03:26.039782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:31.041092+0000","last_change":"2024-09-11T11:01:03.346356+0000","last_active":"2024-09-11T11:03:31.041092+0000","last_peered":"2024-09-11T11:03:31.041092+0000","last_clean":"2024-09-11T11:03:31.041092+0000","last_became_active":"2024-09-11T11:01:03.345528+0000","last_became_peered":"2024-09-11T11:01:03.345528+0000","last_unstale":"2024-09-11T11:03:31.041092+0000","last_undegraded":"2024-09-11T11:03:31.041092+0000","last_fullsized":"2024-09-11T11:03:31.041092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.871170+0000","last_change":"2024-09-11T11:01:05.353141+0000","last_active":"2024-09-11T11:04:17.871170+0000","last_peered":"2024-09-11T11:04:17.871170+0000","last_clean":"2024-09-11T11:04:17.871170+0000","last_became_active":"2024-09-11T11:01:05.352754+0000","last_became_peered":"2024-09-11T11:01:05.352754+0000","last_unstale":"2024-09-11T11:04:17.871170+0000","last_undegraded":"2024-09-11T11:04:17.871170+0000","last_fullsized":"2024-09-11T11:04:17.871170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:31.041027+0000","last_change":"2024-09-11T11:01:03.323543+0000","last_active":"2024-09-11T11:03:31.041027+0000","last_peered":"2024-09-11T11:03:31.041027+0000","last_clean":"2024-09-11T11:03:31.041027+0000","last_became_active":"2024-09-11T11:01:03.321411+0000","last_became_peered":"2024-09-11T11:01:03.321411+0000","last_unstale":"2024-09-11T11:03:31.041027+0000","last_undegraded":"2024-09-11T11:03:31.041027+0000","last_fullsized":"2024-09-11T11:03:31.041027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'32","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.869513+0000","last_change":"2024-09-11T11:01:05.337548+0000","last_active":"2024-09-11T11:04:17.869513+0000","last_peered":"2024-09-11T11:04:17.869513+0000","last_clean":"2024-09-11T11:04:17.869513+0000","last_became_active":"2024-09-11T11:01:05.337040+0000","last_became_peered":"2024-09-11T11:01:05.337040+0000","last_unstale":"2024-09-11T11:04:17.869513+0000","last_undegraded":"2024-09-11T11:04:17.869513+0000","last_fullsized":"2024-09-11T11:04:17.869513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.763074+0000","last_change":"2024-09-11T11:01:03.334314+0000","last_active":"2024-09-11T11:04:17.763074+0000","last_peered":"2024-09-11T11:04:17.763074+0000","last_clean":"2024-09-11T11:04:17.763074+0000","last_became_active":"2024-09-11T11:01:03.333820+0000","last_became_peered":"2024-09-11T11:01:03.333820+0000","last_unstale":"2024-09-11T11:04:17.763074+0000","last_undegraded":"2024-09-11T11:04:17.763074+0000","last_fullsized":"2024-09-11T11:04:17.763074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.591150+0000","last_change":"2024-09-11T11:01:05.342829+0000","last_active":"2024-09-11T11:04:17.591150+0000","last_peered":"2024-09-11T11:04:17.591150+0000","last_clean":"2024-09-11T11:04:17.591150+0000","last_became_active":"2024-09-11T11:01:05.342461+0000","last_became_peered":"2024-09-11T11:01:05.342461+0000","last_unstale":"2024-09-11T11:04:17.591150+0000","last_undegraded":"2024-09-11T11:04:17.591150+0000","last_fullsized":"2024-09-11T11:04:17.591150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.080842+0000","last_change":"2024-09-11T11:01:03.346138+0000","last_active":"2024-09-11T11:04:49.080842+0000","last_peered":"2024-09-11T11:04:49.080842+0000","last_clean":"2024-09-11T11:04:49.080842+0000","last_became_active":"2024-09-11T11:01:03.345866+0000","last_became_peered":"2024-09-11T11:01:03.345866+0000","last_unstale":"2024-09-11T11:04:49.080842+0000","last_undegraded":"2024-09-11T11:04:49.080842+0000","last_fullsized":"2024-09-11T11:04:49.080842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'37","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.962203+0000","last_change":"2024-09-11T11:01:13.415583+0000","last_active":"2024-09-11T11:04:17.962203+0000","last_peered":"2024-09-11T11:04:17.962203+0000","last_clean":"2024-09-11T11:04:17.962203+0000","last_became_active":"2024-09-11T11:01:13.410232+0000","last_became_peered":"2024-09-11T11:01:13.410232+0000","last_unstale":"2024-09-11T11:04:17.962203+0000","last_undegraded":"2024-09-11T11:04:17.962203+0000","last_fullsized":"2024-09-11T11:04:17.962203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'14","reported_seq":94,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.458106+0000","last_change":"2024-09-11T11:01:05.347684+0000","last_active":"2024-09-11T11:04:17.458106+0000","last_peered":"2024-09-11T11:04:17.458106+0000","last_clean":"2024-09-11T11:04:17.458106+0000","last_became_active":"2024-09-11T11:01:05.347254+0000","last_became_peered":"2024-09-11T11:01:05.347254+0000","last_unstale":"2024-09-11T11:04:17.458106+0000","last_undegraded":"2024-09-11T11:04:17.458106+0000","last_fullsized":"2024-09-11T11:04:17.458106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.735004+0000","last_change":"2024-09-11T11:01:03.341239+0000","last_active":"2024-09-11T11:04:17.735004+0000","last_peered":"2024-09-11T11:04:17.735004+0000","last_clean":"2024-09-11T11:04:17.735004+0000","last_became_active":"2024-09-11T11:01:03.340851+0000","last_became_peered":"2024-09-11T11:01:03.340851+0000","last_unstale":"2024-09-11T11:04:17.735004+0000","last_undegraded":"2024-09-11T11:04:17.735004+0000","last_fullsized":"2024-09-11T11:04:17.735004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.702240+0000","last_change":"2024-09-11T11:05:00.702297+0000","last_active":"2024-09-11T11:05:00.702240+0000","last_peered":"2024-09-11T11:05:00.702240+0000","last_clean":"2024-09-11T11:05:00.702240+0000","last_became_active":"2024-09-11T11:01:07.363392+0000","last_became_peered":"2024-09-11T11:01:07.363392+0000","last_unstale":"2024-09-11T11:05:00.702240+0000","last_undegraded":"2024-09-11T11:05:00.702240+0000","last_fullsized":"2024-09-11T11:05:00.702240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.702044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.702044+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.702044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:35.422637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'34","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.140524+0000","last_change":"2024-09-11T11:01:09.392616+0000","last_active":"2024-09-11T11:04:49.140524+0000","last_peered":"2024-09-11T11:04:49.140524+0000","last_clean":"2024-09-11T11:04:49.140524+0000","last_became_active":"2024-09-11T11:01:09.392044+0000","last_became_peered":"2024-09-11T11:01:09.392044+0000","last_unstale":"2024-09-11T11:04:49.140524+0000","last_undegraded":"2024-09-11T11:04:49.140524+0000","last_fullsized":"2024-09-11T11:04:49.140524+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042533+0000","last_change":"2024-09-11T11:01:11.400422+0000","last_active":"2024-09-11T11:03:36.042533+0000","last_peered":"2024-09-11T11:03:36.042533+0000","last_clean":"2024-09-11T11:03:36.042533+0000","last_became_active":"2024-09-11T11:01:11.399820+0000","last_became_peered":"2024-09-11T11:01:11.399820+0000","last_unstale":"2024-09-11T11:03:36.042533+0000","last_undegraded":"2024-09-11T11:03:36.042533+0000","last_fullsized":"2024-09-11T11:03:36.042533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:41.043322+0000","last_change":"2024-09-11T11:01:13.421600+0000","last_active":"2024-09-11T11:03:41.043322+0000","last_peered":"2024-09-11T11:03:41.043322+0000","last_clean":"2024-09-11T11:03:41.043322+0000","last_became_active":"2024-09-11T11:01:13.420843+0000","last_became_peered":"2024-09-11T11:01:13.420843+0000","last_unstale":"2024-09-11T11:03:41.043322+0000","last_undegraded":"2024-09-11T11:03:41.043322+0000","last_fullsized":"2024-09-11T11:03:41.043322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'17","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.019946+0000","last_change":"2024-09-11T11:01:05.335422+0000","last_active":"2024-09-11T11:04:18.019946+0000","last_peered":"2024-09-11T11:04:18.019946+0000","last_clean":"2024-09-11T11:04:18.019946+0000","last_became_active":"2024-09-11T11:01:05.334085+0000","last_became_peered":"2024-09-11T11:01:05.334085+0000","last_unstale":"2024-09-11T11:04:18.019946+0000","last_undegraded":"2024-09-11T11:04:18.019946+0000","last_fullsized":"2024-09-11T11:04:18.019946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.035144+0000","last_change":"2024-09-11T11:01:03.335761+0000","last_active":"2024-09-11T11:03:23.035144+0000","last_peered":"2024-09-11T11:03:23.035144+0000","last_clean":"2024-09-11T11:03:23.035144+0000","last_became_active":"2024-09-11T11:01:03.335439+0000","last_became_peered":"2024-09-11T11:01:03.335439+0000","last_unstale":"2024-09-11T11:03:23.035144+0000","last_undegraded":"2024-09-11T11:03:23.035144+0000","last_fullsized":"2024-09-11T11:03:23.035144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.038623+0000","last_change":"2024-09-11T11:01:07.354963+0000","last_active":"2024-09-11T11:03:28.038623+0000","last_peered":"2024-09-11T11:03:28.038623+0000","last_clean":"2024-09-11T11:03:28.038623+0000","last_became_active":"2024-09-11T11:01:07.350851+0000","last_became_peered":"2024-09-11T11:01:07.350851+0000","last_unstale":"2024-09-11T11:03:28.038623+0000","last_undegraded":"2024-09-11T11:03:28.038623+0000","last_fullsized":"2024-09-11T11:03:28.038623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.834553+0000","last_change":"2024-09-11T11:05:00.834620+0000","last_active":"2024-09-11T11:05:00.834553+0000","last_peered":"2024-09-11T11:05:00.834553+0000","last_clean":"2024-09-11T11:05:00.834553+0000","last_became_active":"2024-09-11T11:01:09.382890+0000","last_became_peered":"2024-09-11T11:01:09.382890+0000","last_unstale":"2024-09-11T11:05:00.834553+0000","last_undegraded":"2024-09-11T11:05:00.834553+0000","last_fullsized":"2024-09-11T11:05:00.834553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:00.834344+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:00.834344+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.834344+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:37:29.350377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042450+0000","last_change":"2024-09-11T11:01:11.401654+0000","last_active":"2024-09-11T11:03:36.042450+0000","last_peered":"2024-09-11T11:03:36.042450+0000","last_clean":"2024-09-11T11:03:36.042450+0000","last_became_active":"2024-09-11T11:01:11.400881+0000","last_became_peered":"2024-09-11T11:01:11.400881+0000","last_unstale":"2024-09-11T11:03:36.042450+0000","last_undegraded":"2024-09-11T11:03:36.042450+0000","last_fullsized":"2024-09-11T11:03:36.042450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:43.042501+0000","last_change":"2024-09-11T11:01:13.423960+0000","last_active":"2024-09-11T11:03:43.042501+0000","last_peered":"2024-09-11T11:03:43.042501+0000","last_clean":"2024-09-11T11:03:43.042501+0000","last_became_active":"2024-09-11T11:01:13.422439+0000","last_became_peered":"2024-09-11T11:01:13.422439+0000","last_unstale":"2024-09-11T11:03:43.042501+0000","last_undegraded":"2024-09-11T11:03:43.042501+0000","last_fullsized":"2024-09-11T11:03:43.042501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.040126+0000","last_change":"2024-09-11T11:01:05.343880+0000","last_active":"2024-09-11T11:03:33.040126+0000","last_peered":"2024-09-11T11:03:33.040126+0000","last_clean":"2024-09-11T11:03:33.040126+0000","last_became_active":"2024-09-11T11:01:05.343489+0000","last_became_peered":"2024-09-11T11:01:05.343489+0000","last_unstale":"2024-09-11T11:03:33.040126+0000","last_undegraded":"2024-09-11T11:03:33.040126+0000","last_fullsized":"2024-09-11T11:03:33.040126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039713+0000","last_change":"2024-09-11T11:01:03.338861+0000","last_active":"2024-09-11T11:03:26.039713+0000","last_peered":"2024-09-11T11:03:26.039713+0000","last_clean":"2024-09-11T11:03:26.039713+0000","last_became_active":"2024-09-11T11:01:03.337993+0000","last_became_peered":"2024-09-11T11:01:03.337993+0000","last_unstale":"2024-09-11T11:03:26.039713+0000","last_undegraded":"2024-09-11T11:03:26.039713+0000","last_fullsized":"2024-09-11T11:03:26.039713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.680699+0000","last_change":"2024-09-11T11:05:01.680805+0000","last_active":"2024-09-11T11:05:01.680699+0000","last_peered":"2024-09-11T11:05:01.680699+0000","last_clean":"2024-09-11T11:05:01.680699+0000","last_became_active":"2024-09-11T11:01:07.363656+0000","last_became_peered":"2024-09-11T11:01:07.363656+0000","last_unstale":"2024-09-11T11:05:01.680699+0000","last_undegraded":"2024-09-11T11:05:01.680699+0000","last_fullsized":"2024-09-11T11:05:01.680699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.680409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.680409+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.680409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:58.475877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'16","reported_seq":55,"reported_epoch":36,"state":"active+clean+scrubbing+deep","last_fresh":"2024-09-11T11:05:08.058281+0000","last_change":"2024-09-11T11:05:08.048607+0000","last_active":"2024-09-11T11:05:08.058281+0000","last_peered":"2024-09-11T11:05:08.058281+0000","last_clean":"2024-09-11T11:05:08.058281+0000","last_became_active":"2024-09-11T11:01:09.365291+0000","last_became_peered":"2024-09-11T11:01:09.365291+0000","last_unstale":"2024-09-11T11:05:08.058281+0000","last_undegraded":"2024-09-11T11:05:08.058281+0000","last_fullsized":"2024-09-11T11:05:08.058281+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.459581+0000","last_change":"2024-09-11T11:05:03.459650+0000","last_active":"2024-09-11T11:05:03.459581+0000","last_peered":"2024-09-11T11:05:03.459581+0000","last_clean":"2024-09-11T11:05:03.459581+0000","last_became_active":"2024-09-11T11:01:11.384635+0000","last_became_peered":"2024-09-11T11:01:11.384635+0000","last_unstale":"2024-09-11T11:05:03.459581+0000","last_undegraded":"2024-09-11T11:05:03.459581+0000","last_fullsized":"2024-09-11T11:05:03.459581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:03.459391+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:03.459391+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.459391+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:45.406062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.952085+0000","last_change":"2024-09-11T11:05:04.952144+0000","last_active":"2024-09-11T11:05:04.952085+0000","last_peered":"2024-09-11T11:05:04.952085+0000","last_clean":"2024-09-11T11:05:04.952085+0000","last_became_active":"2024-09-11T11:01:13.413465+0000","last_became_peered":"2024-09-11T11:01:13.413465+0000","last_unstale":"2024-09-11T11:05:04.952085+0000","last_undegraded":"2024-09-11T11:05:04.952085+0000","last_fullsized":"2024-09-11T11:05:04.952085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:04.951892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:04.951892+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.951892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:22.063365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'18","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.788710+0000","last_change":"2024-09-11T11:01:05.347779+0000","last_active":"2024-09-11T11:04:17.788710+0000","last_peered":"2024-09-11T11:04:17.788710+0000","last_clean":"2024-09-11T11:04:17.788710+0000","last_became_active":"2024-09-11T11:01:05.347434+0000","last_became_peered":"2024-09-11T11:01:05.347434+0000","last_unstale":"2024-09-11T11:04:17.788710+0000","last_undegraded":"2024-09-11T11:04:17.788710+0000","last_fullsized":"2024-09-11T11:04:17.788710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.081768+0000","last_change":"2024-09-11T11:01:03.322006+0000","last_active":"2024-09-11T11:04:49.081768+0000","last_peered":"2024-09-11T11:04:49.081768+0000","last_clean":"2024-09-11T11:04:49.081768+0000","last_became_active":"2024-09-11T11:01:03.320684+0000","last_became_peered":"2024-09-11T11:01:03.320684+0000","last_unstale":"2024-09-11T11:04:49.081768+0000","last_undegraded":"2024-09-11T11:04:49.081768+0000","last_fullsized":"2024-09-11T11:04:49.081768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042482+0000","last_change":"2024-09-11T11:01:07.343287+0000","last_active":"2024-09-11T11:03:36.042482+0000","last_peered":"2024-09-11T11:03:36.042482+0000","last_clean":"2024-09-11T11:03:36.042482+0000","last_became_active":"2024-09-11T11:01:07.342607+0000","last_became_peered":"2024-09-11T11:01:07.342607+0000","last_unstale":"2024-09-11T11:03:36.042482+0000","last_undegraded":"2024-09-11T11:03:36.042482+0000","last_fullsized":"2024-09-11T11:03:36.042482+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.528932+0000","last_change":"2024-09-11T11:05:01.529010+0000","last_active":"2024-09-11T11:05:01.528932+0000","last_peered":"2024-09-11T11:05:01.528932+0000","last_clean":"2024-09-11T11:05:01.528932+0000","last_became_active":"2024-09-11T11:01:09.366811+0000","last_became_peered":"2024-09-11T11:01:09.366811+0000","last_unstale":"2024-09-11T11:05:01.528932+0000","last_undegraded":"2024-09-11T11:05:01.528932+0000","last_fullsized":"2024-09-11T11:05:01.528932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-11T11:05:01.528740+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-11T11:05:01.528740+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.528740+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:15.569259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":419,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.314842+0000","last_change":"2024-09-11T11:01:11.399976+0000","last_active":"2024-09-11T11:04:49.314842+0000","last_peered":"2024-09-11T11:04:49.314842+0000","last_clean":"2024-09-11T11:04:49.314842+0000","last_became_active":"2024-09-11T11:01:11.399213+0000","last_became_peered":"2024-09-11T11:01:11.399213+0000","last_unstale":"2024-09-11T11:04:49.314842+0000","last_undegraded":"2024-09-11T11:04:49.314842+0000","last_fullsized":"2024-09-11T11:04:49.314842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.591461+0000","last_change":"2024-09-11T11:01:05.330488+0000","last_active":"2024-09-11T11:04:17.591461+0000","last_peered":"2024-09-11T11:04:17.591461+0000","last_clean":"2024-09-11T11:04:17.591461+0000","last_became_active":"2024-09-11T11:01:05.330091+0000","last_became_peered":"2024-09-11T11:01:05.330091+0000","last_unstale":"2024-09-11T11:04:17.591461+0000","last_undegraded":"2024-09-11T11:04:17.591461+0000","last_fullsized":"2024-09-11T11:04:17.591461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038748+0000","last_change":"2024-09-11T11:01:03.338267+0000","last_active":"2024-09-11T11:03:21.038748+0000","last_peered":"2024-09-11T11:03:21.038748+0000","last_clean":"2024-09-11T11:03:21.038748+0000","last_became_active":"2024-09-11T11:01:03.337496+0000","last_became_peered":"2024-09-11T11:01:03.337496+0000","last_unstale":"2024-09-11T11:03:21.038748+0000","last_undegraded":"2024-09-11T11:03:21.038748+0000","last_fullsized":"2024-09-11T11:03:21.038748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.037104+0000","last_change":"2024-09-11T11:01:07.366981+0000","last_active":"2024-09-11T11:03:18.037104+0000","last_peered":"2024-09-11T11:03:18.037104+0000","last_clean":"2024-09-11T11:03:18.037104+0000","last_became_active":"2024-09-11T11:01:07.366115+0000","last_became_peered":"2024-09-11T11:01:07.366115+0000","last_unstale":"2024-09-11T11:03:18.037104+0000","last_undegraded":"2024-09-11T11:03:18.037104+0000","last_fullsized":"2024-09-11T11:03:18.037104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":115,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.567404+0000","last_change":"2024-09-11T11:05:08.567491+0000","last_active":"2024-09-11T11:05:08.567404+0000","last_peered":"2024-09-11T11:05:08.567404+0000","last_clean":"2024-09-11T11:05:08.567404+0000","last_became_active":"2024-09-11T11:01:09.376242+0000","last_became_peered":"2024-09-11T11:01:09.376242+0000","last_unstale":"2024-09-11T11:05:08.567404+0000","last_undegraded":"2024-09-11T11:05:08.567404+0000","last_fullsized":"2024-09-11T11:05:08.567404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-11T11:05:08.567207+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-11T11:05:08.567207+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.567207+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:00:58.320487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.791799+0000","last_change":"2024-09-11T11:04:59.791900+0000","last_active":"2024-09-11T11:04:59.791799+0000","last_peered":"2024-09-11T11:04:59.791799+0000","last_clean":"2024-09-11T11:04:59.791799+0000","last_became_active":"2024-09-11T11:01:11.377655+0000","last_became_peered":"2024-09-11T11:01:11.377655+0000","last_unstale":"2024-09-11T11:04:59.791799+0000","last_undegraded":"2024-09-11T11:04:59.791799+0000","last_fullsized":"2024-09-11T11:04:59.791799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.791500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.791500+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.791500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:50.251368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.034146+0000","last_change":"2024-09-11T11:01:13.421261+0000","last_active":"2024-09-11T11:03:18.034146+0000","last_peered":"2024-09-11T11:03:18.034146+0000","last_clean":"2024-09-11T11:03:18.034146+0000","last_became_active":"2024-09-11T11:01:13.420299+0000","last_became_peered":"2024-09-11T11:01:13.420299+0000","last_unstale":"2024-09-11T11:03:18.034146+0000","last_undegraded":"2024-09-11T11:03:18.034146+0000","last_fullsized":"2024-09-11T11:03:18.034146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.037072+0000","last_change":"2024-09-11T11:01:05.355473+0000","last_active":"2024-09-11T11:03:18.037072+0000","last_peered":"2024-09-11T11:03:18.037072+0000","last_clean":"2024-09-11T11:03:18.037072+0000","last_became_active":"2024-09-11T11:01:05.355135+0000","last_became_peered":"2024-09-11T11:01:05.355135+0000","last_unstale":"2024-09-11T11:03:18.037072+0000","last_undegraded":"2024-09-11T11:03:18.037072+0000","last_fullsized":"2024-09-11T11:03:18.037072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038711+0000","last_change":"2024-09-11T11:01:03.322857+0000","last_active":"2024-09-11T11:03:21.038711+0000","last_peered":"2024-09-11T11:03:21.038711+0000","last_clean":"2024-09-11T11:03:21.038711+0000","last_became_active":"2024-09-11T11:01:03.320605+0000","last_became_peered":"2024-09-11T11:01:03.320605+0000","last_unstale":"2024-09-11T11:03:21.038711+0000","last_undegraded":"2024-09-11T11:03:21.038711+0000","last_fullsized":"2024-09-11T11:03:21.038711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.033939+0000","last_change":"2024-09-11T11:01:07.349262+0000","last_active":"2024-09-11T11:03:18.033939+0000","last_peered":"2024-09-11T11:03:18.033939+0000","last_clean":"2024-09-11T11:03:18.033939+0000","last_became_active":"2024-09-11T11:01:07.348627+0000","last_became_peered":"2024-09-11T11:01:07.348627+0000","last_unstale":"2024-09-11T11:03:18.033939+0000","last_undegraded":"2024-09-11T11:03:18.033939+0000","last_fullsized":"2024-09-11T11:03:18.033939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'34","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.002375+0000","last_change":"2024-09-11T11:01:09.385906+0000","last_active":"2024-09-11T11:04:49.002375+0000","last_peered":"2024-09-11T11:04:49.002375+0000","last_clean":"2024-09-11T11:04:49.002375+0000","last_became_active":"2024-09-11T11:01:09.384478+0000","last_became_peered":"2024-09-11T11:01:09.384478+0000","last_unstale":"2024-09-11T11:04:49.002375+0000","last_undegraded":"2024-09-11T11:04:49.002375+0000","last_fullsized":"2024-09-11T11:04:49.002375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.037104+0000","last_change":"2024-09-11T11:01:11.402062+0000","last_active":"2024-09-11T11:03:23.037104+0000","last_peered":"2024-09-11T11:03:23.037104+0000","last_clean":"2024-09-11T11:03:23.037104+0000","last_became_active":"2024-09-11T11:01:11.401382+0000","last_became_peered":"2024-09-11T11:01:11.401382+0000","last_unstale":"2024-09-11T11:03:23.037104+0000","last_undegraded":"2024-09-11T11:03:23.037104+0000","last_fullsized":"2024-09-11T11:03:23.037104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"34'3","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.037328+0000","last_change":"2024-09-11T11:01:13.419597+0000","last_active":"2024-09-11T11:03:18.037328+0000","last_peered":"2024-09-11T11:03:18.037328+0000","last_clean":"2024-09-11T11:03:18.037328+0000","last_became_active":"2024-09-11T11:01:13.415041+0000","last_became_peered":"2024-09-11T11:01:13.415041+0000","last_unstale":"2024-09-11T11:03:18.037328+0000","last_undegraded":"2024-09-11T11:03:18.037328+0000","last_fullsized":"2024-09-11T11:03:18.037328+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'8","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938679+0000","last_change":"2024-09-11T11:01:05.347855+0000","last_active":"2024-09-11T11:04:17.938679+0000","last_peered":"2024-09-11T11:04:17.938679+0000","last_clean":"2024-09-11T11:04:17.938679+0000","last_became_active":"2024-09-11T11:01:05.347137+0000","last_became_peered":"2024-09-11T11:01:05.347137+0000","last_unstale":"2024-09-11T11:04:17.938679+0000","last_undegraded":"2024-09-11T11:04:17.938679+0000","last_fullsized":"2024-09-11T11:04:17.938679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038650+0000","last_change":"2024-09-11T11:01:42.098396+0000","last_active":"2024-09-11T11:03:21.038650+0000","last_peered":"2024-09-11T11:03:21.038650+0000","last_clean":"2024-09-11T11:03:21.038650+0000","last_became_active":"2024-09-11T11:01:42.065732+0000","last_became_peered":"2024-09-11T11:01:42.065732+0000","last_unstale":"2024-09-11T11:03:21.038650+0000","last_undegraded":"2024-09-11T11:03:21.038650+0000","last_fullsized":"2024-09-11T11:03:21.038650+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.035174+0000","last_change":"2024-09-11T11:01:42.064065+0000","last_active":"2024-09-11T11:03:23.035174+0000","last_peered":"2024-09-11T11:03:23.035174+0000","last_clean":"2024-09-11T11:03:23.035174+0000","last_became_active":"2024-09-11T11:01:42.062781+0000","last_became_peered":"2024-09-11T11:01:42.062781+0000","last_unstale":"2024-09-11T11:03:23.035174+0000","last_undegraded":"2024-09-11T11:03:23.035174+0000","last_fullsized":"2024-09-11T11:03:23.035174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.540399+0000","last_change":"2024-09-11T11:04:53.540432+0000","last_active":"2024-09-11T11:04:53.540399+0000","last_peered":"2024-09-11T11:04:53.540399+0000","last_clean":"2024-09-11T11:04:53.540399+0000","last_became_active":"2024-09-11T11:01:09.362260+0000","last_became_peered":"2024-09-11T11:01:09.362260+0000","last_unstale":"2024-09-11T11:04:53.540399+0000","last_undegraded":"2024-09-11T11:04:53.540399+0000","last_fullsized":"2024-09-11T11:04:53.540399+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:04:53.540311+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:04:53.540311+0000","last_clean_scrub_stamp":"2024-09-11T11:04:53.540311+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:22:12.396021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":392,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.964019+0000","last_change":"2024-09-11T11:05:03.964081+0000","last_active":"2024-09-11T11:05:03.964019+0000","last_peered":"2024-09-11T11:05:03.964019+0000","last_clean":"2024-09-11T11:05:03.964019+0000","last_became_active":"2024-09-11T11:01:11.391826+0000","last_became_peered":"2024-09-11T11:01:11.391826+0000","last_unstale":"2024-09-11T11:05:03.964019+0000","last_undegraded":"2024-09-11T11:05:03.964019+0000","last_fullsized":"2024-09-11T11:05:03.964019+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:03.963831+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:03.963831+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.963831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:53:34.267498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.038726+0000","last_change":"2024-09-11T11:01:13.429296+0000","last_active":"2024-09-11T11:03:23.038726+0000","last_peered":"2024-09-11T11:03:23.038726+0000","last_clean":"2024-09-11T11:03:23.038726+0000","last_became_active":"2024-09-11T11:01:13.428914+0000","last_became_peered":"2024-09-11T11:01:13.428914+0000","last_unstale":"2024-09-11T11:03:23.038726+0000","last_undegraded":"2024-09-11T11:03:23.038726+0000","last_fullsized":"2024-09-11T11:03:23.038726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.939765+0000","last_change":"2024-09-11T11:01:05.340468+0000","last_active":"2024-09-11T11:04:17.939765+0000","last_peered":"2024-09-11T11:04:17.939765+0000","last_clean":"2024-09-11T11:04:17.939765+0000","last_became_active":"2024-09-11T11:01:05.340069+0000","last_became_peered":"2024-09-11T11:01:05.340069+0000","last_unstale":"2024-09-11T11:04:17.939765+0000","last_undegraded":"2024-09-11T11:04:17.939765+0000","last_fullsized":"2024-09-11T11:04:17.939765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.396813+0000","last_change":"2024-09-11T11:01:03.334480+0000","last_active":"2024-09-11T11:04:17.396813+0000","last_peered":"2024-09-11T11:04:17.396813+0000","last_clean":"2024-09-11T11:04:17.396813+0000","last_became_active":"2024-09-11T11:01:03.333740+0000","last_became_peered":"2024-09-11T11:01:03.333740+0000","last_unstale":"2024-09-11T11:04:17.396813+0000","last_undegraded":"2024-09-11T11:04:17.396813+0000","last_fullsized":"2024-09-11T11:04:17.396813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.034070+0000","last_change":"2024-09-11T11:01:07.355314+0000","last_active":"2024-09-11T11:03:18.034070+0000","last_peered":"2024-09-11T11:03:18.034070+0000","last_clean":"2024-09-11T11:03:18.034070+0000","last_became_active":"2024-09-11T11:01:07.354827+0000","last_became_peered":"2024-09-11T11:01:07.354827+0000","last_unstale":"2024-09-11T11:03:18.034070+0000","last_undegraded":"2024-09-11T11:03:18.034070+0000","last_fullsized":"2024-09-11T11:03:18.034070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'63","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.696013+0000","last_change":"2024-09-11T11:04:55.696179+0000","last_active":"2024-09-11T11:04:55.696013+0000","last_peered":"2024-09-11T11:04:55.696013+0000","last_clean":"2024-09-11T11:04:55.696013+0000","last_became_active":"2024-09-11T11:01:09.374320+0000","last_became_peered":"2024-09-11T11:01:09.374320+0000","last_unstale":"2024-09-11T11:04:55.696013+0000","last_undegraded":"2024-09-11T11:04:55.696013+0000","last_fullsized":"2024-09-11T11:04:55.696013+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-11T11:04:55.695776+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-11T11:04:55.695776+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.695776+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:06.417243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.035994+0000","last_change":"2024-09-11T11:04:58.036052+0000","last_active":"2024-09-11T11:04:58.035994+0000","last_peered":"2024-09-11T11:04:58.035994+0000","last_clean":"2024-09-11T11:04:58.035994+0000","last_became_active":"2024-09-11T11:01:11.399118+0000","last_became_peered":"2024-09-11T11:01:11.399118+0000","last_unstale":"2024-09-11T11:04:58.035994+0000","last_undegraded":"2024-09-11T11:04:58.035994+0000","last_fullsized":"2024-09-11T11:04:58.035994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:58.035800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:58.035800+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.035800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:38.887084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'18","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.092464+0000","last_change":"2024-09-11T11:01:13.419418+0000","last_active":"2024-09-11T11:04:18.092464+0000","last_peered":"2024-09-11T11:04:18.092464+0000","last_clean":"2024-09-11T11:04:18.092464+0000","last_became_active":"2024-09-11T11:01:13.415242+0000","last_became_peered":"2024-09-11T11:01:13.415242+0000","last_unstale":"2024-09-11T11:04:18.092464+0000","last_undegraded":"2024-09-11T11:04:18.092464+0000","last_fullsized":"2024-09-11T11:04:18.092464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.038597+0000","last_change":"2024-09-11T11:01:05.348021+0000","last_active":"2024-09-11T11:03:23.038597+0000","last_peered":"2024-09-11T11:03:23.038597+0000","last_clean":"2024-09-11T11:03:23.038597+0000","last_became_active":"2024-09-11T11:01:05.347367+0000","last_became_peered":"2024-09-11T11:01:05.347367+0000","last_unstale":"2024-09-11T11:03:23.038597+0000","last_undegraded":"2024-09-11T11:03:23.038597+0000","last_fullsized":"2024-09-11T11:03:23.038597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.035966+0000","last_change":"2024-09-11T11:01:03.349349+0000","last_active":"2024-09-11T11:03:18.035966+0000","last_peered":"2024-09-11T11:03:18.035966+0000","last_clean":"2024-09-11T11:03:18.035966+0000","last_became_active":"2024-09-11T11:01:03.349051+0000","last_became_peered":"2024-09-11T11:01:03.349051+0000","last_unstale":"2024-09-11T11:03:18.035966+0000","last_undegraded":"2024-09-11T11:03:18.035966+0000","last_fullsized":"2024-09-11T11:03:18.035966+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.035283+0000","last_change":"2024-09-11T11:01:07.345118+0000","last_active":"2024-09-11T11:03:23.035283+0000","last_peered":"2024-09-11T11:03:23.035283+0000","last_clean":"2024-09-11T11:03:23.035283+0000","last_became_active":"2024-09-11T11:01:07.344509+0000","last_became_peered":"2024-09-11T11:01:07.344509+0000","last_unstale":"2024-09-11T11:03:23.035283+0000","last_undegraded":"2024-09-11T11:03:23.035283+0000","last_fullsized":"2024-09-11T11:03:23.035283+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.481608+0000","last_change":"2024-09-11T11:05:06.481681+0000","last_active":"2024-09-11T11:05:06.481608+0000","last_peered":"2024-09-11T11:05:06.481608+0000","last_clean":"2024-09-11T11:05:06.481608+0000","last_became_active":"2024-09-11T11:01:09.376576+0000","last_became_peered":"2024-09-11T11:01:09.376576+0000","last_unstale":"2024-09-11T11:05:06.481608+0000","last_undegraded":"2024-09-11T11:05:06.481608+0000","last_fullsized":"2024-09-11T11:05:06.481608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-11T11:05:06.481402+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-11T11:05:06.481402+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.481402+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:17:29.713697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.760451+0000","last_change":"2024-09-11T11:05:05.760504+0000","last_active":"2024-09-11T11:05:05.760451+0000","last_peered":"2024-09-11T11:05:05.760451+0000","last_clean":"2024-09-11T11:05:05.760451+0000","last_became_active":"2024-09-11T11:01:11.394215+0000","last_became_peered":"2024-09-11T11:01:11.394215+0000","last_unstale":"2024-09-11T11:05:05.760451+0000","last_undegraded":"2024-09-11T11:05:05.760451+0000","last_fullsized":"2024-09-11T11:05:05.760451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:05.760254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:05.760254+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.760254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:50:59.140410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'7","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.031291+0000","last_change":"2024-09-11T11:01:13.391142+0000","last_active":"2024-09-11T11:04:18.031291+0000","last_peered":"2024-09-11T11:04:18.031291+0000","last_clean":"2024-09-11T11:04:18.031291+0000","last_became_active":"2024-09-11T11:01:13.390538+0000","last_became_peered":"2024-09-11T11:01:13.390538+0000","last_unstale":"2024-09-11T11:04:18.031291+0000","last_undegraded":"2024-09-11T11:04:18.031291+0000","last_fullsized":"2024-09-11T11:04:18.031291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038682+0000","last_change":"2024-09-11T11:01:05.332887+0000","last_active":"2024-09-11T11:03:21.038682+0000","last_peered":"2024-09-11T11:03:21.038682+0000","last_clean":"2024-09-11T11:03:21.038682+0000","last_became_active":"2024-09-11T11:01:05.332138+0000","last_became_peered":"2024-09-11T11:01:05.332138+0000","last_unstale":"2024-09-11T11:03:21.038682+0000","last_undegraded":"2024-09-11T11:03:21.038682+0000","last_fullsized":"2024-09-11T11:03:21.038682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.037256+0000","last_change":"2024-09-11T11:01:03.321735+0000","last_active":"2024-09-11T11:03:16.037256+0000","last_peered":"2024-09-11T11:03:16.037256+0000","last_clean":"2024-09-11T11:03:16.037256+0000","last_became_active":"2024-09-11T11:01:03.320906+0000","last_became_peered":"2024-09-11T11:01:03.320906+0000","last_unstale":"2024-09-11T11:03:16.037256+0000","last_undegraded":"2024-09-11T11:03:16.037256+0000","last_fullsized":"2024-09-11T11:03:16.037256+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.038525+0000","last_change":"2024-09-11T11:01:07.367900+0000","last_active":"2024-09-11T11:03:23.038525+0000","last_peered":"2024-09-11T11:03:23.038525+0000","last_clean":"2024-09-11T11:03:23.038525+0000","last_became_active":"2024-09-11T11:01:07.367554+0000","last_became_peered":"2024-09-11T11:01:07.367554+0000","last_unstale":"2024-09-11T11:03:23.038525+0000","last_undegraded":"2024-09-11T11:03:23.038525+0000","last_fullsized":"2024-09-11T11:03:23.038525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'47","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.027454+0000","last_change":"2024-09-11T11:05:07.027543+0000","last_active":"2024-09-11T11:05:07.027454+0000","last_peered":"2024-09-11T11:05:07.027454+0000","last_clean":"2024-09-11T11:05:07.027454+0000","last_became_active":"2024-09-11T11:01:09.367246+0000","last_became_peered":"2024-09-11T11:01:09.367246+0000","last_unstale":"2024-09-11T11:05:07.027454+0000","last_undegraded":"2024-09-11T11:05:07.027454+0000","last_fullsized":"2024-09-11T11:05:07.027454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-11T11:05:07.027243+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-11T11:05:07.027243+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.027243+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:08:09.945366+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":426,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.968358+0000","last_change":"2024-09-11T11:05:02.968427+0000","last_active":"2024-09-11T11:05:02.968358+0000","last_peered":"2024-09-11T11:05:02.968358+0000","last_clean":"2024-09-11T11:05:02.968358+0000","last_became_active":"2024-09-11T11:01:11.392359+0000","last_became_peered":"2024-09-11T11:01:11.392359+0000","last_unstale":"2024-09-11T11:05:02.968358+0000","last_undegraded":"2024-09-11T11:05:02.968358+0000","last_fullsized":"2024-09-11T11:05:02.968358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:02.968136+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:02.968136+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.968136+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:59.277030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'16","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.036794+0000","last_change":"2024-09-11T11:01:13.418955+0000","last_active":"2024-09-11T11:04:18.036794+0000","last_peered":"2024-09-11T11:04:18.036794+0000","last_clean":"2024-09-11T11:04:18.036794+0000","last_became_active":"2024-09-11T11:01:13.415115+0000","last_became_peered":"2024-09-11T11:01:13.415115+0000","last_unstale":"2024-09-11T11:04:18.036794+0000","last_undegraded":"2024-09-11T11:04:18.036794+0000","last_fullsized":"2024-09-11T11:04:18.036794+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'8","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.788166+0000","last_change":"2024-09-11T11:01:05.337583+0000","last_active":"2024-09-11T11:04:17.788166+0000","last_peered":"2024-09-11T11:04:17.788166+0000","last_clean":"2024-09-11T11:04:17.788166+0000","last_became_active":"2024-09-11T11:01:05.337055+0000","last_became_peered":"2024-09-11T11:01:05.337055+0000","last_unstale":"2024-09-11T11:04:17.788166+0000","last_undegraded":"2024-09-11T11:04:17.788166+0000","last_fullsized":"2024-09-11T11:04:17.788166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.749493+0000","last_change":"2024-09-11T11:01:03.336594+0000","last_active":"2024-09-11T11:04:17.749493+0000","last_peered":"2024-09-11T11:04:17.749493+0000","last_clean":"2024-09-11T11:04:17.749493+0000","last_became_active":"2024-09-11T11:01:03.334392+0000","last_became_peered":"2024-09-11T11:01:03.334392+0000","last_unstale":"2024-09-11T11:04:17.749493+0000","last_undegraded":"2024-09-11T11:04:17.749493+0000","last_fullsized":"2024-09-11T11:04:17.749493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.571382+0000","last_change":"2024-09-11T11:04:56.571458+0000","last_active":"2024-09-11T11:04:56.571382+0000","last_peered":"2024-09-11T11:04:56.571382+0000","last_clean":"2024-09-11T11:04:56.571382+0000","last_became_active":"2024-09-11T11:01:07.360348+0000","last_became_peered":"2024-09-11T11:01:07.360348+0000","last_unstale":"2024-09-11T11:04:56.571382+0000","last_undegraded":"2024-09-11T11:04:56.571382+0000","last_fullsized":"2024-09-11T11:04:56.571382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-11T11:04:56.571190+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-11T11:04:56.571190+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.571190+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:48.525894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.692067+0000","last_change":"2024-09-11T11:04:54.692151+0000","last_active":"2024-09-11T11:04:54.692067+0000","last_peered":"2024-09-11T11:04:54.692067+0000","last_clean":"2024-09-11T11:04:54.692067+0000","last_became_active":"2024-09-11T11:02:42.501712+0000","last_became_peered":"2024-09-11T11:02:42.501712+0000","last_unstale":"2024-09-11T11:04:54.692067+0000","last_undegraded":"2024-09-11T11:04:54.692067+0000","last_fullsized":"2024-09-11T11:04:54.692067+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-11T11:04:54.691868+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-11T11:04:54.691868+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.691868+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:58:19.231371+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":516,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.466606+0000","last_change":"2024-09-11T11:05:05.466674+0000","last_active":"2024-09-11T11:05:05.466606+0000","last_peered":"2024-09-11T11:05:05.466606+0000","last_clean":"2024-09-11T11:05:05.466606+0000","last_became_active":"2024-09-11T11:01:11.384776+0000","last_became_peered":"2024-09-11T11:01:11.384776+0000","last_unstale":"2024-09-11T11:05:05.466606+0000","last_undegraded":"2024-09-11T11:05:05.466606+0000","last_fullsized":"2024-09-11T11:05:05.466606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:05.466396+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:05.466396+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.466396+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:00:09.842981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.007762+0000","last_change":"2024-09-11T11:05:01.007820+0000","last_active":"2024-09-11T11:05:01.007762+0000","last_peered":"2024-09-11T11:05:01.007762+0000","last_clean":"2024-09-11T11:05:01.007762+0000","last_became_active":"2024-09-11T11:01:13.418296+0000","last_became_peered":"2024-09-11T11:01:13.418296+0000","last_unstale":"2024-09-11T11:05:01.007762+0000","last_undegraded":"2024-09-11T11:05:01.007762+0000","last_fullsized":"2024-09-11T11:05:01.007762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:01.007547+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:01.007547+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.007547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:55:18.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938560+0000","last_change":"2024-09-11T11:01:05.348048+0000","last_active":"2024-09-11T11:04:17.938560+0000","last_peered":"2024-09-11T11:04:17.938560+0000","last_clean":"2024-09-11T11:04:17.938560+0000","last_became_active":"2024-09-11T11:01:05.347644+0000","last_became_peered":"2024-09-11T11:01:05.347644+0000","last_unstale":"2024-09-11T11:04:17.938560+0000","last_undegraded":"2024-09-11T11:04:17.938560+0000","last_fullsized":"2024-09-11T11:04:17.938560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.034777+0000","last_change":"2024-09-11T11:01:03.349954+0000","last_active":"2024-09-11T11:03:13.034777+0000","last_peered":"2024-09-11T11:03:13.034777+0000","last_clean":"2024-09-11T11:03:13.034777+0000","last_became_active":"2024-09-11T11:01:03.349605+0000","last_became_peered":"2024-09-11T11:01:03.349605+0000","last_unstale":"2024-09-11T11:03:13.034777+0000","last_undegraded":"2024-09-11T11:03:13.034777+0000","last_fullsized":"2024-09-11T11:03:13.034777+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.037268+0000","last_change":"2024-09-11T11:01:07.355413+0000","last_active":"2024-09-11T11:03:23.037268+0000","last_peered":"2024-09-11T11:03:23.037268+0000","last_clean":"2024-09-11T11:03:23.037268+0000","last_became_active":"2024-09-11T11:01:07.351403+0000","last_became_peered":"2024-09-11T11:01:07.351403+0000","last_unstale":"2024-09-11T11:03:23.037268+0000","last_undegraded":"2024-09-11T11:03:23.037268+0000","last_fullsized":"2024-09-11T11:03:23.037268+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.534249+0000","last_change":"2024-09-11T11:05:07.534340+0000","last_active":"2024-09-11T11:05:07.534249+0000","last_peered":"2024-09-11T11:05:07.534249+0000","last_clean":"2024-09-11T11:05:07.534249+0000","last_became_active":"2024-09-11T11:01:09.376340+0000","last_became_peered":"2024-09-11T11:01:09.376340+0000","last_unstale":"2024-09-11T11:05:07.534249+0000","last_undegraded":"2024-09-11T11:05:07.534249+0000","last_fullsized":"2024-09-11T11:05:07.534249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-11T11:05:07.534061+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-11T11:05:07.534061+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.534061+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.271487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039876+0000","last_change":"2024-09-11T11:01:11.386915+0000","last_active":"2024-09-11T11:03:26.039876+0000","last_peered":"2024-09-11T11:03:26.039876+0000","last_clean":"2024-09-11T11:03:26.039876+0000","last_became_active":"2024-09-11T11:01:11.385523+0000","last_became_peered":"2024-09-11T11:01:11.385523+0000","last_unstale":"2024-09-11T11:03:26.039876+0000","last_undegraded":"2024-09-11T11:03:26.039876+0000","last_fullsized":"2024-09-11T11:03:26.039876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'7","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.876177+0000","last_change":"2024-09-11T11:05:05.876239+0000","last_active":"2024-09-11T11:05:05.876177+0000","last_peered":"2024-09-11T11:05:05.876177+0000","last_clean":"2024-09-11T11:05:05.876177+0000","last_became_active":"2024-09-11T11:01:13.403125+0000","last_became_peered":"2024-09-11T11:01:13.403125+0000","last_unstale":"2024-09-11T11:05:05.876177+0000","last_undegraded":"2024-09-11T11:05:05.876177+0000","last_fullsized":"2024-09-11T11:05:05.876177+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-11T11:05:05.875973+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-11T11:05:05.875973+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.875973+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:59.171520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'22","reported_seq":82,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.872981+0000","last_change":"2024-09-11T11:01:05.346169+0000","last_active":"2024-09-11T11:04:17.872981+0000","last_peered":"2024-09-11T11:04:17.872981+0000","last_clean":"2024-09-11T11:04:17.872981+0000","last_became_active":"2024-09-11T11:01:05.345474+0000","last_became_peered":"2024-09-11T11:01:05.345474+0000","last_unstale":"2024-09-11T11:04:17.872981+0000","last_undegraded":"2024-09-11T11:04:17.872981+0000","last_fullsized":"2024-09-11T11:04:17.872981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881089+0000","last_change":"2024-09-11T11:00:51.371382+0000","last_active":"2024-09-11T11:04:52.881089+0000","last_peered":"2024-09-11T11:04:52.881089+0000","last_clean":"2024-09-11T11:04:52.881089+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:04:52.881089+0000","last_undegraded":"2024-09-11T11:04:52.881089+0000","last_fullsized":"2024-09-11T11:04:52.881089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_clean_scrub_stamp":"2024-09-11T11:00:49.442581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439117+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:04:52.439117+0000","last_peered":"2024-09-11T11:04:52.439117+0000","last_clean":"2024-09-11T11:04:52.439117+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:04:52.439117+0000","last_undegraded":"2024-09-11T11:04:52.439117+0000","last_fullsized":"2024-09-11T11:04:52.439117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.033959+0000","last_change":"2024-09-11T11:01:03.345152+0000","last_active":"2024-09-11T11:03:08.033959+0000","last_peered":"2024-09-11T11:03:08.033959+0000","last_clean":"2024-09-11T11:03:08.033959+0000","last_became_active":"2024-09-11T11:01:03.334611+0000","last_became_peered":"2024-09-11T11:01:03.334611+0000","last_unstale":"2024-09-11T11:03:08.033959+0000","last_undegraded":"2024-09-11T11:03:08.033959+0000","last_fullsized":"2024-09-11T11:03:08.033959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.036165+0000","last_change":"2024-09-11T11:01:07.352085+0000","last_active":"2024-09-11T11:03:13.036165+0000","last_peered":"2024-09-11T11:03:13.036165+0000","last_clean":"2024-09-11T11:03:13.036165+0000","last_became_active":"2024-09-11T11:01:07.348530+0000","last_became_peered":"2024-09-11T11:01:07.348530+0000","last_unstale":"2024-09-11T11:03:13.036165+0000","last_undegraded":"2024-09-11T11:03:13.036165+0000","last_fullsized":"2024-09-11T11:03:13.036165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'85","reported_seq":171,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.257843+0000","last_change":"2024-09-11T11:01:09.370703+0000","last_active":"2024-09-11T11:04:49.257843+0000","last_peered":"2024-09-11T11:04:49.257843+0000","last_clean":"2024-09-11T11:04:49.257843+0000","last_became_active":"2024-09-11T11:01:09.369066+0000","last_became_peered":"2024-09-11T11:01:09.369066+0000","last_unstale":"2024-09-11T11:04:49.257843+0000","last_undegraded":"2024-09-11T11:04:49.257843+0000","last_fullsized":"2024-09-11T11:04:49.257843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.727459+0000","last_change":"2024-09-11T11:05:04.727517+0000","last_active":"2024-09-11T11:05:04.727459+0000","last_peered":"2024-09-11T11:05:04.727459+0000","last_clean":"2024-09-11T11:05:04.727459+0000","last_became_active":"2024-09-11T11:01:11.394277+0000","last_became_peered":"2024-09-11T11:01:11.394277+0000","last_unstale":"2024-09-11T11:05:04.727459+0000","last_undegraded":"2024-09-11T11:05:04.727459+0000","last_fullsized":"2024-09-11T11:05:04.727459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:04.727229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:04.727229+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.727229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:14.507545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":176,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.089564+0000","last_change":"2024-09-11T11:04:55.089631+0000","last_active":"2024-09-11T11:04:55.089564+0000","last_peered":"2024-09-11T11:04:55.089564+0000","last_clean":"2024-09-11T11:04:55.089564+0000","last_became_active":"2024-09-11T11:01:13.412615+0000","last_became_peered":"2024-09-11T11:01:13.412615+0000","last_unstale":"2024-09-11T11:04:55.089564+0000","last_undegraded":"2024-09-11T11:04:55.089564+0000","last_fullsized":"2024-09-11T11:04:55.089564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-11T11:04:55.089351+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-11T11:04:55.089351+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.089351+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:06.508319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.872367+0000","last_change":"2024-09-11T11:01:05.348037+0000","last_active":"2024-09-11T11:04:17.872367+0000","last_peered":"2024-09-11T11:04:17.872367+0000","last_clean":"2024-09-11T11:04:17.872367+0000","last_became_active":"2024-09-11T11:01:05.346710+0000","last_became_peered":"2024-09-11T11:01:05.346710+0000","last_unstale":"2024-09-11T11:04:17.872367+0000","last_undegraded":"2024-09-11T11:04:17.872367+0000","last_fullsized":"2024-09-11T11:04:17.872367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439050+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:04:52.439050+0000","last_peered":"2024-09-11T11:04:52.439050+0000","last_clean":"2024-09-11T11:04:52.439050+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:04:52.439050+0000","last_undegraded":"2024-09-11T11:04:52.439050+0000","last_fullsized":"2024-09-11T11:04:52.439050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.035226+0000","last_change":"2024-09-11T11:01:03.326592+0000","last_active":"2024-09-11T11:03:08.035226+0000","last_peered":"2024-09-11T11:03:08.035226+0000","last_clean":"2024-09-11T11:03:08.035226+0000","last_became_active":"2024-09-11T11:01:03.325795+0000","last_became_peered":"2024-09-11T11:01:03.325795+0000","last_unstale":"2024-09-11T11:03:08.035226+0000","last_undegraded":"2024-09-11T11:03:08.035226+0000","last_fullsized":"2024-09-11T11:03:08.035226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.500445+0000","last_change":"2024-09-11T11:04:52.500469+0000","last_active":"2024-09-11T11:04:52.500445+0000","last_peered":"2024-09-11T11:04:52.500445+0000","last_clean":"2024-09-11T11:04:52.500445+0000","last_became_active":"2024-09-11T11:01:07.360718+0000","last_became_peered":"2024-09-11T11:01:07.360718+0000","last_unstale":"2024-09-11T11:04:52.500445+0000","last_undegraded":"2024-09-11T11:04:52.500445+0000","last_fullsized":"2024-09-11T11:04:52.500445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:52.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:52.500353+0000","last_clean_scrub_stamp":"2024-09-11T11:04:52.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:05.966274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":520,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.939424+0000","last_change":"2024-09-11T11:05:03.939512+0000","last_active":"2024-09-11T11:05:03.939424+0000","last_peered":"2024-09-11T11:05:03.939424+0000","last_clean":"2024-09-11T11:05:03.939424+0000","last_became_active":"2024-09-11T11:01:09.376555+0000","last_became_peered":"2024-09-11T11:01:09.376555+0000","last_unstale":"2024-09-11T11:05:03.939424+0000","last_undegraded":"2024-09-11T11:05:03.939424+0000","last_fullsized":"2024-09-11T11:05:03.939424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-11T11:05:03.939238+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-11T11:05:03.939238+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.939238+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:17.488538+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.036059+0000","last_change":"2024-09-11T11:01:11.400937+0000","last_active":"2024-09-11T11:03:18.036059+0000","last_peered":"2024-09-11T11:03:18.036059+0000","last_clean":"2024-09-11T11:03:18.036059+0000","last_became_active":"2024-09-11T11:01:11.400253+0000","last_became_peered":"2024-09-11T11:01:11.400253+0000","last_unstale":"2024-09-11T11:03:18.036059+0000","last_undegraded":"2024-09-11T11:03:18.036059+0000","last_fullsized":"2024-09-11T11:03:18.036059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'11","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.038454+0000","last_change":"2024-09-11T11:01:13.422211+0000","last_active":"2024-09-11T11:03:23.038454+0000","last_peered":"2024-09-11T11:03:23.038454+0000","last_clean":"2024-09-11T11:03:23.038454+0000","last_became_active":"2024-09-11T11:01:13.421491+0000","last_became_peered":"2024-09-11T11:01:13.421491+0000","last_unstale":"2024-09-11T11:03:23.038454+0000","last_undegraded":"2024-09-11T11:03:23.038454+0000","last_fullsized":"2024-09-11T11:03:23.038454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.458999+0000","last_change":"2024-09-11T11:01:05.347801+0000","last_active":"2024-09-11T11:04:17.458999+0000","last_peered":"2024-09-11T11:04:17.458999+0000","last_clean":"2024-09-11T11:04:17.458999+0000","last_became_active":"2024-09-11T11:01:05.347359+0000","last_became_peered":"2024-09-11T11:01:05.347359+0000","last_unstale":"2024-09-11T11:04:17.458999+0000","last_undegraded":"2024-09-11T11:04:17.458999+0000","last_fullsized":"2024-09-11T11:04:17.458999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.325928+0000","last_change":"2024-09-11T11:00:56.127438+0000","last_active":"2024-09-11T11:04:53.325928+0000","last_peered":"2024-09-11T11:04:53.325928+0000","last_clean":"2024-09-11T11:04:53.325928+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:04:53.325928+0000","last_undegraded":"2024-09-11T11:04:53.325928+0000","last_fullsized":"2024-09-11T11:04:53.325928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881055+0000","last_change":"2024-09-11T11:01:03.325786+0000","last_active":"2024-09-11T11:04:52.881055+0000","last_peered":"2024-09-11T11:04:52.881055+0000","last_clean":"2024-09-11T11:04:52.881055+0000","last_became_active":"2024-09-11T11:01:03.325168+0000","last_became_peered":"2024-09-11T11:01:03.325168+0000","last_unstale":"2024-09-11T11:04:52.881055+0000","last_undegraded":"2024-09-11T11:04:52.881055+0000","last_fullsized":"2024-09-11T11:04:52.881055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'2","reported_seq":226,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:48.905328+0000","last_change":"2024-09-11T11:01:07.348097+0000","last_active":"2024-09-11T11:04:48.905328+0000","last_peered":"2024-09-11T11:04:48.905328+0000","last_clean":"2024-09-11T11:04:48.905328+0000","last_became_active":"2024-09-11T11:01:07.345998+0000","last_became_peered":"2024-09-11T11:01:07.345998+0000","last_unstale":"2024-09-11T11:04:48.905328+0000","last_undegraded":"2024-09-11T11:04:48.905328+0000","last_fullsized":"2024-09-11T11:04:48.905328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'25","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.622084+0000","last_change":"2024-09-11T11:05:10.622163+0000","last_active":"2024-09-11T11:05:10.622084+0000","last_peered":"2024-09-11T11:05:10.622084+0000","last_clean":"2024-09-11T11:05:10.622084+0000","last_became_active":"2024-09-11T11:01:09.371816+0000","last_became_peered":"2024-09-11T11:01:09.371816+0000","last_unstale":"2024-09-11T11:05:10.622084+0000","last_undegraded":"2024-09-11T11:05:10.622084+0000","last_fullsized":"2024-09-11T11:05:10.622084+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'25","last_scrub_stamp":"2024-09-11T11:05:10.621907+0000","last_deep_scrub":"36'25","last_deep_scrub_stamp":"2024-09-11T11:05:10.621907+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.621907+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:01:58.193453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.900879+0000","last_change":"2024-09-11T11:04:56.900932+0000","last_active":"2024-09-11T11:04:56.900879+0000","last_peered":"2024-09-11T11:04:56.900879+0000","last_clean":"2024-09-11T11:04:56.900879+0000","last_became_active":"2024-09-11T11:01:11.392208+0000","last_became_peered":"2024-09-11T11:01:11.392208+0000","last_unstale":"2024-09-11T11:04:56.900879+0000","last_undegraded":"2024-09-11T11:04:56.900879+0000","last_fullsized":"2024-09-11T11:04:56.900879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:56.900687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:56.900687+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.900687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:38.581779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.038485+0000","last_change":"2024-09-11T11:01:13.408511+0000","last_active":"2024-09-11T11:03:28.038485+0000","last_peered":"2024-09-11T11:03:28.038485+0000","last_clean":"2024-09-11T11:03:28.038485+0000","last_became_active":"2024-09-11T11:01:13.406863+0000","last_became_peered":"2024-09-11T11:01:13.406863+0000","last_unstale":"2024-09-11T11:03:28.038485+0000","last_undegraded":"2024-09-11T11:03:28.038485+0000","last_fullsized":"2024-09-11T11:03:28.038485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.036188+0000","last_change":"2024-09-11T11:01:05.333748+0000","last_active":"2024-09-11T11:03:13.036188+0000","last_peered":"2024-09-11T11:03:13.036188+0000","last_clean":"2024-09-11T11:03:13.036188+0000","last_became_active":"2024-09-11T11:01:05.332361+0000","last_became_peered":"2024-09-11T11:01:05.332361+0000","last_unstale":"2024-09-11T11:03:13.036188+0000","last_undegraded":"2024-09-11T11:03:13.036188+0000","last_fullsized":"2024-09-11T11:03:13.036188+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439078+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:04:52.439078+0000","last_peered":"2024-09-11T11:04:52.439078+0000","last_clean":"2024-09-11T11:04:52.439078+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:04:52.439078+0000","last_undegraded":"2024-09-11T11:04:52.439078+0000","last_fullsized":"2024-09-11T11:04:52.439078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:11.036006+0000","last_change":"2024-09-11T11:01:03.328169+0000","last_active":"2024-09-11T11:03:11.036006+0000","last_peered":"2024-09-11T11:03:11.036006+0000","last_clean":"2024-09-11T11:03:11.036006+0000","last_became_active":"2024-09-11T11:01:03.327456+0000","last_became_peered":"2024-09-11T11:01:03.327456+0000","last_unstale":"2024-09-11T11:03:11.036006+0000","last_undegraded":"2024-09-11T11:03:11.036006+0000","last_fullsized":"2024-09-11T11:03:11.036006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.856444+0000","last_change":"2024-09-11T11:05:07.856498+0000","last_active":"2024-09-11T11:05:07.856444+0000","last_peered":"2024-09-11T11:05:07.856444+0000","last_clean":"2024-09-11T11:05:07.856444+0000","last_became_active":"2024-09-11T11:01:07.367962+0000","last_became_peered":"2024-09-11T11:01:07.367962+0000","last_unstale":"2024-09-11T11:05:07.856444+0000","last_undegraded":"2024-09-11T11:05:07.856444+0000","last_fullsized":"2024-09-11T11:05:07.856444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:07.856251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:07.856251+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.856251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:42.576844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'14","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:16.889817+0000","last_change":"2024-09-11T11:01:09.390513+0000","last_active":"2024-09-11T11:04:16.889817+0000","last_peered":"2024-09-11T11:04:16.889817+0000","last_clean":"2024-09-11T11:04:16.889817+0000","last_became_active":"2024-09-11T11:01:09.389732+0000","last_became_peered":"2024-09-11T11:01:09.389732+0000","last_unstale":"2024-09-11T11:04:16.889817+0000","last_undegraded":"2024-09-11T11:04:16.889817+0000","last_fullsized":"2024-09-11T11:04:16.889817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.037322+0000","last_change":"2024-09-11T11:01:11.398218+0000","last_active":"2024-09-11T11:03:23.037322+0000","last_peered":"2024-09-11T11:03:23.037322+0000","last_clean":"2024-09-11T11:03:23.037322+0000","last_became_active":"2024-09-11T11:01:11.397467+0000","last_became_peered":"2024-09-11T11:01:11.397467+0000","last_unstale":"2024-09-11T11:03:23.037322+0000","last_undegraded":"2024-09-11T11:03:23.037322+0000","last_fullsized":"2024-09-11T11:03:23.037322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.106855+0000","last_change":"2024-09-11T11:01:13.418703+0000","last_active":"2024-09-11T11:04:18.106855+0000","last_peered":"2024-09-11T11:04:18.106855+0000","last_clean":"2024-09-11T11:04:18.106855+0000","last_became_active":"2024-09-11T11:01:13.414898+0000","last_became_peered":"2024-09-11T11:01:13.414898+0000","last_unstale":"2024-09-11T11:04:18.106855+0000","last_undegraded":"2024-09-11T11:04:18.106855+0000","last_fullsized":"2024-09-11T11:04:18.106855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.786976+0000","last_change":"2024-09-11T11:01:05.343143+0000","last_active":"2024-09-11T11:04:17.786976+0000","last_peered":"2024-09-11T11:04:17.786976+0000","last_clean":"2024-09-11T11:04:17.786976+0000","last_became_active":"2024-09-11T11:01:05.342651+0000","last_became_peered":"2024-09-11T11:01:05.342651+0000","last_unstale":"2024-09-11T11:04:17.786976+0000","last_undegraded":"2024-09-11T11:04:17.786976+0000","last_fullsized":"2024-09-11T11:04:17.786976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:11.036091+0000","last_change":"2024-09-11T11:01:03.338569+0000","last_active":"2024-09-11T11:03:11.036091+0000","last_peered":"2024-09-11T11:03:11.036091+0000","last_clean":"2024-09-11T11:03:11.036091+0000","last_became_active":"2024-09-11T11:01:03.336412+0000","last_became_peered":"2024-09-11T11:01:03.336412+0000","last_unstale":"2024-09-11T11:03:11.036091+0000","last_undegraded":"2024-09-11T11:03:11.036091+0000","last_fullsized":"2024-09-11T11:03:11.036091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881049+0000","last_change":"2024-09-11T11:00:55.878837+0000","last_active":"2024-09-11T11:04:52.881049+0000","last_peered":"2024-09-11T11:04:52.881049+0000","last_clean":"2024-09-11T11:04:52.881049+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:04:52.881049+0000","last_undegraded":"2024-09-11T11:04:52.881049+0000","last_fullsized":"2024-09-11T11:04:52.881049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'1","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:48.905874+0000","last_change":"2024-09-11T11:01:07.359762+0000","last_active":"2024-09-11T11:04:48.905874+0000","last_peered":"2024-09-11T11:04:48.905874+0000","last_clean":"2024-09-11T11:04:48.905874+0000","last_became_active":"2024-09-11T11:01:07.359228+0000","last_became_peered":"2024-09-11T11:01:07.359228+0000","last_unstale":"2024-09-11T11:04:48.905874+0000","last_undegraded":"2024-09-11T11:04:48.905874+0000","last_fullsized":"2024-09-11T11:04:48.905874+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'75","reported_seq":155,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.920288+0000","last_change":"2024-09-11T11:04:53.920380+0000","last_active":"2024-09-11T11:04:53.920288+0000","last_peered":"2024-09-11T11:04:53.920288+0000","last_clean":"2024-09-11T11:04:53.920288+0000","last_became_active":"2024-09-11T11:01:09.360676+0000","last_became_peered":"2024-09-11T11:01:09.360676+0000","last_unstale":"2024-09-11T11:04:53.920288+0000","last_undegraded":"2024-09-11T11:04:53.920288+0000","last_fullsized":"2024-09-11T11:04:53.920288+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'75","last_scrub_stamp":"2024-09-11T11:04:53.920094+0000","last_deep_scrub":"36'75","last_deep_scrub_stamp":"2024-09-11T11:04:53.920094+0000","last_clean_scrub_stamp":"2024-09-11T11:04:53.920094+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:28:47.374212+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.573826+0000","last_change":"2024-09-11T11:05:09.573879+0000","last_active":"2024-09-11T11:05:09.573826+0000","last_peered":"2024-09-11T11:05:09.573826+0000","last_clean":"2024-09-11T11:05:09.573826+0000","last_became_active":"2024-09-11T11:01:11.384826+0000","last_became_peered":"2024-09-11T11:01:11.384826+0000","last_unstale":"2024-09-11T11:05:09.573826+0000","last_undegraded":"2024-09-11T11:05:09.573826+0000","last_fullsized":"2024-09-11T11:05:09.573826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:09.573632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:09.573632+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.573632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:05.190454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036378+0000","last_change":"2024-09-11T11:01:13.422273+0000","last_active":"2024-09-11T11:03:28.036378+0000","last_peered":"2024-09-11T11:03:28.036378+0000","last_clean":"2024-09-11T11:03:28.036378+0000","last_became_active":"2024-09-11T11:01:13.421181+0000","last_became_peered":"2024-09-11T11:01:13.421181+0000","last_unstale":"2024-09-11T11:03:28.036378+0000","last_undegraded":"2024-09-11T11:03:28.036378+0000","last_fullsized":"2024-09-11T11:03:28.036378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'6","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.872757+0000","last_change":"2024-09-11T11:01:05.354294+0000","last_active":"2024-09-11T11:04:17.872757+0000","last_peered":"2024-09-11T11:04:17.872757+0000","last_clean":"2024-09-11T11:04:17.872757+0000","last_became_active":"2024-09-11T11:01:05.353896+0000","last_became_peered":"2024-09-11T11:01:05.353896+0000","last_unstale":"2024-09-11T11:04:17.872757+0000","last_undegraded":"2024-09-11T11:04:17.872757+0000","last_fullsized":"2024-09-11T11:04:17.872757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.035324+0000","last_change":"2024-09-11T11:01:03.325763+0000","last_active":"2024-09-11T11:03:08.035324+0000","last_peered":"2024-09-11T11:03:08.035324+0000","last_clean":"2024-09-11T11:03:08.035324+0000","last_became_active":"2024-09-11T11:01:03.324923+0000","last_became_peered":"2024-09-11T11:01:03.324923+0000","last_unstale":"2024-09-11T11:03:08.035324+0000","last_undegraded":"2024-09-11T11:03:08.035324+0000","last_fullsized":"2024-09-11T11:03:08.035324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439091+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:04:52.439091+0000","last_peered":"2024-09-11T11:04:52.439091+0000","last_clean":"2024-09-11T11:04:52.439091+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:04:52.439091+0000","last_undegraded":"2024-09-11T11:04:52.439091+0000","last_fullsized":"2024-09-11T11:04:52.439091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.566704+0000","last_change":"2024-09-11T11:04:54.566765+0000","last_active":"2024-09-11T11:04:54.566704+0000","last_peered":"2024-09-11T11:04:54.566704+0000","last_clean":"2024-09-11T11:04:54.566704+0000","last_became_active":"2024-09-11T11:01:07.360208+0000","last_became_peered":"2024-09-11T11:01:07.360208+0000","last_unstale":"2024-09-11T11:04:54.566704+0000","last_undegraded":"2024-09-11T11:04:54.566704+0000","last_fullsized":"2024-09-11T11:04:54.566704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.566514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.566514+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.566514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:47.862061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.895883+0000","last_change":"2024-09-11T11:05:02.895963+0000","last_active":"2024-09-11T11:05:02.895883+0000","last_peered":"2024-09-11T11:05:02.895883+0000","last_clean":"2024-09-11T11:05:02.895883+0000","last_became_active":"2024-09-11T11:01:09.382364+0000","last_became_peered":"2024-09-11T11:01:09.382364+0000","last_unstale":"2024-09-11T11:05:02.895883+0000","last_undegraded":"2024-09-11T11:05:02.895883+0000","last_fullsized":"2024-09-11T11:05:02.895883+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:02.895625+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:02.895625+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.895625+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:58.883525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":363,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.863585+0000","last_change":"2024-09-11T11:04:57.863644+0000","last_active":"2024-09-11T11:04:57.863585+0000","last_peered":"2024-09-11T11:04:57.863585+0000","last_clean":"2024-09-11T11:04:57.863585+0000","last_became_active":"2024-09-11T11:01:11.395016+0000","last_became_peered":"2024-09-11T11:01:11.395016+0000","last_unstale":"2024-09-11T11:04:57.863585+0000","last_undegraded":"2024-09-11T11:04:57.863585+0000","last_fullsized":"2024-09-11T11:04:57.863585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:04:57.863404+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:04:57.863404+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.863404+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:48.423461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.931466+0000","last_change":"2024-09-11T11:01:13.423655+0000","last_active":"2024-09-11T11:04:17.931466+0000","last_peered":"2024-09-11T11:04:17.931466+0000","last_clean":"2024-09-11T11:04:17.931466+0000","last_became_active":"2024-09-11T11:01:13.422825+0000","last_became_peered":"2024-09-11T11:01:13.422825+0000","last_unstale":"2024-09-11T11:04:17.931466+0000","last_undegraded":"2024-09-11T11:04:17.931466+0000","last_fullsized":"2024-09-11T11:04:17.931466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'12","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:43.039733+0000","last_change":"2024-09-11T11:01:42.069205+0000","last_active":"2024-09-11T11:03:43.039733+0000","last_peered":"2024-09-11T11:03:43.039733+0000","last_clean":"2024-09-11T11:03:43.039733+0000","last_became_active":"2024-09-11T11:01:42.049256+0000","last_became_peered":"2024-09-11T11:01:42.049256+0000","last_unstale":"2024-09-11T11:03:43.039733+0000","last_undegraded":"2024-09-11T11:03:43.039733+0000","last_fullsized":"2024-09-11T11:03:43.039733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.756249+0000","last_change":"2024-09-11T11:01:03.351057+0000","last_active":"2024-09-11T11:04:17.756249+0000","last_peered":"2024-09-11T11:04:17.756249+0000","last_clean":"2024-09-11T11:04:17.756249+0000","last_became_active":"2024-09-11T11:01:03.349487+0000","last_became_peered":"2024-09-11T11:01:03.349487+0000","last_unstale":"2024-09-11T11:04:17.756249+0000","last_undegraded":"2024-09-11T11:04:17.756249+0000","last_fullsized":"2024-09-11T11:04:17.756249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:03.034144+0000","last_change":"2024-09-11T11:00:55.878899+0000","last_active":"2024-09-11T11:03:03.034144+0000","last_peered":"2024-09-11T11:03:03.034144+0000","last_clean":"2024-09-11T11:03:03.034144+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:03:03.034144+0000","last_undegraded":"2024-09-11T11:03:03.034144+0000","last_fullsized":"2024-09-11T11:03:03.034144+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.474641+0000","last_change":"2024-09-11T11:05:00.474692+0000","last_active":"2024-09-11T11:05:00.474641+0000","last_peered":"2024-09-11T11:05:00.474641+0000","last_clean":"2024-09-11T11:05:00.474641+0000","last_became_active":"2024-09-11T11:01:07.344021+0000","last_became_peered":"2024-09-11T11:01:07.344021+0000","last_unstale":"2024-09-11T11:05:00.474641+0000","last_undegraded":"2024-09-11T11:05:00.474641+0000","last_fullsized":"2024-09-11T11:05:00.474641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.474433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.474433+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.474433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:50:53.854590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.695880+0000","last_change":"2024-09-11T11:04:56.695956+0000","last_active":"2024-09-11T11:04:56.695880+0000","last_peered":"2024-09-11T11:04:56.695880+0000","last_clean":"2024-09-11T11:04:56.695880+0000","last_became_active":"2024-09-11T11:01:09.379372+0000","last_became_peered":"2024-09-11T11:01:09.379372+0000","last_unstale":"2024-09-11T11:04:56.695880+0000","last_undegraded":"2024-09-11T11:04:56.695880+0000","last_fullsized":"2024-09-11T11:04:56.695880+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:04:56.695654+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:04:56.695654+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.695654+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:10.244955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'285","reported_seq":426,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.312862+0000","last_change":"2024-09-11T11:01:11.404411+0000","last_active":"2024-09-11T11:04:49.312862+0000","last_peered":"2024-09-11T11:04:49.312862+0000","last_clean":"2024-09-11T11:04:49.312862+0000","last_became_active":"2024-09-11T11:01:11.403355+0000","last_became_peered":"2024-09-11T11:01:11.403355+0000","last_unstale":"2024-09-11T11:04:49.312862+0000","last_undegraded":"2024-09-11T11:04:49.312862+0000","last_fullsized":"2024-09-11T11:04:49.312862+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.039868+0000","last_change":"2024-09-11T11:01:13.420938+0000","last_active":"2024-09-11T11:03:28.039868+0000","last_peered":"2024-09-11T11:03:28.039868+0000","last_clean":"2024-09-11T11:03:28.039868+0000","last_became_active":"2024-09-11T11:01:13.415413+0000","last_became_peered":"2024-09-11T11:01:13.415413+0000","last_unstale":"2024-09-11T11:03:28.039868+0000","last_undegraded":"2024-09-11T11:03:28.039868+0000","last_fullsized":"2024-09-11T11:03:28.039868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'13","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.021977+0000","last_change":"2024-09-11T11:01:05.339012+0000","last_active":"2024-09-11T11:04:18.021977+0000","last_peered":"2024-09-11T11:04:18.021977+0000","last_clean":"2024-09-11T11:04:18.021977+0000","last_became_active":"2024-09-11T11:01:05.338465+0000","last_became_peered":"2024-09-11T11:01:05.338465+0000","last_unstale":"2024-09-11T11:04:18.021977+0000","last_undegraded":"2024-09-11T11:04:18.021977+0000","last_fullsized":"2024-09-11T11:04:18.021977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.079649+0000","last_change":"2024-09-11T11:01:03.327083+0000","last_active":"2024-09-11T11:04:49.079649+0000","last_peered":"2024-09-11T11:04:49.079649+0000","last_clean":"2024-09-11T11:04:49.079649+0000","last_became_active":"2024-09-11T11:01:03.325009+0000","last_became_peered":"2024-09-11T11:01:03.325009+0000","last_unstale":"2024-09-11T11:04:49.079649+0000","last_undegraded":"2024-09-11T11:04:49.079649+0000","last_fullsized":"2024-09-11T11:04:49.079649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:06.035023+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:03:06.035023+0000","last_peered":"2024-09-11T11:03:06.035023+0000","last_clean":"2024-09-11T11:03:06.035023+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:03:06.035023+0000","last_undegraded":"2024-09-11T11:03:06.035023+0000","last_fullsized":"2024-09-11T11:03:06.035023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.729363+0000","last_change":"2024-09-11T11:05:03.729363+0000","last_active":"2024-09-11T11:05:03.729363+0000","last_peered":"2024-09-11T11:05:03.729363+0000","last_clean":"2024-09-11T11:05:03.729363+0000","last_became_active":"2024-09-11T11:01:07.363499+0000","last_became_peered":"2024-09-11T11:01:07.363499+0000","last_unstale":"2024-09-11T11:05:03.729363+0000","last_undegraded":"2024-09-11T11:05:03.729363+0000","last_fullsized":"2024-09-11T11:05:03.729363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:03.729049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:03.729049+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.729049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:46:05.674496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'91","reported_seq":180,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.132867+0000","last_change":"2024-09-11T11:01:09.372054+0000","last_active":"2024-09-11T11:04:49.132867+0000","last_peered":"2024-09-11T11:04:49.132867+0000","last_clean":"2024-09-11T11:04:49.132867+0000","last_became_active":"2024-09-11T11:01:09.371312+0000","last_became_peered":"2024-09-11T11:01:09.371312+0000","last_unstale":"2024-09-11T11:04:49.132867+0000","last_undegraded":"2024-09-11T11:04:49.132867+0000","last_fullsized":"2024-09-11T11:04:49.132867+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.747221+0000","last_change":"2024-09-11T11:05:07.747278+0000","last_active":"2024-09-11T11:05:07.747221+0000","last_peered":"2024-09-11T11:05:07.747221+0000","last_clean":"2024-09-11T11:05:07.747221+0000","last_became_active":"2024-09-11T11:01:11.383342+0000","last_became_peered":"2024-09-11T11:01:11.383342+0000","last_unstale":"2024-09-11T11:05:07.747221+0000","last_undegraded":"2024-09-11T11:05:07.747221+0000","last_fullsized":"2024-09-11T11:05:07.747221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:07.747023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:07.747023+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.747023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:47.852841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.101666+0000","last_change":"2024-09-11T11:04:54.101719+0000","last_active":"2024-09-11T11:04:54.101666+0000","last_peered":"2024-09-11T11:04:54.101666+0000","last_clean":"2024-09-11T11:04:54.101666+0000","last_became_active":"2024-09-11T11:01:13.413156+0000","last_became_peered":"2024-09-11T11:01:13.413156+0000","last_unstale":"2024-09-11T11:04:54.101666+0000","last_undegraded":"2024-09-11T11:04:54.101666+0000","last_fullsized":"2024-09-11T11:04:54.101666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.101491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.101491+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.101491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:08.443409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.084033+0000","last_change":"2024-09-11T11:04:57.084086+0000","last_active":"2024-09-11T11:04:57.084033+0000","last_peered":"2024-09-11T11:04:57.084033+0000","last_clean":"2024-09-11T11:04:57.084033+0000","last_became_active":"2024-09-11T11:01:13.413535+0000","last_became_peered":"2024-09-11T11:01:13.413535+0000","last_unstale":"2024-09-11T11:04:57.084033+0000","last_undegraded":"2024-09-11T11:04:57.084033+0000","last_fullsized":"2024-09-11T11:04:57.084033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:57.083842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:57.083842+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.083842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:07:45.181339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'9","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.021406+0000","last_change":"2024-09-11T11:01:05.338098+0000","last_active":"2024-09-11T11:04:18.021406+0000","last_peered":"2024-09-11T11:04:18.021406+0000","last_clean":"2024-09-11T11:04:18.021406+0000","last_became_active":"2024-09-11T11:01:05.337509+0000","last_became_peered":"2024-09-11T11:01:05.337509+0000","last_unstale":"2024-09-11T11:04:18.021406+0000","last_undegraded":"2024-09-11T11:04:18.021406+0000","last_fullsized":"2024-09-11T11:04:18.021406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039844+0000","last_change":"2024-09-11T11:01:03.321762+0000","last_active":"2024-09-11T11:03:26.039844+0000","last_peered":"2024-09-11T11:03:26.039844+0000","last_clean":"2024-09-11T11:03:26.039844+0000","last_became_active":"2024-09-11T11:01:03.320981+0000","last_became_peered":"2024-09-11T11:01:03.320981+0000","last_unstale":"2024-09-11T11:03:26.039844+0000","last_undegraded":"2024-09-11T11:03:26.039844+0000","last_fullsized":"2024-09-11T11:03:26.039844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.039780+0000","last_change":"2024-09-11T11:01:07.369265+0000","last_active":"2024-09-11T11:03:28.039780+0000","last_peered":"2024-09-11T11:03:28.039780+0000","last_clean":"2024-09-11T11:03:28.039780+0000","last_became_active":"2024-09-11T11:01:07.367778+0000","last_became_peered":"2024-09-11T11:01:07.367778+0000","last_unstale":"2024-09-11T11:03:28.039780+0000","last_undegraded":"2024-09-11T11:03:28.039780+0000","last_fullsized":"2024-09-11T11:03:28.039780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.666167+0000","last_change":"2024-09-11T11:04:57.666250+0000","last_active":"2024-09-11T11:04:57.666167+0000","last_peered":"2024-09-11T11:04:57.666167+0000","last_clean":"2024-09-11T11:04:57.666167+0000","last_became_active":"2024-09-11T11:01:09.369318+0000","last_became_peered":"2024-09-11T11:01:09.369318+0000","last_unstale":"2024-09-11T11:04:57.666167+0000","last_undegraded":"2024-09-11T11:04:57.666167+0000","last_fullsized":"2024-09-11T11:04:57.666167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-11T11:04:57.665979+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-11T11:04:57.665979+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.665979+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:54:56.063485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.760439+0000","last_change":"2024-09-11T11:05:06.760491+0000","last_active":"2024-09-11T11:05:06.760439+0000","last_peered":"2024-09-11T11:05:06.760439+0000","last_clean":"2024-09-11T11:05:06.760439+0000","last_became_active":"2024-09-11T11:01:11.396833+0000","last_became_peered":"2024-09-11T11:01:11.396833+0000","last_unstale":"2024-09-11T11:05:06.760439+0000","last_undegraded":"2024-09-11T11:05:06.760439+0000","last_fullsized":"2024-09-11T11:05:06.760439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:06.760244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:06.760244+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.760244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:21:01.442882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:14.487250+0000","last_change":"2024-09-11T11:01:13.408361+0000","last_active":"2024-09-11T11:03:14.487250+0000","last_peered":"2024-09-11T11:03:14.487250+0000","last_clean":"2024-09-11T11:03:14.487250+0000","last_became_active":"2024-09-11T11:01:13.407663+0000","last_became_peered":"2024-09-11T11:01:13.407663+0000","last_unstale":"2024-09-11T11:03:14.487250+0000","last_undegraded":"2024-09-11T11:03:14.487250+0000","last_fullsized":"2024-09-11T11:03:14.487250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'8","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.591351+0000","last_change":"2024-09-11T11:01:05.340874+0000","last_active":"2024-09-11T11:04:17.591351+0000","last_peered":"2024-09-11T11:04:17.591351+0000","last_clean":"2024-09-11T11:04:17.591351+0000","last_became_active":"2024-09-11T11:01:05.340457+0000","last_became_peered":"2024-09-11T11:01:05.340457+0000","last_unstale":"2024-09-11T11:04:17.591351+0000","last_undegraded":"2024-09-11T11:04:17.591351+0000","last_fullsized":"2024-09-11T11:04:17.591351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036316+0000","last_change":"2024-09-11T11:01:03.336186+0000","last_active":"2024-09-11T11:03:28.036316+0000","last_peered":"2024-09-11T11:03:28.036316+0000","last_clean":"2024-09-11T11:03:28.036316+0000","last_became_active":"2024-09-11T11:01:03.335235+0000","last_became_peered":"2024-09-11T11:01:03.335235+0000","last_unstale":"2024-09-11T11:03:28.036316+0000","last_undegraded":"2024-09-11T11:03:28.036316+0000","last_fullsized":"2024-09-11T11:03:28.036316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.663172+0000","last_change":"2024-09-11T11:04:59.663228+0000","last_active":"2024-09-11T11:04:59.663172+0000","last_peered":"2024-09-11T11:04:59.663172+0000","last_clean":"2024-09-11T11:04:59.663172+0000","last_became_active":"2024-09-11T11:02:42.501867+0000","last_became_peered":"2024-09-11T11:02:42.501867+0000","last_unstale":"2024-09-11T11:04:59.663172+0000","last_undegraded":"2024-09-11T11:04:59.663172+0000","last_fullsized":"2024-09-11T11:04:59.663172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.662970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.662970+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.662970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:06.928697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.868589+0000","last_change":"2024-09-11T11:05:06.868678+0000","last_active":"2024-09-11T11:05:06.868589+0000","last_peered":"2024-09-11T11:05:06.868589+0000","last_clean":"2024-09-11T11:05:06.868589+0000","last_became_active":"2024-09-11T11:01:09.362975+0000","last_became_peered":"2024-09-11T11:01:09.362975+0000","last_unstale":"2024-09-11T11:05:06.868589+0000","last_undegraded":"2024-09-11T11:05:06.868589+0000","last_fullsized":"2024-09-11T11:05:06.868589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:06.868398+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:06.868398+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.868398+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:14.134126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.974940+0000","last_change":"2024-09-11T11:05:01.975001+0000","last_active":"2024-09-11T11:05:01.974940+0000","last_peered":"2024-09-11T11:05:01.974940+0000","last_clean":"2024-09-11T11:05:01.974940+0000","last_became_active":"2024-09-11T11:01:11.393181+0000","last_became_peered":"2024-09-11T11:01:11.393181+0000","last_unstale":"2024-09-11T11:05:01.974940+0000","last_undegraded":"2024-09-11T11:05:01.974940+0000","last_fullsized":"2024-09-11T11:05:01.974940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.974738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.974738+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.974738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:29.665900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.452372+0000","last_change":"2024-09-11T11:01:13.419907+0000","last_active":"2024-09-11T11:04:17.452372+0000","last_peered":"2024-09-11T11:04:17.452372+0000","last_clean":"2024-09-11T11:04:17.452372+0000","last_became_active":"2024-09-11T11:01:13.419238+0000","last_became_peered":"2024-09-11T11:01:13.419238+0000","last_unstale":"2024-09-11T11:04:17.452372+0000","last_undegraded":"2024-09-11T11:04:17.452372+0000","last_fullsized":"2024-09-11T11:04:17.452372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'10","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.937900+0000","last_change":"2024-09-11T11:01:42.073807+0000","last_active":"2024-09-11T11:04:17.937900+0000","last_peered":"2024-09-11T11:04:17.937900+0000","last_clean":"2024-09-11T11:04:17.937900+0000","last_became_active":"2024-09-11T11:01:42.058258+0000","last_became_peered":"2024-09-11T11:01:42.058258+0000","last_unstale":"2024-09-11T11:04:17.937900+0000","last_undegraded":"2024-09-11T11:04:17.937900+0000","last_fullsized":"2024-09-11T11:04:17.937900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:31.041124+0000","last_change":"2024-09-11T11:01:03.339928+0000","last_active":"2024-09-11T11:03:31.041124+0000","last_peered":"2024-09-11T11:03:31.041124+0000","last_clean":"2024-09-11T11:03:31.041124+0000","last_became_active":"2024-09-11T11:01:03.337144+0000","last_became_peered":"2024-09-11T11:01:03.337144+0000","last_unstale":"2024-09-11T11:03:31.041124+0000","last_undegraded":"2024-09-11T11:03:31.041124+0000","last_fullsized":"2024-09-11T11:03:31.041124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"36'5","reported_seq":242,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.547528+0000","last_change":"2024-09-11T11:04:58.547593+0000","last_active":"2024-09-11T11:04:58.547528+0000","last_peered":"2024-09-11T11:04:58.547528+0000","last_clean":"2024-09-11T11:04:58.547528+0000","last_became_active":"2024-09-11T11:01:07.358156+0000","last_became_peered":"2024-09-11T11:01:07.358156+0000","last_unstale":"2024-09-11T11:04:58.547528+0000","last_undegraded":"2024-09-11T11:04:58.547528+0000","last_fullsized":"2024-09-11T11:04:58.547528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-11T11:04:58.547344+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-11T11:04:58.547344+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.547344+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:46:00.492791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'50","reported_seq":126,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.732558+0000","last_change":"2024-09-11T11:05:02.732707+0000","last_active":"2024-09-11T11:05:02.732558+0000","last_peered":"2024-09-11T11:05:02.732558+0000","last_clean":"2024-09-11T11:05:02.732558+0000","last_became_active":"2024-09-11T11:01:09.380595+0000","last_became_peered":"2024-09-11T11:01:09.380595+0000","last_unstale":"2024-09-11T11:05:02.732558+0000","last_undegraded":"2024-09-11T11:05:02.732558+0000","last_fullsized":"2024-09-11T11:05:02.732558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'50","last_scrub_stamp":"2024-09-11T11:05:02.732310+0000","last_deep_scrub":"36'50","last_deep_scrub_stamp":"2024-09-11T11:05:02.732310+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.732310+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:04.576806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":83,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.877470+0000","last_change":"2024-09-11T11:05:01.877523+0000","last_active":"2024-09-11T11:05:01.877470+0000","last_peered":"2024-09-11T11:05:01.877470+0000","last_clean":"2024-09-11T11:05:01.877470+0000","last_became_active":"2024-09-11T11:01:11.401847+0000","last_became_peered":"2024-09-11T11:01:11.401847+0000","last_unstale":"2024-09-11T11:05:01.877470+0000","last_undegraded":"2024-09-11T11:05:01.877470+0000","last_fullsized":"2024-09-11T11:05:01.877470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.877282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.877282+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.877282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:36.973759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:43.042627+0000","last_change":"2024-09-11T11:01:13.397280+0000","last_active":"2024-09-11T11:03:43.042627+0000","last_peered":"2024-09-11T11:03:43.042627+0000","last_clean":"2024-09-11T11:03:43.042627+0000","last_became_active":"2024-09-11T11:01:13.395231+0000","last_became_peered":"2024-09-11T11:01:13.395231+0000","last_unstale":"2024-09-11T11:03:43.042627+0000","last_undegraded":"2024-09-11T11:03:43.042627+0000","last_fullsized":"2024-09-11T11:03:43.042627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'12","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.940311+0000","last_change":"2024-09-11T11:01:05.348465+0000","last_active":"2024-09-11T11:04:17.940311+0000","last_peered":"2024-09-11T11:04:17.940311+0000","last_clean":"2024-09-11T11:04:17.940311+0000","last_became_active":"2024-09-11T11:01:05.348002+0000","last_became_peered":"2024-09-11T11:01:05.348002+0000","last_unstale":"2024-09-11T11:04:17.940311+0000","last_undegraded":"2024-09-11T11:04:17.940311+0000","last_fullsized":"2024-09-11T11:04:17.940311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.040022+0000","last_change":"2024-09-11T11:01:03.338184+0000","last_active":"2024-09-11T11:03:28.040022+0000","last_peered":"2024-09-11T11:03:28.040022+0000","last_clean":"2024-09-11T11:03:28.040022+0000","last_became_active":"2024-09-11T11:01:03.330782+0000","last_became_peered":"2024-09-11T11:01:03.330782+0000","last_unstale":"2024-09-11T11:03:28.040022+0000","last_undegraded":"2024-09-11T11:03:28.040022+0000","last_fullsized":"2024-09-11T11:03:28.040022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.038308+0000","last_change":"2024-09-11T11:01:07.351359+0000","last_active":"2024-09-11T11:03:28.038308+0000","last_peered":"2024-09-11T11:03:28.038308+0000","last_clean":"2024-09-11T11:03:28.038308+0000","last_became_active":"2024-09-11T11:01:07.350685+0000","last_became_peered":"2024-09-11T11:01:07.350685+0000","last_unstale":"2024-09-11T11:03:28.038308+0000","last_undegraded":"2024-09-11T11:03:28.038308+0000","last_fullsized":"2024-09-11T11:03:28.038308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'37","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.597735+0000","last_change":"2024-09-11T11:04:55.597808+0000","last_active":"2024-09-11T11:04:55.597735+0000","last_peered":"2024-09-11T11:04:55.597735+0000","last_clean":"2024-09-11T11:04:55.597735+0000","last_became_active":"2024-09-11T11:01:09.362483+0000","last_became_peered":"2024-09-11T11:01:09.362483+0000","last_unstale":"2024-09-11T11:04:55.597735+0000","last_undegraded":"2024-09-11T11:04:55.597735+0000","last_fullsized":"2024-09-11T11:04:55.597735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:04:55.597543+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:04:55.597543+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.597543+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:28.136198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.018241+0000","last_change":"2024-09-11T11:04:59.018297+0000","last_active":"2024-09-11T11:04:59.018241+0000","last_peered":"2024-09-11T11:04:59.018241+0000","last_clean":"2024-09-11T11:04:59.018241+0000","last_became_active":"2024-09-11T11:01:11.398843+0000","last_became_peered":"2024-09-11T11:01:11.398843+0000","last_unstale":"2024-09-11T11:04:59.018241+0000","last_undegraded":"2024-09-11T11:04:59.018241+0000","last_fullsized":"2024-09-11T11:04:59.018241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.018045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.018045+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.018045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:30:20.573633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.790002+0000","last_change":"2024-09-11T11:01:05.348376+0000","last_active":"2024-09-11T11:04:17.790002+0000","last_peered":"2024-09-11T11:04:17.790002+0000","last_clean":"2024-09-11T11:04:17.790002+0000","last_became_active":"2024-09-11T11:01:05.347496+0000","last_became_peered":"2024-09-11T11:01:05.347496+0000","last_unstale":"2024-09-11T11:04:17.790002+0000","last_undegraded":"2024-09-11T11:04:17.790002+0000","last_fullsized":"2024-09-11T11:04:17.790002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.038156+0000","last_change":"2024-09-11T11:01:03.349185+0000","last_active":"2024-09-11T11:03:28.038156+0000","last_peered":"2024-09-11T11:03:28.038156+0000","last_clean":"2024-09-11T11:03:28.038156+0000","last_became_active":"2024-09-11T11:01:03.348849+0000","last_became_peered":"2024-09-11T11:01:03.348849+0000","last_unstale":"2024-09-11T11:03:28.038156+0000","last_undegraded":"2024-09-11T11:03:28.038156+0000","last_fullsized":"2024-09-11T11:03:28.038156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.882447+0000","last_change":"2024-09-11T11:01:07.366791+0000","last_active":"2024-09-11T11:04:52.882447+0000","last_peered":"2024-09-11T11:04:52.882447+0000","last_clean":"2024-09-11T11:04:52.882447+0000","last_became_active":"2024-09-11T11:01:07.365953+0000","last_became_peered":"2024-09-11T11:01:07.365953+0000","last_unstale":"2024-09-11T11:04:52.882447+0000","last_undegraded":"2024-09-11T11:04:52.882447+0000","last_fullsized":"2024-09-11T11:04:52.882447+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.899052+0000","last_change":"2024-09-11T11:05:04.899131+0000","last_active":"2024-09-11T11:05:04.899052+0000","last_peered":"2024-09-11T11:05:04.899052+0000","last_clean":"2024-09-11T11:05:04.899052+0000","last_became_active":"2024-09-11T11:01:09.374937+0000","last_became_peered":"2024-09-11T11:01:09.374937+0000","last_unstale":"2024-09-11T11:05:04.899052+0000","last_undegraded":"2024-09-11T11:05:04.899052+0000","last_fullsized":"2024-09-11T11:05:04.899052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-11T11:05:04.898835+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-11T11:05:04.898835+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.898835+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:55:03.296341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.012953+0000","last_change":"2024-09-11T11:05:00.013009+0000","last_active":"2024-09-11T11:05:00.012953+0000","last_peered":"2024-09-11T11:05:00.012953+0000","last_clean":"2024-09-11T11:05:00.012953+0000","last_became_active":"2024-09-11T11:01:11.394849+0000","last_became_peered":"2024-09-11T11:01:11.394849+0000","last_unstale":"2024-09-11T11:05:00.012953+0000","last_undegraded":"2024-09-11T11:05:00.012953+0000","last_fullsized":"2024-09-11T11:05:00.012953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.012754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.012754+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.012754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:50.213447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.039920+0000","last_change":"2024-09-11T11:01:13.416940+0000","last_active":"2024-09-11T11:03:33.039920+0000","last_peered":"2024-09-11T11:03:33.039920+0000","last_clean":"2024-09-11T11:03:33.039920+0000","last_became_active":"2024-09-11T11:01:13.416414+0000","last_became_peered":"2024-09-11T11:01:13.416414+0000","last_unstale":"2024-09-11T11:03:33.039920+0000","last_undegraded":"2024-09-11T11:03:33.039920+0000","last_fullsized":"2024-09-11T11:03:33.039920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.882168+0000","last_change":"2024-09-11T11:01:05.340233+0000","last_active":"2024-09-11T11:04:52.882168+0000","last_peered":"2024-09-11T11:04:52.882168+0000","last_clean":"2024-09-11T11:04:52.882168+0000","last_became_active":"2024-09-11T11:01:05.339898+0000","last_became_peered":"2024-09-11T11:01:05.339898+0000","last_unstale":"2024-09-11T11:04:52.882168+0000","last_undegraded":"2024-09-11T11:04:52.882168+0000","last_fullsized":"2024-09-11T11:04:52.882168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.078373+0000","last_change":"2024-09-11T11:01:42.094568+0000","last_active":"2024-09-11T11:04:49.078373+0000","last_peered":"2024-09-11T11:04:49.078373+0000","last_clean":"2024-09-11T11:04:49.078373+0000","last_became_active":"2024-09-11T11:01:42.058648+0000","last_became_peered":"2024-09-11T11:01:42.058648+0000","last_unstale":"2024-09-11T11:04:49.078373+0000","last_undegraded":"2024-09-11T11:04:49.078373+0000","last_fullsized":"2024-09-11T11:04:49.078373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.037504+0000","last_change":"2024-09-11T11:01:07.340610+0000","last_active":"2024-09-11T11:03:16.037504+0000","last_peered":"2024-09-11T11:03:16.037504+0000","last_clean":"2024-09-11T11:03:16.037504+0000","last_became_active":"2024-09-11T11:01:07.340147+0000","last_became_peered":"2024-09-11T11:01:07.340147+0000","last_unstale":"2024-09-11T11:03:16.037504+0000","last_undegraded":"2024-09-11T11:03:16.037504+0000","last_fullsized":"2024-09-11T11:03:16.037504+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'39","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.058460+0000","last_change":"2024-09-11T11:01:09.372272+0000","last_active":"2024-09-11T11:04:49.058460+0000","last_peered":"2024-09-11T11:04:49.058460+0000","last_clean":"2024-09-11T11:04:49.058460+0000","last_became_active":"2024-09-11T11:01:09.371522+0000","last_became_peered":"2024-09-11T11:01:09.371522+0000","last_unstale":"2024-09-11T11:04:49.058460+0000","last_undegraded":"2024-09-11T11:04:49.058460+0000","last_fullsized":"2024-09-11T11:04:49.058460+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.888423+0000","last_change":"2024-09-11T11:04:55.888485+0000","last_active":"2024-09-11T11:04:55.888423+0000","last_peered":"2024-09-11T11:04:55.888423+0000","last_clean":"2024-09-11T11:04:55.888423+0000","last_became_active":"2024-09-11T11:01:11.392489+0000","last_became_peered":"2024-09-11T11:01:11.392489+0000","last_unstale":"2024-09-11T11:04:55.888423+0000","last_undegraded":"2024-09-11T11:04:55.888423+0000","last_fullsized":"2024-09-11T11:04:55.888423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:55.888202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:55.888202+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.888202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:10:13.122333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042146+0000","last_change":"2024-09-11T11:01:13.405032+0000","last_active":"2024-09-11T11:03:36.042146+0000","last_peered":"2024-09-11T11:03:36.042146+0000","last_clean":"2024-09-11T11:03:36.042146+0000","last_became_active":"2024-09-11T11:01:13.404341+0000","last_became_peered":"2024-09-11T11:01:13.404341+0000","last_unstale":"2024-09-11T11:03:36.042146+0000","last_undegraded":"2024-09-11T11:03:36.042146+0000","last_fullsized":"2024-09-11T11:03:36.042146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'18","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.041389+0000","last_change":"2024-09-11T11:01:05.348158+0000","last_active":"2024-09-11T11:03:38.041389+0000","last_peered":"2024-09-11T11:03:38.041389+0000","last_clean":"2024-09-11T11:03:38.041389+0000","last_became_active":"2024-09-11T11:01:05.347745+0000","last_became_peered":"2024-09-11T11:01:05.347745+0000","last_unstale":"2024-09-11T11:03:38.041389+0000","last_undegraded":"2024-09-11T11:03:38.041389+0000","last_fullsized":"2024-09-11T11:03:38.041389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042192+0000","last_change":"2024-09-11T11:01:03.322039+0000","last_active":"2024-09-11T11:03:36.042192+0000","last_peered":"2024-09-11T11:03:36.042192+0000","last_clean":"2024-09-11T11:03:36.042192+0000","last_became_active":"2024-09-11T11:01:03.321106+0000","last_became_peered":"2024-09-11T11:01:03.321106+0000","last_unstale":"2024-09-11T11:03:36.042192+0000","last_undegraded":"2024-09-11T11:03:36.042192+0000","last_fullsized":"2024-09-11T11:03:36.042192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.487689+0000","last_change":"2024-09-11T11:05:02.487740+0000","last_active":"2024-09-11T11:05:02.487689+0000","last_peered":"2024-09-11T11:05:02.487689+0000","last_clean":"2024-09-11T11:05:02.487689+0000","last_became_active":"2024-09-11T11:01:07.342760+0000","last_became_peered":"2024-09-11T11:01:07.342760+0000","last_unstale":"2024-09-11T11:05:02.487689+0000","last_undegraded":"2024-09-11T11:05:02.487689+0000","last_fullsized":"2024-09-11T11:05:02.487689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:02.487502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:02.487502+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.487502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:42.593320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'37","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.224792+0000","last_change":"2024-09-11T11:01:09.390274+0000","last_active":"2024-09-11T11:04:49.224792+0000","last_peered":"2024-09-11T11:04:49.224792+0000","last_clean":"2024-09-11T11:04:49.224792+0000","last_became_active":"2024-09-11T11:01:09.389548+0000","last_became_peered":"2024-09-11T11:01:09.389548+0000","last_unstale":"2024-09-11T11:04:49.224792+0000","last_undegraded":"2024-09-11T11:04:49.224792+0000","last_fullsized":"2024-09-11T11:04:49.224792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.814675+0000","last_change":"2024-09-11T11:04:58.814732+0000","last_active":"2024-09-11T11:04:58.814675+0000","last_peered":"2024-09-11T11:04:58.814675+0000","last_clean":"2024-09-11T11:04:58.814675+0000","last_became_active":"2024-09-11T11:01:11.391080+0000","last_became_peered":"2024-09-11T11:01:11.391080+0000","last_unstale":"2024-09-11T11:04:58.814675+0000","last_undegraded":"2024-09-11T11:04:58.814675+0000","last_fullsized":"2024-09-11T11:04:58.814675+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:58.814489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:58.814489+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.814489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:30:05.782233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042125+0000","last_change":"2024-09-11T11:01:13.421751+0000","last_active":"2024-09-11T11:03:36.042125+0000","last_peered":"2024-09-11T11:03:36.042125+0000","last_clean":"2024-09-11T11:03:36.042125+0000","last_became_active":"2024-09-11T11:01:13.420844+0000","last_became_peered":"2024-09-11T11:01:13.420844+0000","last_unstale":"2024-09-11T11:03:36.042125+0000","last_undegraded":"2024-09-11T11:03:36.042125+0000","last_fullsized":"2024-09-11T11:03:36.042125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.461657+0000","last_change":"2024-09-11T11:01:05.339320+0000","last_active":"2024-09-11T11:04:17.461657+0000","last_peered":"2024-09-11T11:04:17.461657+0000","last_clean":"2024-09-11T11:04:17.461657+0000","last_became_active":"2024-09-11T11:01:05.338036+0000","last_became_peered":"2024-09-11T11:01:05.338036+0000","last_unstale":"2024-09-11T11:04:17.461657+0000","last_undegraded":"2024-09-11T11:04:17.461657+0000","last_fullsized":"2024-09-11T11:04:17.461657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.914162+0000","last_change":"2024-09-11T11:01:03.336252+0000","last_active":"2024-09-11T11:04:17.914162+0000","last_peered":"2024-09-11T11:04:17.914162+0000","last_clean":"2024-09-11T11:04:17.914162+0000","last_became_active":"2024-09-11T11:01:03.335959+0000","last_became_peered":"2024-09-11T11:01:03.335959+0000","last_unstale":"2024-09-11T11:04:17.914162+0000","last_undegraded":"2024-09-11T11:04:17.914162+0000","last_fullsized":"2024-09-11T11:04:17.914162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.936685+0000","last_change":"2024-09-11T11:04:52.936737+0000","last_active":"2024-09-11T11:04:52.936685+0000","last_peered":"2024-09-11T11:04:52.936685+0000","last_clean":"2024-09-11T11:04:52.936685+0000","last_became_active":"2024-09-11T11:01:07.368853+0000","last_became_peered":"2024-09-11T11:01:07.368853+0000","last_unstale":"2024-09-11T11:04:52.936685+0000","last_undegraded":"2024-09-11T11:04:52.936685+0000","last_fullsized":"2024-09-11T11:04:52.936685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:52.936491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:52.936491+0000","last_clean_scrub_stamp":"2024-09-11T11:04:52.936491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:47:53.282179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'11","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.034969+0000","last_change":"2024-09-11T11:01:09.391884+0000","last_active":"2024-09-11T11:03:13.034969+0000","last_peered":"2024-09-11T11:03:13.034969+0000","last_clean":"2024-09-11T11:03:13.034969+0000","last_became_active":"2024-09-11T11:01:09.391249+0000","last_became_peered":"2024-09-11T11:01:09.391249+0000","last_unstale":"2024-09-11T11:03:13.034969+0000","last_undegraded":"2024-09-11T11:03:13.034969+0000","last_fullsized":"2024-09-11T11:03:13.034969+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:08.329158+0000","last_clean_scrub_stamp":"2024-09-11T11:01:08.329158+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":375,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.301196+0000","last_change":"2024-09-11T11:01:11.403073+0000","last_active":"2024-09-11T11:04:49.301196+0000","last_peered":"2024-09-11T11:04:49.301196+0000","last_clean":"2024-09-11T11:04:49.301196+0000","last_became_active":"2024-09-11T11:01:11.401400+0000","last_became_peered":"2024-09-11T11:01:11.401400+0000","last_unstale":"2024-09-11T11:04:49.301196+0000","last_undegraded":"2024-09-11T11:04:49.301196+0000","last_fullsized":"2024-09-11T11:04:49.301196+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.041975+0000","last_change":"2024-09-11T11:01:13.403086+0000","last_active":"2024-09-11T11:03:36.041975+0000","last_peered":"2024-09-11T11:03:36.041975+0000","last_clean":"2024-09-11T11:03:36.041975+0000","last_became_active":"2024-09-11T11:01:13.402406+0000","last_became_peered":"2024-09-11T11:01:13.402406+0000","last_unstale":"2024-09-11T11:03:36.041975+0000","last_undegraded":"2024-09-11T11:03:36.041975+0000","last_fullsized":"2024-09-11T11:03:36.041975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'5","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.021909+0000","last_change":"2024-09-11T11:01:05.353823+0000","last_active":"2024-09-11T11:04:18.021909+0000","last_peered":"2024-09-11T11:04:18.021909+0000","last_clean":"2024-09-11T11:04:18.021909+0000","last_became_active":"2024-09-11T11:01:05.353214+0000","last_became_peered":"2024-09-11T11:01:05.353214+0000","last_unstale":"2024-09-11T11:04:18.021909+0000","last_undegraded":"2024-09-11T11:04:18.021909+0000","last_fullsized":"2024-09-11T11:04:18.021909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.041125+0000","last_change":"2024-09-11T11:01:03.346782+0000","last_active":"2024-09-11T11:03:33.041125+0000","last_peered":"2024-09-11T11:03:33.041125+0000","last_clean":"2024-09-11T11:03:33.041125+0000","last_became_active":"2024-09-11T11:01:03.346318+0000","last_became_peered":"2024-09-11T11:01:03.346318+0000","last_unstale":"2024-09-11T11:03:33.041125+0000","last_undegraded":"2024-09-11T11:03:33.041125+0000","last_fullsized":"2024-09-11T11:03:33.041125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.915520+0000","last_change":"2024-09-11T11:04:54.915574+0000","last_active":"2024-09-11T11:04:54.915520+0000","last_peered":"2024-09-11T11:04:54.915520+0000","last_clean":"2024-09-11T11:04:54.915520+0000","last_became_active":"2024-09-11T11:01:07.368713+0000","last_became_peered":"2024-09-11T11:01:07.368713+0000","last_unstale":"2024-09-11T11:04:54.915520+0000","last_undegraded":"2024-09-11T11:04:54.915520+0000","last_fullsized":"2024-09-11T11:04:54.915520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.915331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.915331+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.915331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:04.269950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.531652+0000","last_change":"2024-09-11T11:04:57.531736+0000","last_active":"2024-09-11T11:04:57.531652+0000","last_peered":"2024-09-11T11:04:57.531652+0000","last_clean":"2024-09-11T11:04:57.531652+0000","last_became_active":"2024-09-11T11:01:09.363530+0000","last_became_peered":"2024-09-11T11:01:09.363530+0000","last_unstale":"2024-09-11T11:04:57.531652+0000","last_undegraded":"2024-09-11T11:04:57.531652+0000","last_fullsized":"2024-09-11T11:04:57.531652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:04:57.531466+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:04:57.531466+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.531466+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:53.383843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.040990+0000","last_change":"2024-09-11T11:01:11.373298+0000","last_active":"2024-09-11T11:03:38.040990+0000","last_peered":"2024-09-11T11:03:38.040990+0000","last_clean":"2024-09-11T11:03:38.040990+0000","last_became_active":"2024-09-11T11:01:11.371526+0000","last_became_peered":"2024-09-11T11:01:11.371526+0000","last_unstale":"2024-09-11T11:03:38.040990+0000","last_undegraded":"2024-09-11T11:03:38.040990+0000","last_fullsized":"2024-09-11T11:03:38.040990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:41.043763+0000","last_change":"2024-09-11T11:01:13.421954+0000","last_active":"2024-09-11T11:03:41.043763+0000","last_peered":"2024-09-11T11:03:41.043763+0000","last_clean":"2024-09-11T11:03:41.043763+0000","last_became_active":"2024-09-11T11:01:13.421220+0000","last_became_peered":"2024-09-11T11:01:13.421220+0000","last_unstale":"2024-09-11T11:03:41.043763+0000","last_undegraded":"2024-09-11T11:03:41.043763+0000","last_fullsized":"2024-09-11T11:03:41.043763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042236+0000","last_change":"2024-09-11T11:01:05.348922+0000","last_active":"2024-09-11T11:03:36.042236+0000","last_peered":"2024-09-11T11:03:36.042236+0000","last_clean":"2024-09-11T11:03:36.042236+0000","last_became_active":"2024-09-11T11:01:05.348256+0000","last_became_peered":"2024-09-11T11:01:05.348256+0000","last_unstale":"2024-09-11T11:03:36.042236+0000","last_undegraded":"2024-09-11T11:03:36.042236+0000","last_fullsized":"2024-09-11T11:03:36.042236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042420+0000","last_change":"2024-09-11T11:01:03.323843+0000","last_active":"2024-09-11T11:03:36.042420+0000","last_peered":"2024-09-11T11:03:36.042420+0000","last_clean":"2024-09-11T11:03:36.042420+0000","last_became_active":"2024-09-11T11:01:03.323106+0000","last_became_peered":"2024-09-11T11:01:03.323106+0000","last_unstale":"2024-09-11T11:03:36.042420+0000","last_undegraded":"2024-09-11T11:03:36.042420+0000","last_fullsized":"2024-09-11T11:03:36.042420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.514431+0000","last_change":"2024-09-11T11:04:59.514486+0000","last_active":"2024-09-11T11:04:59.514431+0000","last_peered":"2024-09-11T11:04:59.514431+0000","last_clean":"2024-09-11T11:04:59.514431+0000","last_became_active":"2024-09-11T11:01:07.346507+0000","last_became_peered":"2024-09-11T11:01:07.346507+0000","last_unstale":"2024-09-11T11:04:59.514431+0000","last_undegraded":"2024-09-11T11:04:59.514431+0000","last_fullsized":"2024-09-11T11:04:59.514431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.514205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.514205+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.514205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:09.294520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.992718+0000","last_change":"2024-09-11T11:05:05.992792+0000","last_active":"2024-09-11T11:05:05.992718+0000","last_peered":"2024-09-11T11:05:05.992718+0000","last_clean":"2024-09-11T11:05:05.992718+0000","last_became_active":"2024-09-11T11:01:09.367104+0000","last_became_peered":"2024-09-11T11:01:09.367104+0000","last_unstale":"2024-09-11T11:05:05.992718+0000","last_undegraded":"2024-09-11T11:05:05.992718+0000","last_fullsized":"2024-09-11T11:05:05.992718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-11T11:05:05.992530+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-11T11:05:05.992530+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.992530+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:53:54.568734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042102+0000","last_change":"2024-09-11T11:01:11.400983+0000","last_active":"2024-09-11T11:03:36.042102+0000","last_peered":"2024-09-11T11:03:36.042102+0000","last_clean":"2024-09-11T11:03:36.042102+0000","last_became_active":"2024-09-11T11:01:11.400269+0000","last_became_peered":"2024-09-11T11:01:11.400269+0000","last_unstale":"2024-09-11T11:03:36.042102+0000","last_undegraded":"2024-09-11T11:03:36.042102+0000","last_fullsized":"2024-09-11T11:03:36.042102+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.041445+0000","last_change":"2024-09-11T11:01:13.424386+0000","last_active":"2024-09-11T11:03:38.041445+0000","last_peered":"2024-09-11T11:03:38.041445+0000","last_clean":"2024-09-11T11:03:38.041445+0000","last_became_active":"2024-09-11T11:01:13.423466+0000","last_became_peered":"2024-09-11T11:01:13.423466+0000","last_unstale":"2024-09-11T11:03:38.041445+0000","last_undegraded":"2024-09-11T11:03:38.041445+0000","last_fullsized":"2024-09-11T11:03:38.041445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.592371+0000","last_change":"2024-09-11T11:01:05.334600+0000","last_active":"2024-09-11T11:04:17.592371+0000","last_peered":"2024-09-11T11:04:17.592371+0000","last_clean":"2024-09-11T11:04:17.592371+0000","last_became_active":"2024-09-11T11:01:05.334141+0000","last_became_peered":"2024-09-11T11:01:05.334141+0000","last_unstale":"2024-09-11T11:04:17.592371+0000","last_undegraded":"2024-09-11T11:04:17.592371+0000","last_fullsized":"2024-09-11T11:04:17.592371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787452+0000","last_change":"2024-09-11T11:01:03.340441+0000","last_active":"2024-09-11T11:04:53.787452+0000","last_peered":"2024-09-11T11:04:53.787452+0000","last_clean":"2024-09-11T11:04:53.787452+0000","last_became_active":"2024-09-11T11:01:03.337584+0000","last_became_peered":"2024-09-11T11:01:03.337584+0000","last_unstale":"2024-09-11T11:04:53.787452+0000","last_undegraded":"2024-09-11T11:04:53.787452+0000","last_fullsized":"2024-09-11T11:04:53.787452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.040928+0000","last_change":"2024-09-11T11:01:07.366290+0000","last_active":"2024-09-11T11:03:33.040928+0000","last_peered":"2024-09-11T11:03:33.040928+0000","last_clean":"2024-09-11T11:03:33.040928+0000","last_became_active":"2024-09-11T11:01:07.365791+0000","last_became_peered":"2024-09-11T11:01:07.365791+0000","last_unstale":"2024-09-11T11:03:33.040928+0000","last_undegraded":"2024-09-11T11:03:33.040928+0000","last_fullsized":"2024-09-11T11:03:33.040928+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.678435+0000","last_change":"2024-09-11T11:04:58.678503+0000","last_active":"2024-09-11T11:04:58.678435+0000","last_peered":"2024-09-11T11:04:58.678435+0000","last_clean":"2024-09-11T11:04:58.678435+0000","last_became_active":"2024-09-11T11:01:09.380531+0000","last_became_peered":"2024-09-11T11:01:09.380531+0000","last_unstale":"2024-09-11T11:04:58.678435+0000","last_undegraded":"2024-09-11T11:04:58.678435+0000","last_fullsized":"2024-09-11T11:04:58.678435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-11T11:04:58.678237+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-11T11:04:58.678237+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.678237+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:51.973784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:41.043411+0000","last_change":"2024-09-11T11:01:11.387269+0000","last_active":"2024-09-11T11:03:41.043411+0000","last_peered":"2024-09-11T11:03:41.043411+0000","last_clean":"2024-09-11T11:03:41.043411+0000","last_became_active":"2024-09-11T11:01:11.386302+0000","last_became_peered":"2024-09-11T11:01:11.386302+0000","last_unstale":"2024-09-11T11:03:41.043411+0000","last_undegraded":"2024-09-11T11:03:41.043411+0000","last_fullsized":"2024-09-11T11:03:41.043411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'8","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.595893+0000","last_change":"2024-09-11T11:01:13.423002+0000","last_active":"2024-09-11T11:04:17.595893+0000","last_peered":"2024-09-11T11:04:17.595893+0000","last_clean":"2024-09-11T11:04:17.595893+0000","last_became_active":"2024-09-11T11:01:13.422285+0000","last_became_peered":"2024-09-11T11:01:13.422285+0000","last_unstale":"2024-09-11T11:04:17.595893+0000","last_undegraded":"2024-09-11T11:04:17.595893+0000","last_fullsized":"2024-09-11T11:04:17.595893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.459765+0000","last_change":"2024-09-11T11:01:05.337161+0000","last_active":"2024-09-11T11:04:17.459765+0000","last_peered":"2024-09-11T11:04:17.459765+0000","last_clean":"2024-09-11T11:04:17.459765+0000","last_became_active":"2024-09-11T11:01:05.336680+0000","last_became_peered":"2024-09-11T11:01:05.336680+0000","last_unstale":"2024-09-11T11:04:17.459765+0000","last_undegraded":"2024-09-11T11:04:17.459765+0000","last_fullsized":"2024-09-11T11:04:17.459765+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.035508+0000","last_change":"2024-09-11T11:01:03.336607+0000","last_active":"2024-09-11T11:03:08.035508+0000","last_peered":"2024-09-11T11:03:08.035508+0000","last_clean":"2024-09-11T11:03:08.035508+0000","last_became_active":"2024-09-11T11:01:03.331816+0000","last_became_peered":"2024-09-11T11:01:03.331816+0000","last_unstale":"2024-09-11T11:03:08.035508+0000","last_undegraded":"2024-09-11T11:03:08.035508+0000","last_fullsized":"2024-09-11T11:03:08.035508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'2","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.040957+0000","last_change":"2024-09-11T11:01:07.364299+0000","last_active":"2024-09-11T11:03:33.040957+0000","last_peered":"2024-09-11T11:03:33.040957+0000","last_clean":"2024-09-11T11:03:33.040957+0000","last_became_active":"2024-09-11T11:01:07.363545+0000","last_became_peered":"2024-09-11T11:01:07.363545+0000","last_unstale":"2024-09-11T11:03:33.040957+0000","last_undegraded":"2024-09-11T11:03:33.040957+0000","last_fullsized":"2024-09-11T11:03:33.040957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'39","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.503812+0000","last_change":"2024-09-11T11:05:04.503885+0000","last_active":"2024-09-11T11:05:04.503812+0000","last_peered":"2024-09-11T11:05:04.503812+0000","last_clean":"2024-09-11T11:05:04.503812+0000","last_became_active":"2024-09-11T11:01:09.377586+0000","last_became_peered":"2024-09-11T11:01:09.377586+0000","last_unstale":"2024-09-11T11:05:04.503812+0000","last_undegraded":"2024-09-11T11:05:04.503812+0000","last_fullsized":"2024-09-11T11:05:04.503812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-11T11:05:04.503625+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-11T11:05:04.503625+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.503625+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:19.713646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.130713+0000","last_change":"2024-09-11T11:04:56.130847+0000","last_active":"2024-09-11T11:04:56.130713+0000","last_peered":"2024-09-11T11:04:56.130713+0000","last_clean":"2024-09-11T11:04:56.130713+0000","last_became_active":"2024-09-11T11:01:11.401078+0000","last_became_peered":"2024-09-11T11:01:11.401078+0000","last_unstale":"2024-09-11T11:04:56.130713+0000","last_undegraded":"2024-09-11T11:04:56.130713+0000","last_fullsized":"2024-09-11T11:04:56.130713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:56.130494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:56.130494+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.130494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:45.639114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042291+0000","last_change":"2024-09-11T11:01:13.422050+0000","last_active":"2024-09-11T11:03:36.042291+0000","last_peered":"2024-09-11T11:03:36.042291+0000","last_clean":"2024-09-11T11:03:36.042291+0000","last_became_active":"2024-09-11T11:01:13.421231+0000","last_became_peered":"2024-09-11T11:01:13.421231+0000","last_unstale":"2024-09-11T11:03:36.042291+0000","last_undegraded":"2024-09-11T11:03:36.042291+0000","last_fullsized":"2024-09-11T11:03:36.042291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'12","reported_seq":70,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.871311+0000","last_change":"2024-09-11T11:01:05.340309+0000","last_active":"2024-09-11T11:04:17.871311+0000","last_peered":"2024-09-11T11:04:17.871311+0000","last_clean":"2024-09-11T11:04:17.871311+0000","last_became_active":"2024-09-11T11:01:05.339760+0000","last_became_peered":"2024-09-11T11:01:05.339760+0000","last_unstale":"2024-09-11T11:04:17.871311+0000","last_undegraded":"2024-09-11T11:04:17.871311+0000","last_fullsized":"2024-09-11T11:04:17.871311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.032227+0000","last_change":"2024-09-11T11:01:03.338307+0000","last_active":"2024-09-11T11:03:08.032227+0000","last_peered":"2024-09-11T11:03:08.032227+0000","last_clean":"2024-09-11T11:03:08.032227+0000","last_became_active":"2024-09-11T11:01:03.338039+0000","last_became_peered":"2024-09-11T11:01:03.338039+0000","last_unstale":"2024-09-11T11:03:08.032227+0000","last_undegraded":"2024-09-11T11:03:08.032227+0000","last_fullsized":"2024-09-11T11:03:08.032227+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.037383+0000","last_change":"2024-09-11T11:01:05.333022+0000","last_active":"2024-09-11T11:03:18.037383+0000","last_peered":"2024-09-11T11:03:18.037383+0000","last_clean":"2024-09-11T11:03:18.037383+0000","last_became_active":"2024-09-11T11:01:05.332632+0000","last_became_peered":"2024-09-11T11:01:05.332632+0000","last_unstale":"2024-09-11T11:03:18.037383+0000","last_undegraded":"2024-09-11T11:03:18.037383+0000","last_fullsized":"2024-09-11T11:03:18.037383+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.032318+0000","last_change":"2024-09-11T11:01:03.327803+0000","last_active":"2024-09-11T11:03:08.032318+0000","last_peered":"2024-09-11T11:03:08.032318+0000","last_clean":"2024-09-11T11:03:08.032318+0000","last_became_active":"2024-09-11T11:01:03.327428+0000","last_became_peered":"2024-09-11T11:01:03.327428+0000","last_unstale":"2024-09-11T11:03:08.032318+0000","last_undegraded":"2024-09-11T11:03:08.032318+0000","last_fullsized":"2024-09-11T11:03:08.032318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.019777+0000","last_change":"2024-09-11T11:01:05.349740+0000","last_active":"2024-09-11T11:04:18.019777+0000","last_peered":"2024-09-11T11:04:18.019777+0000","last_clean":"2024-09-11T11:04:18.019777+0000","last_became_active":"2024-09-11T11:01:05.348827+0000","last_became_peered":"2024-09-11T11:01:05.348827+0000","last_unstale":"2024-09-11T11:04:18.019777+0000","last_undegraded":"2024-09-11T11:04:18.019777+0000","last_fullsized":"2024-09-11T11:04:18.019777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'3","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.033981+0000","last_change":"2024-09-11T11:01:03.333973+0000","last_active":"2024-09-11T11:03:08.033981+0000","last_peered":"2024-09-11T11:03:08.033981+0000","last_clean":"2024-09-11T11:03:08.033981+0000","last_became_active":"2024-09-11T11:01:03.333729+0000","last_became_peered":"2024-09-11T11:01:03.333729+0000","last_unstale":"2024-09-11T11:03:08.033981+0000","last_undegraded":"2024-09-11T11:03:08.033981+0000","last_fullsized":"2024-09-11T11:03:08.033981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.871190+0000","last_change":"2024-09-11T11:01:05.333462+0000","last_active":"2024-09-11T11:04:17.871190+0000","last_peered":"2024-09-11T11:04:17.871190+0000","last_clean":"2024-09-11T11:04:17.871190+0000","last_became_active":"2024-09-11T11:01:05.332274+0000","last_became_peered":"2024-09-11T11:01:05.332274+0000","last_unstale":"2024-09-11T11:04:17.871190+0000","last_undegraded":"2024-09-11T11:04:17.871190+0000","last_fullsized":"2024-09-11T11:04:17.871190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:08.032391+0000","last_change":"2024-09-11T11:01:03.335348+0000","last_active":"2024-09-11T11:03:08.032391+0000","last_peered":"2024-09-11T11:03:08.032391+0000","last_clean":"2024-09-11T11:03:08.032391+0000","last_became_active":"2024-09-11T11:01:03.335054+0000","last_became_peered":"2024-09-11T11:01:03.335054+0000","last_unstale":"2024-09-11T11:03:08.032391+0000","last_undegraded":"2024-09-11T11:03:08.032391+0000","last_fullsized":"2024-09-11T11:03:08.032391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.034888+0000","last_change":"2024-09-11T11:01:05.343162+0000","last_active":"2024-09-11T11:03:13.034888+0000","last_peered":"2024-09-11T11:03:13.034888+0000","last_clean":"2024-09-11T11:03:13.034888+0000","last_became_active":"2024-09-11T11:01:05.330065+0000","last_became_peered":"2024-09-11T11:01:05.330065+0000","last_unstale":"2024-09-11T11:03:13.034888+0000","last_undegraded":"2024-09-11T11:03:13.034888+0000","last_fullsized":"2024-09-11T11:03:13.034888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.034927+0000","last_change":"2024-09-11T11:01:03.351261+0000","last_active":"2024-09-11T11:03:13.034927+0000","last_peered":"2024-09-11T11:03:13.034927+0000","last_clean":"2024-09-11T11:03:13.034927+0000","last_became_active":"2024-09-11T11:01:03.349971+0000","last_became_peered":"2024-09-11T11:01:03.349971+0000","last_unstale":"2024-09-11T11:03:13.034927+0000","last_undegraded":"2024-09-11T11:03:13.034927+0000","last_fullsized":"2024-09-11T11:03:13.034927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.036119+0000","last_change":"2024-09-11T11:01:05.342800+0000","last_active":"2024-09-11T11:03:13.036119+0000","last_peered":"2024-09-11T11:03:13.036119+0000","last_clean":"2024-09-11T11:03:13.036119+0000","last_became_active":"2024-09-11T11:01:05.342092+0000","last_became_peered":"2024-09-11T11:01:05.342092+0000","last_unstale":"2024-09-11T11:03:13.036119+0000","last_undegraded":"2024-09-11T11:03:13.036119+0000","last_fullsized":"2024-09-11T11:03:13.036119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.036208+0000","last_change":"2024-09-11T11:01:42.061260+0000","last_active":"2024-09-11T11:03:13.036208+0000","last_peered":"2024-09-11T11:03:13.036208+0000","last_clean":"2024-09-11T11:03:13.036208+0000","last_became_active":"2024-09-11T11:01:42.060500+0000","last_became_peered":"2024-09-11T11:01:42.060500+0000","last_unstale":"2024-09-11T11:03:13.036208+0000","last_undegraded":"2024-09-11T11:03:13.036208+0000","last_fullsized":"2024-09-11T11:03:13.036208+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'2","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.788591+0000","last_change":"2024-09-11T11:01:05.346623+0000","last_active":"2024-09-11T11:04:17.788591+0000","last_peered":"2024-09-11T11:04:17.788591+0000","last_clean":"2024-09-11T11:04:17.788591+0000","last_became_active":"2024-09-11T11:01:05.346179+0000","last_became_peered":"2024-09-11T11:01:05.346179+0000","last_unstale":"2024-09-11T11:04:17.788591+0000","last_undegraded":"2024-09-11T11:04:17.788591+0000","last_fullsized":"2024-09-11T11:04:17.788591+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.079557+0000","last_change":"2024-09-11T11:01:03.317928+0000","last_active":"2024-09-11T11:04:49.079557+0000","last_peered":"2024-09-11T11:04:49.079557+0000","last_clean":"2024-09-11T11:04:49.079557+0000","last_became_active":"2024-09-11T11:01:03.315737+0000","last_became_peered":"2024-09-11T11:01:03.315737+0000","last_unstale":"2024-09-11T11:04:49.079557+0000","last_undegraded":"2024-09-11T11:04:49.079557+0000","last_fullsized":"2024-09-11T11:04:49.079557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.022264+0000","last_change":"2024-09-11T11:01:05.333619+0000","last_active":"2024-09-11T11:04:18.022264+0000","last_peered":"2024-09-11T11:04:18.022264+0000","last_clean":"2024-09-11T11:04:18.022264+0000","last_became_active":"2024-09-11T11:01:05.331901+0000","last_became_peered":"2024-09-11T11:01:05.331901+0000","last_unstale":"2024-09-11T11:04:18.022264+0000","last_undegraded":"2024-09-11T11:04:18.022264+0000","last_fullsized":"2024-09-11T11:04:18.022264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.034995+0000","last_change":"2024-09-11T11:01:03.351395+0000","last_active":"2024-09-11T11:03:13.034995+0000","last_peered":"2024-09-11T11:03:13.034995+0000","last_clean":"2024-09-11T11:03:13.034995+0000","last_became_active":"2024-09-11T11:01:03.351125+0000","last_became_peered":"2024-09-11T11:01:03.351125+0000","last_unstale":"2024-09-11T11:03:13.034995+0000","last_undegraded":"2024-09-11T11:03:13.034995+0000","last_fullsized":"2024-09-11T11:03:13.034995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'1","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.022024+0000","last_change":"2024-09-11T11:01:05.333352+0000","last_active":"2024-09-11T11:04:18.022024+0000","last_peered":"2024-09-11T11:04:18.022024+0000","last_clean":"2024-09-11T11:04:18.022024+0000","last_became_active":"2024-09-11T11:01:05.332203+0000","last_became_peered":"2024-09-11T11:01:05.332203+0000","last_unstale":"2024-09-11T11:04:18.022024+0000","last_undegraded":"2024-09-11T11:04:18.022024+0000","last_fullsized":"2024-09-11T11:04:18.022024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:13.034797+0000","last_change":"2024-09-11T11:01:03.337164+0000","last_active":"2024-09-11T11:03:13.034797+0000","last_peered":"2024-09-11T11:03:13.034797+0000","last_clean":"2024-09-11T11:03:13.034797+0000","last_became_active":"2024-09-11T11:01:03.336786+0000","last_became_peered":"2024-09-11T11:01:03.336786+0000","last_unstale":"2024-09-11T11:03:13.034797+0000","last_undegraded":"2024-09-11T11:03:13.034797+0000","last_fullsized":"2024-09-11T11:03:13.034797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'14","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938453+0000","last_change":"2024-09-11T11:01:05.333095+0000","last_active":"2024-09-11T11:04:17.938453+0000","last_peered":"2024-09-11T11:04:17.938453+0000","last_clean":"2024-09-11T11:04:17.938453+0000","last_became_active":"2024-09-11T11:01:05.332747+0000","last_became_peered":"2024-09-11T11:01:05.332747+0000","last_unstale":"2024-09-11T11:04:17.938453+0000","last_undegraded":"2024-09-11T11:04:17.938453+0000","last_fullsized":"2024-09-11T11:04:17.938453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.035837+0000","last_change":"2024-09-11T11:01:03.336167+0000","last_active":"2024-09-11T11:03:18.035837+0000","last_peered":"2024-09-11T11:03:18.035837+0000","last_clean":"2024-09-11T11:03:18.035837+0000","last_became_active":"2024-09-11T11:01:03.335854+0000","last_became_peered":"2024-09-11T11:01:03.335854+0000","last_unstale":"2024-09-11T11:03:18.035837+0000","last_undegraded":"2024-09-11T11:03:18.035837+0000","last_fullsized":"2024-09-11T11:03:18.035837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.035264+0000","last_change":"2024-09-11T11:01:05.344244+0000","last_active":"2024-09-11T11:03:23.035264+0000","last_peered":"2024-09-11T11:03:23.035264+0000","last_clean":"2024-09-11T11:03:23.035264+0000","last_became_active":"2024-09-11T11:01:05.343590+0000","last_became_peered":"2024-09-11T11:01:05.343590+0000","last_unstale":"2024-09-11T11:03:23.035264+0000","last_undegraded":"2024-09-11T11:03:23.035264+0000","last_fullsized":"2024-09-11T11:03:23.035264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038524+0000","last_change":"2024-09-11T11:01:03.339537+0000","last_active":"2024-09-11T11:03:21.038524+0000","last_peered":"2024-09-11T11:03:21.038524+0000","last_clean":"2024-09-11T11:03:21.038524+0000","last_became_active":"2024-09-11T11:01:03.336224+0000","last_became_peered":"2024-09-11T11:01:03.336224+0000","last_unstale":"2024-09-11T11:03:21.038524+0000","last_undegraded":"2024-09-11T11:03:21.038524+0000","last_fullsized":"2024-09-11T11:03:21.038524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.038640+0000","last_change":"2024-09-11T11:01:05.342088+0000","last_active":"2024-09-11T11:03:23.038640+0000","last_peered":"2024-09-11T11:03:23.038640+0000","last_clean":"2024-09-11T11:03:23.038640+0000","last_became_active":"2024-09-11T11:01:05.341761+0000","last_became_peered":"2024-09-11T11:01:05.341761+0000","last_unstale":"2024-09-11T11:03:23.038640+0000","last_undegraded":"2024-09-11T11:03:23.038640+0000","last_fullsized":"2024-09-11T11:03:23.038640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.037204+0000","last_change":"2024-09-11T11:01:03.320022+0000","last_active":"2024-09-11T11:03:18.037204+0000","last_peered":"2024-09-11T11:03:18.037204+0000","last_clean":"2024-09-11T11:03:18.037204+0000","last_became_active":"2024-09-11T11:01:03.318984+0000","last_became_peered":"2024-09-11T11:01:03.318984+0000","last_unstale":"2024-09-11T11:03:18.037204+0000","last_undegraded":"2024-09-11T11:03:18.037204+0000","last_fullsized":"2024-09-11T11:03:18.037204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.789250+0000","last_change":"2024-09-11T11:01:42.059933+0000","last_active":"2024-09-11T11:04:17.789250+0000","last_peered":"2024-09-11T11:04:17.789250+0000","last_clean":"2024-09-11T11:04:17.789250+0000","last_became_active":"2024-09-11T11:01:42.059147+0000","last_became_peered":"2024-09-11T11:01:42.059147+0000","last_unstale":"2024-09-11T11:04:17.789250+0000","last_undegraded":"2024-09-11T11:04:17.789250+0000","last_fullsized":"2024-09-11T11:04:17.789250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:18.036019+0000","last_change":"2024-09-11T11:01:03.350789+0000","last_active":"2024-09-11T11:03:18.036019+0000","last_peered":"2024-09-11T11:03:18.036019+0000","last_clean":"2024-09-11T11:03:18.036019+0000","last_became_active":"2024-09-11T11:01:03.349120+0000","last_became_peered":"2024-09-11T11:01:03.349120+0000","last_unstale":"2024-09-11T11:03:18.036019+0000","last_undegraded":"2024-09-11T11:03:18.036019+0000","last_fullsized":"2024-09-11T11:03:18.036019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'7","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.020245+0000","last_change":"2024-09-11T11:01:05.343458+0000","last_active":"2024-09-11T11:04:18.020245+0000","last_peered":"2024-09-11T11:04:18.020245+0000","last_clean":"2024-09-11T11:04:18.020245+0000","last_became_active":"2024-09-11T11:01:05.343121+0000","last_became_peered":"2024-09-11T11:01:05.343121+0000","last_unstale":"2024-09-11T11:04:18.020245+0000","last_undegraded":"2024-09-11T11:04:18.020245+0000","last_fullsized":"2024-09-11T11:04:18.020245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:58.046966+0000","last_change":"2024-09-11T11:01:42.056195+0000","last_active":"2024-09-11T11:03:58.046966+0000","last_peered":"2024-09-11T11:03:58.046966+0000","last_clean":"2024-09-11T11:03:58.046966+0000","last_became_active":"2024-09-11T11:01:42.055356+0000","last_became_peered":"2024-09-11T11:01:42.055356+0000","last_unstale":"2024-09-11T11:03:58.046966+0000","last_undegraded":"2024-09-11T11:03:58.046966+0000","last_fullsized":"2024-09-11T11:03:58.046966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.037027+0000","last_change":"2024-09-11T11:01:05.346901+0000","last_active":"2024-09-11T11:03:23.037027+0000","last_peered":"2024-09-11T11:03:23.037027+0000","last_clean":"2024-09-11T11:03:23.037027+0000","last_became_active":"2024-09-11T11:01:05.346563+0000","last_became_peered":"2024-09-11T11:01:05.346563+0000","last_unstale":"2024-09-11T11:03:23.037027+0000","last_undegraded":"2024-09-11T11:03:23.037027+0000","last_fullsized":"2024-09-11T11:03:23.037027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.035310+0000","last_change":"2024-09-11T11:01:03.316299+0000","last_active":"2024-09-11T11:03:23.035310+0000","last_peered":"2024-09-11T11:03:23.035310+0000","last_clean":"2024-09-11T11:03:23.035310+0000","last_became_active":"2024-09-11T11:01:03.315651+0000","last_became_peered":"2024-09-11T11:01:03.315651+0000","last_unstale":"2024-09-11T11:03:23.035310+0000","last_undegraded":"2024-09-11T11:03:23.035310+0000","last_fullsized":"2024-09-11T11:03:23.035310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:16.838495+0000","last_change":"2024-09-11T11:01:05.348683+0000","last_active":"2024-09-11T11:03:16.838495+0000","last_peered":"2024-09-11T11:03:16.838495+0000","last_clean":"2024-09-11T11:03:16.838495+0000","last_became_active":"2024-09-11T11:01:05.347760+0000","last_became_peered":"2024-09-11T11:01:05.347760+0000","last_unstale":"2024-09-11T11:03:16.838495+0000","last_undegraded":"2024-09-11T11:03:16.838495+0000","last_fullsized":"2024-09-11T11:03:16.838495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.037351+0000","last_change":"2024-09-11T11:01:03.340726+0000","last_active":"2024-09-11T11:03:23.037351+0000","last_peered":"2024-09-11T11:03:23.037351+0000","last_clean":"2024-09-11T11:03:23.037351+0000","last_became_active":"2024-09-11T11:01:03.337667+0000","last_became_peered":"2024-09-11T11:01:03.337667+0000","last_unstale":"2024-09-11T11:03:23.037351+0000","last_undegraded":"2024-09-11T11:03:23.037351+0000","last_fullsized":"2024-09-11T11:03:23.037351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039646+0000","last_change":"2024-09-11T11:01:03.322086+0000","last_active":"2024-09-11T11:03:26.039646+0000","last_peered":"2024-09-11T11:03:26.039646+0000","last_clean":"2024-09-11T11:03:26.039646+0000","last_became_active":"2024-09-11T11:01:03.321242+0000","last_became_peered":"2024-09-11T11:01:03.321242+0000","last_unstale":"2024-09-11T11:03:26.039646+0000","last_undegraded":"2024-09-11T11:03:26.039646+0000","last_fullsized":"2024-09-11T11:03:26.039646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'12","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.458562+0000","last_change":"2024-09-11T11:01:05.344698+0000","last_active":"2024-09-11T11:04:17.458562+0000","last_peered":"2024-09-11T11:04:17.458562+0000","last_clean":"2024-09-11T11:04:17.458562+0000","last_became_active":"2024-09-11T11:01:05.344285+0000","last_became_peered":"2024-09-11T11:01:05.344285+0000","last_unstale":"2024-09-11T11:04:17.458562+0000","last_undegraded":"2024-09-11T11:04:17.458562+0000","last_fullsized":"2024-09-11T11:04:17.458562+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.038336+0000","last_change":"2024-09-11T11:01:03.325391+0000","last_active":"2024-09-11T11:03:23.038336+0000","last_peered":"2024-09-11T11:03:23.038336+0000","last_clean":"2024-09-11T11:03:23.038336+0000","last_became_active":"2024-09-11T11:01:03.320391+0000","last_became_peered":"2024-09-11T11:01:03.320391+0000","last_unstale":"2024-09-11T11:03:23.038336+0000","last_undegraded":"2024-09-11T11:03:23.038336+0000","last_fullsized":"2024-09-11T11:03:23.038336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:08.045290+0000","last_change":"2024-09-11T11:01:42.076222+0000","last_active":"2024-09-11T11:04:08.045290+0000","last_peered":"2024-09-11T11:04:08.045290+0000","last_clean":"2024-09-11T11:04:08.045290+0000","last_became_active":"2024-09-11T11:01:42.069954+0000","last_became_peered":"2024-09-11T11:01:42.069954+0000","last_unstale":"2024-09-11T11:04:08.045290+0000","last_undegraded":"2024-09-11T11:04:08.045290+0000","last_fullsized":"2024-09-11T11:04:08.045290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":269,"ondisk_log_size":269,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2342,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1489,"ondisk_log_size":1489,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1608,"num_read_kb":1498,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673015,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35788,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336052,"statfs":{"total":96636764160,"available":96600117248,"internally_reserved":0,"allocated":454656,"data_stored":155251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673015,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":744125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40556,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331284,"statfs":{"total":96636764160,"available":96595234816,"internally_reserved":0,"allocated":1077248,"data_stored":746823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":156613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:05:14.633 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.633 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.633 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.633 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.634 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.635 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.636 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.637 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.638 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.638 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.638 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.638 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.638 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.638 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.638 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.639 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.640 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.640 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.640 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.640 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.640 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.640 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.640 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.640 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.641 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.641 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.641 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.641 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.641 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.641 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.641 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.642 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.642 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.642 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.642 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.642 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.642 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.642 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.642 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T11:00:49.442581+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.643 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.644 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.644 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.644 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.644 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.644 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.644 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.644 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.644 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.645 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.646 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.646 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.646 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.646 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.646 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.646 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.646 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.646 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.647 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.647 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.647 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.647 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.647 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.647 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.647 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.647 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.648 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.648 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.648 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.648 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.648 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.648 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.648 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.648 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.649 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.649 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.649 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.649 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.649 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.649 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.649 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.649 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.650 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.650 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.650 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.650 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.650 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.650 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.650 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.650 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-11T11:01:08.329158+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=8, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.651 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.652 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.653 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.653 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.653 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.653 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.653 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.653 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.653 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.653 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.654 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.655 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.656 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.657 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.657 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:14.657 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T11:05:34.658 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:05:34.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbdda4f640 1 Processor -- start 2024-09-11T11:05:34.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbdda4f640 1 -- start start 2024-09-11T11:05:34.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbdda4f640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffbd8071860 0x7ffbd81318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:34.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbdda4f640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbd806c6b0 con 0x7ffbd8070d70 2024-09-11T11:05:34.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbdda4f640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ffbd806c8d0 con 0x7ffbd8071860 2024-09-11T11:05:34.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd67fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffbd8071860 0x7ffbd81318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:34.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd6ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ffbd8070d70 0x7ffbd8071150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:47224/0 (socket says 172.21.15.102:47224) 2024-09-11T11:05:34.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd6ffd640 1 -- 172.21.15.102:0/3822618873 learned_addr learned my addr 172.21.15.102:0/3822618873 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:05:34.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd67fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ffbd8071860 0x7ffbd81318d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52746/0 (socket says 172.21.15.102:52746) 2024-09-11T11:05:34.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd67fc640 1 -- 172.21.15.102:0/3822618873 >> v1:172.21.15.102:6789/0 conn(0x7ffbd8070d70 legacy=0x7ffbd8071150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:34.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd67fc640 1 -- 172.21.15.102:0/3822618873 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd806be20 con 0x7ffbd8071860 2024-09-11T11:05:34.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd67fc640 1 --2- 172.21.15.102:0/3822618873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8071860 0x7ffbd81318d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009740 tx=0x7ffbcc01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8d25a499121bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:34.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd5ffb640 1 -- 172.21.15.102:0/3822618873 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbcc0b1070 con 0x7ffbd8071860 2024-09-11T11:05:34.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd5ffb640 1 -- 172.21.15.102:0/3822618873 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0ac520 con 0x7ffbd8071860 2024-09-11T11:05:34.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.787+0000 7ffbd5ffb640 1 -- 172.21.15.102:0/3822618873 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbcc0ac820 con 0x7ffbd8071860 2024-09-11T11:05:34.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- 172.21.15.102:0/3822618873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8071860 msgr2=0x7ffbd81318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:34.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 --2- 172.21.15.102:0/3822618873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8071860 0x7ffbd81318d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009740 tx=0x7ffbcc01c330 comp rx=0 tx=0).stop 2024-09-11T11:05:34.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- 172.21.15.102:0/3822618873 shutdown_connections 2024-09-11T11:05:34.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 --2- 172.21.15.102:0/3822618873 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8071860 0x7ffbd81318d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:34.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- 172.21.15.102:0/3822618873 >> 172.21.15.102:0/3822618873 conn(0x7ffbd809ac70 msgr2=0x7ffbd806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:05:34.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- 172.21.15.102:0/3822618873 shutdown_connections 2024-09-11T11:05:34.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- 172.21.15.102:0/3822618873 wait complete. 2024-09-11T11:05:34.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 Processor -- start 2024-09-11T11:05:34.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- start start 2024-09-11T11:05:34.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8070d70 0x7ffbd806e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:34.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffbd81349c0 con 0x7ffbd8070d70 2024-09-11T11:05:34.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbd6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8070d70 0x7ffbd806e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:34.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbd6ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8070d70 0x7ffbd806e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:52758/0 (socket says 172.21.15.102:52758) 2024-09-11T11:05:34.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbd6ffd640 1 -- 172.21.15.102:0/4069833359 learned_addr learned my addr 172.21.15.102:0/4069833359 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:05:34.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbd6ffd640 1 -- 172.21.15.102:0/4069833359 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbd8126e80 con 0x7ffbd8070d70 2024-09-11T11:05:34.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbd6ffd640 1 --2- 172.21.15.102:0/4069833359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8070d70 0x7ffbd806e850 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c480 tx=0x7ffbc800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:34.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbbffff640 1 -- 172.21.15.102:0/4069833359 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc8017070 con 0x7ffbd8070d70 2024-09-11T11:05:34.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbbffff640 1 -- 172.21.15.102:0/4069833359 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbc8005c20 con 0x7ffbd8070d70 2024-09-11T11:05:34.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbbffff640 1 -- 172.21.15.102:0/4069833359 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbc8007070 con 0x7ffbd8070d70 2024-09-11T11:05:34.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbd8097bf0 con 0x7ffbd8070d70 2024-09-11T11:05:34.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbd812e450 con 0x7ffbd8070d70 2024-09-11T11:05:34.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbbffff640 1 -- 172.21.15.102:0/4069833359 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7ffbc801a070 con 0x7ffbd8070d70 2024-09-11T11:05:34.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbd8071150 con 0x7ffbd8070d70 2024-09-11T11:05:34.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbbffff640 1 --2- 172.21.15.102:0/4069833359 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ffbc4035db0 0x7ffbc4038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:34.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbbffff640 1 -- 172.21.15.102:0/4069833359 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7ffbc8048360 con 0x7ffbd8070d70 2024-09-11T11:05:34.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.791+0000 7ffbd67fc640 1 --2- 172.21.15.102:0/4069833359 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ffbc4035db0 0x7ffbc4038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:34.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.795+0000 7ffbd67fc640 1 --2- 172.21.15.102:0/4069833359 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ffbc4035db0 0x7ffbc4038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0ae000 tx=0x7ffbcc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:34.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.799+0000 7ffbbffff640 1 -- 172.21.15.102:0/4069833359 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffbc801b480 con 0x7ffbd8070d70 2024-09-11T11:05:34.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.955+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffbd81313f0 con 0x7ffbc4035db0 2024-09-11T11:05:35.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:34.999+0000 7ffbbffff640 1 -- 172.21.15.102:0/4069833359 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661850 (secure 0 0 0) 0x7ffbd81313f0 con 0x7ffbc4035db0 2024-09-11T11:05:35.006 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:05:35.013 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:05:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ffbc4035db0 msgr2=0x7ffbc4038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 --2- 172.21.15.102:0/4069833359 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ffbc4035db0 0x7ffbc4038270 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0ae000 tx=0x7ffbcc0a7000 comp rx=0 tx=0).stop 2024-09-11T11:05:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8070d70 msgr2=0x7ffbd806e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 --2- 172.21.15.102:0/4069833359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8070d70 0x7ffbd806e850 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c480 tx=0x7ffbc800c940 comp rx=0 tx=0).stop 2024-09-11T11:05:35.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 shutdown_connections 2024-09-11T11:05:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 --2- 172.21.15.102:0/4069833359 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7ffbc4035db0 0x7ffbc4038270 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 --2- 172.21.15.102:0/4069833359 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffbd8070d70 0x7ffbd806e850 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 >> 172.21.15.102:0/4069833359 conn(0x7ffbd809ac70 msgr2=0x7ffbd8126090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:05:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 shutdown_connections 2024-09-11T11:05:35.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:35.011+0000 7ffbdda4f640 1 -- 172.21.15.102:0/4069833359 wait complete. 2024-09-11T11:05:35.032 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-11T11:05:33.070931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5090,"num_read_kb":4675,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4786,"ondisk_log_size":4786,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160992,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326368,"statfs":{"total":386547056640,"available":386382200832,"internally_reserved":0,"allocated":3047424,"data_stored":1802812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006181"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.440260+0000","last_change":"2024-09-11T11:01:03.337877+0000","last_active":"2024-09-11T11:04:52.440260+0000","last_peered":"2024-09-11T11:04:52.440260+0000","last_clean":"2024-09-11T11:04:52.440260+0000","last_became_active":"2024-09-11T11:01:03.336333+0000","last_became_peered":"2024-09-11T11:01:03.336333+0000","last_unstale":"2024-09-11T11:04:52.440260+0000","last_undegraded":"2024-09-11T11:04:52.440260+0000","last_fullsized":"2024-09-11T11:04:52.440260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.638621+0000","last_change":"2024-09-11T11:05:30.638687+0000","last_active":"2024-09-11T11:05:30.638621+0000","last_peered":"2024-09-11T11:05:30.638621+0000","last_clean":"2024-09-11T11:05:30.638621+0000","last_became_active":"2024-09-11T11:01:05.332897+0000","last_became_peered":"2024-09-11T11:01:05.332897+0000","last_unstale":"2024-09-11T11:05:30.638621+0000","last_undegraded":"2024-09-11T11:05:30.638621+0000","last_fullsized":"2024-09-11T11:05:30.638621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:30.638397+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:30.638397+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.638397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:26.020290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881354+0000","last_change":"2024-09-11T11:01:03.346417+0000","last_active":"2024-09-11T11:04:52.881354+0000","last_peered":"2024-09-11T11:04:52.881354+0000","last_clean":"2024-09-11T11:04:52.881354+0000","last_became_active":"2024-09-11T11:01:03.346113+0000","last_became_peered":"2024-09-11T11:01:03.346113+0000","last_unstale":"2024-09-11T11:04:52.881354+0000","last_undegraded":"2024-09-11T11:04:52.881354+0000","last_fullsized":"2024-09-11T11:04:52.881354+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.041104+0000","last_change":"2024-09-11T11:01:05.333693+0000","last_active":"2024-09-11T11:03:38.041104+0000","last_peered":"2024-09-11T11:03:38.041104+0000","last_clean":"2024-09-11T11:03:38.041104+0000","last_became_active":"2024-09-11T11:01:05.330885+0000","last_became_peered":"2024-09-11T11:01:05.330885+0000","last_unstale":"2024-09-11T11:03:38.041104+0000","last_undegraded":"2024-09-11T11:03:38.041104+0000","last_fullsized":"2024-09-11T11:03:38.041104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787980+0000","last_change":"2024-09-11T11:01:03.346111+0000","last_active":"2024-09-11T11:04:53.787980+0000","last_peered":"2024-09-11T11:04:53.787980+0000","last_clean":"2024-09-11T11:04:53.787980+0000","last_became_active":"2024-09-11T11:01:03.345673+0000","last_became_peered":"2024-09-11T11:01:03.345673+0000","last_unstale":"2024-09-11T11:04:53.787980+0000","last_undegraded":"2024-09-11T11:04:53.787980+0000","last_fullsized":"2024-09-11T11:04:53.787980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'12","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.457605+0000","last_change":"2024-09-11T11:01:05.331041+0000","last_active":"2024-09-11T11:04:17.457605+0000","last_peered":"2024-09-11T11:04:17.457605+0000","last_clean":"2024-09-11T11:04:17.457605+0000","last_became_active":"2024-09-11T11:01:05.330639+0000","last_became_peered":"2024-09-11T11:01:05.330639+0000","last_unstale":"2024-09-11T11:04:17.457605+0000","last_undegraded":"2024-09-11T11:04:17.457605+0000","last_fullsized":"2024-09-11T11:04:17.457605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:32.267553+0000","last_change":"2024-09-11T11:05:32.267614+0000","last_active":"2024-09-11T11:05:32.267553+0000","last_peered":"2024-09-11T11:05:32.267553+0000","last_clean":"2024-09-11T11:05:32.267553+0000","last_became_active":"2024-09-11T11:01:03.335132+0000","last_became_peered":"2024-09-11T11:01:03.335132+0000","last_unstale":"2024-09-11T11:05:32.267553+0000","last_undegraded":"2024-09-11T11:05:32.267553+0000","last_fullsized":"2024-09-11T11:05:32.267553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:32.267363+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:32.267363+0000","last_clean_scrub_stamp":"2024-09-11T11:05:32.267363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:39:39.620550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.976093+0000","last_change":"2024-09-11T11:05:29.976154+0000","last_active":"2024-09-11T11:05:29.976093+0000","last_peered":"2024-09-11T11:05:29.976093+0000","last_clean":"2024-09-11T11:05:29.976093+0000","last_became_active":"2024-09-11T11:01:05.339018+0000","last_became_peered":"2024-09-11T11:01:05.339018+0000","last_unstale":"2024-09-11T11:05:29.976093+0000","last_undegraded":"2024-09-11T11:05:29.976093+0000","last_fullsized":"2024-09-11T11:05:29.976093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:29.975892+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:29.975892+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.975892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:54:20.926150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042259+0000","last_change":"2024-09-11T11:01:03.324287+0000","last_active":"2024-09-11T11:03:36.042259+0000","last_peered":"2024-09-11T11:03:36.042259+0000","last_clean":"2024-09-11T11:03:36.042259+0000","last_became_active":"2024-09-11T11:01:03.322877+0000","last_became_peered":"2024-09-11T11:01:03.322877+0000","last_unstale":"2024-09-11T11:03:36.042259+0000","last_undegraded":"2024-09-11T11:03:36.042259+0000","last_fullsized":"2024-09-11T11:03:36.042259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.759603+0000","last_change":"2024-09-11T11:05:19.759671+0000","last_active":"2024-09-11T11:05:19.759603+0000","last_peered":"2024-09-11T11:05:19.759603+0000","last_clean":"2024-09-11T11:05:19.759603+0000","last_became_active":"2024-09-11T11:01:05.353908+0000","last_became_peered":"2024-09-11T11:01:05.353908+0000","last_unstale":"2024-09-11T11:05:19.759603+0000","last_undegraded":"2024-09-11T11:05:19.759603+0000","last_fullsized":"2024-09-11T11:05:19.759603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:19.759407+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:19.759407+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.759407+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:40.655656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042217+0000","last_change":"2024-09-11T11:01:03.346652+0000","last_active":"2024-09-11T11:03:36.042217+0000","last_peered":"2024-09-11T11:03:36.042217+0000","last_clean":"2024-09-11T11:03:36.042217+0000","last_became_active":"2024-09-11T11:01:03.345964+0000","last_became_peered":"2024-09-11T11:01:03.345964+0000","last_unstale":"2024-09-11T11:03:36.042217+0000","last_undegraded":"2024-09-11T11:03:36.042217+0000","last_fullsized":"2024-09-11T11:03:36.042217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'14","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.563987+0000","last_change":"2024-09-11T11:05:26.564047+0000","last_active":"2024-09-11T11:05:26.563987+0000","last_peered":"2024-09-11T11:05:26.563987+0000","last_clean":"2024-09-11T11:05:26.563987+0000","last_became_active":"2024-09-11T11:01:05.345664+0000","last_became_peered":"2024-09-11T11:01:05.345664+0000","last_unstale":"2024-09-11T11:05:26.563987+0000","last_undegraded":"2024-09-11T11:05:26.563987+0000","last_fullsized":"2024-09-11T11:05:26.563987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:26.563791+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:26.563791+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.563791+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:18.491908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.039856+0000","last_change":"2024-09-11T11:01:03.349146+0000","last_active":"2024-09-11T11:03:33.039856+0000","last_peered":"2024-09-11T11:03:33.039856+0000","last_clean":"2024-09-11T11:03:33.039856+0000","last_became_active":"2024-09-11T11:01:03.348822+0000","last_became_peered":"2024-09-11T11:01:03.348822+0000","last_unstale":"2024-09-11T11:03:33.039856+0000","last_undegraded":"2024-09-11T11:03:33.039856+0000","last_fullsized":"2024-09-11T11:03:33.039856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.557877+0000","last_change":"2024-09-11T11:05:24.557938+0000","last_active":"2024-09-11T11:05:24.557877+0000","last_peered":"2024-09-11T11:05:24.557877+0000","last_clean":"2024-09-11T11:05:24.557877+0000","last_became_active":"2024-09-11T11:01:05.345698+0000","last_became_peered":"2024-09-11T11:01:05.345698+0000","last_unstale":"2024-09-11T11:05:24.557877+0000","last_undegraded":"2024-09-11T11:05:24.557877+0000","last_fullsized":"2024-09-11T11:05:24.557877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:24.557683+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:24.557683+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.557683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:54:15.507940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.039729+0000","last_change":"2024-09-11T11:01:03.336343+0000","last_active":"2024-09-11T11:03:33.039729+0000","last_peered":"2024-09-11T11:03:33.039729+0000","last_clean":"2024-09-11T11:03:33.039729+0000","last_became_active":"2024-09-11T11:01:03.335830+0000","last_became_peered":"2024-09-11T11:01:03.335830+0000","last_unstale":"2024-09-11T11:03:33.039729+0000","last_undegraded":"2024-09-11T11:03:33.039729+0000","last_fullsized":"2024-09-11T11:03:33.039729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.099939+0000","last_change":"2024-09-11T11:05:11.099939+0000","last_active":"2024-09-11T11:05:11.099939+0000","last_peered":"2024-09-11T11:05:11.099939+0000","last_clean":"2024-09-11T11:05:11.099939+0000","last_became_active":"2024-09-11T11:01:05.343805+0000","last_became_peered":"2024-09-11T11:01:05.343805+0000","last_unstale":"2024-09-11T11:05:11.099939+0000","last_undegraded":"2024-09-11T11:05:11.099939+0000","last_fullsized":"2024-09-11T11:05:11.099939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:11.099653+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:11.099653+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.099653+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:26:10.519865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039672+0000","last_change":"2024-09-11T11:01:05.333623+0000","last_active":"2024-09-11T11:03:26.039672+0000","last_peered":"2024-09-11T11:03:26.039672+0000","last_clean":"2024-09-11T11:03:26.039672+0000","last_became_active":"2024-09-11T11:01:05.332915+0000","last_became_peered":"2024-09-11T11:01:05.332915+0000","last_unstale":"2024-09-11T11:03:26.039672+0000","last_undegraded":"2024-09-11T11:03:26.039672+0000","last_fullsized":"2024-09-11T11:03:26.039672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:32.818792+0000","last_change":"2024-09-11T11:05:32.818873+0000","last_active":"2024-09-11T11:05:32.818792+0000","last_peered":"2024-09-11T11:05:32.818792+0000","last_clean":"2024-09-11T11:05:32.818792+0000","last_became_active":"2024-09-11T11:01:03.346878+0000","last_became_peered":"2024-09-11T11:01:03.346878+0000","last_unstale":"2024-09-11T11:05:32.818792+0000","last_undegraded":"2024-09-11T11:05:32.818792+0000","last_fullsized":"2024-09-11T11:05:32.818792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:32.818568+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:32.818568+0000","last_clean_scrub_stamp":"2024-09-11T11:05:32.818568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:06:00.813359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:03.044062+0000","last_change":"2024-09-11T11:01:42.051383+0000","last_active":"2024-09-11T11:04:03.044062+0000","last_peered":"2024-09-11T11:04:03.044062+0000","last_clean":"2024-09-11T11:04:03.044062+0000","last_became_active":"2024-09-11T11:01:42.050609+0000","last_became_peered":"2024-09-11T11:01:42.050609+0000","last_unstale":"2024-09-11T11:04:03.044062+0000","last_undegraded":"2024-09-11T11:04:03.044062+0000","last_fullsized":"2024-09-11T11:04:03.044062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036400+0000","last_change":"2024-09-11T11:01:03.335675+0000","last_active":"2024-09-11T11:03:28.036400+0000","last_peered":"2024-09-11T11:03:28.036400+0000","last_clean":"2024-09-11T11:03:28.036400+0000","last_became_active":"2024-09-11T11:01:03.335121+0000","last_became_peered":"2024-09-11T11:01:03.335121+0000","last_unstale":"2024-09-11T11:03:28.036400+0000","last_undegraded":"2024-09-11T11:03:28.036400+0000","last_fullsized":"2024-09-11T11:03:28.036400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039782+0000","last_change":"2024-09-11T11:01:05.332966+0000","last_active":"2024-09-11T11:03:26.039782+0000","last_peered":"2024-09-11T11:03:26.039782+0000","last_clean":"2024-09-11T11:03:26.039782+0000","last_became_active":"2024-09-11T11:01:05.332299+0000","last_became_peered":"2024-09-11T11:01:05.332299+0000","last_unstale":"2024-09-11T11:03:26.039782+0000","last_undegraded":"2024-09-11T11:03:26.039782+0000","last_fullsized":"2024-09-11T11:03:26.039782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:31.041092+0000","last_change":"2024-09-11T11:01:03.346356+0000","last_active":"2024-09-11T11:03:31.041092+0000","last_peered":"2024-09-11T11:03:31.041092+0000","last_clean":"2024-09-11T11:03:31.041092+0000","last_became_active":"2024-09-11T11:01:03.345528+0000","last_became_peered":"2024-09-11T11:01:03.345528+0000","last_unstale":"2024-09-11T11:03:31.041092+0000","last_undegraded":"2024-09-11T11:03:31.041092+0000","last_fullsized":"2024-09-11T11:03:31.041092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.098812+0000","last_change":"2024-09-11T11:05:17.098881+0000","last_active":"2024-09-11T11:05:17.098812+0000","last_peered":"2024-09-11T11:05:17.098812+0000","last_clean":"2024-09-11T11:05:17.098812+0000","last_became_active":"2024-09-11T11:01:05.352754+0000","last_became_peered":"2024-09-11T11:01:05.352754+0000","last_unstale":"2024-09-11T11:05:17.098812+0000","last_undegraded":"2024-09-11T11:05:17.098812+0000","last_fullsized":"2024-09-11T11:05:17.098812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:17.098602+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:17.098602+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.098602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:55:03.563158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:31.041027+0000","last_change":"2024-09-11T11:01:03.323543+0000","last_active":"2024-09-11T11:03:31.041027+0000","last_peered":"2024-09-11T11:03:31.041027+0000","last_clean":"2024-09-11T11:03:31.041027+0000","last_became_active":"2024-09-11T11:01:03.321411+0000","last_became_peered":"2024-09-11T11:01:03.321411+0000","last_unstale":"2024-09-11T11:03:31.041027+0000","last_undegraded":"2024-09-11T11:03:31.041027+0000","last_fullsized":"2024-09-11T11:03:31.041027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'32","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.206616+0000","last_change":"2024-09-11T11:05:22.206736+0000","last_active":"2024-09-11T11:05:22.206616+0000","last_peered":"2024-09-11T11:05:22.206616+0000","last_clean":"2024-09-11T11:05:22.206616+0000","last_became_active":"2024-09-11T11:01:05.337040+0000","last_became_peered":"2024-09-11T11:01:05.337040+0000","last_unstale":"2024-09-11T11:05:22.206616+0000","last_undegraded":"2024-09-11T11:05:22.206616+0000","last_fullsized":"2024-09-11T11:05:22.206616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'32","last_scrub_stamp":"2024-09-11T11:05:22.206344+0000","last_deep_scrub":"36'32","last_deep_scrub_stamp":"2024-09-11T11:05:22.206344+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.206344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:41:54.884487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.763074+0000","last_change":"2024-09-11T11:01:03.334314+0000","last_active":"2024-09-11T11:04:17.763074+0000","last_peered":"2024-09-11T11:04:17.763074+0000","last_clean":"2024-09-11T11:04:17.763074+0000","last_became_active":"2024-09-11T11:01:03.333820+0000","last_became_peered":"2024-09-11T11:01:03.333820+0000","last_unstale":"2024-09-11T11:04:17.763074+0000","last_undegraded":"2024-09-11T11:04:17.763074+0000","last_fullsized":"2024-09-11T11:04:17.763074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.591150+0000","last_change":"2024-09-11T11:01:05.342829+0000","last_active":"2024-09-11T11:04:17.591150+0000","last_peered":"2024-09-11T11:04:17.591150+0000","last_clean":"2024-09-11T11:04:17.591150+0000","last_became_active":"2024-09-11T11:01:05.342461+0000","last_became_peered":"2024-09-11T11:01:05.342461+0000","last_unstale":"2024-09-11T11:04:17.591150+0000","last_undegraded":"2024-09-11T11:04:17.591150+0000","last_fullsized":"2024-09-11T11:04:17.591150+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'4","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.080842+0000","last_change":"2024-09-11T11:01:03.346138+0000","last_active":"2024-09-11T11:04:49.080842+0000","last_peered":"2024-09-11T11:04:49.080842+0000","last_clean":"2024-09-11T11:04:49.080842+0000","last_became_active":"2024-09-11T11:01:03.345866+0000","last_became_peered":"2024-09-11T11:01:03.345866+0000","last_unstale":"2024-09-11T11:04:49.080842+0000","last_undegraded":"2024-09-11T11:04:49.080842+0000","last_fullsized":"2024-09-11T11:04:49.080842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'38","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.928354+0000","last_change":"2024-09-11T11:05:09.928423+0000","last_active":"2024-09-11T11:05:09.928354+0000","last_peered":"2024-09-11T11:05:09.928354+0000","last_clean":"2024-09-11T11:05:09.928354+0000","last_became_active":"2024-09-11T11:01:13.410232+0000","last_became_peered":"2024-09-11T11:01:13.410232+0000","last_unstale":"2024-09-11T11:05:09.928354+0000","last_undegraded":"2024-09-11T11:05:09.928354+0000","last_fullsized":"2024-09-11T11:05:09.928354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-11T11:05:09.928140+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-11T11:05:09.928140+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.928140+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:11.772636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'14","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.871342+0000","last_change":"2024-09-11T11:05:25.871402+0000","last_active":"2024-09-11T11:05:25.871342+0000","last_peered":"2024-09-11T11:05:25.871342+0000","last_clean":"2024-09-11T11:05:25.871342+0000","last_became_active":"2024-09-11T11:01:05.347254+0000","last_became_peered":"2024-09-11T11:01:05.347254+0000","last_unstale":"2024-09-11T11:05:25.871342+0000","last_undegraded":"2024-09-11T11:05:25.871342+0000","last_fullsized":"2024-09-11T11:05:25.871342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:25.871155+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:25.871155+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.871155+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:49:47.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.735004+0000","last_change":"2024-09-11T11:01:03.341239+0000","last_active":"2024-09-11T11:04:17.735004+0000","last_peered":"2024-09-11T11:04:17.735004+0000","last_clean":"2024-09-11T11:04:17.735004+0000","last_became_active":"2024-09-11T11:01:03.340851+0000","last_became_peered":"2024-09-11T11:01:03.340851+0000","last_unstale":"2024-09-11T11:04:17.735004+0000","last_undegraded":"2024-09-11T11:04:17.735004+0000","last_fullsized":"2024-09-11T11:04:17.735004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.702240+0000","last_change":"2024-09-11T11:05:00.702297+0000","last_active":"2024-09-11T11:05:00.702240+0000","last_peered":"2024-09-11T11:05:00.702240+0000","last_clean":"2024-09-11T11:05:00.702240+0000","last_became_active":"2024-09-11T11:01:07.363392+0000","last_became_peered":"2024-09-11T11:01:07.363392+0000","last_unstale":"2024-09-11T11:05:00.702240+0000","last_undegraded":"2024-09-11T11:05:00.702240+0000","last_fullsized":"2024-09-11T11:05:00.702240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.702044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.702044+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.702044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:35.422637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'37","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.718686+0000","last_change":"2024-09-11T11:05:09.718768+0000","last_active":"2024-09-11T11:05:09.718686+0000","last_peered":"2024-09-11T11:05:09.718686+0000","last_clean":"2024-09-11T11:05:09.718686+0000","last_became_active":"2024-09-11T11:01:09.392044+0000","last_became_peered":"2024-09-11T11:01:09.392044+0000","last_unstale":"2024-09-11T11:05:09.718686+0000","last_undegraded":"2024-09-11T11:05:09.718686+0000","last_fullsized":"2024-09-11T11:05:09.718686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:05:09.718489+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:05:09.718489+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.718489+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:24.928510+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.525882+0000","last_change":"2024-09-11T11:05:21.525939+0000","last_active":"2024-09-11T11:05:21.525882+0000","last_peered":"2024-09-11T11:05:21.525882+0000","last_clean":"2024-09-11T11:05:21.525882+0000","last_became_active":"2024-09-11T11:01:11.399820+0000","last_became_peered":"2024-09-11T11:01:11.399820+0000","last_unstale":"2024-09-11T11:05:21.525882+0000","last_undegraded":"2024-09-11T11:05:21.525882+0000","last_fullsized":"2024-09-11T11:05:21.525882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:21.525658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:21.525658+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.525658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:58.144083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:41.043322+0000","last_change":"2024-09-11T11:01:13.421600+0000","last_active":"2024-09-11T11:03:41.043322+0000","last_peered":"2024-09-11T11:03:41.043322+0000","last_clean":"2024-09-11T11:03:41.043322+0000","last_became_active":"2024-09-11T11:01:13.420843+0000","last_became_peered":"2024-09-11T11:01:13.420843+0000","last_unstale":"2024-09-11T11:03:41.043322+0000","last_undegraded":"2024-09-11T11:03:41.043322+0000","last_fullsized":"2024-09-11T11:03:41.043322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'17","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:18.019946+0000","last_change":"2024-09-11T11:01:05.335422+0000","last_active":"2024-09-11T11:04:18.019946+0000","last_peered":"2024-09-11T11:04:18.019946+0000","last_clean":"2024-09-11T11:04:18.019946+0000","last_became_active":"2024-09-11T11:01:05.334085+0000","last_became_peered":"2024-09-11T11:01:05.334085+0000","last_unstale":"2024-09-11T11:04:18.019946+0000","last_undegraded":"2024-09-11T11:04:18.019946+0000","last_fullsized":"2024-09-11T11:04:18.019946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.035144+0000","last_change":"2024-09-11T11:01:03.335761+0000","last_active":"2024-09-11T11:03:23.035144+0000","last_peered":"2024-09-11T11:03:23.035144+0000","last_clean":"2024-09-11T11:03:23.035144+0000","last_became_active":"2024-09-11T11:01:03.335439+0000","last_became_peered":"2024-09-11T11:01:03.335439+0000","last_unstale":"2024-09-11T11:03:23.035144+0000","last_undegraded":"2024-09-11T11:03:23.035144+0000","last_fullsized":"2024-09-11T11:03:23.035144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.792216+0000","last_change":"2024-09-11T11:05:17.792269+0000","last_active":"2024-09-11T11:05:17.792216+0000","last_peered":"2024-09-11T11:05:17.792216+0000","last_clean":"2024-09-11T11:05:17.792216+0000","last_became_active":"2024-09-11T11:01:07.350851+0000","last_became_peered":"2024-09-11T11:01:07.350851+0000","last_unstale":"2024-09-11T11:05:17.792216+0000","last_undegraded":"2024-09-11T11:05:17.792216+0000","last_fullsized":"2024-09-11T11:05:17.792216+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:17.792030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:17.792030+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.792030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:12.128368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.834553+0000","last_change":"2024-09-11T11:05:00.834620+0000","last_active":"2024-09-11T11:05:00.834553+0000","last_peered":"2024-09-11T11:05:00.834553+0000","last_clean":"2024-09-11T11:05:00.834553+0000","last_became_active":"2024-09-11T11:01:09.382890+0000","last_became_peered":"2024-09-11T11:01:09.382890+0000","last_unstale":"2024-09-11T11:05:00.834553+0000","last_undegraded":"2024-09-11T11:05:00.834553+0000","last_fullsized":"2024-09-11T11:05:00.834553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:00.834344+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:00.834344+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.834344+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:37:29.350377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.589501+0000","last_change":"2024-09-11T11:05:29.589554+0000","last_active":"2024-09-11T11:05:29.589501+0000","last_peered":"2024-09-11T11:05:29.589501+0000","last_clean":"2024-09-11T11:05:29.589501+0000","last_became_active":"2024-09-11T11:01:11.400881+0000","last_became_peered":"2024-09-11T11:01:11.400881+0000","last_unstale":"2024-09-11T11:05:29.589501+0000","last_undegraded":"2024-09-11T11:05:29.589501+0000","last_fullsized":"2024-09-11T11:05:29.589501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:29.589300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:29.589300+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.589300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:07:20.230027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:43.042501+0000","last_change":"2024-09-11T11:01:13.423960+0000","last_active":"2024-09-11T11:03:43.042501+0000","last_peered":"2024-09-11T11:03:43.042501+0000","last_clean":"2024-09-11T11:03:43.042501+0000","last_became_active":"2024-09-11T11:01:13.422439+0000","last_became_peered":"2024-09-11T11:01:13.422439+0000","last_unstale":"2024-09-11T11:03:43.042501+0000","last_undegraded":"2024-09-11T11:03:43.042501+0000","last_fullsized":"2024-09-11T11:03:43.042501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.949292+0000","last_change":"2024-09-11T11:05:31.949348+0000","last_active":"2024-09-11T11:05:31.949292+0000","last_peered":"2024-09-11T11:05:31.949292+0000","last_clean":"2024-09-11T11:05:31.949292+0000","last_became_active":"2024-09-11T11:01:05.343489+0000","last_became_peered":"2024-09-11T11:01:05.343489+0000","last_unstale":"2024-09-11T11:05:31.949292+0000","last_undegraded":"2024-09-11T11:05:31.949292+0000","last_fullsized":"2024-09-11T11:05:31.949292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:31.949083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:31.949083+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.949083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:23.877200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039713+0000","last_change":"2024-09-11T11:01:03.338861+0000","last_active":"2024-09-11T11:03:26.039713+0000","last_peered":"2024-09-11T11:03:26.039713+0000","last_clean":"2024-09-11T11:03:26.039713+0000","last_became_active":"2024-09-11T11:01:03.337993+0000","last_became_peered":"2024-09-11T11:01:03.337993+0000","last_unstale":"2024-09-11T11:03:26.039713+0000","last_undegraded":"2024-09-11T11:03:26.039713+0000","last_fullsized":"2024-09-11T11:03:26.039713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.680699+0000","last_change":"2024-09-11T11:05:01.680805+0000","last_active":"2024-09-11T11:05:01.680699+0000","last_peered":"2024-09-11T11:05:01.680699+0000","last_clean":"2024-09-11T11:05:01.680699+0000","last_became_active":"2024-09-11T11:01:07.363656+0000","last_became_peered":"2024-09-11T11:01:07.363656+0000","last_unstale":"2024-09-11T11:05:01.680699+0000","last_undegraded":"2024-09-11T11:05:01.680699+0000","last_fullsized":"2024-09-11T11:05:01.680699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.680409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.680409+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.680409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:58.475877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.060236+0000","last_change":"2024-09-11T11:05:08.060383+0000","last_active":"2024-09-11T11:05:08.060236+0000","last_peered":"2024-09-11T11:05:08.060236+0000","last_clean":"2024-09-11T11:05:08.060236+0000","last_became_active":"2024-09-11T11:01:09.365291+0000","last_became_peered":"2024-09-11T11:01:09.365291+0000","last_unstale":"2024-09-11T11:05:08.060236+0000","last_undegraded":"2024-09-11T11:05:08.060236+0000","last_fullsized":"2024-09-11T11:05:08.060236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:05:08.060026+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:05:08.060026+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.060026+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:05:14.856797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.459581+0000","last_change":"2024-09-11T11:05:03.459650+0000","last_active":"2024-09-11T11:05:03.459581+0000","last_peered":"2024-09-11T11:05:03.459581+0000","last_clean":"2024-09-11T11:05:03.459581+0000","last_became_active":"2024-09-11T11:01:11.384635+0000","last_became_peered":"2024-09-11T11:01:11.384635+0000","last_unstale":"2024-09-11T11:05:03.459581+0000","last_undegraded":"2024-09-11T11:05:03.459581+0000","last_fullsized":"2024-09-11T11:05:03.459581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:03.459391+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:03.459391+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.459391+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:45.406062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.952085+0000","last_change":"2024-09-11T11:05:04.952144+0000","last_active":"2024-09-11T11:05:04.952085+0000","last_peered":"2024-09-11T11:05:04.952085+0000","last_clean":"2024-09-11T11:05:04.952085+0000","last_became_active":"2024-09-11T11:01:13.413465+0000","last_became_peered":"2024-09-11T11:01:13.413465+0000","last_unstale":"2024-09-11T11:05:04.952085+0000","last_undegraded":"2024-09-11T11:05:04.952085+0000","last_fullsized":"2024-09-11T11:05:04.952085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:04.951892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:04.951892+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.951892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:22.063365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.851906+0000","last_change":"2024-09-11T11:05:24.851968+0000","last_active":"2024-09-11T11:05:24.851906+0000","last_peered":"2024-09-11T11:05:24.851906+0000","last_clean":"2024-09-11T11:05:24.851906+0000","last_became_active":"2024-09-11T11:01:05.347434+0000","last_became_peered":"2024-09-11T11:01:05.347434+0000","last_unstale":"2024-09-11T11:05:24.851906+0000","last_undegraded":"2024-09-11T11:05:24.851906+0000","last_fullsized":"2024-09-11T11:05:24.851906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:24.851668+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:24.851668+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.851668+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:03.456585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"36'6","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.081768+0000","last_change":"2024-09-11T11:01:03.322006+0000","last_active":"2024-09-11T11:04:49.081768+0000","last_peered":"2024-09-11T11:04:49.081768+0000","last_clean":"2024-09-11T11:04:49.081768+0000","last_became_active":"2024-09-11T11:01:03.320684+0000","last_became_peered":"2024-09-11T11:01:03.320684+0000","last_unstale":"2024-09-11T11:04:49.081768+0000","last_undegraded":"2024-09-11T11:04:49.081768+0000","last_fullsized":"2024-09-11T11:04:49.081768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.523432+0000","last_change":"2024-09-11T11:05:15.523485+0000","last_active":"2024-09-11T11:05:15.523432+0000","last_peered":"2024-09-11T11:05:15.523432+0000","last_clean":"2024-09-11T11:05:15.523432+0000","last_became_active":"2024-09-11T11:01:07.342607+0000","last_became_peered":"2024-09-11T11:01:07.342607+0000","last_unstale":"2024-09-11T11:05:15.523432+0000","last_undegraded":"2024-09-11T11:05:15.523432+0000","last_fullsized":"2024-09-11T11:05:15.523432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:15.523235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:15.523235+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.523235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:57.922368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.528932+0000","last_change":"2024-09-11T11:05:01.529010+0000","last_active":"2024-09-11T11:05:01.528932+0000","last_peered":"2024-09-11T11:05:01.528932+0000","last_clean":"2024-09-11T11:05:01.528932+0000","last_became_active":"2024-09-11T11:01:09.366811+0000","last_became_peered":"2024-09-11T11:01:09.366811+0000","last_unstale":"2024-09-11T11:05:01.528932+0000","last_undegraded":"2024-09-11T11:05:01.528932+0000","last_fullsized":"2024-09-11T11:05:01.528932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-11T11:05:01.528740+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-11T11:05:01.528740+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.528740+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:15.569259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.811349+0000","last_change":"2024-09-11T11:05:14.811502+0000","last_active":"2024-09-11T11:05:14.811349+0000","last_peered":"2024-09-11T11:05:14.811349+0000","last_clean":"2024-09-11T11:05:14.811349+0000","last_became_active":"2024-09-11T11:01:11.399213+0000","last_became_peered":"2024-09-11T11:01:11.399213+0000","last_unstale":"2024-09-11T11:05:14.811349+0000","last_undegraded":"2024-09-11T11:05:14.811349+0000","last_fullsized":"2024-09-11T11:05:14.811349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:14.811094+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:14.811094+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.811094+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:21.184720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.788074+0000","last_change":"2024-09-11T11:01:05.330488+0000","last_active":"2024-09-11T11:04:53.788074+0000","last_peered":"2024-09-11T11:04:53.788074+0000","last_clean":"2024-09-11T11:04:53.788074+0000","last_became_active":"2024-09-11T11:01:05.330091+0000","last_became_peered":"2024-09-11T11:01:05.330091+0000","last_unstale":"2024-09-11T11:04:53.788074+0000","last_undegraded":"2024-09-11T11:04:53.788074+0000","last_fullsized":"2024-09-11T11:04:53.788074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038748+0000","last_change":"2024-09-11T11:01:03.338267+0000","last_active":"2024-09-11T11:03:21.038748+0000","last_peered":"2024-09-11T11:03:21.038748+0000","last_clean":"2024-09-11T11:03:21.038748+0000","last_became_active":"2024-09-11T11:01:03.337496+0000","last_became_peered":"2024-09-11T11:01:03.337496+0000","last_unstale":"2024-09-11T11:03:21.038748+0000","last_undegraded":"2024-09-11T11:03:21.038748+0000","last_fullsized":"2024-09-11T11:03:21.038748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.926709+0000","last_change":"2024-09-11T11:05:11.926709+0000","last_active":"2024-09-11T11:05:11.926709+0000","last_peered":"2024-09-11T11:05:11.926709+0000","last_clean":"2024-09-11T11:05:11.926709+0000","last_became_active":"2024-09-11T11:01:07.366115+0000","last_became_peered":"2024-09-11T11:01:07.366115+0000","last_unstale":"2024-09-11T11:05:11.926709+0000","last_undegraded":"2024-09-11T11:05:11.926709+0000","last_fullsized":"2024-09-11T11:05:11.926709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:11.926427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:11.926427+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.926427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:21.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":116,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.567491+0000","last_change":"2024-09-11T11:05:08.567491+0000","last_active":"2024-09-11T11:05:08.567491+0000","last_peered":"2024-09-11T11:05:08.567491+0000","last_clean":"2024-09-11T11:05:08.567491+0000","last_became_active":"2024-09-11T11:01:09.376242+0000","last_became_peered":"2024-09-11T11:01:09.376242+0000","last_unstale":"2024-09-11T11:05:08.567491+0000","last_undegraded":"2024-09-11T11:05:08.567491+0000","last_fullsized":"2024-09-11T11:05:08.567491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-11T11:05:08.567207+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-11T11:05:08.567207+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.567207+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:00:58.320487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.791799+0000","last_change":"2024-09-11T11:04:59.791900+0000","last_active":"2024-09-11T11:04:59.791799+0000","last_peered":"2024-09-11T11:04:59.791799+0000","last_clean":"2024-09-11T11:04:59.791799+0000","last_became_active":"2024-09-11T11:01:11.377655+0000","last_became_peered":"2024-09-11T11:01:11.377655+0000","last_unstale":"2024-09-11T11:04:59.791799+0000","last_undegraded":"2024-09-11T11:04:59.791799+0000","last_fullsized":"2024-09-11T11:04:59.791799+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.791500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.791500+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.791500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:50.251368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.100323+0000","last_change":"2024-09-11T11:05:09.100323+0000","last_active":"2024-09-11T11:05:09.100323+0000","last_peered":"2024-09-11T11:05:09.100323+0000","last_clean":"2024-09-11T11:05:09.100323+0000","last_became_active":"2024-09-11T11:01:13.420299+0000","last_became_peered":"2024-09-11T11:01:13.420299+0000","last_unstale":"2024-09-11T11:05:09.100323+0000","last_undegraded":"2024-09-11T11:05:09.100323+0000","last_fullsized":"2024-09-11T11:05:09.100323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-11T11:05:09.099958+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-11T11:05:09.099958+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.099958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:33:10.200502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.768459+0000","last_change":"2024-09-11T11:05:18.768459+0000","last_active":"2024-09-11T11:05:18.768459+0000","last_peered":"2024-09-11T11:05:18.768459+0000","last_clean":"2024-09-11T11:05:18.768459+0000","last_became_active":"2024-09-11T11:01:05.355135+0000","last_became_peered":"2024-09-11T11:01:05.355135+0000","last_unstale":"2024-09-11T11:05:18.768459+0000","last_undegraded":"2024-09-11T11:05:18.768459+0000","last_fullsized":"2024-09-11T11:05:18.768459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:18.768214+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:18.768214+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.768214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:21:01.255786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038711+0000","last_change":"2024-09-11T11:01:03.322857+0000","last_active":"2024-09-11T11:03:21.038711+0000","last_peered":"2024-09-11T11:03:21.038711+0000","last_clean":"2024-09-11T11:03:21.038711+0000","last_became_active":"2024-09-11T11:01:03.320605+0000","last_became_peered":"2024-09-11T11:01:03.320605+0000","last_unstale":"2024-09-11T11:03:21.038711+0000","last_undegraded":"2024-09-11T11:03:21.038711+0000","last_fullsized":"2024-09-11T11:03:21.038711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.228408+0000","last_change":"2024-09-11T11:05:25.228408+0000","last_active":"2024-09-11T11:05:25.228408+0000","last_peered":"2024-09-11T11:05:25.228408+0000","last_clean":"2024-09-11T11:05:25.228408+0000","last_became_active":"2024-09-11T11:01:07.348627+0000","last_became_peered":"2024-09-11T11:01:07.348627+0000","last_unstale":"2024-09-11T11:05:25.228408+0000","last_undegraded":"2024-09-11T11:05:25.228408+0000","last_fullsized":"2024-09-11T11:05:25.228408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:25.228148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:25.228148+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.228148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:47.980976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'37","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.803638+0000","last_change":"2024-09-11T11:05:15.803733+0000","last_active":"2024-09-11T11:05:15.803638+0000","last_peered":"2024-09-11T11:05:15.803638+0000","last_clean":"2024-09-11T11:05:15.803638+0000","last_became_active":"2024-09-11T11:01:09.384478+0000","last_became_peered":"2024-09-11T11:01:09.384478+0000","last_unstale":"2024-09-11T11:05:15.803638+0000","last_undegraded":"2024-09-11T11:05:15.803638+0000","last_fullsized":"2024-09-11T11:05:15.803638+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:05:15.803452+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:05:15.803452+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.803452+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:02:03.374998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.809410+0000","last_change":"2024-09-11T11:05:22.809410+0000","last_active":"2024-09-11T11:05:22.809410+0000","last_peered":"2024-09-11T11:05:22.809410+0000","last_clean":"2024-09-11T11:05:22.809410+0000","last_became_active":"2024-09-11T11:01:11.401382+0000","last_became_peered":"2024-09-11T11:01:11.401382+0000","last_unstale":"2024-09-11T11:05:22.809410+0000","last_undegraded":"2024-09-11T11:05:22.809410+0000","last_fullsized":"2024-09-11T11:05:22.809410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:22.809156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:22.809156+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.809156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:39.640451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.782301+0000","last_change":"2024-09-11T11:05:25.782361+0000","last_active":"2024-09-11T11:05:25.782301+0000","last_peered":"2024-09-11T11:05:25.782301+0000","last_clean":"2024-09-11T11:05:25.782301+0000","last_became_active":"2024-09-11T11:01:13.415041+0000","last_became_peered":"2024-09-11T11:01:13.415041+0000","last_unstale":"2024-09-11T11:05:25.782301+0000","last_undegraded":"2024-09-11T11:05:25.782301+0000","last_fullsized":"2024-09-11T11:05:25.782301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:25.782127+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:25.782127+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.782127+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:59:13.498641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'8","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.510039+0000","last_change":"2024-09-11T11:05:23.510039+0000","last_active":"2024-09-11T11:05:23.510039+0000","last_peered":"2024-09-11T11:05:23.510039+0000","last_clean":"2024-09-11T11:05:23.510039+0000","last_became_active":"2024-09-11T11:01:05.347137+0000","last_became_peered":"2024-09-11T11:01:05.347137+0000","last_unstale":"2024-09-11T11:05:23.510039+0000","last_undegraded":"2024-09-11T11:05:23.510039+0000","last_fullsized":"2024-09-11T11:05:23.510039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:23.509784+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:23.509784+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.509784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:35.128425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038650+0000","last_change":"2024-09-11T11:01:42.098396+0000","last_active":"2024-09-11T11:03:21.038650+0000","last_peered":"2024-09-11T11:03:21.038650+0000","last_clean":"2024-09-11T11:03:21.038650+0000","last_became_active":"2024-09-11T11:01:42.065732+0000","last_became_peered":"2024-09-11T11:01:42.065732+0000","last_unstale":"2024-09-11T11:03:21.038650+0000","last_undegraded":"2024-09-11T11:03:21.038650+0000","last_fullsized":"2024-09-11T11:03:21.038650+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.035174+0000","last_change":"2024-09-11T11:01:42.064065+0000","last_active":"2024-09-11T11:03:23.035174+0000","last_peered":"2024-09-11T11:03:23.035174+0000","last_clean":"2024-09-11T11:03:23.035174+0000","last_became_active":"2024-09-11T11:01:42.062781+0000","last_became_peered":"2024-09-11T11:01:42.062781+0000","last_unstale":"2024-09-11T11:03:23.035174+0000","last_undegraded":"2024-09-11T11:03:23.035174+0000","last_fullsized":"2024-09-11T11:03:23.035174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.540432+0000","last_change":"2024-09-11T11:04:53.540432+0000","last_active":"2024-09-11T11:04:53.540432+0000","last_peered":"2024-09-11T11:04:53.540432+0000","last_clean":"2024-09-11T11:04:53.540432+0000","last_became_active":"2024-09-11T11:01:09.362260+0000","last_became_peered":"2024-09-11T11:01:09.362260+0000","last_unstale":"2024-09-11T11:04:53.540432+0000","last_undegraded":"2024-09-11T11:04:53.540432+0000","last_fullsized":"2024-09-11T11:04:53.540432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:04:53.540311+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:04:53.540311+0000","last_clean_scrub_stamp":"2024-09-11T11:04:53.540311+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:22:12.396021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.964081+0000","last_change":"2024-09-11T11:05:03.964081+0000","last_active":"2024-09-11T11:05:03.964081+0000","last_peered":"2024-09-11T11:05:03.964081+0000","last_clean":"2024-09-11T11:05:03.964081+0000","last_became_active":"2024-09-11T11:01:11.391826+0000","last_became_peered":"2024-09-11T11:01:11.391826+0000","last_unstale":"2024-09-11T11:05:03.964081+0000","last_undegraded":"2024-09-11T11:05:03.964081+0000","last_fullsized":"2024-09-11T11:05:03.964081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:03.963831+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:03.963831+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.963831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:53:34.267498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.883391+0000","last_change":"2024-09-11T11:01:13.429296+0000","last_active":"2024-09-11T11:04:52.883391+0000","last_peered":"2024-09-11T11:04:52.883391+0000","last_clean":"2024-09-11T11:04:52.883391+0000","last_became_active":"2024-09-11T11:01:13.428914+0000","last_became_peered":"2024-09-11T11:01:13.428914+0000","last_unstale":"2024-09-11T11:04:52.883391+0000","last_undegraded":"2024-09-11T11:04:52.883391+0000","last_fullsized":"2024-09-11T11:04:52.883391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.074601+0000","last_change":"2024-09-11T11:05:12.074666+0000","last_active":"2024-09-11T11:05:12.074601+0000","last_peered":"2024-09-11T11:05:12.074601+0000","last_clean":"2024-09-11T11:05:12.074601+0000","last_became_active":"2024-09-11T11:01:05.340069+0000","last_became_peered":"2024-09-11T11:01:05.340069+0000","last_unstale":"2024-09-11T11:05:12.074601+0000","last_undegraded":"2024-09-11T11:05:12.074601+0000","last_fullsized":"2024-09-11T11:05:12.074601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:12.074380+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:12.074380+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.074380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:40.669898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.396813+0000","last_change":"2024-09-11T11:01:03.334480+0000","last_active":"2024-09-11T11:04:17.396813+0000","last_peered":"2024-09-11T11:04:17.396813+0000","last_clean":"2024-09-11T11:04:17.396813+0000","last_became_active":"2024-09-11T11:01:03.333740+0000","last_became_peered":"2024-09-11T11:01:03.333740+0000","last_unstale":"2024-09-11T11:04:17.396813+0000","last_undegraded":"2024-09-11T11:04:17.396813+0000","last_fullsized":"2024-09-11T11:04:17.396813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.326641+0000","last_change":"2024-09-11T11:01:07.355314+0000","last_active":"2024-09-11T11:04:53.326641+0000","last_peered":"2024-09-11T11:04:53.326641+0000","last_clean":"2024-09-11T11:04:53.326641+0000","last_became_active":"2024-09-11T11:01:07.354827+0000","last_became_peered":"2024-09-11T11:01:07.354827+0000","last_unstale":"2024-09-11T11:04:53.326641+0000","last_undegraded":"2024-09-11T11:04:53.326641+0000","last_fullsized":"2024-09-11T11:04:53.326641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:06.309813+0000","last_clean_scrub_stamp":"2024-09-11T11:01:06.309813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'63","reported_seq":141,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.696179+0000","last_change":"2024-09-11T11:04:55.696179+0000","last_active":"2024-09-11T11:04:55.696179+0000","last_peered":"2024-09-11T11:04:55.696179+0000","last_clean":"2024-09-11T11:04:55.696179+0000","last_became_active":"2024-09-11T11:01:09.374320+0000","last_became_peered":"2024-09-11T11:01:09.374320+0000","last_unstale":"2024-09-11T11:04:55.696179+0000","last_undegraded":"2024-09-11T11:04:55.696179+0000","last_fullsized":"2024-09-11T11:04:55.696179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-11T11:04:55.695776+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-11T11:04:55.695776+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.695776+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:06.417243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.036052+0000","last_change":"2024-09-11T11:04:58.036052+0000","last_active":"2024-09-11T11:04:58.036052+0000","last_peered":"2024-09-11T11:04:58.036052+0000","last_clean":"2024-09-11T11:04:58.036052+0000","last_became_active":"2024-09-11T11:01:11.399118+0000","last_became_peered":"2024-09-11T11:01:11.399118+0000","last_unstale":"2024-09-11T11:04:58.036052+0000","last_undegraded":"2024-09-11T11:04:58.036052+0000","last_fullsized":"2024-09-11T11:04:58.036052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:58.035800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:58.035800+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.035800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:38.887084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.813199+0000","last_change":"2024-09-11T11:05:21.813199+0000","last_active":"2024-09-11T11:05:21.813199+0000","last_peered":"2024-09-11T11:05:21.813199+0000","last_clean":"2024-09-11T11:05:21.813199+0000","last_became_active":"2024-09-11T11:01:13.415242+0000","last_became_peered":"2024-09-11T11:01:13.415242+0000","last_unstale":"2024-09-11T11:05:21.813199+0000","last_undegraded":"2024-09-11T11:05:21.813199+0000","last_fullsized":"2024-09-11T11:05:21.813199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:21.812919+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:21.812919+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.812919+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:28.186545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.825082+0000","last_change":"2024-09-11T11:05:23.825139+0000","last_active":"2024-09-11T11:05:23.825082+0000","last_peered":"2024-09-11T11:05:23.825082+0000","last_clean":"2024-09-11T11:05:23.825082+0000","last_became_active":"2024-09-11T11:01:05.347367+0000","last_became_peered":"2024-09-11T11:01:05.347367+0000","last_unstale":"2024-09-11T11:05:23.825082+0000","last_undegraded":"2024-09-11T11:05:23.825082+0000","last_fullsized":"2024-09-11T11:05:23.825082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:23.824889+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:23.824889+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.824889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:06:33.988458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787245+0000","last_change":"2024-09-11T11:01:03.349349+0000","last_active":"2024-09-11T11:04:53.787245+0000","last_peered":"2024-09-11T11:04:53.787245+0000","last_clean":"2024-09-11T11:04:53.787245+0000","last_became_active":"2024-09-11T11:01:03.349051+0000","last_became_peered":"2024-09-11T11:01:03.349051+0000","last_unstale":"2024-09-11T11:04:53.787245+0000","last_undegraded":"2024-09-11T11:04:53.787245+0000","last_fullsized":"2024-09-11T11:04:53.787245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.160703+0000","last_change":"2024-09-11T11:05:21.160763+0000","last_active":"2024-09-11T11:05:21.160703+0000","last_peered":"2024-09-11T11:05:21.160703+0000","last_clean":"2024-09-11T11:05:21.160703+0000","last_became_active":"2024-09-11T11:01:07.344509+0000","last_became_peered":"2024-09-11T11:01:07.344509+0000","last_unstale":"2024-09-11T11:05:21.160703+0000","last_undegraded":"2024-09-11T11:05:21.160703+0000","last_fullsized":"2024-09-11T11:05:21.160703+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:21.160509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:21.160509+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.160509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:21.895766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":99,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.481608+0000","last_change":"2024-09-11T11:05:06.481681+0000","last_active":"2024-09-11T11:05:06.481608+0000","last_peered":"2024-09-11T11:05:06.481608+0000","last_clean":"2024-09-11T11:05:06.481608+0000","last_became_active":"2024-09-11T11:01:09.376576+0000","last_became_peered":"2024-09-11T11:01:09.376576+0000","last_unstale":"2024-09-11T11:05:06.481608+0000","last_undegraded":"2024-09-11T11:05:06.481608+0000","last_fullsized":"2024-09-11T11:05:06.481608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-11T11:05:06.481402+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-11T11:05:06.481402+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.481402+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:17:29.713697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.760451+0000","last_change":"2024-09-11T11:05:05.760504+0000","last_active":"2024-09-11T11:05:05.760451+0000","last_peered":"2024-09-11T11:05:05.760451+0000","last_clean":"2024-09-11T11:05:05.760451+0000","last_became_active":"2024-09-11T11:01:11.394215+0000","last_became_peered":"2024-09-11T11:01:11.394215+0000","last_unstale":"2024-09-11T11:05:05.760451+0000","last_undegraded":"2024-09-11T11:05:05.760451+0000","last_fullsized":"2024-09-11T11:05:05.760451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:05.760254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:05.760254+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.760254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:50:59.140410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'8","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.944316+0000","last_change":"2024-09-11T11:05:30.944380+0000","last_active":"2024-09-11T11:05:30.944316+0000","last_peered":"2024-09-11T11:05:30.944316+0000","last_clean":"2024-09-11T11:05:30.944316+0000","last_became_active":"2024-09-11T11:01:13.390538+0000","last_became_peered":"2024-09-11T11:01:13.390538+0000","last_unstale":"2024-09-11T11:05:30.944316+0000","last_undegraded":"2024-09-11T11:05:30.944316+0000","last_fullsized":"2024-09-11T11:05:30.944316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:30.944123+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:30.944123+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.944123+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:47.191730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038682+0000","last_change":"2024-09-11T11:01:05.332887+0000","last_active":"2024-09-11T11:03:21.038682+0000","last_peered":"2024-09-11T11:03:21.038682+0000","last_clean":"2024-09-11T11:03:21.038682+0000","last_became_active":"2024-09-11T11:01:05.332138+0000","last_became_peered":"2024-09-11T11:01:05.332138+0000","last_unstale":"2024-09-11T11:03:21.038682+0000","last_undegraded":"2024-09-11T11:03:21.038682+0000","last_fullsized":"2024-09-11T11:03:21.038682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439336+0000","last_change":"2024-09-11T11:01:03.321735+0000","last_active":"2024-09-11T11:04:52.439336+0000","last_peered":"2024-09-11T11:04:52.439336+0000","last_clean":"2024-09-11T11:04:52.439336+0000","last_became_active":"2024-09-11T11:01:03.320906+0000","last_became_peered":"2024-09-11T11:01:03.320906+0000","last_unstale":"2024-09-11T11:04:52.439336+0000","last_undegraded":"2024-09-11T11:04:52.439336+0000","last_fullsized":"2024-09-11T11:04:52.439336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.947695+0000","last_change":"2024-09-11T11:05:10.947793+0000","last_active":"2024-09-11T11:05:10.947695+0000","last_peered":"2024-09-11T11:05:10.947695+0000","last_clean":"2024-09-11T11:05:10.947695+0000","last_became_active":"2024-09-11T11:01:07.367554+0000","last_became_peered":"2024-09-11T11:01:07.367554+0000","last_unstale":"2024-09-11T11:05:10.947695+0000","last_undegraded":"2024-09-11T11:05:10.947695+0000","last_fullsized":"2024-09-11T11:05:10.947695+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:10.947506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:10.947506+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.947506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:44.583302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'47","reported_seq":109,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.027454+0000","last_change":"2024-09-11T11:05:07.027543+0000","last_active":"2024-09-11T11:05:07.027454+0000","last_peered":"2024-09-11T11:05:07.027454+0000","last_clean":"2024-09-11T11:05:07.027454+0000","last_became_active":"2024-09-11T11:01:09.367246+0000","last_became_peered":"2024-09-11T11:01:09.367246+0000","last_unstale":"2024-09-11T11:05:07.027454+0000","last_undegraded":"2024-09-11T11:05:07.027454+0000","last_fullsized":"2024-09-11T11:05:07.027454+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-11T11:05:07.027243+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-11T11:05:07.027243+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.027243+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:08:09.945366+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":426,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.968358+0000","last_change":"2024-09-11T11:05:02.968427+0000","last_active":"2024-09-11T11:05:02.968358+0000","last_peered":"2024-09-11T11:05:02.968358+0000","last_clean":"2024-09-11T11:05:02.968358+0000","last_became_active":"2024-09-11T11:01:11.392359+0000","last_became_peered":"2024-09-11T11:01:11.392359+0000","last_unstale":"2024-09-11T11:05:02.968358+0000","last_undegraded":"2024-09-11T11:05:02.968358+0000","last_fullsized":"2024-09-11T11:05:02.968358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:02.968136+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:02.968136+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.968136+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:59.277030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'17","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.770923+0000","last_change":"2024-09-11T11:05:17.770923+0000","last_active":"2024-09-11T11:05:17.770923+0000","last_peered":"2024-09-11T11:05:17.770923+0000","last_clean":"2024-09-11T11:05:17.770923+0000","last_became_active":"2024-09-11T11:01:13.415115+0000","last_became_peered":"2024-09-11T11:01:13.415115+0000","last_unstale":"2024-09-11T11:05:17.770923+0000","last_undegraded":"2024-09-11T11:05:17.770923+0000","last_fullsized":"2024-09-11T11:05:17.770923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'17","last_scrub_stamp":"2024-09-11T11:05:17.770533+0000","last_deep_scrub":"36'17","last_deep_scrub_stamp":"2024-09-11T11:05:17.770533+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.770533+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:46.446476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'8","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.168264+0000","last_change":"2024-09-11T11:05:20.168321+0000","last_active":"2024-09-11T11:05:20.168264+0000","last_peered":"2024-09-11T11:05:20.168264+0000","last_clean":"2024-09-11T11:05:20.168264+0000","last_became_active":"2024-09-11T11:01:05.337055+0000","last_became_peered":"2024-09-11T11:01:05.337055+0000","last_unstale":"2024-09-11T11:05:20.168264+0000","last_undegraded":"2024-09-11T11:05:20.168264+0000","last_fullsized":"2024-09-11T11:05:20.168264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:20.168067+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:20.168067+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.168067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:11.957107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787270+0000","last_change":"2024-09-11T11:01:03.336594+0000","last_active":"2024-09-11T11:04:53.787270+0000","last_peered":"2024-09-11T11:04:53.787270+0000","last_clean":"2024-09-11T11:04:53.787270+0000","last_became_active":"2024-09-11T11:01:03.334392+0000","last_became_peered":"2024-09-11T11:01:03.334392+0000","last_unstale":"2024-09-11T11:04:53.787270+0000","last_undegraded":"2024-09-11T11:04:53.787270+0000","last_fullsized":"2024-09-11T11:04:53.787270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":432,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.571382+0000","last_change":"2024-09-11T11:04:56.571458+0000","last_active":"2024-09-11T11:04:56.571382+0000","last_peered":"2024-09-11T11:04:56.571382+0000","last_clean":"2024-09-11T11:04:56.571382+0000","last_became_active":"2024-09-11T11:01:07.360348+0000","last_became_peered":"2024-09-11T11:01:07.360348+0000","last_unstale":"2024-09-11T11:04:56.571382+0000","last_undegraded":"2024-09-11T11:04:56.571382+0000","last_fullsized":"2024-09-11T11:04:56.571382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-11T11:04:56.571190+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-11T11:04:56.571190+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.571190+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:48.525894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.692067+0000","last_change":"2024-09-11T11:04:54.692151+0000","last_active":"2024-09-11T11:04:54.692067+0000","last_peered":"2024-09-11T11:04:54.692067+0000","last_clean":"2024-09-11T11:04:54.692067+0000","last_became_active":"2024-09-11T11:02:42.501712+0000","last_became_peered":"2024-09-11T11:02:42.501712+0000","last_unstale":"2024-09-11T11:04:54.692067+0000","last_undegraded":"2024-09-11T11:04:54.692067+0000","last_fullsized":"2024-09-11T11:04:54.692067+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-11T11:04:54.691868+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-11T11:04:54.691868+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.691868+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:58:19.231371+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":516,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.466606+0000","last_change":"2024-09-11T11:05:05.466674+0000","last_active":"2024-09-11T11:05:05.466606+0000","last_peered":"2024-09-11T11:05:05.466606+0000","last_clean":"2024-09-11T11:05:05.466606+0000","last_became_active":"2024-09-11T11:01:11.384776+0000","last_became_peered":"2024-09-11T11:01:11.384776+0000","last_unstale":"2024-09-11T11:05:05.466606+0000","last_undegraded":"2024-09-11T11:05:05.466606+0000","last_fullsized":"2024-09-11T11:05:05.466606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:05.466396+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:05.466396+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.466396+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:00:09.842981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.007820+0000","last_change":"2024-09-11T11:05:01.007820+0000","last_active":"2024-09-11T11:05:01.007820+0000","last_peered":"2024-09-11T11:05:01.007820+0000","last_clean":"2024-09-11T11:05:01.007820+0000","last_became_active":"2024-09-11T11:01:13.418296+0000","last_became_peered":"2024-09-11T11:01:13.418296+0000","last_unstale":"2024-09-11T11:05:01.007820+0000","last_undegraded":"2024-09-11T11:05:01.007820+0000","last_fullsized":"2024-09-11T11:05:01.007820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:01.007547+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:01.007547+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.007547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:55:18.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'18","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.805861+0000","last_change":"2024-09-11T11:05:22.805924+0000","last_active":"2024-09-11T11:05:22.805861+0000","last_peered":"2024-09-11T11:05:22.805861+0000","last_clean":"2024-09-11T11:05:22.805861+0000","last_became_active":"2024-09-11T11:01:05.347644+0000","last_became_peered":"2024-09-11T11:01:05.347644+0000","last_unstale":"2024-09-11T11:05:22.805861+0000","last_undegraded":"2024-09-11T11:05:22.805861+0000","last_fullsized":"2024-09-11T11:05:22.805861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:22.805671+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:22.805671+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.805671+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:31.023813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787270+0000","last_change":"2024-09-11T11:01:03.349954+0000","last_active":"2024-09-11T11:04:53.787270+0000","last_peered":"2024-09-11T11:04:53.787270+0000","last_clean":"2024-09-11T11:04:53.787270+0000","last_became_active":"2024-09-11T11:01:03.349605+0000","last_became_peered":"2024-09-11T11:01:03.349605+0000","last_unstale":"2024-09-11T11:04:53.787270+0000","last_undegraded":"2024-09-11T11:04:53.787270+0000","last_fullsized":"2024-09-11T11:04:53.787270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.793180+0000","last_change":"2024-09-11T11:05:16.793239+0000","last_active":"2024-09-11T11:05:16.793180+0000","last_peered":"2024-09-11T11:05:16.793180+0000","last_clean":"2024-09-11T11:05:16.793180+0000","last_became_active":"2024-09-11T11:01:07.351403+0000","last_became_peered":"2024-09-11T11:01:07.351403+0000","last_unstale":"2024-09-11T11:05:16.793180+0000","last_undegraded":"2024-09-11T11:05:16.793180+0000","last_fullsized":"2024-09-11T11:05:16.793180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.792993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.792993+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.792993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:52:24.716938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":111,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.534249+0000","last_change":"2024-09-11T11:05:07.534340+0000","last_active":"2024-09-11T11:05:07.534249+0000","last_peered":"2024-09-11T11:05:07.534249+0000","last_clean":"2024-09-11T11:05:07.534249+0000","last_became_active":"2024-09-11T11:01:09.376340+0000","last_became_peered":"2024-09-11T11:01:09.376340+0000","last_unstale":"2024-09-11T11:05:07.534249+0000","last_undegraded":"2024-09-11T11:05:07.534249+0000","last_fullsized":"2024-09-11T11:05:07.534249+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-11T11:05:07.534061+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-11T11:05:07.534061+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.534061+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.271487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.598034+0000","last_change":"2024-09-11T11:05:13.598087+0000","last_active":"2024-09-11T11:05:13.598034+0000","last_peered":"2024-09-11T11:05:13.598034+0000","last_clean":"2024-09-11T11:05:13.598034+0000","last_became_active":"2024-09-11T11:01:11.385523+0000","last_became_peered":"2024-09-11T11:01:11.385523+0000","last_unstale":"2024-09-11T11:05:13.598034+0000","last_undegraded":"2024-09-11T11:05:13.598034+0000","last_fullsized":"2024-09-11T11:05:13.598034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:13.597842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:13.597842+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.597842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:47.342062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'7","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.876239+0000","last_change":"2024-09-11T11:05:05.876239+0000","last_active":"2024-09-11T11:05:05.876239+0000","last_peered":"2024-09-11T11:05:05.876239+0000","last_clean":"2024-09-11T11:05:05.876239+0000","last_became_active":"2024-09-11T11:01:13.403125+0000","last_became_peered":"2024-09-11T11:01:13.403125+0000","last_unstale":"2024-09-11T11:05:05.876239+0000","last_undegraded":"2024-09-11T11:05:05.876239+0000","last_fullsized":"2024-09-11T11:05:05.876239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-11T11:05:05.875973+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-11T11:05:05.875973+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.875973+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:59.171520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'22","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.588013+0000","last_change":"2024-09-11T11:05:27.588075+0000","last_active":"2024-09-11T11:05:27.588013+0000","last_peered":"2024-09-11T11:05:27.588013+0000","last_clean":"2024-09-11T11:05:27.588013+0000","last_became_active":"2024-09-11T11:01:05.345474+0000","last_became_peered":"2024-09-11T11:01:05.345474+0000","last_unstale":"2024-09-11T11:05:27.588013+0000","last_undegraded":"2024-09-11T11:05:27.588013+0000","last_fullsized":"2024-09-11T11:05:27.588013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-11T11:05:27.587826+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-11T11:05:27.587826+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.587826+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:48.653691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'117","reported_seq":208,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881089+0000","last_change":"2024-09-11T11:00:51.371382+0000","last_active":"2024-09-11T11:04:52.881089+0000","last_peered":"2024-09-11T11:04:52.881089+0000","last_clean":"2024-09-11T11:04:52.881089+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:04:52.881089+0000","last_undegraded":"2024-09-11T11:04:52.881089+0000","last_fullsized":"2024-09-11T11:04:52.881089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:49.442581+0000","last_clean_scrub_stamp":"2024-09-11T11:00:49.442581+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439117+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:04:52.439117+0000","last_peered":"2024-09-11T11:04:52.439117+0000","last_clean":"2024-09-11T11:04:52.439117+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:04:52.439117+0000","last_undegraded":"2024-09-11T11:04:52.439117+0000","last_fullsized":"2024-09-11T11:04:52.439117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787228+0000","last_change":"2024-09-11T11:01:03.345152+0000","last_active":"2024-09-11T11:04:53.787228+0000","last_peered":"2024-09-11T11:04:53.787228+0000","last_clean":"2024-09-11T11:04:53.787228+0000","last_became_active":"2024-09-11T11:01:03.334611+0000","last_became_peered":"2024-09-11T11:01:03.334611+0000","last_unstale":"2024-09-11T11:04:53.787228+0000","last_undegraded":"2024-09-11T11:04:53.787228+0000","last_fullsized":"2024-09-11T11:04:53.787228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.806822+0000","last_change":"2024-09-11T11:05:16.806822+0000","last_active":"2024-09-11T11:05:16.806822+0000","last_peered":"2024-09-11T11:05:16.806822+0000","last_clean":"2024-09-11T11:05:16.806822+0000","last_became_active":"2024-09-11T11:01:07.348530+0000","last_became_peered":"2024-09-11T11:01:07.348530+0000","last_unstale":"2024-09-11T11:05:16.806822+0000","last_undegraded":"2024-09-11T11:05:16.806822+0000","last_fullsized":"2024-09-11T11:05:16.806822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.806573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.806573+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.806573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:00:07.850946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.560070+0000","last_change":"2024-09-11T11:05:14.560070+0000","last_active":"2024-09-11T11:05:14.560070+0000","last_peered":"2024-09-11T11:05:14.560070+0000","last_clean":"2024-09-11T11:05:14.560070+0000","last_became_active":"2024-09-11T11:01:09.369066+0000","last_became_peered":"2024-09-11T11:01:09.369066+0000","last_unstale":"2024-09-11T11:05:14.560070+0000","last_undegraded":"2024-09-11T11:05:14.560070+0000","last_fullsized":"2024-09-11T11:05:14.560070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-09-11T11:05:14.559823+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-09-11T11:05:14.559823+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.559823+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:34:23.881642+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.727517+0000","last_change":"2024-09-11T11:05:04.727517+0000","last_active":"2024-09-11T11:05:04.727517+0000","last_peered":"2024-09-11T11:05:04.727517+0000","last_clean":"2024-09-11T11:05:04.727517+0000","last_became_active":"2024-09-11T11:01:11.394277+0000","last_became_peered":"2024-09-11T11:01:11.394277+0000","last_unstale":"2024-09-11T11:05:04.727517+0000","last_undegraded":"2024-09-11T11:05:04.727517+0000","last_fullsized":"2024-09-11T11:05:04.727517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:04.727229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:04.727229+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.727229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:14.507545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.089631+0000","last_change":"2024-09-11T11:04:55.089631+0000","last_active":"2024-09-11T11:04:55.089631+0000","last_peered":"2024-09-11T11:04:55.089631+0000","last_clean":"2024-09-11T11:04:55.089631+0000","last_became_active":"2024-09-11T11:01:13.412615+0000","last_became_peered":"2024-09-11T11:01:13.412615+0000","last_unstale":"2024-09-11T11:04:55.089631+0000","last_undegraded":"2024-09-11T11:04:55.089631+0000","last_fullsized":"2024-09-11T11:04:55.089631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-11T11:04:55.089351+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-11T11:04:55.089351+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.089351+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:06.508319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.805718+0000","last_change":"2024-09-11T11:05:23.805718+0000","last_active":"2024-09-11T11:05:23.805718+0000","last_peered":"2024-09-11T11:05:23.805718+0000","last_clean":"2024-09-11T11:05:23.805718+0000","last_became_active":"2024-09-11T11:01:05.346710+0000","last_became_peered":"2024-09-11T11:01:05.346710+0000","last_unstale":"2024-09-11T11:05:23.805718+0000","last_undegraded":"2024-09-11T11:05:23.805718+0000","last_fullsized":"2024-09-11T11:05:23.805718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:23.805304+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:23.805304+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.805304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:46.899730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439050+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:04:52.439050+0000","last_peered":"2024-09-11T11:04:52.439050+0000","last_clean":"2024-09-11T11:04:52.439050+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:04:52.439050+0000","last_undegraded":"2024-09-11T11:04:52.439050+0000","last_fullsized":"2024-09-11T11:04:52.439050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881420+0000","last_change":"2024-09-11T11:01:03.326592+0000","last_active":"2024-09-11T11:04:52.881420+0000","last_peered":"2024-09-11T11:04:52.881420+0000","last_clean":"2024-09-11T11:04:52.881420+0000","last_became_active":"2024-09-11T11:01:03.325795+0000","last_became_peered":"2024-09-11T11:01:03.325795+0000","last_unstale":"2024-09-11T11:04:52.881420+0000","last_undegraded":"2024-09-11T11:04:52.881420+0000","last_fullsized":"2024-09-11T11:04:52.881420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.500469+0000","last_change":"2024-09-11T11:04:52.500469+0000","last_active":"2024-09-11T11:04:52.500469+0000","last_peered":"2024-09-11T11:04:52.500469+0000","last_clean":"2024-09-11T11:04:52.500469+0000","last_became_active":"2024-09-11T11:01:07.360718+0000","last_became_peered":"2024-09-11T11:01:07.360718+0000","last_unstale":"2024-09-11T11:04:52.500469+0000","last_undegraded":"2024-09-11T11:04:52.500469+0000","last_fullsized":"2024-09-11T11:04:52.500469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:52.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:52.500353+0000","last_clean_scrub_stamp":"2024-09-11T11:04:52.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:05.966274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.939512+0000","last_change":"2024-09-11T11:05:03.939512+0000","last_active":"2024-09-11T11:05:03.939512+0000","last_peered":"2024-09-11T11:05:03.939512+0000","last_clean":"2024-09-11T11:05:03.939512+0000","last_became_active":"2024-09-11T11:01:09.376555+0000","last_became_peered":"2024-09-11T11:01:09.376555+0000","last_unstale":"2024-09-11T11:05:03.939512+0000","last_undegraded":"2024-09-11T11:05:03.939512+0000","last_fullsized":"2024-09-11T11:05:03.939512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-11T11:05:03.939238+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-11T11:05:03.939238+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.939238+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:17.488538+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.787021+0000","last_change":"2024-09-11T11:05:18.787021+0000","last_active":"2024-09-11T11:05:18.787021+0000","last_peered":"2024-09-11T11:05:18.787021+0000","last_clean":"2024-09-11T11:05:18.787021+0000","last_became_active":"2024-09-11T11:01:11.400253+0000","last_became_peered":"2024-09-11T11:01:11.400253+0000","last_unstale":"2024-09-11T11:05:18.787021+0000","last_undegraded":"2024-09-11T11:05:18.787021+0000","last_fullsized":"2024-09-11T11:05:18.787021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:18.786712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:18.786712+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.786712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:52.530932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'11","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.883409+0000","last_change":"2024-09-11T11:01:13.422211+0000","last_active":"2024-09-11T11:04:52.883409+0000","last_peered":"2024-09-11T11:04:52.883409+0000","last_clean":"2024-09-11T11:04:52.883409+0000","last_became_active":"2024-09-11T11:01:13.421491+0000","last_became_peered":"2024-09-11T11:01:13.421491+0000","last_unstale":"2024-09-11T11:04:52.883409+0000","last_undegraded":"2024-09-11T11:04:52.883409+0000","last_fullsized":"2024-09-11T11:04:52.883409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.828471+0000","last_change":"2024-09-11T11:05:24.828471+0000","last_active":"2024-09-11T11:05:24.828471+0000","last_peered":"2024-09-11T11:05:24.828471+0000","last_clean":"2024-09-11T11:05:24.828471+0000","last_became_active":"2024-09-11T11:01:05.347359+0000","last_became_peered":"2024-09-11T11:01:05.347359+0000","last_unstale":"2024-09-11T11:05:24.828471+0000","last_undegraded":"2024-09-11T11:05:24.828471+0000","last_fullsized":"2024-09-11T11:05:24.828471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:24.828225+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:24.828225+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.828225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:55.815883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.223190+0000","last_change":"2024-09-11T11:05:27.223243+0000","last_active":"2024-09-11T11:05:27.223190+0000","last_peered":"2024-09-11T11:05:27.223190+0000","last_clean":"2024-09-11T11:05:27.223190+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:05:27.223190+0000","last_undegraded":"2024-09-11T11:05:27.223190+0000","last_fullsized":"2024-09-11T11:05:27.223190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:27.223007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:27.223007+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.223007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:50.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881055+0000","last_change":"2024-09-11T11:01:03.325786+0000","last_active":"2024-09-11T11:04:52.881055+0000","last_peered":"2024-09-11T11:04:52.881055+0000","last_clean":"2024-09-11T11:04:52.881055+0000","last_became_active":"2024-09-11T11:01:03.325168+0000","last_became_peered":"2024-09-11T11:01:03.325168+0000","last_unstale":"2024-09-11T11:04:52.881055+0000","last_undegraded":"2024-09-11T11:04:52.881055+0000","last_fullsized":"2024-09-11T11:04:52.881055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"36'4","reported_seq":237,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.215881+0000","last_change":"2024-09-11T11:05:23.215881+0000","last_active":"2024-09-11T11:05:23.215881+0000","last_peered":"2024-09-11T11:05:23.215881+0000","last_clean":"2024-09-11T11:05:23.215881+0000","last_became_active":"2024-09-11T11:01:07.345998+0000","last_became_peered":"2024-09-11T11:01:07.345998+0000","last_unstale":"2024-09-11T11:05:23.215881+0000","last_undegraded":"2024-09-11T11:05:23.215881+0000","last_fullsized":"2024-09-11T11:05:23.215881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:23.215586+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:23.215586+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.215586+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:14.462637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'25","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.622163+0000","last_change":"2024-09-11T11:05:10.622163+0000","last_active":"2024-09-11T11:05:10.622163+0000","last_peered":"2024-09-11T11:05:10.622163+0000","last_clean":"2024-09-11T11:05:10.622163+0000","last_became_active":"2024-09-11T11:01:09.371816+0000","last_became_peered":"2024-09-11T11:01:09.371816+0000","last_unstale":"2024-09-11T11:05:10.622163+0000","last_undegraded":"2024-09-11T11:05:10.622163+0000","last_fullsized":"2024-09-11T11:05:10.622163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'25","last_scrub_stamp":"2024-09-11T11:05:10.621907+0000","last_deep_scrub":"36'25","last_deep_scrub_stamp":"2024-09-11T11:05:10.621907+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.621907+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:01:58.193453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.900932+0000","last_change":"2024-09-11T11:04:56.900932+0000","last_active":"2024-09-11T11:04:56.900932+0000","last_peered":"2024-09-11T11:04:56.900932+0000","last_clean":"2024-09-11T11:04:56.900932+0000","last_became_active":"2024-09-11T11:01:11.392208+0000","last_became_peered":"2024-09-11T11:01:11.392208+0000","last_unstale":"2024-09-11T11:04:56.900932+0000","last_undegraded":"2024-09-11T11:04:56.900932+0000","last_fullsized":"2024-09-11T11:04:56.900932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:56.900687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:56.900687+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.900687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:38.581779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.038485+0000","last_change":"2024-09-11T11:01:13.408511+0000","last_active":"2024-09-11T11:03:28.038485+0000","last_peered":"2024-09-11T11:03:28.038485+0000","last_clean":"2024-09-11T11:03:28.038485+0000","last_became_active":"2024-09-11T11:01:13.406863+0000","last_became_peered":"2024-09-11T11:01:13.406863+0000","last_unstale":"2024-09-11T11:03:28.038485+0000","last_undegraded":"2024-09-11T11:03:28.038485+0000","last_fullsized":"2024-09-11T11:03:28.038485+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.751460+0000","last_change":"2024-09-11T11:05:29.751522+0000","last_active":"2024-09-11T11:05:29.751460+0000","last_peered":"2024-09-11T11:05:29.751460+0000","last_clean":"2024-09-11T11:05:29.751460+0000","last_became_active":"2024-09-11T11:01:05.332361+0000","last_became_peered":"2024-09-11T11:01:05.332361+0000","last_unstale":"2024-09-11T11:05:29.751460+0000","last_undegraded":"2024-09-11T11:05:29.751460+0000","last_fullsized":"2024-09-11T11:05:29.751460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:29.751228+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:29.751228+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.751228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:46.582523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439078+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:04:52.439078+0000","last_peered":"2024-09-11T11:04:52.439078+0000","last_clean":"2024-09-11T11:04:52.439078+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:04:52.439078+0000","last_undegraded":"2024-09-11T11:04:52.439078+0000","last_fullsized":"2024-09-11T11:04:52.439078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439276+0000","last_change":"2024-09-11T11:01:03.328169+0000","last_active":"2024-09-11T11:04:52.439276+0000","last_peered":"2024-09-11T11:04:52.439276+0000","last_clean":"2024-09-11T11:04:52.439276+0000","last_became_active":"2024-09-11T11:01:03.327456+0000","last_became_peered":"2024-09-11T11:01:03.327456+0000","last_unstale":"2024-09-11T11:04:52.439276+0000","last_undegraded":"2024-09-11T11:04:52.439276+0000","last_fullsized":"2024-09-11T11:04:52.439276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.856498+0000","last_change":"2024-09-11T11:05:07.856498+0000","last_active":"2024-09-11T11:05:07.856498+0000","last_peered":"2024-09-11T11:05:07.856498+0000","last_clean":"2024-09-11T11:05:07.856498+0000","last_became_active":"2024-09-11T11:01:07.367962+0000","last_became_peered":"2024-09-11T11:01:07.367962+0000","last_unstale":"2024-09-11T11:05:07.856498+0000","last_undegraded":"2024-09-11T11:05:07.856498+0000","last_fullsized":"2024-09-11T11:05:07.856498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:07.856251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:07.856251+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.856251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:42.576844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'21","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.823311+0000","last_change":"2024-09-11T11:05:12.823311+0000","last_active":"2024-09-11T11:05:12.823311+0000","last_peered":"2024-09-11T11:05:12.823311+0000","last_clean":"2024-09-11T11:05:12.823311+0000","last_became_active":"2024-09-11T11:01:09.389732+0000","last_became_peered":"2024-09-11T11:01:09.389732+0000","last_unstale":"2024-09-11T11:05:12.823311+0000","last_undegraded":"2024-09-11T11:05:12.823311+0000","last_fullsized":"2024-09-11T11:05:12.823311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:12.823022+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:12.823022+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.823022+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:55.560448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.739913+0000","last_change":"2024-09-11T11:05:10.739913+0000","last_active":"2024-09-11T11:05:10.739913+0000","last_peered":"2024-09-11T11:05:10.739913+0000","last_clean":"2024-09-11T11:05:10.739913+0000","last_became_active":"2024-09-11T11:01:11.397467+0000","last_became_peered":"2024-09-11T11:01:11.397467+0000","last_unstale":"2024-09-11T11:05:10.739913+0000","last_undegraded":"2024-09-11T11:05:10.739913+0000","last_fullsized":"2024-09-11T11:05:10.739913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:10.739645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:10.739645+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.739645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:39.415587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'9","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.865986+0000","last_change":"2024-09-11T11:05:13.865986+0000","last_active":"2024-09-11T11:05:13.865986+0000","last_peered":"2024-09-11T11:05:13.865986+0000","last_clean":"2024-09-11T11:05:13.865986+0000","last_became_active":"2024-09-11T11:01:13.414898+0000","last_became_peered":"2024-09-11T11:01:13.414898+0000","last_unstale":"2024-09-11T11:05:13.865986+0000","last_undegraded":"2024-09-11T11:05:13.865986+0000","last_fullsized":"2024-09-11T11:05:13.865986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:13.865733+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:13.865733+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.865733+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:27.906253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881377+0000","last_change":"2024-09-11T11:01:05.343143+0000","last_active":"2024-09-11T11:04:52.881377+0000","last_peered":"2024-09-11T11:04:52.881377+0000","last_clean":"2024-09-11T11:04:52.881377+0000","last_became_active":"2024-09-11T11:01:05.342651+0000","last_became_peered":"2024-09-11T11:01:05.342651+0000","last_unstale":"2024-09-11T11:04:52.881377+0000","last_undegraded":"2024-09-11T11:04:52.881377+0000","last_fullsized":"2024-09-11T11:04:52.881377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439298+0000","last_change":"2024-09-11T11:01:03.338569+0000","last_active":"2024-09-11T11:04:52.439298+0000","last_peered":"2024-09-11T11:04:52.439298+0000","last_clean":"2024-09-11T11:04:52.439298+0000","last_became_active":"2024-09-11T11:01:03.336412+0000","last_became_peered":"2024-09-11T11:01:03.336412+0000","last_unstale":"2024-09-11T11:04:52.439298+0000","last_undegraded":"2024-09-11T11:04:52.439298+0000","last_fullsized":"2024-09-11T11:04:52.439298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881049+0000","last_change":"2024-09-11T11:00:55.878837+0000","last_active":"2024-09-11T11:04:52.881049+0000","last_peered":"2024-09-11T11:04:52.881049+0000","last_clean":"2024-09-11T11:04:52.881049+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:04:52.881049+0000","last_undegraded":"2024-09-11T11:04:52.881049+0000","last_fullsized":"2024-09-11T11:04:52.881049+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.111176+0000","last_change":"2024-09-11T11:05:10.111176+0000","last_active":"2024-09-11T11:05:10.111176+0000","last_peered":"2024-09-11T11:05:10.111176+0000","last_clean":"2024-09-11T11:05:10.111176+0000","last_became_active":"2024-09-11T11:01:07.359228+0000","last_became_peered":"2024-09-11T11:01:07.359228+0000","last_unstale":"2024-09-11T11:05:10.111176+0000","last_undegraded":"2024-09-11T11:05:10.111176+0000","last_fullsized":"2024-09-11T11:05:10.111176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:10.110911+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:10.110911+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.110911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:59:28.679839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'75","reported_seq":156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.920380+0000","last_change":"2024-09-11T11:04:53.920380+0000","last_active":"2024-09-11T11:04:53.920380+0000","last_peered":"2024-09-11T11:04:53.920380+0000","last_clean":"2024-09-11T11:04:53.920380+0000","last_became_active":"2024-09-11T11:01:09.360676+0000","last_became_peered":"2024-09-11T11:01:09.360676+0000","last_unstale":"2024-09-11T11:04:53.920380+0000","last_undegraded":"2024-09-11T11:04:53.920380+0000","last_fullsized":"2024-09-11T11:04:53.920380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'75","last_scrub_stamp":"2024-09-11T11:04:53.920094+0000","last_deep_scrub":"36'75","last_deep_scrub_stamp":"2024-09-11T11:04:53.920094+0000","last_clean_scrub_stamp":"2024-09-11T11:04:53.920094+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:28:47.374212+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.573879+0000","last_change":"2024-09-11T11:05:09.573879+0000","last_active":"2024-09-11T11:05:09.573879+0000","last_peered":"2024-09-11T11:05:09.573879+0000","last_clean":"2024-09-11T11:05:09.573879+0000","last_became_active":"2024-09-11T11:01:11.384826+0000","last_became_peered":"2024-09-11T11:01:11.384826+0000","last_unstale":"2024-09-11T11:05:09.573879+0000","last_undegraded":"2024-09-11T11:05:09.573879+0000","last_fullsized":"2024-09-11T11:05:09.573879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:09.573632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:09.573632+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.573632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:05.190454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.036378+0000","last_change":"2024-09-11T11:01:13.422273+0000","last_active":"2024-09-11T11:03:28.036378+0000","last_peered":"2024-09-11T11:03:28.036378+0000","last_clean":"2024-09-11T11:03:28.036378+0000","last_became_active":"2024-09-11T11:01:13.421181+0000","last_became_peered":"2024-09-11T11:01:13.421181+0000","last_unstale":"2024-09-11T11:03:28.036378+0000","last_undegraded":"2024-09-11T11:03:28.036378+0000","last_fullsized":"2024-09-11T11:03:28.036378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.793875+0000","last_change":"2024-09-11T11:05:20.793990+0000","last_active":"2024-09-11T11:05:20.793875+0000","last_peered":"2024-09-11T11:05:20.793875+0000","last_clean":"2024-09-11T11:05:20.793875+0000","last_became_active":"2024-09-11T11:01:05.353896+0000","last_became_peered":"2024-09-11T11:01:05.353896+0000","last_unstale":"2024-09-11T11:05:20.793875+0000","last_undegraded":"2024-09-11T11:05:20.793875+0000","last_fullsized":"2024-09-11T11:05:20.793875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:20.793577+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:20.793577+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.793577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:36.069658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881403+0000","last_change":"2024-09-11T11:01:03.325763+0000","last_active":"2024-09-11T11:04:52.881403+0000","last_peered":"2024-09-11T11:04:52.881403+0000","last_clean":"2024-09-11T11:04:52.881403+0000","last_became_active":"2024-09-11T11:01:03.324923+0000","last_became_peered":"2024-09-11T11:01:03.324923+0000","last_unstale":"2024-09-11T11:04:52.881403+0000","last_undegraded":"2024-09-11T11:04:52.881403+0000","last_fullsized":"2024-09-11T11:04:52.881403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439091+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:04:52.439091+0000","last_peered":"2024-09-11T11:04:52.439091+0000","last_clean":"2024-09-11T11:04:52.439091+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:04:52.439091+0000","last_undegraded":"2024-09-11T11:04:52.439091+0000","last_fullsized":"2024-09-11T11:04:52.439091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.566765+0000","last_change":"2024-09-11T11:04:54.566765+0000","last_active":"2024-09-11T11:04:54.566765+0000","last_peered":"2024-09-11T11:04:54.566765+0000","last_clean":"2024-09-11T11:04:54.566765+0000","last_became_active":"2024-09-11T11:01:07.360208+0000","last_became_peered":"2024-09-11T11:01:07.360208+0000","last_unstale":"2024-09-11T11:04:54.566765+0000","last_undegraded":"2024-09-11T11:04:54.566765+0000","last_fullsized":"2024-09-11T11:04:54.566765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.566514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.566514+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.566514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:47.862061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.895963+0000","last_change":"2024-09-11T11:05:02.895963+0000","last_active":"2024-09-11T11:05:02.895963+0000","last_peered":"2024-09-11T11:05:02.895963+0000","last_clean":"2024-09-11T11:05:02.895963+0000","last_became_active":"2024-09-11T11:01:09.382364+0000","last_became_peered":"2024-09-11T11:01:09.382364+0000","last_unstale":"2024-09-11T11:05:02.895963+0000","last_undegraded":"2024-09-11T11:05:02.895963+0000","last_fullsized":"2024-09-11T11:05:02.895963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:02.895625+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:02.895625+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.895625+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:58.883525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":364,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.863644+0000","last_change":"2024-09-11T11:04:57.863644+0000","last_active":"2024-09-11T11:04:57.863644+0000","last_peered":"2024-09-11T11:04:57.863644+0000","last_clean":"2024-09-11T11:04:57.863644+0000","last_became_active":"2024-09-11T11:01:11.395016+0000","last_became_peered":"2024-09-11T11:01:11.395016+0000","last_unstale":"2024-09-11T11:04:57.863644+0000","last_undegraded":"2024-09-11T11:04:57.863644+0000","last_fullsized":"2024-09-11T11:04:57.863644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:04:57.863404+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:04:57.863404+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.863404+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:48.423461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.931466+0000","last_change":"2024-09-11T11:01:13.423655+0000","last_active":"2024-09-11T11:04:17.931466+0000","last_peered":"2024-09-11T11:04:17.931466+0000","last_clean":"2024-09-11T11:04:17.931466+0000","last_became_active":"2024-09-11T11:01:13.422825+0000","last_became_peered":"2024-09-11T11:01:13.422825+0000","last_unstale":"2024-09-11T11:04:17.931466+0000","last_undegraded":"2024-09-11T11:04:17.931466+0000","last_fullsized":"2024-09-11T11:04:17.931466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'12","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:43.039733+0000","last_change":"2024-09-11T11:01:42.069205+0000","last_active":"2024-09-11T11:03:43.039733+0000","last_peered":"2024-09-11T11:03:43.039733+0000","last_clean":"2024-09-11T11:03:43.039733+0000","last_became_active":"2024-09-11T11:01:42.049256+0000","last_became_peered":"2024-09-11T11:01:42.049256+0000","last_unstale":"2024-09-11T11:03:43.039733+0000","last_undegraded":"2024-09-11T11:03:43.039733+0000","last_fullsized":"2024-09-11T11:03:43.039733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787218+0000","last_change":"2024-09-11T11:01:03.351057+0000","last_active":"2024-09-11T11:04:53.787218+0000","last_peered":"2024-09-11T11:04:53.787218+0000","last_clean":"2024-09-11T11:04:53.787218+0000","last_became_active":"2024-09-11T11:01:03.349487+0000","last_became_peered":"2024-09-11T11:01:03.349487+0000","last_unstale":"2024-09-11T11:04:53.787218+0000","last_undegraded":"2024-09-11T11:04:53.787218+0000","last_fullsized":"2024-09-11T11:04:53.787218+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881087+0000","last_change":"2024-09-11T11:00:55.878899+0000","last_active":"2024-09-11T11:04:52.881087+0000","last_peered":"2024-09-11T11:04:52.881087+0000","last_clean":"2024-09-11T11:04:52.881087+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:04:52.881087+0000","last_undegraded":"2024-09-11T11:04:52.881087+0000","last_fullsized":"2024-09-11T11:04:52.881087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.474692+0000","last_change":"2024-09-11T11:05:00.474692+0000","last_active":"2024-09-11T11:05:00.474692+0000","last_peered":"2024-09-11T11:05:00.474692+0000","last_clean":"2024-09-11T11:05:00.474692+0000","last_became_active":"2024-09-11T11:01:07.344021+0000","last_became_peered":"2024-09-11T11:01:07.344021+0000","last_unstale":"2024-09-11T11:05:00.474692+0000","last_undegraded":"2024-09-11T11:05:00.474692+0000","last_fullsized":"2024-09-11T11:05:00.474692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.474433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.474433+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.474433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:50:53.854590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.695956+0000","last_change":"2024-09-11T11:04:56.695956+0000","last_active":"2024-09-11T11:04:56.695956+0000","last_peered":"2024-09-11T11:04:56.695956+0000","last_clean":"2024-09-11T11:04:56.695956+0000","last_became_active":"2024-09-11T11:01:09.379372+0000","last_became_peered":"2024-09-11T11:01:09.379372+0000","last_unstale":"2024-09-11T11:04:56.695956+0000","last_undegraded":"2024-09-11T11:04:56.695956+0000","last_fullsized":"2024-09-11T11:04:56.695956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:04:56.695654+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:04:56.695654+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.695654+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:10.244955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'286","reported_seq":436,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.884364+0000","last_change":"2024-09-11T11:05:26.884426+0000","last_active":"2024-09-11T11:05:26.884364+0000","last_peered":"2024-09-11T11:05:26.884364+0000","last_clean":"2024-09-11T11:05:26.884364+0000","last_became_active":"2024-09-11T11:01:11.403355+0000","last_became_peered":"2024-09-11T11:01:11.403355+0000","last_unstale":"2024-09-11T11:05:26.884364+0000","last_undegraded":"2024-09-11T11:05:26.884364+0000","last_fullsized":"2024-09-11T11:05:26.884364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-11T11:05:26.884181+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-11T11:05:26.884181+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.884181+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:03.502606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.039868+0000","last_change":"2024-09-11T11:01:13.420938+0000","last_active":"2024-09-11T11:03:28.039868+0000","last_peered":"2024-09-11T11:03:28.039868+0000","last_clean":"2024-09-11T11:03:28.039868+0000","last_became_active":"2024-09-11T11:01:13.415413+0000","last_became_peered":"2024-09-11T11:01:13.415413+0000","last_unstale":"2024-09-11T11:03:28.039868+0000","last_undegraded":"2024-09-11T11:03:28.039868+0000","last_fullsized":"2024-09-11T11:03:28.039868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.122525+0000","last_change":"2024-09-11T11:05:16.122525+0000","last_active":"2024-09-11T11:05:16.122525+0000","last_peered":"2024-09-11T11:05:16.122525+0000","last_clean":"2024-09-11T11:05:16.122525+0000","last_became_active":"2024-09-11T11:01:05.338465+0000","last_became_peered":"2024-09-11T11:01:05.338465+0000","last_unstale":"2024-09-11T11:05:16.122525+0000","last_undegraded":"2024-09-11T11:05:16.122525+0000","last_fullsized":"2024-09-11T11:05:16.122525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:16.122266+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:16.122266+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.122266+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:53:41.559513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881159+0000","last_change":"2024-09-11T11:01:03.327083+0000","last_active":"2024-09-11T11:04:52.881159+0000","last_peered":"2024-09-11T11:04:52.881159+0000","last_clean":"2024-09-11T11:04:52.881159+0000","last_became_active":"2024-09-11T11:01:03.325009+0000","last_became_peered":"2024-09-11T11:01:03.325009+0000","last_unstale":"2024-09-11T11:04:52.881159+0000","last_undegraded":"2024-09-11T11:04:52.881159+0000","last_fullsized":"2024-09-11T11:04:52.881159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439149+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:04:52.439149+0000","last_peered":"2024-09-11T11:04:52.439149+0000","last_clean":"2024-09-11T11:04:52.439149+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:04:52.439149+0000","last_undegraded":"2024-09-11T11:04:52.439149+0000","last_fullsized":"2024-09-11T11:04:52.439149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.729363+0000","last_change":"2024-09-11T11:05:03.729363+0000","last_active":"2024-09-11T11:05:03.729363+0000","last_peered":"2024-09-11T11:05:03.729363+0000","last_clean":"2024-09-11T11:05:03.729363+0000","last_became_active":"2024-09-11T11:01:07.363499+0000","last_became_peered":"2024-09-11T11:01:07.363499+0000","last_unstale":"2024-09-11T11:05:03.729363+0000","last_undegraded":"2024-09-11T11:05:03.729363+0000","last_fullsized":"2024-09-11T11:05:03.729363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:03.729049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:03.729049+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.729049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:46:05.674496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'96","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.645636+0000","last_change":"2024-09-11T11:05:12.645636+0000","last_active":"2024-09-11T11:05:12.645636+0000","last_peered":"2024-09-11T11:05:12.645636+0000","last_clean":"2024-09-11T11:05:12.645636+0000","last_became_active":"2024-09-11T11:01:09.371312+0000","last_became_peered":"2024-09-11T11:01:09.371312+0000","last_unstale":"2024-09-11T11:05:12.645636+0000","last_undegraded":"2024-09-11T11:05:12.645636+0000","last_fullsized":"2024-09-11T11:05:12.645636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-09-11T11:05:12.645367+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-09-11T11:05:12.645367+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.645367+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:06.981705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.747278+0000","last_change":"2024-09-11T11:05:07.747278+0000","last_active":"2024-09-11T11:05:07.747278+0000","last_peered":"2024-09-11T11:05:07.747278+0000","last_clean":"2024-09-11T11:05:07.747278+0000","last_became_active":"2024-09-11T11:01:11.383342+0000","last_became_peered":"2024-09-11T11:01:11.383342+0000","last_unstale":"2024-09-11T11:05:07.747278+0000","last_undegraded":"2024-09-11T11:05:07.747278+0000","last_fullsized":"2024-09-11T11:05:07.747278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:07.747023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:07.747023+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.747023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:47.852841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.101666+0000","last_change":"2024-09-11T11:04:54.101719+0000","last_active":"2024-09-11T11:04:54.101666+0000","last_peered":"2024-09-11T11:04:54.101666+0000","last_clean":"2024-09-11T11:04:54.101666+0000","last_became_active":"2024-09-11T11:01:13.413156+0000","last_became_peered":"2024-09-11T11:01:13.413156+0000","last_unstale":"2024-09-11T11:04:54.101666+0000","last_undegraded":"2024-09-11T11:04:54.101666+0000","last_fullsized":"2024-09-11T11:04:54.101666+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.101491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.101491+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.101491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:08.443409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.084086+0000","last_change":"2024-09-11T11:04:57.084086+0000","last_active":"2024-09-11T11:04:57.084086+0000","last_peered":"2024-09-11T11:04:57.084086+0000","last_clean":"2024-09-11T11:04:57.084086+0000","last_became_active":"2024-09-11T11:01:13.413535+0000","last_became_peered":"2024-09-11T11:01:13.413535+0000","last_unstale":"2024-09-11T11:04:57.084086+0000","last_undegraded":"2024-09-11T11:04:57.084086+0000","last_fullsized":"2024-09-11T11:04:57.084086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:57.083842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:57.083842+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.083842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:07:45.181339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.135429+0000","last_change":"2024-09-11T11:05:18.135493+0000","last_active":"2024-09-11T11:05:18.135429+0000","last_peered":"2024-09-11T11:05:18.135429+0000","last_clean":"2024-09-11T11:05:18.135429+0000","last_became_active":"2024-09-11T11:01:05.337509+0000","last_became_peered":"2024-09-11T11:01:05.337509+0000","last_unstale":"2024-09-11T11:05:18.135429+0000","last_undegraded":"2024-09-11T11:05:18.135429+0000","last_fullsized":"2024-09-11T11:05:18.135429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-11T11:05:18.135238+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-11T11:05:18.135238+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.135238+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:48:42.915671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039844+0000","last_change":"2024-09-11T11:01:03.321762+0000","last_active":"2024-09-11T11:03:26.039844+0000","last_peered":"2024-09-11T11:03:26.039844+0000","last_clean":"2024-09-11T11:03:26.039844+0000","last_became_active":"2024-09-11T11:01:03.320981+0000","last_became_peered":"2024-09-11T11:01:03.320981+0000","last_unstale":"2024-09-11T11:03:26.039844+0000","last_undegraded":"2024-09-11T11:03:26.039844+0000","last_fullsized":"2024-09-11T11:03:26.039844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.904312+0000","last_change":"2024-09-11T11:05:08.904364+0000","last_active":"2024-09-11T11:05:08.904312+0000","last_peered":"2024-09-11T11:05:08.904312+0000","last_clean":"2024-09-11T11:05:08.904312+0000","last_became_active":"2024-09-11T11:01:07.367778+0000","last_became_peered":"2024-09-11T11:01:07.367778+0000","last_unstale":"2024-09-11T11:05:08.904312+0000","last_undegraded":"2024-09-11T11:05:08.904312+0000","last_fullsized":"2024-09-11T11:05:08.904312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:08.904124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:08.904124+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.904124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:30:05.699592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.666167+0000","last_change":"2024-09-11T11:04:57.666250+0000","last_active":"2024-09-11T11:04:57.666167+0000","last_peered":"2024-09-11T11:04:57.666167+0000","last_clean":"2024-09-11T11:04:57.666167+0000","last_became_active":"2024-09-11T11:01:09.369318+0000","last_became_peered":"2024-09-11T11:01:09.369318+0000","last_unstale":"2024-09-11T11:04:57.666167+0000","last_undegraded":"2024-09-11T11:04:57.666167+0000","last_fullsized":"2024-09-11T11:04:57.666167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-11T11:04:57.665979+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-11T11:04:57.665979+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.665979+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:54:56.063485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.760439+0000","last_change":"2024-09-11T11:05:06.760491+0000","last_active":"2024-09-11T11:05:06.760439+0000","last_peered":"2024-09-11T11:05:06.760439+0000","last_clean":"2024-09-11T11:05:06.760439+0000","last_became_active":"2024-09-11T11:01:11.396833+0000","last_became_peered":"2024-09-11T11:01:11.396833+0000","last_unstale":"2024-09-11T11:05:06.760439+0000","last_undegraded":"2024-09-11T11:05:06.760439+0000","last_fullsized":"2024-09-11T11:05:06.760439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:06.760244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:06.760244+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.760244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:21:01.442882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.789907+0000","last_change":"2024-09-11T11:01:13.408361+0000","last_active":"2024-09-11T11:04:53.789907+0000","last_peered":"2024-09-11T11:04:53.789907+0000","last_clean":"2024-09-11T11:04:53.789907+0000","last_became_active":"2024-09-11T11:01:13.407663+0000","last_became_peered":"2024-09-11T11:01:13.407663+0000","last_unstale":"2024-09-11T11:04:53.789907+0000","last_undegraded":"2024-09-11T11:04:53.789907+0000","last_fullsized":"2024-09-11T11:04:53.789907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'8","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.591351+0000","last_change":"2024-09-11T11:01:05.340874+0000","last_active":"2024-09-11T11:04:17.591351+0000","last_peered":"2024-09-11T11:04:17.591351+0000","last_clean":"2024-09-11T11:04:17.591351+0000","last_became_active":"2024-09-11T11:01:05.340457+0000","last_became_peered":"2024-09-11T11:01:05.340457+0000","last_unstale":"2024-09-11T11:04:17.591351+0000","last_undegraded":"2024-09-11T11:04:17.591351+0000","last_fullsized":"2024-09-11T11:04:17.591351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.224793+0000","last_change":"2024-09-11T11:05:26.224918+0000","last_active":"2024-09-11T11:05:26.224793+0000","last_peered":"2024-09-11T11:05:26.224793+0000","last_clean":"2024-09-11T11:05:26.224793+0000","last_became_active":"2024-09-11T11:01:03.335235+0000","last_became_peered":"2024-09-11T11:01:03.335235+0000","last_unstale":"2024-09-11T11:05:26.224793+0000","last_undegraded":"2024-09-11T11:05:26.224793+0000","last_fullsized":"2024-09-11T11:05:26.224793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:26.224557+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:26.224557+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.224557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:35:54.595969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.663172+0000","last_change":"2024-09-11T11:04:59.663228+0000","last_active":"2024-09-11T11:04:59.663172+0000","last_peered":"2024-09-11T11:04:59.663172+0000","last_clean":"2024-09-11T11:04:59.663172+0000","last_became_active":"2024-09-11T11:02:42.501867+0000","last_became_peered":"2024-09-11T11:02:42.501867+0000","last_unstale":"2024-09-11T11:04:59.663172+0000","last_undegraded":"2024-09-11T11:04:59.663172+0000","last_fullsized":"2024-09-11T11:04:59.663172+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.662970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.662970+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.662970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:06.928697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.868589+0000","last_change":"2024-09-11T11:05:06.868678+0000","last_active":"2024-09-11T11:05:06.868589+0000","last_peered":"2024-09-11T11:05:06.868589+0000","last_clean":"2024-09-11T11:05:06.868589+0000","last_became_active":"2024-09-11T11:01:09.362975+0000","last_became_peered":"2024-09-11T11:01:09.362975+0000","last_unstale":"2024-09-11T11:05:06.868589+0000","last_undegraded":"2024-09-11T11:05:06.868589+0000","last_fullsized":"2024-09-11T11:05:06.868589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:06.868398+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:06.868398+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.868398+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:14.134126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.974940+0000","last_change":"2024-09-11T11:05:01.975001+0000","last_active":"2024-09-11T11:05:01.974940+0000","last_peered":"2024-09-11T11:05:01.974940+0000","last_clean":"2024-09-11T11:05:01.974940+0000","last_became_active":"2024-09-11T11:01:11.393181+0000","last_became_peered":"2024-09-11T11:01:11.393181+0000","last_unstale":"2024-09-11T11:05:01.974940+0000","last_undegraded":"2024-09-11T11:05:01.974940+0000","last_fullsized":"2024-09-11T11:05:01.974940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.974738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.974738+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.974738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:29.665900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'8","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.452372+0000","last_change":"2024-09-11T11:01:13.419907+0000","last_active":"2024-09-11T11:04:17.452372+0000","last_peered":"2024-09-11T11:04:17.452372+0000","last_clean":"2024-09-11T11:04:17.452372+0000","last_became_active":"2024-09-11T11:01:13.419238+0000","last_became_peered":"2024-09-11T11:01:13.419238+0000","last_unstale":"2024-09-11T11:04:17.452372+0000","last_undegraded":"2024-09-11T11:04:17.452372+0000","last_fullsized":"2024-09-11T11:04:17.452372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'10","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.937900+0000","last_change":"2024-09-11T11:01:42.073807+0000","last_active":"2024-09-11T11:04:17.937900+0000","last_peered":"2024-09-11T11:04:17.937900+0000","last_clean":"2024-09-11T11:04:17.937900+0000","last_became_active":"2024-09-11T11:01:42.058258+0000","last_became_peered":"2024-09-11T11:01:42.058258+0000","last_unstale":"2024-09-11T11:04:17.937900+0000","last_undegraded":"2024-09-11T11:04:17.937900+0000","last_fullsized":"2024-09-11T11:04:17.937900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:31.041124+0000","last_change":"2024-09-11T11:01:03.339928+0000","last_active":"2024-09-11T11:03:31.041124+0000","last_peered":"2024-09-11T11:03:31.041124+0000","last_clean":"2024-09-11T11:03:31.041124+0000","last_became_active":"2024-09-11T11:01:03.337144+0000","last_became_peered":"2024-09-11T11:01:03.337144+0000","last_unstale":"2024-09-11T11:03:31.041124+0000","last_undegraded":"2024-09-11T11:03:31.041124+0000","last_fullsized":"2024-09-11T11:03:31.041124+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"36'5","reported_seq":242,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.547528+0000","last_change":"2024-09-11T11:04:58.547593+0000","last_active":"2024-09-11T11:04:58.547528+0000","last_peered":"2024-09-11T11:04:58.547528+0000","last_clean":"2024-09-11T11:04:58.547528+0000","last_became_active":"2024-09-11T11:01:07.358156+0000","last_became_peered":"2024-09-11T11:01:07.358156+0000","last_unstale":"2024-09-11T11:04:58.547528+0000","last_undegraded":"2024-09-11T11:04:58.547528+0000","last_fullsized":"2024-09-11T11:04:58.547528+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-11T11:04:58.547344+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-11T11:04:58.547344+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.547344+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:46:00.492791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'50","reported_seq":126,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.732558+0000","last_change":"2024-09-11T11:05:02.732707+0000","last_active":"2024-09-11T11:05:02.732558+0000","last_peered":"2024-09-11T11:05:02.732558+0000","last_clean":"2024-09-11T11:05:02.732558+0000","last_became_active":"2024-09-11T11:01:09.380595+0000","last_became_peered":"2024-09-11T11:01:09.380595+0000","last_unstale":"2024-09-11T11:05:02.732558+0000","last_undegraded":"2024-09-11T11:05:02.732558+0000","last_fullsized":"2024-09-11T11:05:02.732558+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'50","last_scrub_stamp":"2024-09-11T11:05:02.732310+0000","last_deep_scrub":"36'50","last_deep_scrub_stamp":"2024-09-11T11:05:02.732310+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.732310+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:04.576806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":83,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.877470+0000","last_change":"2024-09-11T11:05:01.877523+0000","last_active":"2024-09-11T11:05:01.877470+0000","last_peered":"2024-09-11T11:05:01.877470+0000","last_clean":"2024-09-11T11:05:01.877470+0000","last_became_active":"2024-09-11T11:01:11.401847+0000","last_became_peered":"2024-09-11T11:01:11.401847+0000","last_unstale":"2024-09-11T11:05:01.877470+0000","last_undegraded":"2024-09-11T11:05:01.877470+0000","last_fullsized":"2024-09-11T11:05:01.877470+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.877282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.877282+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.877282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:36.973759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:43.042627+0000","last_change":"2024-09-11T11:01:13.397280+0000","last_active":"2024-09-11T11:03:43.042627+0000","last_peered":"2024-09-11T11:03:43.042627+0000","last_clean":"2024-09-11T11:03:43.042627+0000","last_became_active":"2024-09-11T11:01:13.395231+0000","last_became_peered":"2024-09-11T11:01:13.395231+0000","last_unstale":"2024-09-11T11:03:43.042627+0000","last_undegraded":"2024-09-11T11:03:43.042627+0000","last_fullsized":"2024-09-11T11:03:43.042627+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'12","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.785451+0000","last_change":"2024-09-11T11:05:20.785513+0000","last_active":"2024-09-11T11:05:20.785451+0000","last_peered":"2024-09-11T11:05:20.785451+0000","last_clean":"2024-09-11T11:05:20.785451+0000","last_became_active":"2024-09-11T11:01:05.348002+0000","last_became_peered":"2024-09-11T11:01:05.348002+0000","last_unstale":"2024-09-11T11:05:20.785451+0000","last_undegraded":"2024-09-11T11:05:20.785451+0000","last_fullsized":"2024-09-11T11:05:20.785451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:20.785263+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:20.785263+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.785263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:15:03.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.040022+0000","last_change":"2024-09-11T11:01:03.338184+0000","last_active":"2024-09-11T11:03:28.040022+0000","last_peered":"2024-09-11T11:03:28.040022+0000","last_clean":"2024-09-11T11:03:28.040022+0000","last_became_active":"2024-09-11T11:01:03.330782+0000","last_became_peered":"2024-09-11T11:01:03.330782+0000","last_unstale":"2024-09-11T11:03:28.040022+0000","last_undegraded":"2024-09-11T11:03:28.040022+0000","last_fullsized":"2024-09-11T11:03:28.040022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.796210+0000","last_change":"2024-09-11T11:05:19.796271+0000","last_active":"2024-09-11T11:05:19.796210+0000","last_peered":"2024-09-11T11:05:19.796210+0000","last_clean":"2024-09-11T11:05:19.796210+0000","last_became_active":"2024-09-11T11:01:07.350685+0000","last_became_peered":"2024-09-11T11:01:07.350685+0000","last_unstale":"2024-09-11T11:05:19.796210+0000","last_undegraded":"2024-09-11T11:05:19.796210+0000","last_fullsized":"2024-09-11T11:05:19.796210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:19.796009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:19.796009+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.796009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:34:29.117828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'37","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.597735+0000","last_change":"2024-09-11T11:04:55.597808+0000","last_active":"2024-09-11T11:04:55.597735+0000","last_peered":"2024-09-11T11:04:55.597735+0000","last_clean":"2024-09-11T11:04:55.597735+0000","last_became_active":"2024-09-11T11:01:09.362483+0000","last_became_peered":"2024-09-11T11:01:09.362483+0000","last_unstale":"2024-09-11T11:04:55.597735+0000","last_undegraded":"2024-09-11T11:04:55.597735+0000","last_fullsized":"2024-09-11T11:04:55.597735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:04:55.597543+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:04:55.597543+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.597543+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:28.136198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.018241+0000","last_change":"2024-09-11T11:04:59.018297+0000","last_active":"2024-09-11T11:04:59.018241+0000","last_peered":"2024-09-11T11:04:59.018241+0000","last_clean":"2024-09-11T11:04:59.018241+0000","last_became_active":"2024-09-11T11:01:11.398843+0000","last_became_peered":"2024-09-11T11:01:11.398843+0000","last_unstale":"2024-09-11T11:04:59.018241+0000","last_undegraded":"2024-09-11T11:04:59.018241+0000","last_fullsized":"2024-09-11T11:04:59.018241+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.018045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.018045+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.018045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:30:20.573633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.485209+0000","last_change":"2024-09-11T11:05:22.485267+0000","last_active":"2024-09-11T11:05:22.485209+0000","last_peered":"2024-09-11T11:05:22.485209+0000","last_clean":"2024-09-11T11:05:22.485209+0000","last_became_active":"2024-09-11T11:01:05.347496+0000","last_became_peered":"2024-09-11T11:01:05.347496+0000","last_unstale":"2024-09-11T11:05:22.485209+0000","last_undegraded":"2024-09-11T11:05:22.485209+0000","last_fullsized":"2024-09-11T11:05:22.485209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:22.485029+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:22.485029+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.485029+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:12.896348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:28.038156+0000","last_change":"2024-09-11T11:01:03.349185+0000","last_active":"2024-09-11T11:03:28.038156+0000","last_peered":"2024-09-11T11:03:28.038156+0000","last_clean":"2024-09-11T11:03:28.038156+0000","last_became_active":"2024-09-11T11:01:03.348849+0000","last_became_peered":"2024-09-11T11:01:03.348849+0000","last_unstale":"2024-09-11T11:03:28.038156+0000","last_undegraded":"2024-09-11T11:03:28.038156+0000","last_fullsized":"2024-09-11T11:03:28.038156+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.904463+0000","last_change":"2024-09-11T11:05:12.904513+0000","last_active":"2024-09-11T11:05:12.904463+0000","last_peered":"2024-09-11T11:05:12.904463+0000","last_clean":"2024-09-11T11:05:12.904463+0000","last_became_active":"2024-09-11T11:01:07.365953+0000","last_became_peered":"2024-09-11T11:01:07.365953+0000","last_unstale":"2024-09-11T11:05:12.904463+0000","last_undegraded":"2024-09-11T11:05:12.904463+0000","last_fullsized":"2024-09-11T11:05:12.904463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:12.904281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:12.904281+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.904281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:06.284437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.899052+0000","last_change":"2024-09-11T11:05:04.899131+0000","last_active":"2024-09-11T11:05:04.899052+0000","last_peered":"2024-09-11T11:05:04.899052+0000","last_clean":"2024-09-11T11:05:04.899052+0000","last_became_active":"2024-09-11T11:01:09.374937+0000","last_became_peered":"2024-09-11T11:01:09.374937+0000","last_unstale":"2024-09-11T11:05:04.899052+0000","last_undegraded":"2024-09-11T11:05:04.899052+0000","last_fullsized":"2024-09-11T11:05:04.899052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-11T11:05:04.898835+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-11T11:05:04.898835+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.898835+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:55:03.296341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.012953+0000","last_change":"2024-09-11T11:05:00.013009+0000","last_active":"2024-09-11T11:05:00.012953+0000","last_peered":"2024-09-11T11:05:00.012953+0000","last_clean":"2024-09-11T11:05:00.012953+0000","last_became_active":"2024-09-11T11:01:11.394849+0000","last_became_peered":"2024-09-11T11:01:11.394849+0000","last_unstale":"2024-09-11T11:05:00.012953+0000","last_undegraded":"2024-09-11T11:05:00.012953+0000","last_fullsized":"2024-09-11T11:05:00.012953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.012754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.012754+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.012754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:50.213447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.039920+0000","last_change":"2024-09-11T11:01:13.416940+0000","last_active":"2024-09-11T11:03:33.039920+0000","last_peered":"2024-09-11T11:03:33.039920+0000","last_clean":"2024-09-11T11:03:33.039920+0000","last_became_active":"2024-09-11T11:01:13.416414+0000","last_became_peered":"2024-09-11T11:01:13.416414+0000","last_unstale":"2024-09-11T11:03:33.039920+0000","last_undegraded":"2024-09-11T11:03:33.039920+0000","last_fullsized":"2024-09-11T11:03:33.039920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.777103+0000","last_change":"2024-09-11T11:05:31.777167+0000","last_active":"2024-09-11T11:05:31.777103+0000","last_peered":"2024-09-11T11:05:31.777103+0000","last_clean":"2024-09-11T11:05:31.777103+0000","last_became_active":"2024-09-11T11:01:05.339898+0000","last_became_peered":"2024-09-11T11:01:05.339898+0000","last_unstale":"2024-09-11T11:05:31.777103+0000","last_undegraded":"2024-09-11T11:05:31.777103+0000","last_fullsized":"2024-09-11T11:05:31.777103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:31.776907+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:31.776907+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.776907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:10.381824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:49.078373+0000","last_change":"2024-09-11T11:01:42.094568+0000","last_active":"2024-09-11T11:04:49.078373+0000","last_peered":"2024-09-11T11:04:49.078373+0000","last_clean":"2024-09-11T11:04:49.078373+0000","last_became_active":"2024-09-11T11:01:42.058648+0000","last_became_peered":"2024-09-11T11:01:42.058648+0000","last_unstale":"2024-09-11T11:04:49.078373+0000","last_undegraded":"2024-09-11T11:04:49.078373+0000","last_fullsized":"2024-09-11T11:04:49.078373+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.564057+0000","last_change":"2024-09-11T11:05:16.564057+0000","last_active":"2024-09-11T11:05:16.564057+0000","last_peered":"2024-09-11T11:05:16.564057+0000","last_clean":"2024-09-11T11:05:16.564057+0000","last_became_active":"2024-09-11T11:01:07.340147+0000","last_became_peered":"2024-09-11T11:01:07.340147+0000","last_unstale":"2024-09-11T11:05:16.564057+0000","last_undegraded":"2024-09-11T11:05:16.564057+0000","last_fullsized":"2024-09-11T11:05:16.564057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.563796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.563796+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.563796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:18.185050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.646330+0000","last_change":"2024-09-11T11:05:11.646407+0000","last_active":"2024-09-11T11:05:11.646330+0000","last_peered":"2024-09-11T11:05:11.646330+0000","last_clean":"2024-09-11T11:05:11.646330+0000","last_became_active":"2024-09-11T11:01:09.371522+0000","last_became_peered":"2024-09-11T11:01:09.371522+0000","last_unstale":"2024-09-11T11:05:11.646330+0000","last_undegraded":"2024-09-11T11:05:11.646330+0000","last_fullsized":"2024-09-11T11:05:11.646330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:05:11.646224+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:05:11.646224+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.646224+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:29:32.853566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.888423+0000","last_change":"2024-09-11T11:04:55.888485+0000","last_active":"2024-09-11T11:04:55.888423+0000","last_peered":"2024-09-11T11:04:55.888423+0000","last_clean":"2024-09-11T11:04:55.888423+0000","last_became_active":"2024-09-11T11:01:11.392489+0000","last_became_peered":"2024-09-11T11:01:11.392489+0000","last_unstale":"2024-09-11T11:04:55.888423+0000","last_undegraded":"2024-09-11T11:04:55.888423+0000","last_fullsized":"2024-09-11T11:04:55.888423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:55.888202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:55.888202+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.888202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:10:13.122333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042146+0000","last_change":"2024-09-11T11:01:13.405032+0000","last_active":"2024-09-11T11:03:36.042146+0000","last_peered":"2024-09-11T11:03:36.042146+0000","last_clean":"2024-09-11T11:03:36.042146+0000","last_became_active":"2024-09-11T11:01:13.404341+0000","last_became_peered":"2024-09-11T11:01:13.404341+0000","last_unstale":"2024-09-11T11:03:36.042146+0000","last_undegraded":"2024-09-11T11:03:36.042146+0000","last_fullsized":"2024-09-11T11:03:36.042146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'18","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.804764+0000","last_change":"2024-09-11T11:05:21.804823+0000","last_active":"2024-09-11T11:05:21.804764+0000","last_peered":"2024-09-11T11:05:21.804764+0000","last_clean":"2024-09-11T11:05:21.804764+0000","last_became_active":"2024-09-11T11:01:05.347745+0000","last_became_peered":"2024-09-11T11:01:05.347745+0000","last_unstale":"2024-09-11T11:05:21.804764+0000","last_undegraded":"2024-09-11T11:05:21.804764+0000","last_fullsized":"2024-09-11T11:05:21.804764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:21.804546+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:21.804546+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.804546+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:23.425800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042192+0000","last_change":"2024-09-11T11:01:03.322039+0000","last_active":"2024-09-11T11:03:36.042192+0000","last_peered":"2024-09-11T11:03:36.042192+0000","last_clean":"2024-09-11T11:03:36.042192+0000","last_became_active":"2024-09-11T11:01:03.321106+0000","last_became_peered":"2024-09-11T11:01:03.321106+0000","last_unstale":"2024-09-11T11:03:36.042192+0000","last_undegraded":"2024-09-11T11:03:36.042192+0000","last_fullsized":"2024-09-11T11:03:36.042192+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.487689+0000","last_change":"2024-09-11T11:05:02.487740+0000","last_active":"2024-09-11T11:05:02.487689+0000","last_peered":"2024-09-11T11:05:02.487689+0000","last_clean":"2024-09-11T11:05:02.487689+0000","last_became_active":"2024-09-11T11:01:07.342760+0000","last_became_peered":"2024-09-11T11:01:07.342760+0000","last_unstale":"2024-09-11T11:05:02.487689+0000","last_undegraded":"2024-09-11T11:05:02.487689+0000","last_fullsized":"2024-09-11T11:05:02.487689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:02.487502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:02.487502+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.487502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:42.593320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'41","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.821592+0000","last_change":"2024-09-11T11:05:13.821592+0000","last_active":"2024-09-11T11:05:13.821592+0000","last_peered":"2024-09-11T11:05:13.821592+0000","last_clean":"2024-09-11T11:05:13.821592+0000","last_became_active":"2024-09-11T11:01:09.389548+0000","last_became_peered":"2024-09-11T11:01:09.389548+0000","last_unstale":"2024-09-11T11:05:13.821592+0000","last_undegraded":"2024-09-11T11:05:13.821592+0000","last_fullsized":"2024-09-11T11:05:13.821592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-11T11:05:13.821343+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-11T11:05:13.821343+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.821343+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:01:03.574623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.814732+0000","last_change":"2024-09-11T11:04:58.814732+0000","last_active":"2024-09-11T11:04:58.814732+0000","last_peered":"2024-09-11T11:04:58.814732+0000","last_clean":"2024-09-11T11:04:58.814732+0000","last_became_active":"2024-09-11T11:01:11.391080+0000","last_became_peered":"2024-09-11T11:01:11.391080+0000","last_unstale":"2024-09-11T11:04:58.814732+0000","last_undegraded":"2024-09-11T11:04:58.814732+0000","last_fullsized":"2024-09-11T11:04:58.814732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:58.814489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:58.814489+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.814489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:30:05.782233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042125+0000","last_change":"2024-09-11T11:01:13.421751+0000","last_active":"2024-09-11T11:03:36.042125+0000","last_peered":"2024-09-11T11:03:36.042125+0000","last_clean":"2024-09-11T11:03:36.042125+0000","last_became_active":"2024-09-11T11:01:13.420844+0000","last_became_peered":"2024-09-11T11:01:13.420844+0000","last_unstale":"2024-09-11T11:03:36.042125+0000","last_undegraded":"2024-09-11T11:03:36.042125+0000","last_fullsized":"2024-09-11T11:03:36.042125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.077237+0000","last_change":"2024-09-11T11:05:14.077302+0000","last_active":"2024-09-11T11:05:14.077237+0000","last_peered":"2024-09-11T11:05:14.077237+0000","last_clean":"2024-09-11T11:05:14.077237+0000","last_became_active":"2024-09-11T11:01:05.338036+0000","last_became_peered":"2024-09-11T11:01:05.338036+0000","last_unstale":"2024-09-11T11:05:14.077237+0000","last_undegraded":"2024-09-11T11:05:14.077237+0000","last_fullsized":"2024-09-11T11:05:14.077237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:14.077033+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:14.077033+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.077033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:34:09.324339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.914162+0000","last_change":"2024-09-11T11:01:03.336252+0000","last_active":"2024-09-11T11:04:17.914162+0000","last_peered":"2024-09-11T11:04:17.914162+0000","last_clean":"2024-09-11T11:04:17.914162+0000","last_became_active":"2024-09-11T11:01:03.335959+0000","last_became_peered":"2024-09-11T11:01:03.335959+0000","last_unstale":"2024-09-11T11:04:17.914162+0000","last_undegraded":"2024-09-11T11:04:17.914162+0000","last_fullsized":"2024-09-11T11:04:17.914162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.936685+0000","last_change":"2024-09-11T11:04:52.936737+0000","last_active":"2024-09-11T11:04:52.936685+0000","last_peered":"2024-09-11T11:04:52.936685+0000","last_clean":"2024-09-11T11:04:52.936685+0000","last_became_active":"2024-09-11T11:01:07.368853+0000","last_became_peered":"2024-09-11T11:01:07.368853+0000","last_unstale":"2024-09-11T11:04:52.936685+0000","last_undegraded":"2024-09-11T11:04:52.936685+0000","last_fullsized":"2024-09-11T11:04:52.936685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:52.936491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:52.936491+0000","last_clean_scrub_stamp":"2024-09-11T11:04:52.936491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:47:53.282179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.798050+0000","last_change":"2024-09-11T11:05:11.798050+0000","last_active":"2024-09-11T11:05:11.798050+0000","last_peered":"2024-09-11T11:05:11.798050+0000","last_clean":"2024-09-11T11:05:11.798050+0000","last_became_active":"2024-09-11T11:01:09.391249+0000","last_became_peered":"2024-09-11T11:01:09.391249+0000","last_unstale":"2024-09-11T11:05:11.798050+0000","last_undegraded":"2024-09-11T11:05:11.798050+0000","last_fullsized":"2024-09-11T11:05:11.798050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:05:11.797766+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:05:11.797766+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.797766+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:17:35.030060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'285","reported_seq":376,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.441043+0000","last_change":"2024-09-11T11:01:11.403073+0000","last_active":"2024-09-11T11:04:52.441043+0000","last_peered":"2024-09-11T11:04:52.441043+0000","last_clean":"2024-09-11T11:04:52.441043+0000","last_became_active":"2024-09-11T11:01:11.401400+0000","last_became_peered":"2024-09-11T11:01:11.401400+0000","last_unstale":"2024-09-11T11:04:52.441043+0000","last_undegraded":"2024-09-11T11:04:52.441043+0000","last_fullsized":"2024-09-11T11:04:52.441043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:10.343716+0000","last_clean_scrub_stamp":"2024-09-11T11:01:10.343716+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.041975+0000","last_change":"2024-09-11T11:01:13.403086+0000","last_active":"2024-09-11T11:03:36.041975+0000","last_peered":"2024-09-11T11:03:36.041975+0000","last_clean":"2024-09-11T11:03:36.041975+0000","last_became_active":"2024-09-11T11:01:13.402406+0000","last_became_peered":"2024-09-11T11:01:13.402406+0000","last_unstale":"2024-09-11T11:03:36.041975+0000","last_undegraded":"2024-09-11T11:03:36.041975+0000","last_fullsized":"2024-09-11T11:03:36.041975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.182058+0000","last_change":"2024-09-11T11:05:19.182120+0000","last_active":"2024-09-11T11:05:19.182058+0000","last_peered":"2024-09-11T11:05:19.182058+0000","last_clean":"2024-09-11T11:05:19.182058+0000","last_became_active":"2024-09-11T11:01:05.353214+0000","last_became_peered":"2024-09-11T11:01:05.353214+0000","last_unstale":"2024-09-11T11:05:19.182058+0000","last_undegraded":"2024-09-11T11:05:19.182058+0000","last_fullsized":"2024-09-11T11:05:19.182058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:19.181864+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:19.181864+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.181864+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:55.950071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.041125+0000","last_change":"2024-09-11T11:01:03.346782+0000","last_active":"2024-09-11T11:03:33.041125+0000","last_peered":"2024-09-11T11:03:33.041125+0000","last_clean":"2024-09-11T11:03:33.041125+0000","last_became_active":"2024-09-11T11:01:03.346318+0000","last_became_peered":"2024-09-11T11:01:03.346318+0000","last_unstale":"2024-09-11T11:03:33.041125+0000","last_undegraded":"2024-09-11T11:03:33.041125+0000","last_fullsized":"2024-09-11T11:03:33.041125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.915520+0000","last_change":"2024-09-11T11:04:54.915574+0000","last_active":"2024-09-11T11:04:54.915520+0000","last_peered":"2024-09-11T11:04:54.915520+0000","last_clean":"2024-09-11T11:04:54.915520+0000","last_became_active":"2024-09-11T11:01:07.368713+0000","last_became_peered":"2024-09-11T11:01:07.368713+0000","last_unstale":"2024-09-11T11:04:54.915520+0000","last_undegraded":"2024-09-11T11:04:54.915520+0000","last_fullsized":"2024-09-11T11:04:54.915520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.915331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.915331+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.915331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:04.269950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.531652+0000","last_change":"2024-09-11T11:04:57.531736+0000","last_active":"2024-09-11T11:04:57.531652+0000","last_peered":"2024-09-11T11:04:57.531652+0000","last_clean":"2024-09-11T11:04:57.531652+0000","last_became_active":"2024-09-11T11:01:09.363530+0000","last_became_peered":"2024-09-11T11:01:09.363530+0000","last_unstale":"2024-09-11T11:04:57.531652+0000","last_undegraded":"2024-09-11T11:04:57.531652+0000","last_fullsized":"2024-09-11T11:04:57.531652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:04:57.531466+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:04:57.531466+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.531466+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:53.383843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.753485+0000","last_change":"2024-09-11T11:05:08.753629+0000","last_active":"2024-09-11T11:05:08.753485+0000","last_peered":"2024-09-11T11:05:08.753485+0000","last_clean":"2024-09-11T11:05:08.753485+0000","last_became_active":"2024-09-11T11:01:11.371526+0000","last_became_peered":"2024-09-11T11:01:11.371526+0000","last_unstale":"2024-09-11T11:05:08.753485+0000","last_undegraded":"2024-09-11T11:05:08.753485+0000","last_fullsized":"2024-09-11T11:05:08.753485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:08.753213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:08.753213+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.753213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:50.699884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:41.043763+0000","last_change":"2024-09-11T11:01:13.421954+0000","last_active":"2024-09-11T11:03:41.043763+0000","last_peered":"2024-09-11T11:03:41.043763+0000","last_clean":"2024-09-11T11:03:41.043763+0000","last_became_active":"2024-09-11T11:01:13.421220+0000","last_became_peered":"2024-09-11T11:01:13.421220+0000","last_unstale":"2024-09-11T11:03:41.043763+0000","last_undegraded":"2024-09-11T11:03:41.043763+0000","last_fullsized":"2024-09-11T11:03:41.043763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.529896+0000","last_change":"2024-09-11T11:05:19.529955+0000","last_active":"2024-09-11T11:05:19.529896+0000","last_peered":"2024-09-11T11:05:19.529896+0000","last_clean":"2024-09-11T11:05:19.529896+0000","last_became_active":"2024-09-11T11:01:05.348256+0000","last_became_peered":"2024-09-11T11:01:05.348256+0000","last_unstale":"2024-09-11T11:05:19.529896+0000","last_undegraded":"2024-09-11T11:05:19.529896+0000","last_fullsized":"2024-09-11T11:05:19.529896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:19.529705+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:19.529705+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.529705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:22:58.134622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042420+0000","last_change":"2024-09-11T11:01:03.323843+0000","last_active":"2024-09-11T11:03:36.042420+0000","last_peered":"2024-09-11T11:03:36.042420+0000","last_clean":"2024-09-11T11:03:36.042420+0000","last_became_active":"2024-09-11T11:01:03.323106+0000","last_became_peered":"2024-09-11T11:01:03.323106+0000","last_unstale":"2024-09-11T11:03:36.042420+0000","last_undegraded":"2024-09-11T11:03:36.042420+0000","last_fullsized":"2024-09-11T11:03:36.042420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.514431+0000","last_change":"2024-09-11T11:04:59.514486+0000","last_active":"2024-09-11T11:04:59.514431+0000","last_peered":"2024-09-11T11:04:59.514431+0000","last_clean":"2024-09-11T11:04:59.514431+0000","last_became_active":"2024-09-11T11:01:07.346507+0000","last_became_peered":"2024-09-11T11:01:07.346507+0000","last_unstale":"2024-09-11T11:04:59.514431+0000","last_undegraded":"2024-09-11T11:04:59.514431+0000","last_fullsized":"2024-09-11T11:04:59.514431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.514205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.514205+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.514205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:09.294520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.992718+0000","last_change":"2024-09-11T11:05:05.992792+0000","last_active":"2024-09-11T11:05:05.992718+0000","last_peered":"2024-09-11T11:05:05.992718+0000","last_clean":"2024-09-11T11:05:05.992718+0000","last_became_active":"2024-09-11T11:01:09.367104+0000","last_became_peered":"2024-09-11T11:01:09.367104+0000","last_unstale":"2024-09-11T11:05:05.992718+0000","last_undegraded":"2024-09-11T11:05:05.992718+0000","last_fullsized":"2024-09-11T11:05:05.992718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-11T11:05:05.992530+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-11T11:05:05.992530+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.992530+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:53:54.568734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.594385+0000","last_change":"2024-09-11T11:05:25.594444+0000","last_active":"2024-09-11T11:05:25.594385+0000","last_peered":"2024-09-11T11:05:25.594385+0000","last_clean":"2024-09-11T11:05:25.594385+0000","last_became_active":"2024-09-11T11:01:11.400269+0000","last_became_peered":"2024-09-11T11:01:11.400269+0000","last_unstale":"2024-09-11T11:05:25.594385+0000","last_undegraded":"2024-09-11T11:05:25.594385+0000","last_fullsized":"2024-09-11T11:05:25.594385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:25.594179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:25.594179+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.594179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:41.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.041445+0000","last_change":"2024-09-11T11:01:13.424386+0000","last_active":"2024-09-11T11:03:38.041445+0000","last_peered":"2024-09-11T11:03:38.041445+0000","last_clean":"2024-09-11T11:03:38.041445+0000","last_became_active":"2024-09-11T11:01:13.423466+0000","last_became_peered":"2024-09-11T11:01:13.423466+0000","last_unstale":"2024-09-11T11:03:38.041445+0000","last_undegraded":"2024-09-11T11:03:38.041445+0000","last_fullsized":"2024-09-11T11:03:38.041445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.592371+0000","last_change":"2024-09-11T11:01:05.334600+0000","last_active":"2024-09-11T11:04:17.592371+0000","last_peered":"2024-09-11T11:04:17.592371+0000","last_clean":"2024-09-11T11:04:17.592371+0000","last_became_active":"2024-09-11T11:01:05.334141+0000","last_became_peered":"2024-09-11T11:01:05.334141+0000","last_unstale":"2024-09-11T11:04:17.592371+0000","last_undegraded":"2024-09-11T11:04:17.592371+0000","last_fullsized":"2024-09-11T11:04:17.592371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787452+0000","last_change":"2024-09-11T11:01:03.340441+0000","last_active":"2024-09-11T11:04:53.787452+0000","last_peered":"2024-09-11T11:04:53.787452+0000","last_clean":"2024-09-11T11:04:53.787452+0000","last_became_active":"2024-09-11T11:01:03.337584+0000","last_became_peered":"2024-09-11T11:01:03.337584+0000","last_unstale":"2024-09-11T11:04:53.787452+0000","last_undegraded":"2024-09-11T11:04:53.787452+0000","last_fullsized":"2024-09-11T11:04:53.787452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.834278+0000","last_change":"2024-09-11T11:05:14.834334+0000","last_active":"2024-09-11T11:05:14.834278+0000","last_peered":"2024-09-11T11:05:14.834278+0000","last_clean":"2024-09-11T11:05:14.834278+0000","last_became_active":"2024-09-11T11:01:07.365791+0000","last_became_peered":"2024-09-11T11:01:07.365791+0000","last_unstale":"2024-09-11T11:05:14.834278+0000","last_undegraded":"2024-09-11T11:05:14.834278+0000","last_fullsized":"2024-09-11T11:05:14.834278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:14.834085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:14.834085+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.834085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:21.684279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.678435+0000","last_change":"2024-09-11T11:04:58.678503+0000","last_active":"2024-09-11T11:04:58.678435+0000","last_peered":"2024-09-11T11:04:58.678435+0000","last_clean":"2024-09-11T11:04:58.678435+0000","last_became_active":"2024-09-11T11:01:09.380531+0000","last_became_peered":"2024-09-11T11:01:09.380531+0000","last_unstale":"2024-09-11T11:04:58.678435+0000","last_undegraded":"2024-09-11T11:04:58.678435+0000","last_fullsized":"2024-09-11T11:04:58.678435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-11T11:04:58.678237+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-11T11:04:58.678237+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.678237+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:51.973784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.571459+0000","last_change":"2024-09-11T11:05:17.571511+0000","last_active":"2024-09-11T11:05:17.571459+0000","last_peered":"2024-09-11T11:05:17.571459+0000","last_clean":"2024-09-11T11:05:17.571459+0000","last_became_active":"2024-09-11T11:01:11.386302+0000","last_became_peered":"2024-09-11T11:01:11.386302+0000","last_unstale":"2024-09-11T11:05:17.571459+0000","last_undegraded":"2024-09-11T11:05:17.571459+0000","last_fullsized":"2024-09-11T11:05:17.571459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:17.571262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:17.571262+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.571262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:34.402557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'8","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.595893+0000","last_change":"2024-09-11T11:01:13.423002+0000","last_active":"2024-09-11T11:04:17.595893+0000","last_peered":"2024-09-11T11:04:17.595893+0000","last_clean":"2024-09-11T11:04:17.595893+0000","last_became_active":"2024-09-11T11:01:13.422285+0000","last_became_peered":"2024-09-11T11:01:13.422285+0000","last_unstale":"2024-09-11T11:04:17.595893+0000","last_undegraded":"2024-09-11T11:04:17.595893+0000","last_fullsized":"2024-09-11T11:04:17.595893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.627315+0000","last_change":"2024-09-11T11:05:28.627375+0000","last_active":"2024-09-11T11:05:28.627315+0000","last_peered":"2024-09-11T11:05:28.627315+0000","last_clean":"2024-09-11T11:05:28.627315+0000","last_became_active":"2024-09-11T11:01:05.336680+0000","last_became_peered":"2024-09-11T11:01:05.336680+0000","last_unstale":"2024-09-11T11:05:28.627315+0000","last_undegraded":"2024-09-11T11:05:28.627315+0000","last_fullsized":"2024-09-11T11:05:28.627315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:28.627119+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:28.627119+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.627119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:20:00.550003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881231+0000","last_change":"2024-09-11T11:01:03.336607+0000","last_active":"2024-09-11T11:04:52.881231+0000","last_peered":"2024-09-11T11:04:52.881231+0000","last_clean":"2024-09-11T11:04:52.881231+0000","last_became_active":"2024-09-11T11:01:03.331816+0000","last_became_peered":"2024-09-11T11:01:03.331816+0000","last_unstale":"2024-09-11T11:04:52.881231+0000","last_undegraded":"2024-09-11T11:04:52.881231+0000","last_fullsized":"2024-09-11T11:04:52.881231+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.790257+0000","last_change":"2024-09-11T11:05:15.790325+0000","last_active":"2024-09-11T11:05:15.790257+0000","last_peered":"2024-09-11T11:05:15.790257+0000","last_clean":"2024-09-11T11:05:15.790257+0000","last_became_active":"2024-09-11T11:01:07.363545+0000","last_became_peered":"2024-09-11T11:01:07.363545+0000","last_unstale":"2024-09-11T11:05:15.790257+0000","last_undegraded":"2024-09-11T11:05:15.790257+0000","last_fullsized":"2024-09-11T11:05:15.790257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-11T11:05:15.790071+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-11T11:05:15.790071+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.790071+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:57.736742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'39","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.503812+0000","last_change":"2024-09-11T11:05:04.503885+0000","last_active":"2024-09-11T11:05:04.503812+0000","last_peered":"2024-09-11T11:05:04.503812+0000","last_clean":"2024-09-11T11:05:04.503812+0000","last_became_active":"2024-09-11T11:01:09.377586+0000","last_became_peered":"2024-09-11T11:01:09.377586+0000","last_unstale":"2024-09-11T11:05:04.503812+0000","last_undegraded":"2024-09-11T11:05:04.503812+0000","last_fullsized":"2024-09-11T11:05:04.503812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-11T11:05:04.503625+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-11T11:05:04.503625+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.503625+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:19.713646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.130713+0000","last_change":"2024-09-11T11:04:56.130847+0000","last_active":"2024-09-11T11:04:56.130713+0000","last_peered":"2024-09-11T11:04:56.130713+0000","last_clean":"2024-09-11T11:04:56.130713+0000","last_became_active":"2024-09-11T11:01:11.401078+0000","last_became_peered":"2024-09-11T11:01:11.401078+0000","last_unstale":"2024-09-11T11:04:56.130713+0000","last_undegraded":"2024-09-11T11:04:56.130713+0000","last_fullsized":"2024-09-11T11:04:56.130713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:56.130494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:56.130494+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.130494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:45.639114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042291+0000","last_change":"2024-09-11T11:01:13.422050+0000","last_active":"2024-09-11T11:03:36.042291+0000","last_peered":"2024-09-11T11:03:36.042291+0000","last_clean":"2024-09-11T11:03:36.042291+0000","last_became_active":"2024-09-11T11:01:13.421231+0000","last_became_peered":"2024-09-11T11:01:13.421231+0000","last_unstale":"2024-09-11T11:03:36.042291+0000","last_undegraded":"2024-09-11T11:03:36.042291+0000","last_fullsized":"2024-09-11T11:03:36.042291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'12","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881977+0000","last_change":"2024-09-11T11:01:05.340309+0000","last_active":"2024-09-11T11:04:52.881977+0000","last_peered":"2024-09-11T11:04:52.881977+0000","last_clean":"2024-09-11T11:04:52.881977+0000","last_became_active":"2024-09-11T11:01:05.339760+0000","last_became_peered":"2024-09-11T11:01:05.339760+0000","last_unstale":"2024-09-11T11:04:52.881977+0000","last_undegraded":"2024-09-11T11:04:52.881977+0000","last_fullsized":"2024-09-11T11:04:52.881977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.228509+0000","last_change":"2024-09-11T11:05:24.228568+0000","last_active":"2024-09-11T11:05:24.228509+0000","last_peered":"2024-09-11T11:05:24.228509+0000","last_clean":"2024-09-11T11:05:24.228509+0000","last_became_active":"2024-09-11T11:01:03.338039+0000","last_became_peered":"2024-09-11T11:01:03.338039+0000","last_unstale":"2024-09-11T11:05:24.228509+0000","last_undegraded":"2024-09-11T11:05:24.228509+0000","last_fullsized":"2024-09-11T11:05:24.228509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:24.228296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:24.228296+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.228296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:21:06.516380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.735670+0000","last_change":"2024-09-11T11:05:30.735753+0000","last_active":"2024-09-11T11:05:30.735670+0000","last_peered":"2024-09-11T11:05:30.735670+0000","last_clean":"2024-09-11T11:05:30.735670+0000","last_became_active":"2024-09-11T11:01:05.332632+0000","last_became_peered":"2024-09-11T11:01:05.332632+0000","last_unstale":"2024-09-11T11:05:30.735670+0000","last_undegraded":"2024-09-11T11:05:30.735670+0000","last_fullsized":"2024-09-11T11:05:30.735670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:30.735470+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:30.735470+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.735470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:53.829897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.266178+0000","last_change":"2024-09-11T11:05:30.266240+0000","last_active":"2024-09-11T11:05:30.266178+0000","last_peered":"2024-09-11T11:05:30.266178+0000","last_clean":"2024-09-11T11:05:30.266178+0000","last_became_active":"2024-09-11T11:01:03.327428+0000","last_became_peered":"2024-09-11T11:01:03.327428+0000","last_unstale":"2024-09-11T11:05:30.266178+0000","last_undegraded":"2024-09-11T11:05:30.266178+0000","last_fullsized":"2024-09-11T11:05:30.266178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:30.265963+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:30.265963+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.265963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:58.012199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.534760+0000","last_change":"2024-09-11T11:05:18.534760+0000","last_active":"2024-09-11T11:05:18.534760+0000","last_peered":"2024-09-11T11:05:18.534760+0000","last_clean":"2024-09-11T11:05:18.534760+0000","last_became_active":"2024-09-11T11:01:05.348827+0000","last_became_peered":"2024-09-11T11:01:05.348827+0000","last_unstale":"2024-09-11T11:05:18.534760+0000","last_undegraded":"2024-09-11T11:05:18.534760+0000","last_fullsized":"2024-09-11T11:05:18.534760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:18.534472+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:18.534472+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.534472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:41.628898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'3","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787442+0000","last_change":"2024-09-11T11:01:03.333973+0000","last_active":"2024-09-11T11:04:53.787442+0000","last_peered":"2024-09-11T11:04:53.787442+0000","last_clean":"2024-09-11T11:04:53.787442+0000","last_became_active":"2024-09-11T11:01:03.333729+0000","last_became_peered":"2024-09-11T11:01:03.333729+0000","last_unstale":"2024-09-11T11:04:53.787442+0000","last_undegraded":"2024-09-11T11:04:53.787442+0000","last_fullsized":"2024-09-11T11:04:53.787442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.775042+0000","last_change":"2024-09-11T11:05:27.775042+0000","last_active":"2024-09-11T11:05:27.775042+0000","last_peered":"2024-09-11T11:05:27.775042+0000","last_clean":"2024-09-11T11:05:27.775042+0000","last_became_active":"2024-09-11T11:01:05.332274+0000","last_became_peered":"2024-09-11T11:01:05.332274+0000","last_unstale":"2024-09-11T11:05:27.775042+0000","last_undegraded":"2024-09-11T11:05:27.775042+0000","last_fullsized":"2024-09-11T11:05:27.775042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:27.774642+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:27.774642+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.774642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:25:43.946676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.224359+0000","last_change":"2024-09-11T11:05:31.224414+0000","last_active":"2024-09-11T11:05:31.224359+0000","last_peered":"2024-09-11T11:05:31.224359+0000","last_clean":"2024-09-11T11:05:31.224359+0000","last_became_active":"2024-09-11T11:01:03.335054+0000","last_became_peered":"2024-09-11T11:01:03.335054+0000","last_unstale":"2024-09-11T11:05:31.224359+0000","last_undegraded":"2024-09-11T11:05:31.224359+0000","last_fullsized":"2024-09-11T11:05:31.224359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:31.224173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:31.224173+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.224173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:49:48.898919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.000601+0000","last_change":"2024-09-11T11:05:33.000653+0000","last_active":"2024-09-11T11:05:33.000601+0000","last_peered":"2024-09-11T11:05:33.000601+0000","last_clean":"2024-09-11T11:05:33.000601+0000","last_became_active":"2024-09-11T11:01:05.330065+0000","last_became_peered":"2024-09-11T11:01:05.330065+0000","last_unstale":"2024-09-11T11:05:33.000601+0000","last_undegraded":"2024-09-11T11:05:33.000601+0000","last_fullsized":"2024-09-11T11:05:33.000601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:33.000394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:33.000394+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.000394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:54.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787507+0000","last_change":"2024-09-11T11:01:03.351261+0000","last_active":"2024-09-11T11:04:53.787507+0000","last_peered":"2024-09-11T11:04:53.787507+0000","last_clean":"2024-09-11T11:04:53.787507+0000","last_became_active":"2024-09-11T11:01:03.349971+0000","last_became_peered":"2024-09-11T11:01:03.349971+0000","last_unstale":"2024-09-11T11:04:53.787507+0000","last_undegraded":"2024-09-11T11:04:53.787507+0000","last_fullsized":"2024-09-11T11:04:53.787507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.882019+0000","last_change":"2024-09-11T11:01:05.342800+0000","last_active":"2024-09-11T11:04:52.882019+0000","last_peered":"2024-09-11T11:04:52.882019+0000","last_clean":"2024-09-11T11:04:52.882019+0000","last_became_active":"2024-09-11T11:01:05.342092+0000","last_became_peered":"2024-09-11T11:01:05.342092+0000","last_unstale":"2024-09-11T11:04:52.882019+0000","last_undegraded":"2024-09-11T11:04:52.882019+0000","last_fullsized":"2024-09-11T11:04:52.882019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881250+0000","last_change":"2024-09-11T11:01:42.061260+0000","last_active":"2024-09-11T11:04:52.881250+0000","last_peered":"2024-09-11T11:04:52.881250+0000","last_clean":"2024-09-11T11:04:52.881250+0000","last_became_active":"2024-09-11T11:01:42.060500+0000","last_became_peered":"2024-09-11T11:01:42.060500+0000","last_unstale":"2024-09-11T11:04:52.881250+0000","last_undegraded":"2024-09-11T11:04:52.881250+0000","last_fullsized":"2024-09-11T11:04:52.881250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.941170+0000","last_change":"2024-09-11T11:05:28.941231+0000","last_active":"2024-09-11T11:05:28.941170+0000","last_peered":"2024-09-11T11:05:28.941170+0000","last_clean":"2024-09-11T11:05:28.941170+0000","last_became_active":"2024-09-11T11:01:05.346179+0000","last_became_peered":"2024-09-11T11:01:05.346179+0000","last_unstale":"2024-09-11T11:05:28.941170+0000","last_undegraded":"2024-09-11T11:05:28.941170+0000","last_fullsized":"2024-09-11T11:05:28.941170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:28.940973+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:28.940973+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.940973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:40.559614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.256697+0000","last_change":"2024-09-11T11:05:29.256755+0000","last_active":"2024-09-11T11:05:29.256697+0000","last_peered":"2024-09-11T11:05:29.256697+0000","last_clean":"2024-09-11T11:05:29.256697+0000","last_became_active":"2024-09-11T11:01:03.315737+0000","last_became_peered":"2024-09-11T11:01:03.315737+0000","last_unstale":"2024-09-11T11:05:29.256697+0000","last_undegraded":"2024-09-11T11:05:29.256697+0000","last_fullsized":"2024-09-11T11:05:29.256697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:29.256510+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:29.256510+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.256510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:46:54.652124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'1","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.440090+0000","last_change":"2024-09-11T11:01:05.333619+0000","last_active":"2024-09-11T11:04:52.440090+0000","last_peered":"2024-09-11T11:04:52.440090+0000","last_clean":"2024-09-11T11:04:52.440090+0000","last_became_active":"2024-09-11T11:01:05.331901+0000","last_became_peered":"2024-09-11T11:01:05.331901+0000","last_unstale":"2024-09-11T11:04:52.440090+0000","last_undegraded":"2024-09-11T11:04:52.440090+0000","last_fullsized":"2024-09-11T11:04:52.440090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787619+0000","last_change":"2024-09-11T11:01:03.351395+0000","last_active":"2024-09-11T11:04:53.787619+0000","last_peered":"2024-09-11T11:04:53.787619+0000","last_clean":"2024-09-11T11:04:53.787619+0000","last_became_active":"2024-09-11T11:01:03.351125+0000","last_became_peered":"2024-09-11T11:01:03.351125+0000","last_unstale":"2024-09-11T11:04:53.787619+0000","last_undegraded":"2024-09-11T11:04:53.787619+0000","last_fullsized":"2024-09-11T11:04:53.787619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'2","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.761790+0000","last_change":"2024-09-11T11:05:28.761851+0000","last_active":"2024-09-11T11:05:28.761790+0000","last_peered":"2024-09-11T11:05:28.761790+0000","last_clean":"2024-09-11T11:05:28.761790+0000","last_became_active":"2024-09-11T11:01:05.332203+0000","last_became_peered":"2024-09-11T11:01:05.332203+0000","last_unstale":"2024-09-11T11:05:28.761790+0000","last_undegraded":"2024-09-11T11:05:28.761790+0000","last_fullsized":"2024-09-11T11:05:28.761790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:28.761615+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:28.761615+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.761615+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:26.880299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787676+0000","last_change":"2024-09-11T11:01:03.337164+0000","last_active":"2024-09-11T11:04:53.787676+0000","last_peered":"2024-09-11T11:04:53.787676+0000","last_clean":"2024-09-11T11:04:53.787676+0000","last_became_active":"2024-09-11T11:01:03.336786+0000","last_became_peered":"2024-09-11T11:01:03.336786+0000","last_unstale":"2024-09-11T11:04:53.787676+0000","last_undegraded":"2024-09-11T11:04:53.787676+0000","last_fullsized":"2024-09-11T11:04:53.787676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'14","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.938453+0000","last_change":"2024-09-11T11:01:05.333095+0000","last_active":"2024-09-11T11:04:17.938453+0000","last_peered":"2024-09-11T11:04:17.938453+0000","last_clean":"2024-09-11T11:04:17.938453+0000","last_became_active":"2024-09-11T11:01:05.332747+0000","last_became_peered":"2024-09-11T11:01:05.332747+0000","last_unstale":"2024-09-11T11:04:17.938453+0000","last_undegraded":"2024-09-11T11:04:17.938453+0000","last_fullsized":"2024-09-11T11:04:17.938453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787722+0000","last_change":"2024-09-11T11:01:03.336167+0000","last_active":"2024-09-11T11:04:53.787722+0000","last_peered":"2024-09-11T11:04:53.787722+0000","last_clean":"2024-09-11T11:04:53.787722+0000","last_became_active":"2024-09-11T11:01:03.335854+0000","last_became_peered":"2024-09-11T11:01:03.335854+0000","last_unstale":"2024-09-11T11:04:53.787722+0000","last_undegraded":"2024-09-11T11:04:53.787722+0000","last_fullsized":"2024-09-11T11:04:53.787722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.048231+0000","last_change":"2024-09-11T11:05:13.048283+0000","last_active":"2024-09-11T11:05:13.048231+0000","last_peered":"2024-09-11T11:05:13.048231+0000","last_clean":"2024-09-11T11:05:13.048231+0000","last_became_active":"2024-09-11T11:01:05.343590+0000","last_became_peered":"2024-09-11T11:01:05.343590+0000","last_unstale":"2024-09-11T11:05:13.048231+0000","last_undegraded":"2024-09-11T11:05:13.048231+0000","last_fullsized":"2024-09-11T11:05:13.048231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:13.048016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:13.048016+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.048016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:34.967696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:21.038524+0000","last_change":"2024-09-11T11:01:03.339537+0000","last_active":"2024-09-11T11:03:21.038524+0000","last_peered":"2024-09-11T11:03:21.038524+0000","last_clean":"2024-09-11T11:03:21.038524+0000","last_became_active":"2024-09-11T11:01:03.336224+0000","last_became_peered":"2024-09-11T11:01:03.336224+0000","last_unstale":"2024-09-11T11:03:21.038524+0000","last_undegraded":"2024-09-11T11:03:21.038524+0000","last_fullsized":"2024-09-11T11:03:21.038524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.038640+0000","last_change":"2024-09-11T11:01:05.342088+0000","last_active":"2024-09-11T11:03:23.038640+0000","last_peered":"2024-09-11T11:03:23.038640+0000","last_clean":"2024-09-11T11:03:23.038640+0000","last_became_active":"2024-09-11T11:01:05.341761+0000","last_became_peered":"2024-09-11T11:01:05.341761+0000","last_unstale":"2024-09-11T11:03:23.038640+0000","last_undegraded":"2024-09-11T11:03:23.038640+0000","last_fullsized":"2024-09-11T11:03:23.038640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881586+0000","last_change":"2024-09-11T11:01:03.320022+0000","last_active":"2024-09-11T11:04:52.881586+0000","last_peered":"2024-09-11T11:04:52.881586+0000","last_clean":"2024-09-11T11:04:52.881586+0000","last_became_active":"2024-09-11T11:01:03.318984+0000","last_became_peered":"2024-09-11T11:01:03.318984+0000","last_unstale":"2024-09-11T11:04:52.881586+0000","last_undegraded":"2024-09-11T11:04:52.881586+0000","last_fullsized":"2024-09-11T11:04:52.881586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'6","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.789250+0000","last_change":"2024-09-11T11:01:42.059933+0000","last_active":"2024-09-11T11:04:17.789250+0000","last_peered":"2024-09-11T11:04:17.789250+0000","last_clean":"2024-09-11T11:04:17.789250+0000","last_became_active":"2024-09-11T11:01:42.059147+0000","last_became_peered":"2024-09-11T11:01:42.059147+0000","last_unstale":"2024-09-11T11:04:17.789250+0000","last_undegraded":"2024-09-11T11:04:17.789250+0000","last_fullsized":"2024-09-11T11:04:17.789250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787744+0000","last_change":"2024-09-11T11:01:03.350789+0000","last_active":"2024-09-11T11:04:53.787744+0000","last_peered":"2024-09-11T11:04:53.787744+0000","last_clean":"2024-09-11T11:04:53.787744+0000","last_became_active":"2024-09-11T11:01:03.349120+0000","last_became_peered":"2024-09-11T11:01:03.349120+0000","last_unstale":"2024-09-11T11:04:53.787744+0000","last_undegraded":"2024-09-11T11:04:53.787744+0000","last_fullsized":"2024-09-11T11:04:53.787744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'8","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.792894+0000","last_change":"2024-09-11T11:05:26.792959+0000","last_active":"2024-09-11T11:05:26.792894+0000","last_peered":"2024-09-11T11:05:26.792894+0000","last_clean":"2024-09-11T11:05:26.792894+0000","last_became_active":"2024-09-11T11:01:05.343121+0000","last_became_peered":"2024-09-11T11:01:05.343121+0000","last_unstale":"2024-09-11T11:05:26.792894+0000","last_undegraded":"2024-09-11T11:05:26.792894+0000","last_fullsized":"2024-09-11T11:05:26.792894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:26.792707+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:26.792707+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.792707+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:14.577427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:58.046966+0000","last_change":"2024-09-11T11:01:42.056195+0000","last_active":"2024-09-11T11:03:58.046966+0000","last_peered":"2024-09-11T11:03:58.046966+0000","last_clean":"2024-09-11T11:03:58.046966+0000","last_became_active":"2024-09-11T11:01:42.055356+0000","last_became_peered":"2024-09-11T11:01:42.055356+0000","last_unstale":"2024-09-11T11:03:58.046966+0000","last_undegraded":"2024-09-11T11:03:58.046966+0000","last_fullsized":"2024-09-11T11:03:58.046966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.928130+0000","last_change":"2024-09-11T11:05:27.928276+0000","last_active":"2024-09-11T11:05:27.928130+0000","last_peered":"2024-09-11T11:05:27.928130+0000","last_clean":"2024-09-11T11:05:27.928130+0000","last_became_active":"2024-09-11T11:01:05.346563+0000","last_became_peered":"2024-09-11T11:01:05.346563+0000","last_unstale":"2024-09-11T11:05:27.928130+0000","last_undegraded":"2024-09-11T11:05:27.928130+0000","last_fullsized":"2024-09-11T11:05:27.928130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:27.927866+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:27.927866+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.927866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:18.339185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.247792+0000","last_change":"2024-09-11T11:05:28.247847+0000","last_active":"2024-09-11T11:05:28.247792+0000","last_peered":"2024-09-11T11:05:28.247792+0000","last_clean":"2024-09-11T11:05:28.247792+0000","last_became_active":"2024-09-11T11:01:03.315651+0000","last_became_peered":"2024-09-11T11:01:03.315651+0000","last_unstale":"2024-09-11T11:05:28.247792+0000","last_undegraded":"2024-09-11T11:05:28.247792+0000","last_fullsized":"2024-09-11T11:05:28.247792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:28.247584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:28.247584+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.247584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:05:01.500658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.572672+0000","last_change":"2024-09-11T11:05:20.572672+0000","last_active":"2024-09-11T11:05:20.572672+0000","last_peered":"2024-09-11T11:05:20.572672+0000","last_clean":"2024-09-11T11:05:20.572672+0000","last_became_active":"2024-09-11T11:01:05.347760+0000","last_became_peered":"2024-09-11T11:01:05.347760+0000","last_unstale":"2024-09-11T11:05:20.572672+0000","last_undegraded":"2024-09-11T11:05:20.572672+0000","last_fullsized":"2024-09-11T11:05:20.572672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:20.572423+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:20.572423+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.572423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:49:41.914766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.037351+0000","last_change":"2024-09-11T11:01:03.340726+0000","last_active":"2024-09-11T11:03:23.037351+0000","last_peered":"2024-09-11T11:03:23.037351+0000","last_clean":"2024-09-11T11:03:23.037351+0000","last_became_active":"2024-09-11T11:01:03.337667+0000","last_became_peered":"2024-09-11T11:01:03.337667+0000","last_unstale":"2024-09-11T11:03:23.037351+0000","last_undegraded":"2024-09-11T11:03:23.037351+0000","last_fullsized":"2024-09-11T11:03:23.037351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:26.039646+0000","last_change":"2024-09-11T11:01:03.322086+0000","last_active":"2024-09-11T11:03:26.039646+0000","last_peered":"2024-09-11T11:03:26.039646+0000","last_clean":"2024-09-11T11:03:26.039646+0000","last_became_active":"2024-09-11T11:01:03.321242+0000","last_became_peered":"2024-09-11T11:01:03.321242+0000","last_unstale":"2024-09-11T11:03:26.039646+0000","last_undegraded":"2024-09-11T11:03:26.039646+0000","last_fullsized":"2024-09-11T11:03:26.039646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.098992+0000","last_change":"2024-09-11T11:05:15.099143+0000","last_active":"2024-09-11T11:05:15.098992+0000","last_peered":"2024-09-11T11:05:15.098992+0000","last_clean":"2024-09-11T11:05:15.098992+0000","last_became_active":"2024-09-11T11:01:05.344285+0000","last_became_peered":"2024-09-11T11:01:05.344285+0000","last_unstale":"2024-09-11T11:05:15.098992+0000","last_undegraded":"2024-09-11T11:05:15.098992+0000","last_fullsized":"2024-09-11T11:05:15.098992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:15.098771+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:15.098771+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.098771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:54:16.965356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:23.038336+0000","last_change":"2024-09-11T11:01:03.325391+0000","last_active":"2024-09-11T11:03:23.038336+0000","last_peered":"2024-09-11T11:03:23.038336+0000","last_clean":"2024-09-11T11:03:23.038336+0000","last_became_active":"2024-09-11T11:01:03.320391+0000","last_became_peered":"2024-09-11T11:01:03.320391+0000","last_unstale":"2024-09-11T11:03:23.038336+0000","last_undegraded":"2024-09-11T11:03:23.038336+0000","last_fullsized":"2024-09-11T11:03:23.038336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:08.045290+0000","last_change":"2024-09-11T11:01:42.076222+0000","last_active":"2024-09-11T11:04:08.045290+0000","last_peered":"2024-09-11T11:04:08.045290+0000","last_clean":"2024-09-11T11:04:08.045290+0000","last_became_active":"2024-09-11T11:01:42.069954+0000","last_became_peered":"2024-09-11T11:01:42.069954+0000","last_unstale":"2024-09-11T11:04:08.045290+0000","last_undegraded":"2024-09-11T11:04:08.045290+0000","last_fullsized":"2024-09-11T11:04:08.045290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1524,"ondisk_log_size":1524,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1608,"num_read_kb":1498,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673020,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":454656,"data_stored":155251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673020,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":744125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673021,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40556,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331284,"statfs":{"total":96636764160,"available":96595234816,"internally_reserved":0,"allocated":1077248,"data_stored":746823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":156613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:05:35.041 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.041 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.041 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.041 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.042 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.042 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.042 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.042 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.042 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.042 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.042 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.042 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.043 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.043 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.043 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.043 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.043 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.043 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.043 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.044 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.044 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.044 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.044 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.044 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.044 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.044 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.044 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.045 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.045 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.045 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.045 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.045 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.045 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-11T11:01:06.309813+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=6, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.045 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.046 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.046 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.046 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.046 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.046 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T11:00:49.442581+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=49, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.046 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.046 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.047 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.047 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.047 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.047 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.047 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.047 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.047 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.048 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.048 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.048 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.048 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.048 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.048 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.048 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.049 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.049 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.049 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.049 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.049 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.049 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.049 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.049 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.050 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.050 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.050 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.050 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.050 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.050 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.050 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-11T11:01:10.343716+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=10, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.051 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.052 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.052 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.052 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.052 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.052 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.052 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.052 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.053 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.053 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.053 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.053 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.053 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.053 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.053 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.053 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.054 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.055 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.055 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.055 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.055 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:35.055 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T11:05:55.056 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:05:55.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.186+0000 7f1143b77640 1 Processor -- start 2024-09-11T11:05:55.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.186+0000 7f1143b77640 1 -- start start 2024-09-11T11:05:55.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.186+0000 7f1143b77640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f113c06dbd0 0x7f113c138440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:55.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.186+0000 7f1143b77640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f113c06eb20 con 0x7f113c06d0e0 2024-09-11T11:05:55.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.186+0000 7f1143b77640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f113c072f80 con 0x7f113c06dbd0 2024-09-11T11:05:55.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1141112640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f113c06dbd0 0x7f113c138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:55.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1141913640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f113c06d0e0 0x7f113c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:42734/0 (socket says 172.21.15.102:42734) 2024-09-11T11:05:55.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1141112640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f113c06dbd0 0x7f113c138440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45130/0 (socket says 172.21.15.102:45130) 2024-09-11T11:05:55.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1141913640 1 -- 172.21.15.102:0/3233727907 learned_addr learned my addr 172.21.15.102:0/3233727907 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:05:55.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1141112640 1 -- 172.21.15.102:0/3233727907 >> v1:172.21.15.102:6789/0 conn(0x7f113c06d0e0 legacy=0x7f113c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:55.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1141112640 1 -- 172.21.15.102:0/3233727907 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113c098b90 con 0x7f113c06dbd0 2024-09-11T11:05:55.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1141112640 1 --2- 172.21.15.102:0/3233727907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06dbd0 0x7f113c138440 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f113801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47daa96da9e95274 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:55.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1140911640 1 -- 172.21.15.102:0/3233727907 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11380b2070 con 0x7f113c06dbd0 2024-09-11T11:05:55.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1140911640 1 -- 172.21.15.102:0/3233727907 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11380a5740 con 0x7f113c06dbd0 2024-09-11T11:05:55.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1140911640 1 -- 172.21.15.102:0/3233727907 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11380a5a40 con 0x7f113c06dbd0 2024-09-11T11:05:55.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1143b77640 1 -- 172.21.15.102:0/3233727907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06dbd0 msgr2=0x7f113c138440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:55.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1143b77640 1 --2- 172.21.15.102:0/3233727907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06dbd0 0x7f113c138440 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f113801c8c0 comp rx=0 tx=0).stop 2024-09-11T11:05:55.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1143b77640 1 -- 172.21.15.102:0/3233727907 shutdown_connections 2024-09-11T11:05:55.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1143b77640 1 --2- 172.21.15.102:0/3233727907 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06dbd0 0x7f113c138440 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:55.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1143b77640 1 -- 172.21.15.102:0/3233727907 >> 172.21.15.102:0/3233727907 conn(0x7f113c099a50 msgr2=0x7f113c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:05:55.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1143b77640 1 -- 172.21.15.102:0/3233727907 shutdown_connections 2024-09-11T11:05:55.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.190+0000 7f1143b77640 1 -- 172.21.15.102:0/3233727907 wait complete. 2024-09-11T11:05:55.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1143b77640 1 Processor -- start 2024-09-11T11:05:55.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1143b77640 1 -- start start 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1143b77640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06d0e0 0x7f113c136490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1143b77640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f113c13b3b0 con 0x7f113c06d0e0 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1141913640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06d0e0 0x7f113c136490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1141913640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06d0e0 0x7f113c136490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:45134/0 (socket says 172.21.15.102:45134) 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1141913640 1 -- 172.21.15.102:0/1606633246 learned_addr learned my addr 172.21.15.102:0/1606633246 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1141913640 1 -- 172.21.15.102:0/1606633246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f113c094650 con 0x7f113c06d0e0 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1141913640 1 --2- 172.21.15.102:0/1606633246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06d0e0 0x7f113c136490 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f113000c480 tx=0x7f113000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f112e7fc640 1 -- 172.21.15.102:0/1606633246 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1130017070 con 0x7f113c06d0e0 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f112e7fc640 1 -- 172.21.15.102:0/1606633246 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1130005c20 con 0x7f113c06d0e0 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f113c0939b0 con 0x7f113c06d0e0 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f112e7fc640 1 -- 172.21.15.102:0/1606633246 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1130007070 con 0x7f113c06d0e0 2024-09-11T11:05:55.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f113c094290 con 0x7f113c06d0e0 2024-09-11T11:05:55.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f112e7fc640 1 -- 172.21.15.102:0/1606633246 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f113001a070 con 0x7f113c06d0e0 2024-09-11T11:05:55.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f113c095570 con 0x7f113c06d0e0 2024-09-11T11:05:55.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f112e7fc640 1 --2- 172.21.15.102:0/1606633246 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1120035db0 0x7f1120038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:05:55.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f112e7fc640 1 -- 172.21.15.102:0/1606633246 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1130048360 con 0x7f113c06d0e0 2024-09-11T11:05:55.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1141112640 1 --2- 172.21.15.102:0/1606633246 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1120035db0 0x7f1120038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:05:55.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.194+0000 7f1141112640 1 --2- 172.21.15.102:0/1606633246 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1120035db0 0x7f1120038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f11380af000 tx=0x7f11380a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:05:55.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.198+0000 7f112e7fc640 1 -- 172.21.15.102:0/1606633246 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1130007210 con 0x7f113c06d0e0 2024-09-11T11:05:55.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.350+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f113c073790 con 0x7f1120035db0 2024-09-11T11:05:55.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.394+0000 7f112e7fc640 1 -- 172.21.15.102:0/1606633246 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664532 (secure 0 0 0) 0x7f113c073790 con 0x7f1120035db0 2024-09-11T11:05:55.404 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:05:55.410 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:05:55.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1120035db0 msgr2=0x7f1120038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:55.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 --2- 172.21.15.102:0/1606633246 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1120035db0 0x7f1120038270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f11380af000 tx=0x7f11380a7070 comp rx=0 tx=0).stop 2024-09-11T11:05:55.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06d0e0 msgr2=0x7f113c136490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:05:55.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 --2- 172.21.15.102:0/1606633246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06d0e0 0x7f113c136490 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f113000c480 tx=0x7f113000c940 comp rx=0 tx=0).stop 2024-09-11T11:05:55.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 shutdown_connections 2024-09-11T11:05:55.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 --2- 172.21.15.102:0/1606633246 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1120035db0 0x7f1120038270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:55.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 --2- 172.21.15.102:0/1606633246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f113c06d0e0 0x7f113c136490 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:05:55.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 >> 172.21.15.102:0/1606633246 conn(0x7f113c099a50 msgr2=0x7f113c0708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:05:55.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 shutdown_connections 2024-09-11T11:05:55.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:05:55.402+0000 7f1143b77640 1 -- 172.21.15.102:0/1606633246 wait complete. 2024-09-11T11:05:55.424 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-09-11T11:05:55.082683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5090,"num_read_kb":4675,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4791,"ondisk_log_size":4791,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160992,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326368,"statfs":{"total":386547056640,"available":386382200832,"internally_reserved":0,"allocated":3047424,"data_stored":1802812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006574"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:35.526672+0000","last_change":"2024-09-11T11:05:35.526727+0000","last_active":"2024-09-11T11:05:35.526672+0000","last_peered":"2024-09-11T11:05:35.526672+0000","last_clean":"2024-09-11T11:05:35.526672+0000","last_became_active":"2024-09-11T11:01:03.336333+0000","last_became_peered":"2024-09-11T11:01:03.336333+0000","last_unstale":"2024-09-11T11:05:35.526672+0000","last_undegraded":"2024-09-11T11:05:35.526672+0000","last_fullsized":"2024-09-11T11:05:35.526672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:35.526457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:35.526457+0000","last_clean_scrub_stamp":"2024-09-11T11:05:35.526457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:23:10.416627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.638621+0000","last_change":"2024-09-11T11:05:30.638687+0000","last_active":"2024-09-11T11:05:30.638621+0000","last_peered":"2024-09-11T11:05:30.638621+0000","last_clean":"2024-09-11T11:05:30.638621+0000","last_became_active":"2024-09-11T11:01:05.332897+0000","last_became_peered":"2024-09-11T11:01:05.332897+0000","last_unstale":"2024-09-11T11:05:30.638621+0000","last_undegraded":"2024-09-11T11:05:30.638621+0000","last_fullsized":"2024-09-11T11:05:30.638621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:30.638397+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:30.638397+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.638397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:26.020290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:36.786479+0000","last_change":"2024-09-11T11:05:36.786537+0000","last_active":"2024-09-11T11:05:36.786479+0000","last_peered":"2024-09-11T11:05:36.786479+0000","last_clean":"2024-09-11T11:05:36.786479+0000","last_became_active":"2024-09-11T11:01:03.346113+0000","last_became_peered":"2024-09-11T11:01:03.346113+0000","last_unstale":"2024-09-11T11:05:36.786479+0000","last_undegraded":"2024-09-11T11:05:36.786479+0000","last_fullsized":"2024-09-11T11:05:36.786479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:36.786303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:36.786303+0000","last_clean_scrub_stamp":"2024-09-11T11:05:36.786303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:05:09.126121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":62,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.041104+0000","last_change":"2024-09-11T11:01:05.333693+0000","last_active":"2024-09-11T11:03:38.041104+0000","last_peered":"2024-09-11T11:03:38.041104+0000","last_clean":"2024-09-11T11:03:38.041104+0000","last_became_active":"2024-09-11T11:01:05.330885+0000","last_became_peered":"2024-09-11T11:01:05.330885+0000","last_unstale":"2024-09-11T11:03:38.041104+0000","last_undegraded":"2024-09-11T11:03:38.041104+0000","last_fullsized":"2024-09-11T11:03:38.041104+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:45.980138+0000","last_change":"2024-09-11T11:05:45.980191+0000","last_active":"2024-09-11T11:05:45.980138+0000","last_peered":"2024-09-11T11:05:45.980138+0000","last_clean":"2024-09-11T11:05:45.980138+0000","last_became_active":"2024-09-11T11:01:03.345673+0000","last_became_peered":"2024-09-11T11:01:03.345673+0000","last_unstale":"2024-09-11T11:05:45.980138+0000","last_undegraded":"2024-09-11T11:05:45.980138+0000","last_fullsized":"2024-09-11T11:05:45.980138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:45.979942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:45.979942+0000","last_clean_scrub_stamp":"2024-09-11T11:05:45.979942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:40:55.993232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'12","reported_seq":92,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:48.996887+0000","last_change":"2024-09-11T11:05:48.996945+0000","last_active":"2024-09-11T11:05:48.996887+0000","last_peered":"2024-09-11T11:05:48.996887+0000","last_clean":"2024-09-11T11:05:48.996887+0000","last_became_active":"2024-09-11T11:01:05.330639+0000","last_became_peered":"2024-09-11T11:01:05.330639+0000","last_unstale":"2024-09-11T11:05:48.996887+0000","last_undegraded":"2024-09-11T11:05:48.996887+0000","last_fullsized":"2024-09-11T11:05:48.996887+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:48.996690+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:48.996690+0000","last_clean_scrub_stamp":"2024-09-11T11:05:48.996690+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:59.136490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:32.267553+0000","last_change":"2024-09-11T11:05:32.267614+0000","last_active":"2024-09-11T11:05:32.267553+0000","last_peered":"2024-09-11T11:05:32.267553+0000","last_clean":"2024-09-11T11:05:32.267553+0000","last_became_active":"2024-09-11T11:01:03.335132+0000","last_became_peered":"2024-09-11T11:01:03.335132+0000","last_unstale":"2024-09-11T11:05:32.267553+0000","last_undegraded":"2024-09-11T11:05:32.267553+0000","last_fullsized":"2024-09-11T11:05:32.267553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:32.267363+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:32.267363+0000","last_clean_scrub_stamp":"2024-09-11T11:05:32.267363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:39:39.620550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.976093+0000","last_change":"2024-09-11T11:05:29.976154+0000","last_active":"2024-09-11T11:05:29.976093+0000","last_peered":"2024-09-11T11:05:29.976093+0000","last_clean":"2024-09-11T11:05:29.976093+0000","last_became_active":"2024-09-11T11:01:05.339018+0000","last_became_peered":"2024-09-11T11:01:05.339018+0000","last_unstale":"2024-09-11T11:05:29.976093+0000","last_undegraded":"2024-09-11T11:05:29.976093+0000","last_fullsized":"2024-09-11T11:05:29.976093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:29.975892+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:29.975892+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.975892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:54:20.926150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:42.524581+0000","last_change":"2024-09-11T11:05:42.524642+0000","last_active":"2024-09-11T11:05:42.524581+0000","last_peered":"2024-09-11T11:05:42.524581+0000","last_clean":"2024-09-11T11:05:42.524581+0000","last_became_active":"2024-09-11T11:01:03.322877+0000","last_became_peered":"2024-09-11T11:01:03.322877+0000","last_unstale":"2024-09-11T11:05:42.524581+0000","last_undegraded":"2024-09-11T11:05:42.524581+0000","last_fullsized":"2024-09-11T11:05:42.524581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:42.524386+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:42.524386+0000","last_clean_scrub_stamp":"2024-09-11T11:05:42.524386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:13.145812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.759603+0000","last_change":"2024-09-11T11:05:19.759671+0000","last_active":"2024-09-11T11:05:19.759603+0000","last_peered":"2024-09-11T11:05:19.759603+0000","last_clean":"2024-09-11T11:05:19.759603+0000","last_became_active":"2024-09-11T11:01:05.353908+0000","last_became_peered":"2024-09-11T11:01:05.353908+0000","last_unstale":"2024-09-11T11:05:19.759603+0000","last_undegraded":"2024-09-11T11:05:19.759603+0000","last_fullsized":"2024-09-11T11:05:19.759603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:19.759407+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:19.759407+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.759407+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:40.655656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:49.697916+0000","last_change":"2024-09-11T11:05:49.697968+0000","last_active":"2024-09-11T11:05:49.697916+0000","last_peered":"2024-09-11T11:05:49.697916+0000","last_clean":"2024-09-11T11:05:49.697916+0000","last_became_active":"2024-09-11T11:01:03.345964+0000","last_became_peered":"2024-09-11T11:01:03.345964+0000","last_unstale":"2024-09-11T11:05:49.697916+0000","last_undegraded":"2024-09-11T11:05:49.697916+0000","last_fullsized":"2024-09-11T11:05:49.697916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:49.697720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:49.697720+0000","last_clean_scrub_stamp":"2024-09-11T11:05:49.697720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:43:07.988491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'14","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.563987+0000","last_change":"2024-09-11T11:05:26.564047+0000","last_active":"2024-09-11T11:05:26.563987+0000","last_peered":"2024-09-11T11:05:26.563987+0000","last_clean":"2024-09-11T11:05:26.563987+0000","last_became_active":"2024-09-11T11:01:05.345664+0000","last_became_peered":"2024-09-11T11:01:05.345664+0000","last_unstale":"2024-09-11T11:05:26.563987+0000","last_undegraded":"2024-09-11T11:05:26.563987+0000","last_fullsized":"2024-09-11T11:05:26.563987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:26.563791+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:26.563791+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.563791+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:18.491908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:41.928743+0000","last_change":"2024-09-11T11:05:41.928864+0000","last_active":"2024-09-11T11:05:41.928743+0000","last_peered":"2024-09-11T11:05:41.928743+0000","last_clean":"2024-09-11T11:05:41.928743+0000","last_became_active":"2024-09-11T11:01:03.348822+0000","last_became_peered":"2024-09-11T11:01:03.348822+0000","last_unstale":"2024-09-11T11:05:41.928743+0000","last_undegraded":"2024-09-11T11:05:41.928743+0000","last_fullsized":"2024-09-11T11:05:41.928743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:41.928439+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:41.928439+0000","last_clean_scrub_stamp":"2024-09-11T11:05:41.928439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:18:42.464276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.557877+0000","last_change":"2024-09-11T11:05:24.557938+0000","last_active":"2024-09-11T11:05:24.557877+0000","last_peered":"2024-09-11T11:05:24.557877+0000","last_clean":"2024-09-11T11:05:24.557877+0000","last_became_active":"2024-09-11T11:01:05.345698+0000","last_became_peered":"2024-09-11T11:01:05.345698+0000","last_unstale":"2024-09-11T11:05:24.557877+0000","last_undegraded":"2024-09-11T11:05:24.557877+0000","last_fullsized":"2024-09-11T11:05:24.557877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:24.557683+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:24.557683+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.557683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:54:15.507940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:33.039729+0000","last_change":"2024-09-11T11:01:03.336343+0000","last_active":"2024-09-11T11:03:33.039729+0000","last_peered":"2024-09-11T11:03:33.039729+0000","last_clean":"2024-09-11T11:03:33.039729+0000","last_became_active":"2024-09-11T11:01:03.335830+0000","last_became_peered":"2024-09-11T11:01:03.335830+0000","last_unstale":"2024-09-11T11:03:33.039729+0000","last_undegraded":"2024-09-11T11:03:33.039729+0000","last_fullsized":"2024-09-11T11:03:33.039729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.099939+0000","last_change":"2024-09-11T11:05:11.099939+0000","last_active":"2024-09-11T11:05:11.099939+0000","last_peered":"2024-09-11T11:05:11.099939+0000","last_clean":"2024-09-11T11:05:11.099939+0000","last_became_active":"2024-09-11T11:01:05.343805+0000","last_became_peered":"2024-09-11T11:01:05.343805+0000","last_unstale":"2024-09-11T11:05:11.099939+0000","last_undegraded":"2024-09-11T11:05:11.099939+0000","last_fullsized":"2024-09-11T11:05:11.099939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:11.099653+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:11.099653+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.099653+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:26:10.519865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.625311+0000","last_change":"2024-09-11T11:05:31.625311+0000","last_active":"2024-09-11T11:05:31.625311+0000","last_peered":"2024-09-11T11:05:31.625311+0000","last_clean":"2024-09-11T11:05:31.625311+0000","last_became_active":"2024-09-11T11:01:05.332915+0000","last_became_peered":"2024-09-11T11:01:05.332915+0000","last_unstale":"2024-09-11T11:05:31.625311+0000","last_undegraded":"2024-09-11T11:05:31.625311+0000","last_fullsized":"2024-09-11T11:05:31.625311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:31.625052+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:31.625052+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.625052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:46:56.650684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:32.818873+0000","last_change":"2024-09-11T11:05:32.818873+0000","last_active":"2024-09-11T11:05:32.818873+0000","last_peered":"2024-09-11T11:05:32.818873+0000","last_clean":"2024-09-11T11:05:32.818873+0000","last_became_active":"2024-09-11T11:01:03.346878+0000","last_became_peered":"2024-09-11T11:01:03.346878+0000","last_unstale":"2024-09-11T11:05:32.818873+0000","last_undegraded":"2024-09-11T11:05:32.818873+0000","last_fullsized":"2024-09-11T11:05:32.818873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:32.818568+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:32.818568+0000","last_clean_scrub_stamp":"2024-09-11T11:05:32.818568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:06:00.813359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:37.350600+0000","last_change":"2024-09-11T11:05:37.350680+0000","last_active":"2024-09-11T11:05:37.350600+0000","last_peered":"2024-09-11T11:05:37.350600+0000","last_clean":"2024-09-11T11:05:37.350600+0000","last_became_active":"2024-09-11T11:01:42.050609+0000","last_became_peered":"2024-09-11T11:01:42.050609+0000","last_unstale":"2024-09-11T11:05:37.350600+0000","last_undegraded":"2024-09-11T11:05:37.350600+0000","last_fullsized":"2024-09-11T11:05:37.350600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:37.350371+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:37.350371+0000","last_clean_scrub_stamp":"2024-09-11T11:05:37.350371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:39:50.143752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.314221+0000","last_change":"2024-09-11T11:05:33.314221+0000","last_active":"2024-09-11T11:05:33.314221+0000","last_peered":"2024-09-11T11:05:33.314221+0000","last_clean":"2024-09-11T11:05:33.314221+0000","last_became_active":"2024-09-11T11:01:03.335121+0000","last_became_peered":"2024-09-11T11:01:03.335121+0000","last_unstale":"2024-09-11T11:05:33.314221+0000","last_undegraded":"2024-09-11T11:05:33.314221+0000","last_fullsized":"2024-09-11T11:05:33.314221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:33.313854+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:33.313854+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.313854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:45:52.502378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:34.549971+0000","last_change":"2024-09-11T11:05:34.549971+0000","last_active":"2024-09-11T11:05:34.549971+0000","last_peered":"2024-09-11T11:05:34.549971+0000","last_clean":"2024-09-11T11:05:34.549971+0000","last_became_active":"2024-09-11T11:01:05.332299+0000","last_became_peered":"2024-09-11T11:01:05.332299+0000","last_unstale":"2024-09-11T11:05:34.549971+0000","last_undegraded":"2024-09-11T11:05:34.549971+0000","last_fullsized":"2024-09-11T11:05:34.549971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-11T11:05:34.549716+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-11T11:05:34.549716+0000","last_clean_scrub_stamp":"2024-09-11T11:05:34.549716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:06.497295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:47.652959+0000","last_change":"2024-09-11T11:05:47.653060+0000","last_active":"2024-09-11T11:05:47.652959+0000","last_peered":"2024-09-11T11:05:47.652959+0000","last_clean":"2024-09-11T11:05:47.652959+0000","last_became_active":"2024-09-11T11:01:03.345528+0000","last_became_peered":"2024-09-11T11:01:03.345528+0000","last_unstale":"2024-09-11T11:05:47.652959+0000","last_undegraded":"2024-09-11T11:05:47.652959+0000","last_fullsized":"2024-09-11T11:05:47.652959+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:47.652748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:47.652748+0000","last_clean_scrub_stamp":"2024-09-11T11:05:47.652748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:26.607016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.098812+0000","last_change":"2024-09-11T11:05:17.098881+0000","last_active":"2024-09-11T11:05:17.098812+0000","last_peered":"2024-09-11T11:05:17.098812+0000","last_clean":"2024-09-11T11:05:17.098812+0000","last_became_active":"2024-09-11T11:01:05.352754+0000","last_became_peered":"2024-09-11T11:01:05.352754+0000","last_unstale":"2024-09-11T11:05:17.098812+0000","last_undegraded":"2024-09-11T11:05:17.098812+0000","last_fullsized":"2024-09-11T11:05:17.098812+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:17.098602+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:17.098602+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.098602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:55:03.563158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:44.593978+0000","last_change":"2024-09-11T11:05:44.594034+0000","last_active":"2024-09-11T11:05:44.593978+0000","last_peered":"2024-09-11T11:05:44.593978+0000","last_clean":"2024-09-11T11:05:44.593978+0000","last_became_active":"2024-09-11T11:01:03.321411+0000","last_became_peered":"2024-09-11T11:01:03.321411+0000","last_unstale":"2024-09-11T11:05:44.593978+0000","last_undegraded":"2024-09-11T11:05:44.593978+0000","last_fullsized":"2024-09-11T11:05:44.593978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:44.593722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:44.593722+0000","last_clean_scrub_stamp":"2024-09-11T11:05:44.593722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:30.905715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'32","reported_seq":120,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.206616+0000","last_change":"2024-09-11T11:05:22.206736+0000","last_active":"2024-09-11T11:05:22.206616+0000","last_peered":"2024-09-11T11:05:22.206616+0000","last_clean":"2024-09-11T11:05:22.206616+0000","last_became_active":"2024-09-11T11:01:05.337040+0000","last_became_peered":"2024-09-11T11:01:05.337040+0000","last_unstale":"2024-09-11T11:05:22.206616+0000","last_undegraded":"2024-09-11T11:05:22.206616+0000","last_fullsized":"2024-09-11T11:05:22.206616+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'32","last_scrub_stamp":"2024-09-11T11:05:22.206344+0000","last_deep_scrub":"36'32","last_deep_scrub_stamp":"2024-09-11T11:05:22.206344+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.206344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:41:54.884487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787825+0000","last_change":"2024-09-11T11:01:03.334314+0000","last_active":"2024-09-11T11:04:53.787825+0000","last_peered":"2024-09-11T11:04:53.787825+0000","last_clean":"2024-09-11T11:04:53.787825+0000","last_became_active":"2024-09-11T11:01:03.333820+0000","last_became_peered":"2024-09-11T11:01:03.333820+0000","last_unstale":"2024-09-11T11:04:53.787825+0000","last_undegraded":"2024-09-11T11:04:53.787825+0000","last_fullsized":"2024-09-11T11:04:53.787825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:41.801662+0000","last_change":"2024-09-11T11:05:41.801724+0000","last_active":"2024-09-11T11:05:41.801662+0000","last_peered":"2024-09-11T11:05:41.801662+0000","last_clean":"2024-09-11T11:05:41.801662+0000","last_became_active":"2024-09-11T11:01:05.342461+0000","last_became_peered":"2024-09-11T11:01:05.342461+0000","last_unstale":"2024-09-11T11:05:41.801662+0000","last_undegraded":"2024-09-11T11:05:41.801662+0000","last_fullsized":"2024-09-11T11:05:41.801662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:41.801462+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:41.801462+0000","last_clean_scrub_stamp":"2024-09-11T11:05:41.801462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:02:49.901613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:43.946070+0000","last_change":"2024-09-11T11:05:43.946131+0000","last_active":"2024-09-11T11:05:43.946070+0000","last_peered":"2024-09-11T11:05:43.946070+0000","last_clean":"2024-09-11T11:05:43.946070+0000","last_became_active":"2024-09-11T11:01:03.345866+0000","last_became_peered":"2024-09-11T11:01:03.345866+0000","last_unstale":"2024-09-11T11:05:43.946070+0000","last_undegraded":"2024-09-11T11:05:43.946070+0000","last_fullsized":"2024-09-11T11:05:43.946070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:43.945871+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:43.945871+0000","last_clean_scrub_stamp":"2024-09-11T11:05:43.945871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:52.147561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'38","reported_seq":118,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.928354+0000","last_change":"2024-09-11T11:05:09.928423+0000","last_active":"2024-09-11T11:05:09.928354+0000","last_peered":"2024-09-11T11:05:09.928354+0000","last_clean":"2024-09-11T11:05:09.928354+0000","last_became_active":"2024-09-11T11:01:13.410232+0000","last_became_peered":"2024-09-11T11:01:13.410232+0000","last_unstale":"2024-09-11T11:05:09.928354+0000","last_undegraded":"2024-09-11T11:05:09.928354+0000","last_fullsized":"2024-09-11T11:05:09.928354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-11T11:05:09.928140+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-11T11:05:09.928140+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.928140+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:11.772636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'14","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.871402+0000","last_change":"2024-09-11T11:05:25.871402+0000","last_active":"2024-09-11T11:05:25.871402+0000","last_peered":"2024-09-11T11:05:25.871402+0000","last_clean":"2024-09-11T11:05:25.871402+0000","last_became_active":"2024-09-11T11:01:05.347254+0000","last_became_peered":"2024-09-11T11:01:05.347254+0000","last_unstale":"2024-09-11T11:05:25.871402+0000","last_undegraded":"2024-09-11T11:05:25.871402+0000","last_fullsized":"2024-09-11T11:05:25.871402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:25.871155+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:25.871155+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.871155+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:49:47.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:49.957858+0000","last_change":"2024-09-11T11:05:49.957921+0000","last_active":"2024-09-11T11:05:49.957858+0000","last_peered":"2024-09-11T11:05:49.957858+0000","last_clean":"2024-09-11T11:05:49.957858+0000","last_became_active":"2024-09-11T11:01:03.340851+0000","last_became_peered":"2024-09-11T11:01:03.340851+0000","last_unstale":"2024-09-11T11:05:49.957858+0000","last_undegraded":"2024-09-11T11:05:49.957858+0000","last_fullsized":"2024-09-11T11:05:49.957858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:49.957655+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:49.957655+0000","last_clean_scrub_stamp":"2024-09-11T11:05:49.957655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:36.269648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.702240+0000","last_change":"2024-09-11T11:05:00.702297+0000","last_active":"2024-09-11T11:05:00.702240+0000","last_peered":"2024-09-11T11:05:00.702240+0000","last_clean":"2024-09-11T11:05:00.702240+0000","last_became_active":"2024-09-11T11:01:07.363392+0000","last_became_peered":"2024-09-11T11:01:07.363392+0000","last_unstale":"2024-09-11T11:05:00.702240+0000","last_undegraded":"2024-09-11T11:05:00.702240+0000","last_fullsized":"2024-09-11T11:05:00.702240+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.702044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.702044+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.702044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:35.422637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'37","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.718686+0000","last_change":"2024-09-11T11:05:09.718768+0000","last_active":"2024-09-11T11:05:09.718686+0000","last_peered":"2024-09-11T11:05:09.718686+0000","last_clean":"2024-09-11T11:05:09.718686+0000","last_became_active":"2024-09-11T11:01:09.392044+0000","last_became_peered":"2024-09-11T11:01:09.392044+0000","last_unstale":"2024-09-11T11:05:09.718686+0000","last_undegraded":"2024-09-11T11:05:09.718686+0000","last_fullsized":"2024-09-11T11:05:09.718686+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:05:09.718489+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:05:09.718489+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.718489+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:24.928510+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.525882+0000","last_change":"2024-09-11T11:05:21.525939+0000","last_active":"2024-09-11T11:05:21.525882+0000","last_peered":"2024-09-11T11:05:21.525882+0000","last_clean":"2024-09-11T11:05:21.525882+0000","last_became_active":"2024-09-11T11:01:11.399820+0000","last_became_peered":"2024-09-11T11:01:11.399820+0000","last_unstale":"2024-09-11T11:05:21.525882+0000","last_undegraded":"2024-09-11T11:05:21.525882+0000","last_fullsized":"2024-09-11T11:05:21.525882+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:21.525658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:21.525658+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.525658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:58.144083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:41.043322+0000","last_change":"2024-09-11T11:01:13.421600+0000","last_active":"2024-09-11T11:03:41.043322+0000","last_peered":"2024-09-11T11:03:41.043322+0000","last_clean":"2024-09-11T11:03:41.043322+0000","last_became_active":"2024-09-11T11:01:13.420843+0000","last_became_peered":"2024-09-11T11:01:13.420843+0000","last_unstale":"2024-09-11T11:03:41.043322+0000","last_undegraded":"2024-09-11T11:03:41.043322+0000","last_fullsized":"2024-09-11T11:03:41.043322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'18","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.982814+0000","last_change":"2024-09-11T11:05:33.982877+0000","last_active":"2024-09-11T11:05:33.982814+0000","last_peered":"2024-09-11T11:05:33.982814+0000","last_clean":"2024-09-11T11:05:33.982814+0000","last_became_active":"2024-09-11T11:01:05.334085+0000","last_became_peered":"2024-09-11T11:01:05.334085+0000","last_unstale":"2024-09-11T11:05:33.982814+0000","last_undegraded":"2024-09-11T11:05:33.982814+0000","last_fullsized":"2024-09-11T11:05:33.982814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:33.982608+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:33.982608+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.982608+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:20:05.905492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:34.321025+0000","last_change":"2024-09-11T11:05:34.321025+0000","last_active":"2024-09-11T11:05:34.321025+0000","last_peered":"2024-09-11T11:05:34.321025+0000","last_clean":"2024-09-11T11:05:34.321025+0000","last_became_active":"2024-09-11T11:01:03.335439+0000","last_became_peered":"2024-09-11T11:01:03.335439+0000","last_unstale":"2024-09-11T11:05:34.321025+0000","last_undegraded":"2024-09-11T11:05:34.321025+0000","last_fullsized":"2024-09-11T11:05:34.321025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:34.320743+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:34.320743+0000","last_clean_scrub_stamp":"2024-09-11T11:05:34.320743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:11.922999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.792269+0000","last_change":"2024-09-11T11:05:17.792269+0000","last_active":"2024-09-11T11:05:17.792269+0000","last_peered":"2024-09-11T11:05:17.792269+0000","last_clean":"2024-09-11T11:05:17.792269+0000","last_became_active":"2024-09-11T11:01:07.350851+0000","last_became_peered":"2024-09-11T11:01:07.350851+0000","last_unstale":"2024-09-11T11:05:17.792269+0000","last_undegraded":"2024-09-11T11:05:17.792269+0000","last_fullsized":"2024-09-11T11:05:17.792269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:17.792030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:17.792030+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.792030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:12.128368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.834553+0000","last_change":"2024-09-11T11:05:00.834620+0000","last_active":"2024-09-11T11:05:00.834553+0000","last_peered":"2024-09-11T11:05:00.834553+0000","last_clean":"2024-09-11T11:05:00.834553+0000","last_became_active":"2024-09-11T11:01:09.382890+0000","last_became_peered":"2024-09-11T11:01:09.382890+0000","last_unstale":"2024-09-11T11:05:00.834553+0000","last_undegraded":"2024-09-11T11:05:00.834553+0000","last_fullsized":"2024-09-11T11:05:00.834553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:00.834344+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:00.834344+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.834344+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:37:29.350377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.589501+0000","last_change":"2024-09-11T11:05:29.589554+0000","last_active":"2024-09-11T11:05:29.589501+0000","last_peered":"2024-09-11T11:05:29.589501+0000","last_clean":"2024-09-11T11:05:29.589501+0000","last_became_active":"2024-09-11T11:01:11.400881+0000","last_became_peered":"2024-09-11T11:01:11.400881+0000","last_unstale":"2024-09-11T11:05:29.589501+0000","last_undegraded":"2024-09-11T11:05:29.589501+0000","last_fullsized":"2024-09-11T11:05:29.589501+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:29.589300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:29.589300+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.589300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:07:20.230027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:43.042501+0000","last_change":"2024-09-11T11:01:13.423960+0000","last_active":"2024-09-11T11:03:43.042501+0000","last_peered":"2024-09-11T11:03:43.042501+0000","last_clean":"2024-09-11T11:03:43.042501+0000","last_became_active":"2024-09-11T11:01:13.422439+0000","last_became_peered":"2024-09-11T11:01:13.422439+0000","last_unstale":"2024-09-11T11:03:43.042501+0000","last_undegraded":"2024-09-11T11:03:43.042501+0000","last_fullsized":"2024-09-11T11:03:43.042501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.949292+0000","last_change":"2024-09-11T11:05:31.949348+0000","last_active":"2024-09-11T11:05:31.949292+0000","last_peered":"2024-09-11T11:05:31.949292+0000","last_clean":"2024-09-11T11:05:31.949292+0000","last_became_active":"2024-09-11T11:01:05.343489+0000","last_became_peered":"2024-09-11T11:01:05.343489+0000","last_unstale":"2024-09-11T11:05:31.949292+0000","last_undegraded":"2024-09-11T11:05:31.949292+0000","last_fullsized":"2024-09-11T11:05:31.949292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:31.949083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:31.949083+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.949083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:23.877200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:41.481083+0000","last_change":"2024-09-11T11:05:41.481083+0000","last_active":"2024-09-11T11:05:41.481083+0000","last_peered":"2024-09-11T11:05:41.481083+0000","last_clean":"2024-09-11T11:05:41.481083+0000","last_became_active":"2024-09-11T11:01:03.337993+0000","last_became_peered":"2024-09-11T11:01:03.337993+0000","last_unstale":"2024-09-11T11:05:41.481083+0000","last_undegraded":"2024-09-11T11:05:41.481083+0000","last_fullsized":"2024-09-11T11:05:41.481083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:41.480819+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:41.480819+0000","last_clean_scrub_stamp":"2024-09-11T11:05:41.480819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:57:36.269805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.680699+0000","last_change":"2024-09-11T11:05:01.680805+0000","last_active":"2024-09-11T11:05:01.680699+0000","last_peered":"2024-09-11T11:05:01.680699+0000","last_clean":"2024-09-11T11:05:01.680699+0000","last_became_active":"2024-09-11T11:01:07.363656+0000","last_became_peered":"2024-09-11T11:01:07.363656+0000","last_unstale":"2024-09-11T11:05:01.680699+0000","last_undegraded":"2024-09-11T11:05:01.680699+0000","last_fullsized":"2024-09-11T11:05:01.680699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.680409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.680409+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.680409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:58.475877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.060236+0000","last_change":"2024-09-11T11:05:08.060383+0000","last_active":"2024-09-11T11:05:08.060236+0000","last_peered":"2024-09-11T11:05:08.060236+0000","last_clean":"2024-09-11T11:05:08.060236+0000","last_became_active":"2024-09-11T11:01:09.365291+0000","last_became_peered":"2024-09-11T11:01:09.365291+0000","last_unstale":"2024-09-11T11:05:08.060236+0000","last_undegraded":"2024-09-11T11:05:08.060236+0000","last_fullsized":"2024-09-11T11:05:08.060236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:05:08.060026+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:05:08.060026+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.060026+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:05:14.856797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":398,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.459581+0000","last_change":"2024-09-11T11:05:03.459650+0000","last_active":"2024-09-11T11:05:03.459581+0000","last_peered":"2024-09-11T11:05:03.459581+0000","last_clean":"2024-09-11T11:05:03.459581+0000","last_became_active":"2024-09-11T11:01:11.384635+0000","last_became_peered":"2024-09-11T11:01:11.384635+0000","last_unstale":"2024-09-11T11:05:03.459581+0000","last_undegraded":"2024-09-11T11:05:03.459581+0000","last_fullsized":"2024-09-11T11:05:03.459581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:03.459391+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:03.459391+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.459391+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:45.406062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":32,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.952085+0000","last_change":"2024-09-11T11:05:04.952144+0000","last_active":"2024-09-11T11:05:04.952085+0000","last_peered":"2024-09-11T11:05:04.952085+0000","last_clean":"2024-09-11T11:05:04.952085+0000","last_became_active":"2024-09-11T11:01:13.413465+0000","last_became_peered":"2024-09-11T11:01:13.413465+0000","last_unstale":"2024-09-11T11:05:04.952085+0000","last_undegraded":"2024-09-11T11:05:04.952085+0000","last_fullsized":"2024-09-11T11:05:04.952085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:04.951892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:04.951892+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.951892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:22.063365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'18","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.851906+0000","last_change":"2024-09-11T11:05:24.851968+0000","last_active":"2024-09-11T11:05:24.851906+0000","last_peered":"2024-09-11T11:05:24.851906+0000","last_clean":"2024-09-11T11:05:24.851906+0000","last_became_active":"2024-09-11T11:01:05.347434+0000","last_became_peered":"2024-09-11T11:01:05.347434+0000","last_unstale":"2024-09-11T11:05:24.851906+0000","last_undegraded":"2024-09-11T11:05:24.851906+0000","last_fullsized":"2024-09-11T11:05:24.851906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:24.851668+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:24.851668+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.851668+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:03.456585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"36'6","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439451+0000","last_change":"2024-09-11T11:01:03.322006+0000","last_active":"2024-09-11T11:04:52.439451+0000","last_peered":"2024-09-11T11:04:52.439451+0000","last_clean":"2024-09-11T11:04:52.439451+0000","last_became_active":"2024-09-11T11:01:03.320684+0000","last_became_peered":"2024-09-11T11:01:03.320684+0000","last_unstale":"2024-09-11T11:04:52.439451+0000","last_undegraded":"2024-09-11T11:04:52.439451+0000","last_fullsized":"2024-09-11T11:04:52.439451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.523432+0000","last_change":"2024-09-11T11:05:15.523485+0000","last_active":"2024-09-11T11:05:15.523432+0000","last_peered":"2024-09-11T11:05:15.523432+0000","last_clean":"2024-09-11T11:05:15.523432+0000","last_became_active":"2024-09-11T11:01:07.342607+0000","last_became_peered":"2024-09-11T11:01:07.342607+0000","last_unstale":"2024-09-11T11:05:15.523432+0000","last_undegraded":"2024-09-11T11:05:15.523432+0000","last_fullsized":"2024-09-11T11:05:15.523432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:15.523235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:15.523235+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.523235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:57.922368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.528932+0000","last_change":"2024-09-11T11:05:01.529010+0000","last_active":"2024-09-11T11:05:01.528932+0000","last_peered":"2024-09-11T11:05:01.528932+0000","last_clean":"2024-09-11T11:05:01.528932+0000","last_became_active":"2024-09-11T11:01:09.366811+0000","last_became_peered":"2024-09-11T11:01:09.366811+0000","last_unstale":"2024-09-11T11:05:01.528932+0000","last_undegraded":"2024-09-11T11:05:01.528932+0000","last_fullsized":"2024-09-11T11:05:01.528932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-11T11:05:01.528740+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-11T11:05:01.528740+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.528740+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:15.569259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.811502+0000","last_change":"2024-09-11T11:05:14.811502+0000","last_active":"2024-09-11T11:05:14.811502+0000","last_peered":"2024-09-11T11:05:14.811502+0000","last_clean":"2024-09-11T11:05:14.811502+0000","last_became_active":"2024-09-11T11:01:11.399213+0000","last_became_peered":"2024-09-11T11:01:11.399213+0000","last_unstale":"2024-09-11T11:05:14.811502+0000","last_undegraded":"2024-09-11T11:05:14.811502+0000","last_fullsized":"2024-09-11T11:05:14.811502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:14.811094+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:14.811094+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.811094+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:21.184720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:46.950733+0000","last_change":"2024-09-11T11:05:46.950801+0000","last_active":"2024-09-11T11:05:46.950733+0000","last_peered":"2024-09-11T11:05:46.950733+0000","last_clean":"2024-09-11T11:05:46.950733+0000","last_became_active":"2024-09-11T11:01:05.330091+0000","last_became_peered":"2024-09-11T11:01:05.330091+0000","last_unstale":"2024-09-11T11:05:46.950733+0000","last_undegraded":"2024-09-11T11:05:46.950733+0000","last_fullsized":"2024-09-11T11:05:46.950733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:46.950544+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:46.950544+0000","last_clean_scrub_stamp":"2024-09-11T11:05:46.950544+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:57:41.739529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:37.578146+0000","last_change":"2024-09-11T11:05:37.578204+0000","last_active":"2024-09-11T11:05:37.578146+0000","last_peered":"2024-09-11T11:05:37.578146+0000","last_clean":"2024-09-11T11:05:37.578146+0000","last_became_active":"2024-09-11T11:01:03.337496+0000","last_became_peered":"2024-09-11T11:01:03.337496+0000","last_unstale":"2024-09-11T11:05:37.578146+0000","last_undegraded":"2024-09-11T11:05:37.578146+0000","last_fullsized":"2024-09-11T11:05:37.578146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:37.577957+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:37.577957+0000","last_clean_scrub_stamp":"2024-09-11T11:05:37.577957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:56:54.829409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.926709+0000","last_change":"2024-09-11T11:05:11.926709+0000","last_active":"2024-09-11T11:05:11.926709+0000","last_peered":"2024-09-11T11:05:11.926709+0000","last_clean":"2024-09-11T11:05:11.926709+0000","last_became_active":"2024-09-11T11:01:07.366115+0000","last_became_peered":"2024-09-11T11:01:07.366115+0000","last_unstale":"2024-09-11T11:05:11.926709+0000","last_undegraded":"2024-09-11T11:05:11.926709+0000","last_fullsized":"2024-09-11T11:05:11.926709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:11.926427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:11.926427+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.926427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:21.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":116,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.567491+0000","last_change":"2024-09-11T11:05:08.567491+0000","last_active":"2024-09-11T11:05:08.567491+0000","last_peered":"2024-09-11T11:05:08.567491+0000","last_clean":"2024-09-11T11:05:08.567491+0000","last_became_active":"2024-09-11T11:01:09.376242+0000","last_became_peered":"2024-09-11T11:01:09.376242+0000","last_unstale":"2024-09-11T11:05:08.567491+0000","last_undegraded":"2024-09-11T11:05:08.567491+0000","last_fullsized":"2024-09-11T11:05:08.567491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-11T11:05:08.567207+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-11T11:05:08.567207+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.567207+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:00:58.320487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.791900+0000","last_change":"2024-09-11T11:04:59.791900+0000","last_active":"2024-09-11T11:04:59.791900+0000","last_peered":"2024-09-11T11:04:59.791900+0000","last_clean":"2024-09-11T11:04:59.791900+0000","last_became_active":"2024-09-11T11:01:11.377655+0000","last_became_peered":"2024-09-11T11:01:11.377655+0000","last_unstale":"2024-09-11T11:04:59.791900+0000","last_undegraded":"2024-09-11T11:04:59.791900+0000","last_fullsized":"2024-09-11T11:04:59.791900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.791500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.791500+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.791500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:50.251368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.100323+0000","last_change":"2024-09-11T11:05:09.100323+0000","last_active":"2024-09-11T11:05:09.100323+0000","last_peered":"2024-09-11T11:05:09.100323+0000","last_clean":"2024-09-11T11:05:09.100323+0000","last_became_active":"2024-09-11T11:01:13.420299+0000","last_became_peered":"2024-09-11T11:01:13.420299+0000","last_unstale":"2024-09-11T11:05:09.100323+0000","last_undegraded":"2024-09-11T11:05:09.100323+0000","last_fullsized":"2024-09-11T11:05:09.100323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-11T11:05:09.099958+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-11T11:05:09.099958+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.099958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:33:10.200502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.768459+0000","last_change":"2024-09-11T11:05:18.768459+0000","last_active":"2024-09-11T11:05:18.768459+0000","last_peered":"2024-09-11T11:05:18.768459+0000","last_clean":"2024-09-11T11:05:18.768459+0000","last_became_active":"2024-09-11T11:01:05.355135+0000","last_became_peered":"2024-09-11T11:01:05.355135+0000","last_unstale":"2024-09-11T11:05:18.768459+0000","last_undegraded":"2024-09-11T11:05:18.768459+0000","last_fullsized":"2024-09-11T11:05:18.768459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:18.768214+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:18.768214+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.768214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:21:01.255786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:46.645430+0000","last_change":"2024-09-11T11:05:46.645481+0000","last_active":"2024-09-11T11:05:46.645430+0000","last_peered":"2024-09-11T11:05:46.645430+0000","last_clean":"2024-09-11T11:05:46.645430+0000","last_became_active":"2024-09-11T11:01:03.320605+0000","last_became_peered":"2024-09-11T11:01:03.320605+0000","last_unstale":"2024-09-11T11:05:46.645430+0000","last_undegraded":"2024-09-11T11:05:46.645430+0000","last_fullsized":"2024-09-11T11:05:46.645430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:46.645205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:46.645205+0000","last_clean_scrub_stamp":"2024-09-11T11:05:46.645205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:14.831040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.228408+0000","last_change":"2024-09-11T11:05:25.228408+0000","last_active":"2024-09-11T11:05:25.228408+0000","last_peered":"2024-09-11T11:05:25.228408+0000","last_clean":"2024-09-11T11:05:25.228408+0000","last_became_active":"2024-09-11T11:01:07.348627+0000","last_became_peered":"2024-09-11T11:01:07.348627+0000","last_unstale":"2024-09-11T11:05:25.228408+0000","last_undegraded":"2024-09-11T11:05:25.228408+0000","last_fullsized":"2024-09-11T11:05:25.228408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:25.228148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:25.228148+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.228148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:47.980976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'37","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.803733+0000","last_change":"2024-09-11T11:05:15.803733+0000","last_active":"2024-09-11T11:05:15.803733+0000","last_peered":"2024-09-11T11:05:15.803733+0000","last_clean":"2024-09-11T11:05:15.803733+0000","last_became_active":"2024-09-11T11:01:09.384478+0000","last_became_peered":"2024-09-11T11:01:09.384478+0000","last_unstale":"2024-09-11T11:05:15.803733+0000","last_undegraded":"2024-09-11T11:05:15.803733+0000","last_fullsized":"2024-09-11T11:05:15.803733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:05:15.803452+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:05:15.803452+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.803452+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:02:03.374998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.809410+0000","last_change":"2024-09-11T11:05:22.809410+0000","last_active":"2024-09-11T11:05:22.809410+0000","last_peered":"2024-09-11T11:05:22.809410+0000","last_clean":"2024-09-11T11:05:22.809410+0000","last_became_active":"2024-09-11T11:01:11.401382+0000","last_became_peered":"2024-09-11T11:01:11.401382+0000","last_unstale":"2024-09-11T11:05:22.809410+0000","last_undegraded":"2024-09-11T11:05:22.809410+0000","last_fullsized":"2024-09-11T11:05:22.809410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:22.809156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:22.809156+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.809156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:39.640451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.782301+0000","last_change":"2024-09-11T11:05:25.782361+0000","last_active":"2024-09-11T11:05:25.782301+0000","last_peered":"2024-09-11T11:05:25.782301+0000","last_clean":"2024-09-11T11:05:25.782301+0000","last_became_active":"2024-09-11T11:01:13.415041+0000","last_became_peered":"2024-09-11T11:01:13.415041+0000","last_unstale":"2024-09-11T11:05:25.782301+0000","last_undegraded":"2024-09-11T11:05:25.782301+0000","last_fullsized":"2024-09-11T11:05:25.782301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:25.782127+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:25.782127+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.782127+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:59:13.498641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'8","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.510039+0000","last_change":"2024-09-11T11:05:23.510039+0000","last_active":"2024-09-11T11:05:23.510039+0000","last_peered":"2024-09-11T11:05:23.510039+0000","last_clean":"2024-09-11T11:05:23.510039+0000","last_became_active":"2024-09-11T11:01:05.347137+0000","last_became_peered":"2024-09-11T11:01:05.347137+0000","last_unstale":"2024-09-11T11:05:23.510039+0000","last_undegraded":"2024-09-11T11:05:23.510039+0000","last_fullsized":"2024-09-11T11:05:23.510039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:23.509784+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:23.509784+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.509784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:35.128425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439386+0000","last_change":"2024-09-11T11:01:42.098396+0000","last_active":"2024-09-11T11:04:52.439386+0000","last_peered":"2024-09-11T11:04:52.439386+0000","last_clean":"2024-09-11T11:04:52.439386+0000","last_became_active":"2024-09-11T11:01:42.065732+0000","last_became_peered":"2024-09-11T11:01:42.065732+0000","last_unstale":"2024-09-11T11:04:52.439386+0000","last_undegraded":"2024-09-11T11:04:52.439386+0000","last_fullsized":"2024-09-11T11:04:52.439386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:39.344584+0000","last_change":"2024-09-11T11:05:39.344638+0000","last_active":"2024-09-11T11:05:39.344584+0000","last_peered":"2024-09-11T11:05:39.344584+0000","last_clean":"2024-09-11T11:05:39.344584+0000","last_became_active":"2024-09-11T11:01:42.062781+0000","last_became_peered":"2024-09-11T11:01:42.062781+0000","last_unstale":"2024-09-11T11:05:39.344584+0000","last_undegraded":"2024-09-11T11:05:39.344584+0000","last_fullsized":"2024-09-11T11:05:39.344584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:39.344388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:39.344388+0000","last_clean_scrub_stamp":"2024-09-11T11:05:39.344388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:02:59.563125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.540432+0000","last_change":"2024-09-11T11:04:53.540432+0000","last_active":"2024-09-11T11:04:53.540432+0000","last_peered":"2024-09-11T11:04:53.540432+0000","last_clean":"2024-09-11T11:04:53.540432+0000","last_became_active":"2024-09-11T11:01:09.362260+0000","last_became_peered":"2024-09-11T11:01:09.362260+0000","last_unstale":"2024-09-11T11:04:53.540432+0000","last_undegraded":"2024-09-11T11:04:53.540432+0000","last_fullsized":"2024-09-11T11:04:53.540432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:04:53.540311+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:04:53.540311+0000","last_clean_scrub_stamp":"2024-09-11T11:04:53.540311+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:22:12.396021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.964081+0000","last_change":"2024-09-11T11:05:03.964081+0000","last_active":"2024-09-11T11:05:03.964081+0000","last_peered":"2024-09-11T11:05:03.964081+0000","last_clean":"2024-09-11T11:05:03.964081+0000","last_became_active":"2024-09-11T11:01:11.391826+0000","last_became_peered":"2024-09-11T11:01:11.391826+0000","last_unstale":"2024-09-11T11:05:03.964081+0000","last_undegraded":"2024-09-11T11:05:03.964081+0000","last_fullsized":"2024-09-11T11:05:03.964081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:03.963831+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:03.963831+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.963831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:53:34.267498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.883391+0000","last_change":"2024-09-11T11:01:13.429296+0000","last_active":"2024-09-11T11:04:52.883391+0000","last_peered":"2024-09-11T11:04:52.883391+0000","last_clean":"2024-09-11T11:04:52.883391+0000","last_became_active":"2024-09-11T11:01:13.428914+0000","last_became_peered":"2024-09-11T11:01:13.428914+0000","last_unstale":"2024-09-11T11:04:52.883391+0000","last_undegraded":"2024-09-11T11:04:52.883391+0000","last_fullsized":"2024-09-11T11:04:52.883391+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.074666+0000","last_change":"2024-09-11T11:05:12.074666+0000","last_active":"2024-09-11T11:05:12.074666+0000","last_peered":"2024-09-11T11:05:12.074666+0000","last_clean":"2024-09-11T11:05:12.074666+0000","last_became_active":"2024-09-11T11:01:05.340069+0000","last_became_peered":"2024-09-11T11:01:05.340069+0000","last_unstale":"2024-09-11T11:05:12.074666+0000","last_undegraded":"2024-09-11T11:05:12.074666+0000","last_fullsized":"2024-09-11T11:05:12.074666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:12.074380+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:12.074380+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.074380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:40.669898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:36.567094+0000","last_change":"2024-09-11T11:05:36.567242+0000","last_active":"2024-09-11T11:05:36.567094+0000","last_peered":"2024-09-11T11:05:36.567094+0000","last_clean":"2024-09-11T11:05:36.567094+0000","last_became_active":"2024-09-11T11:01:03.333740+0000","last_became_peered":"2024-09-11T11:01:03.333740+0000","last_unstale":"2024-09-11T11:05:36.567094+0000","last_undegraded":"2024-09-11T11:05:36.567094+0000","last_fullsized":"2024-09-11T11:05:36.567094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:36.566790+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:36.566790+0000","last_clean_scrub_stamp":"2024-09-11T11:05:36.566790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:18:37.102627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:35.343780+0000","last_change":"2024-09-11T11:05:35.343842+0000","last_active":"2024-09-11T11:05:35.343780+0000","last_peered":"2024-09-11T11:05:35.343780+0000","last_clean":"2024-09-11T11:05:35.343780+0000","last_became_active":"2024-09-11T11:01:07.354827+0000","last_became_peered":"2024-09-11T11:01:07.354827+0000","last_unstale":"2024-09-11T11:05:35.343780+0000","last_undegraded":"2024-09-11T11:05:35.343780+0000","last_fullsized":"2024-09-11T11:05:35.343780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:35.343551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:35.343551+0000","last_clean_scrub_stamp":"2024-09-11T11:05:35.343551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:18:53.785510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'63","reported_seq":141,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.696179+0000","last_change":"2024-09-11T11:04:55.696179+0000","last_active":"2024-09-11T11:04:55.696179+0000","last_peered":"2024-09-11T11:04:55.696179+0000","last_clean":"2024-09-11T11:04:55.696179+0000","last_became_active":"2024-09-11T11:01:09.374320+0000","last_became_peered":"2024-09-11T11:01:09.374320+0000","last_unstale":"2024-09-11T11:04:55.696179+0000","last_undegraded":"2024-09-11T11:04:55.696179+0000","last_fullsized":"2024-09-11T11:04:55.696179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-11T11:04:55.695776+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-11T11:04:55.695776+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.695776+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:06.417243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.036052+0000","last_change":"2024-09-11T11:04:58.036052+0000","last_active":"2024-09-11T11:04:58.036052+0000","last_peered":"2024-09-11T11:04:58.036052+0000","last_clean":"2024-09-11T11:04:58.036052+0000","last_became_active":"2024-09-11T11:01:11.399118+0000","last_became_peered":"2024-09-11T11:01:11.399118+0000","last_unstale":"2024-09-11T11:04:58.036052+0000","last_undegraded":"2024-09-11T11:04:58.036052+0000","last_fullsized":"2024-09-11T11:04:58.036052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:58.035800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:58.035800+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.035800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:38.887084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.813199+0000","last_change":"2024-09-11T11:05:21.813199+0000","last_active":"2024-09-11T11:05:21.813199+0000","last_peered":"2024-09-11T11:05:21.813199+0000","last_clean":"2024-09-11T11:05:21.813199+0000","last_became_active":"2024-09-11T11:01:13.415242+0000","last_became_peered":"2024-09-11T11:01:13.415242+0000","last_unstale":"2024-09-11T11:05:21.813199+0000","last_undegraded":"2024-09-11T11:05:21.813199+0000","last_fullsized":"2024-09-11T11:05:21.813199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:21.812919+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:21.812919+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.812919+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:28.186545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.825139+0000","last_change":"2024-09-11T11:05:23.825139+0000","last_active":"2024-09-11T11:05:23.825139+0000","last_peered":"2024-09-11T11:05:23.825139+0000","last_clean":"2024-09-11T11:05:23.825139+0000","last_became_active":"2024-09-11T11:01:05.347367+0000","last_became_peered":"2024-09-11T11:01:05.347367+0000","last_unstale":"2024-09-11T11:05:23.825139+0000","last_undegraded":"2024-09-11T11:05:23.825139+0000","last_fullsized":"2024-09-11T11:05:23.825139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:23.824889+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:23.824889+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.824889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:06:33.988458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:36.921243+0000","last_change":"2024-09-11T11:05:36.921304+0000","last_active":"2024-09-11T11:05:36.921243+0000","last_peered":"2024-09-11T11:05:36.921243+0000","last_clean":"2024-09-11T11:05:36.921243+0000","last_became_active":"2024-09-11T11:01:03.349051+0000","last_became_peered":"2024-09-11T11:01:03.349051+0000","last_unstale":"2024-09-11T11:05:36.921243+0000","last_undegraded":"2024-09-11T11:05:36.921243+0000","last_fullsized":"2024-09-11T11:05:36.921243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:36.921036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:36.921036+0000","last_clean_scrub_stamp":"2024-09-11T11:05:36.921036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:47:01.946669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.160763+0000","last_change":"2024-09-11T11:05:21.160763+0000","last_active":"2024-09-11T11:05:21.160763+0000","last_peered":"2024-09-11T11:05:21.160763+0000","last_clean":"2024-09-11T11:05:21.160763+0000","last_became_active":"2024-09-11T11:01:07.344509+0000","last_became_peered":"2024-09-11T11:01:07.344509+0000","last_unstale":"2024-09-11T11:05:21.160763+0000","last_undegraded":"2024-09-11T11:05:21.160763+0000","last_fullsized":"2024-09-11T11:05:21.160763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:21.160509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:21.160509+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.160509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:21.895766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.481681+0000","last_change":"2024-09-11T11:05:06.481681+0000","last_active":"2024-09-11T11:05:06.481681+0000","last_peered":"2024-09-11T11:05:06.481681+0000","last_clean":"2024-09-11T11:05:06.481681+0000","last_became_active":"2024-09-11T11:01:09.376576+0000","last_became_peered":"2024-09-11T11:01:09.376576+0000","last_unstale":"2024-09-11T11:05:06.481681+0000","last_undegraded":"2024-09-11T11:05:06.481681+0000","last_fullsized":"2024-09-11T11:05:06.481681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-11T11:05:06.481402+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-11T11:05:06.481402+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.481402+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:17:29.713697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.760504+0000","last_change":"2024-09-11T11:05:05.760504+0000","last_active":"2024-09-11T11:05:05.760504+0000","last_peered":"2024-09-11T11:05:05.760504+0000","last_clean":"2024-09-11T11:05:05.760504+0000","last_became_active":"2024-09-11T11:01:11.394215+0000","last_became_peered":"2024-09-11T11:01:11.394215+0000","last_unstale":"2024-09-11T11:05:05.760504+0000","last_undegraded":"2024-09-11T11:05:05.760504+0000","last_fullsized":"2024-09-11T11:05:05.760504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:05.760254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:05.760254+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.760254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:50:59.140410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'8","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.944316+0000","last_change":"2024-09-11T11:05:30.944380+0000","last_active":"2024-09-11T11:05:30.944316+0000","last_peered":"2024-09-11T11:05:30.944316+0000","last_clean":"2024-09-11T11:05:30.944316+0000","last_became_active":"2024-09-11T11:01:13.390538+0000","last_became_peered":"2024-09-11T11:01:13.390538+0000","last_unstale":"2024-09-11T11:05:30.944316+0000","last_undegraded":"2024-09-11T11:05:30.944316+0000","last_fullsized":"2024-09-11T11:05:30.944316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:30.944123+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:30.944123+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.944123+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:47.191730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.440000+0000","last_change":"2024-09-11T11:01:05.332887+0000","last_active":"2024-09-11T11:04:52.440000+0000","last_peered":"2024-09-11T11:04:52.440000+0000","last_clean":"2024-09-11T11:04:52.440000+0000","last_became_active":"2024-09-11T11:01:05.332138+0000","last_became_peered":"2024-09-11T11:01:05.332138+0000","last_unstale":"2024-09-11T11:04:52.440000+0000","last_undegraded":"2024-09-11T11:04:52.440000+0000","last_fullsized":"2024-09-11T11:04:52.440000+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:04.296343+0000","last_clean_scrub_stamp":"2024-09-11T11:01:04.296343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439336+0000","last_change":"2024-09-11T11:01:03.321735+0000","last_active":"2024-09-11T11:04:52.439336+0000","last_peered":"2024-09-11T11:04:52.439336+0000","last_clean":"2024-09-11T11:04:52.439336+0000","last_became_active":"2024-09-11T11:01:03.320906+0000","last_became_peered":"2024-09-11T11:01:03.320906+0000","last_unstale":"2024-09-11T11:04:52.439336+0000","last_undegraded":"2024-09-11T11:04:52.439336+0000","last_fullsized":"2024-09-11T11:04:52.439336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.947793+0000","last_change":"2024-09-11T11:05:10.947793+0000","last_active":"2024-09-11T11:05:10.947793+0000","last_peered":"2024-09-11T11:05:10.947793+0000","last_clean":"2024-09-11T11:05:10.947793+0000","last_became_active":"2024-09-11T11:01:07.367554+0000","last_became_peered":"2024-09-11T11:01:07.367554+0000","last_unstale":"2024-09-11T11:05:10.947793+0000","last_undegraded":"2024-09-11T11:05:10.947793+0000","last_fullsized":"2024-09-11T11:05:10.947793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:10.947506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:10.947506+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.947506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:44.583302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'47","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.027543+0000","last_change":"2024-09-11T11:05:07.027543+0000","last_active":"2024-09-11T11:05:07.027543+0000","last_peered":"2024-09-11T11:05:07.027543+0000","last_clean":"2024-09-11T11:05:07.027543+0000","last_became_active":"2024-09-11T11:01:09.367246+0000","last_became_peered":"2024-09-11T11:01:09.367246+0000","last_unstale":"2024-09-11T11:05:07.027543+0000","last_undegraded":"2024-09-11T11:05:07.027543+0000","last_fullsized":"2024-09-11T11:05:07.027543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-11T11:05:07.027243+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-11T11:05:07.027243+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.027243+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:08:09.945366+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.968427+0000","last_change":"2024-09-11T11:05:02.968427+0000","last_active":"2024-09-11T11:05:02.968427+0000","last_peered":"2024-09-11T11:05:02.968427+0000","last_clean":"2024-09-11T11:05:02.968427+0000","last_became_active":"2024-09-11T11:01:11.392359+0000","last_became_peered":"2024-09-11T11:01:11.392359+0000","last_unstale":"2024-09-11T11:05:02.968427+0000","last_undegraded":"2024-09-11T11:05:02.968427+0000","last_fullsized":"2024-09-11T11:05:02.968427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:02.968136+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:02.968136+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.968136+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:59.277030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'17","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.770923+0000","last_change":"2024-09-11T11:05:17.770923+0000","last_active":"2024-09-11T11:05:17.770923+0000","last_peered":"2024-09-11T11:05:17.770923+0000","last_clean":"2024-09-11T11:05:17.770923+0000","last_became_active":"2024-09-11T11:01:13.415115+0000","last_became_peered":"2024-09-11T11:01:13.415115+0000","last_unstale":"2024-09-11T11:05:17.770923+0000","last_undegraded":"2024-09-11T11:05:17.770923+0000","last_fullsized":"2024-09-11T11:05:17.770923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'17","last_scrub_stamp":"2024-09-11T11:05:17.770533+0000","last_deep_scrub":"36'17","last_deep_scrub_stamp":"2024-09-11T11:05:17.770533+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.770533+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:46.446476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'8","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.168321+0000","last_change":"2024-09-11T11:05:20.168321+0000","last_active":"2024-09-11T11:05:20.168321+0000","last_peered":"2024-09-11T11:05:20.168321+0000","last_clean":"2024-09-11T11:05:20.168321+0000","last_became_active":"2024-09-11T11:01:05.337055+0000","last_became_peered":"2024-09-11T11:01:05.337055+0000","last_unstale":"2024-09-11T11:05:20.168321+0000","last_undegraded":"2024-09-11T11:05:20.168321+0000","last_fullsized":"2024-09-11T11:05:20.168321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:20.168067+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:20.168067+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.168067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:11.957107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'4","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787270+0000","last_change":"2024-09-11T11:01:03.336594+0000","last_active":"2024-09-11T11:04:53.787270+0000","last_peered":"2024-09-11T11:04:53.787270+0000","last_clean":"2024-09-11T11:04:53.787270+0000","last_became_active":"2024-09-11T11:01:03.334392+0000","last_became_peered":"2024-09-11T11:01:03.334392+0000","last_unstale":"2024-09-11T11:04:53.787270+0000","last_undegraded":"2024-09-11T11:04:53.787270+0000","last_fullsized":"2024-09-11T11:04:53.787270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.571458+0000","last_change":"2024-09-11T11:04:56.571458+0000","last_active":"2024-09-11T11:04:56.571458+0000","last_peered":"2024-09-11T11:04:56.571458+0000","last_clean":"2024-09-11T11:04:56.571458+0000","last_became_active":"2024-09-11T11:01:07.360348+0000","last_became_peered":"2024-09-11T11:01:07.360348+0000","last_unstale":"2024-09-11T11:04:56.571458+0000","last_undegraded":"2024-09-11T11:04:56.571458+0000","last_fullsized":"2024-09-11T11:04:56.571458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-11T11:04:56.571190+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-11T11:04:56.571190+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.571190+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:48.525894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.692151+0000","last_change":"2024-09-11T11:04:54.692151+0000","last_active":"2024-09-11T11:04:54.692151+0000","last_peered":"2024-09-11T11:04:54.692151+0000","last_clean":"2024-09-11T11:04:54.692151+0000","last_became_active":"2024-09-11T11:02:42.501712+0000","last_became_peered":"2024-09-11T11:02:42.501712+0000","last_unstale":"2024-09-11T11:04:54.692151+0000","last_undegraded":"2024-09-11T11:04:54.692151+0000","last_fullsized":"2024-09-11T11:04:54.692151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-11T11:04:54.691868+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-11T11:04:54.691868+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.691868+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:58:19.231371+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.466674+0000","last_change":"2024-09-11T11:05:05.466674+0000","last_active":"2024-09-11T11:05:05.466674+0000","last_peered":"2024-09-11T11:05:05.466674+0000","last_clean":"2024-09-11T11:05:05.466674+0000","last_became_active":"2024-09-11T11:01:11.384776+0000","last_became_peered":"2024-09-11T11:01:11.384776+0000","last_unstale":"2024-09-11T11:05:05.466674+0000","last_undegraded":"2024-09-11T11:05:05.466674+0000","last_fullsized":"2024-09-11T11:05:05.466674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:05.466396+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:05.466396+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.466396+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:00:09.842981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.007820+0000","last_change":"2024-09-11T11:05:01.007820+0000","last_active":"2024-09-11T11:05:01.007820+0000","last_peered":"2024-09-11T11:05:01.007820+0000","last_clean":"2024-09-11T11:05:01.007820+0000","last_became_active":"2024-09-11T11:01:13.418296+0000","last_became_peered":"2024-09-11T11:01:13.418296+0000","last_unstale":"2024-09-11T11:05:01.007820+0000","last_undegraded":"2024-09-11T11:05:01.007820+0000","last_fullsized":"2024-09-11T11:05:01.007820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:01.007547+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:01.007547+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.007547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:55:18.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'18","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.805924+0000","last_change":"2024-09-11T11:05:22.805924+0000","last_active":"2024-09-11T11:05:22.805924+0000","last_peered":"2024-09-11T11:05:22.805924+0000","last_clean":"2024-09-11T11:05:22.805924+0000","last_became_active":"2024-09-11T11:01:05.347644+0000","last_became_peered":"2024-09-11T11:01:05.347644+0000","last_unstale":"2024-09-11T11:05:22.805924+0000","last_undegraded":"2024-09-11T11:05:22.805924+0000","last_fullsized":"2024-09-11T11:05:22.805924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:22.805671+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:22.805671+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.805671+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:31.023813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:37.886385+0000","last_change":"2024-09-11T11:05:37.886436+0000","last_active":"2024-09-11T11:05:37.886385+0000","last_peered":"2024-09-11T11:05:37.886385+0000","last_clean":"2024-09-11T11:05:37.886385+0000","last_became_active":"2024-09-11T11:01:03.349605+0000","last_became_peered":"2024-09-11T11:01:03.349605+0000","last_unstale":"2024-09-11T11:05:37.886385+0000","last_undegraded":"2024-09-11T11:05:37.886385+0000","last_fullsized":"2024-09-11T11:05:37.886385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:37.886201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:37.886201+0000","last_clean_scrub_stamp":"2024-09-11T11:05:37.886201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:37.948015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.793239+0000","last_change":"2024-09-11T11:05:16.793239+0000","last_active":"2024-09-11T11:05:16.793239+0000","last_peered":"2024-09-11T11:05:16.793239+0000","last_clean":"2024-09-11T11:05:16.793239+0000","last_became_active":"2024-09-11T11:01:07.351403+0000","last_became_peered":"2024-09-11T11:01:07.351403+0000","last_unstale":"2024-09-11T11:05:16.793239+0000","last_undegraded":"2024-09-11T11:05:16.793239+0000","last_fullsized":"2024-09-11T11:05:16.793239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.792993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.792993+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.792993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:52:24.716938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.534340+0000","last_change":"2024-09-11T11:05:07.534340+0000","last_active":"2024-09-11T11:05:07.534340+0000","last_peered":"2024-09-11T11:05:07.534340+0000","last_clean":"2024-09-11T11:05:07.534340+0000","last_became_active":"2024-09-11T11:01:09.376340+0000","last_became_peered":"2024-09-11T11:01:09.376340+0000","last_unstale":"2024-09-11T11:05:07.534340+0000","last_undegraded":"2024-09-11T11:05:07.534340+0000","last_fullsized":"2024-09-11T11:05:07.534340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-11T11:05:07.534061+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-11T11:05:07.534061+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.534061+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.271487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.598087+0000","last_change":"2024-09-11T11:05:13.598087+0000","last_active":"2024-09-11T11:05:13.598087+0000","last_peered":"2024-09-11T11:05:13.598087+0000","last_clean":"2024-09-11T11:05:13.598087+0000","last_became_active":"2024-09-11T11:01:11.385523+0000","last_became_peered":"2024-09-11T11:01:11.385523+0000","last_unstale":"2024-09-11T11:05:13.598087+0000","last_undegraded":"2024-09-11T11:05:13.598087+0000","last_fullsized":"2024-09-11T11:05:13.598087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:13.597842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:13.597842+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.597842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:47.342062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'7","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.876239+0000","last_change":"2024-09-11T11:05:05.876239+0000","last_active":"2024-09-11T11:05:05.876239+0000","last_peered":"2024-09-11T11:05:05.876239+0000","last_clean":"2024-09-11T11:05:05.876239+0000","last_became_active":"2024-09-11T11:01:13.403125+0000","last_became_peered":"2024-09-11T11:01:13.403125+0000","last_unstale":"2024-09-11T11:05:05.876239+0000","last_undegraded":"2024-09-11T11:05:05.876239+0000","last_fullsized":"2024-09-11T11:05:05.876239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-11T11:05:05.875973+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-11T11:05:05.875973+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.875973+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:59.171520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'22","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.588013+0000","last_change":"2024-09-11T11:05:27.588075+0000","last_active":"2024-09-11T11:05:27.588013+0000","last_peered":"2024-09-11T11:05:27.588013+0000","last_clean":"2024-09-11T11:05:27.588013+0000","last_became_active":"2024-09-11T11:01:05.345474+0000","last_became_peered":"2024-09-11T11:01:05.345474+0000","last_unstale":"2024-09-11T11:05:27.588013+0000","last_undegraded":"2024-09-11T11:05:27.588013+0000","last_fullsized":"2024-09-11T11:05:27.588013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-11T11:05:27.587826+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-11T11:05:27.587826+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.587826+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:48.653691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":218,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:43.792273+0000","last_change":"2024-09-11T11:05:43.792342+0000","last_active":"2024-09-11T11:05:43.792273+0000","last_peered":"2024-09-11T11:05:43.792273+0000","last_clean":"2024-09-11T11:05:43.792273+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:05:43.792273+0000","last_undegraded":"2024-09-11T11:05:43.792273+0000","last_fullsized":"2024-09-11T11:05:43.792273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-11T11:05:43.792088+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-11T11:05:43.792088+0000","last_clean_scrub_stamp":"2024-09-11T11:05:43.792088+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:02:23.310483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439117+0000","last_change":"2024-09-11T11:00:55.884398+0000","last_active":"2024-09-11T11:04:52.439117+0000","last_peered":"2024-09-11T11:04:52.439117+0000","last_clean":"2024-09-11T11:04:52.439117+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:04:52.439117+0000","last_undegraded":"2024-09-11T11:04:52.439117+0000","last_fullsized":"2024-09-11T11:04:52.439117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:47.962335+0000","last_change":"2024-09-11T11:05:47.962386+0000","last_active":"2024-09-11T11:05:47.962335+0000","last_peered":"2024-09-11T11:05:47.962335+0000","last_clean":"2024-09-11T11:05:47.962335+0000","last_became_active":"2024-09-11T11:01:03.334611+0000","last_became_peered":"2024-09-11T11:01:03.334611+0000","last_unstale":"2024-09-11T11:05:47.962335+0000","last_undegraded":"2024-09-11T11:05:47.962335+0000","last_fullsized":"2024-09-11T11:05:47.962335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:47.962146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:47.962146+0000","last_clean_scrub_stamp":"2024-09-11T11:05:47.962146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:18.583571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.806822+0000","last_change":"2024-09-11T11:05:16.806822+0000","last_active":"2024-09-11T11:05:16.806822+0000","last_peered":"2024-09-11T11:05:16.806822+0000","last_clean":"2024-09-11T11:05:16.806822+0000","last_became_active":"2024-09-11T11:01:07.348530+0000","last_became_peered":"2024-09-11T11:01:07.348530+0000","last_unstale":"2024-09-11T11:05:16.806822+0000","last_undegraded":"2024-09-11T11:05:16.806822+0000","last_fullsized":"2024-09-11T11:05:16.806822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.806573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.806573+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.806573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:00:07.850946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.560070+0000","last_change":"2024-09-11T11:05:14.560070+0000","last_active":"2024-09-11T11:05:14.560070+0000","last_peered":"2024-09-11T11:05:14.560070+0000","last_clean":"2024-09-11T11:05:14.560070+0000","last_became_active":"2024-09-11T11:01:09.369066+0000","last_became_peered":"2024-09-11T11:01:09.369066+0000","last_unstale":"2024-09-11T11:05:14.560070+0000","last_undegraded":"2024-09-11T11:05:14.560070+0000","last_fullsized":"2024-09-11T11:05:14.560070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-09-11T11:05:14.559823+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-09-11T11:05:14.559823+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.559823+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:34:23.881642+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.727517+0000","last_change":"2024-09-11T11:05:04.727517+0000","last_active":"2024-09-11T11:05:04.727517+0000","last_peered":"2024-09-11T11:05:04.727517+0000","last_clean":"2024-09-11T11:05:04.727517+0000","last_became_active":"2024-09-11T11:01:11.394277+0000","last_became_peered":"2024-09-11T11:01:11.394277+0000","last_unstale":"2024-09-11T11:05:04.727517+0000","last_undegraded":"2024-09-11T11:05:04.727517+0000","last_fullsized":"2024-09-11T11:05:04.727517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:04.727229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:04.727229+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.727229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:14.507545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.089631+0000","last_change":"2024-09-11T11:04:55.089631+0000","last_active":"2024-09-11T11:04:55.089631+0000","last_peered":"2024-09-11T11:04:55.089631+0000","last_clean":"2024-09-11T11:04:55.089631+0000","last_became_active":"2024-09-11T11:01:13.412615+0000","last_became_peered":"2024-09-11T11:01:13.412615+0000","last_unstale":"2024-09-11T11:04:55.089631+0000","last_undegraded":"2024-09-11T11:04:55.089631+0000","last_fullsized":"2024-09-11T11:04:55.089631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-11T11:04:55.089351+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-11T11:04:55.089351+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.089351+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:06.508319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.805718+0000","last_change":"2024-09-11T11:05:23.805718+0000","last_active":"2024-09-11T11:05:23.805718+0000","last_peered":"2024-09-11T11:05:23.805718+0000","last_clean":"2024-09-11T11:05:23.805718+0000","last_became_active":"2024-09-11T11:01:05.346710+0000","last_became_peered":"2024-09-11T11:01:05.346710+0000","last_unstale":"2024-09-11T11:05:23.805718+0000","last_undegraded":"2024-09-11T11:05:23.805718+0000","last_fullsized":"2024-09-11T11:05:23.805718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:23.805304+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:23.805304+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.805304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:46.899730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439050+0000","last_change":"2024-09-11T11:00:55.882458+0000","last_active":"2024-09-11T11:04:52.439050+0000","last_peered":"2024-09-11T11:04:52.439050+0000","last_clean":"2024-09-11T11:04:52.439050+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:04:52.439050+0000","last_undegraded":"2024-09-11T11:04:52.439050+0000","last_fullsized":"2024-09-11T11:04:52.439050+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:50.975161+0000","last_change":"2024-09-11T11:05:50.975265+0000","last_active":"2024-09-11T11:05:50.975161+0000","last_peered":"2024-09-11T11:05:50.975161+0000","last_clean":"2024-09-11T11:05:50.975161+0000","last_became_active":"2024-09-11T11:01:03.325795+0000","last_became_peered":"2024-09-11T11:01:03.325795+0000","last_unstale":"2024-09-11T11:05:50.975161+0000","last_undegraded":"2024-09-11T11:05:50.975161+0000","last_fullsized":"2024-09-11T11:05:50.975161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:50.974863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:50.974863+0000","last_clean_scrub_stamp":"2024-09-11T11:05:50.974863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:16:03.129341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.500469+0000","last_change":"2024-09-11T11:04:52.500469+0000","last_active":"2024-09-11T11:04:52.500469+0000","last_peered":"2024-09-11T11:04:52.500469+0000","last_clean":"2024-09-11T11:04:52.500469+0000","last_became_active":"2024-09-11T11:01:07.360718+0000","last_became_peered":"2024-09-11T11:01:07.360718+0000","last_unstale":"2024-09-11T11:04:52.500469+0000","last_undegraded":"2024-09-11T11:04:52.500469+0000","last_fullsized":"2024-09-11T11:04:52.500469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:52.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:52.500353+0000","last_clean_scrub_stamp":"2024-09-11T11:04:52.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:05.966274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.939512+0000","last_change":"2024-09-11T11:05:03.939512+0000","last_active":"2024-09-11T11:05:03.939512+0000","last_peered":"2024-09-11T11:05:03.939512+0000","last_clean":"2024-09-11T11:05:03.939512+0000","last_became_active":"2024-09-11T11:01:09.376555+0000","last_became_peered":"2024-09-11T11:01:09.376555+0000","last_unstale":"2024-09-11T11:05:03.939512+0000","last_undegraded":"2024-09-11T11:05:03.939512+0000","last_fullsized":"2024-09-11T11:05:03.939512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-11T11:05:03.939238+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-11T11:05:03.939238+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.939238+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:17.488538+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.787021+0000","last_change":"2024-09-11T11:05:18.787021+0000","last_active":"2024-09-11T11:05:18.787021+0000","last_peered":"2024-09-11T11:05:18.787021+0000","last_clean":"2024-09-11T11:05:18.787021+0000","last_became_active":"2024-09-11T11:01:11.400253+0000","last_became_peered":"2024-09-11T11:01:11.400253+0000","last_unstale":"2024-09-11T11:05:18.787021+0000","last_undegraded":"2024-09-11T11:05:18.787021+0000","last_fullsized":"2024-09-11T11:05:18.787021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:18.786712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:18.786712+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.786712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:52.530932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'11","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.883409+0000","last_change":"2024-09-11T11:01:13.422211+0000","last_active":"2024-09-11T11:04:52.883409+0000","last_peered":"2024-09-11T11:04:52.883409+0000","last_clean":"2024-09-11T11:04:52.883409+0000","last_became_active":"2024-09-11T11:01:13.421491+0000","last_became_peered":"2024-09-11T11:01:13.421491+0000","last_unstale":"2024-09-11T11:04:52.883409+0000","last_undegraded":"2024-09-11T11:04:52.883409+0000","last_fullsized":"2024-09-11T11:04:52.883409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.828471+0000","last_change":"2024-09-11T11:05:24.828471+0000","last_active":"2024-09-11T11:05:24.828471+0000","last_peered":"2024-09-11T11:05:24.828471+0000","last_clean":"2024-09-11T11:05:24.828471+0000","last_became_active":"2024-09-11T11:01:05.347359+0000","last_became_peered":"2024-09-11T11:01:05.347359+0000","last_unstale":"2024-09-11T11:05:24.828471+0000","last_undegraded":"2024-09-11T11:05:24.828471+0000","last_fullsized":"2024-09-11T11:05:24.828471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:24.828225+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:24.828225+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.828225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:55.815883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.223190+0000","last_change":"2024-09-11T11:05:27.223243+0000","last_active":"2024-09-11T11:05:27.223190+0000","last_peered":"2024-09-11T11:05:27.223190+0000","last_clean":"2024-09-11T11:05:27.223190+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:05:27.223190+0000","last_undegraded":"2024-09-11T11:05:27.223190+0000","last_fullsized":"2024-09-11T11:05:27.223190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:27.223007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:27.223007+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.223007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:50.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:48.920712+0000","last_change":"2024-09-11T11:05:48.920764+0000","last_active":"2024-09-11T11:05:48.920712+0000","last_peered":"2024-09-11T11:05:48.920712+0000","last_clean":"2024-09-11T11:05:48.920712+0000","last_became_active":"2024-09-11T11:01:03.325168+0000","last_became_peered":"2024-09-11T11:01:03.325168+0000","last_unstale":"2024-09-11T11:05:48.920712+0000","last_undegraded":"2024-09-11T11:05:48.920712+0000","last_fullsized":"2024-09-11T11:05:48.920712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:48.920515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:48.920515+0000","last_clean_scrub_stamp":"2024-09-11T11:05:48.920515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:09.558068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"36'4","reported_seq":237,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.215881+0000","last_change":"2024-09-11T11:05:23.215881+0000","last_active":"2024-09-11T11:05:23.215881+0000","last_peered":"2024-09-11T11:05:23.215881+0000","last_clean":"2024-09-11T11:05:23.215881+0000","last_became_active":"2024-09-11T11:01:07.345998+0000","last_became_peered":"2024-09-11T11:01:07.345998+0000","last_unstale":"2024-09-11T11:05:23.215881+0000","last_undegraded":"2024-09-11T11:05:23.215881+0000","last_fullsized":"2024-09-11T11:05:23.215881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:23.215586+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:23.215586+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.215586+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:14.462637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'25","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.622163+0000","last_change":"2024-09-11T11:05:10.622163+0000","last_active":"2024-09-11T11:05:10.622163+0000","last_peered":"2024-09-11T11:05:10.622163+0000","last_clean":"2024-09-11T11:05:10.622163+0000","last_became_active":"2024-09-11T11:01:09.371816+0000","last_became_peered":"2024-09-11T11:01:09.371816+0000","last_unstale":"2024-09-11T11:05:10.622163+0000","last_undegraded":"2024-09-11T11:05:10.622163+0000","last_fullsized":"2024-09-11T11:05:10.622163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'25","last_scrub_stamp":"2024-09-11T11:05:10.621907+0000","last_deep_scrub":"36'25","last_deep_scrub_stamp":"2024-09-11T11:05:10.621907+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.621907+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:01:58.193453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.900932+0000","last_change":"2024-09-11T11:04:56.900932+0000","last_active":"2024-09-11T11:04:56.900932+0000","last_peered":"2024-09-11T11:04:56.900932+0000","last_clean":"2024-09-11T11:04:56.900932+0000","last_became_active":"2024-09-11T11:01:11.392208+0000","last_became_peered":"2024-09-11T11:01:11.392208+0000","last_unstale":"2024-09-11T11:04:56.900932+0000","last_undegraded":"2024-09-11T11:04:56.900932+0000","last_fullsized":"2024-09-11T11:04:56.900932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:56.900687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:56.900687+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.900687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:38.581779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.789732+0000","last_change":"2024-09-11T11:01:13.408511+0000","last_active":"2024-09-11T11:04:53.789732+0000","last_peered":"2024-09-11T11:04:53.789732+0000","last_clean":"2024-09-11T11:04:53.789732+0000","last_became_active":"2024-09-11T11:01:13.406863+0000","last_became_peered":"2024-09-11T11:01:13.406863+0000","last_unstale":"2024-09-11T11:04:53.789732+0000","last_undegraded":"2024-09-11T11:04:53.789732+0000","last_fullsized":"2024-09-11T11:04:53.789732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.751460+0000","last_change":"2024-09-11T11:05:29.751522+0000","last_active":"2024-09-11T11:05:29.751460+0000","last_peered":"2024-09-11T11:05:29.751460+0000","last_clean":"2024-09-11T11:05:29.751460+0000","last_became_active":"2024-09-11T11:01:05.332361+0000","last_became_peered":"2024-09-11T11:01:05.332361+0000","last_unstale":"2024-09-11T11:05:29.751460+0000","last_undegraded":"2024-09-11T11:05:29.751460+0000","last_fullsized":"2024-09-11T11:05:29.751460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:29.751228+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:29.751228+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.751228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:46.582523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439078+0000","last_change":"2024-09-11T11:00:55.883516+0000","last_active":"2024-09-11T11:04:52.439078+0000","last_peered":"2024-09-11T11:04:52.439078+0000","last_clean":"2024-09-11T11:04:52.439078+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:04:52.439078+0000","last_undegraded":"2024-09-11T11:04:52.439078+0000","last_fullsized":"2024-09-11T11:04:52.439078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:38.531896+0000","last_change":"2024-09-11T11:05:38.531955+0000","last_active":"2024-09-11T11:05:38.531896+0000","last_peered":"2024-09-11T11:05:38.531896+0000","last_clean":"2024-09-11T11:05:38.531896+0000","last_became_active":"2024-09-11T11:01:03.327456+0000","last_became_peered":"2024-09-11T11:01:03.327456+0000","last_unstale":"2024-09-11T11:05:38.531896+0000","last_undegraded":"2024-09-11T11:05:38.531896+0000","last_fullsized":"2024-09-11T11:05:38.531896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:38.531676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:38.531676+0000","last_clean_scrub_stamp":"2024-09-11T11:05:38.531676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:46.733365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.856498+0000","last_change":"2024-09-11T11:05:07.856498+0000","last_active":"2024-09-11T11:05:07.856498+0000","last_peered":"2024-09-11T11:05:07.856498+0000","last_clean":"2024-09-11T11:05:07.856498+0000","last_became_active":"2024-09-11T11:01:07.367962+0000","last_became_peered":"2024-09-11T11:01:07.367962+0000","last_unstale":"2024-09-11T11:05:07.856498+0000","last_undegraded":"2024-09-11T11:05:07.856498+0000","last_fullsized":"2024-09-11T11:05:07.856498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:07.856251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:07.856251+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.856251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:42.576844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'21","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.823311+0000","last_change":"2024-09-11T11:05:12.823311+0000","last_active":"2024-09-11T11:05:12.823311+0000","last_peered":"2024-09-11T11:05:12.823311+0000","last_clean":"2024-09-11T11:05:12.823311+0000","last_became_active":"2024-09-11T11:01:09.389732+0000","last_became_peered":"2024-09-11T11:01:09.389732+0000","last_unstale":"2024-09-11T11:05:12.823311+0000","last_undegraded":"2024-09-11T11:05:12.823311+0000","last_fullsized":"2024-09-11T11:05:12.823311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:12.823022+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:12.823022+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.823022+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:55.560448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.739913+0000","last_change":"2024-09-11T11:05:10.739913+0000","last_active":"2024-09-11T11:05:10.739913+0000","last_peered":"2024-09-11T11:05:10.739913+0000","last_clean":"2024-09-11T11:05:10.739913+0000","last_became_active":"2024-09-11T11:01:11.397467+0000","last_became_peered":"2024-09-11T11:01:11.397467+0000","last_unstale":"2024-09-11T11:05:10.739913+0000","last_undegraded":"2024-09-11T11:05:10.739913+0000","last_fullsized":"2024-09-11T11:05:10.739913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:10.739645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:10.739645+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.739645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:39.415587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'9","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.865986+0000","last_change":"2024-09-11T11:05:13.865986+0000","last_active":"2024-09-11T11:05:13.865986+0000","last_peered":"2024-09-11T11:05:13.865986+0000","last_clean":"2024-09-11T11:05:13.865986+0000","last_became_active":"2024-09-11T11:01:13.414898+0000","last_became_peered":"2024-09-11T11:01:13.414898+0000","last_unstale":"2024-09-11T11:05:13.865986+0000","last_undegraded":"2024-09-11T11:05:13.865986+0000","last_fullsized":"2024-09-11T11:05:13.865986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:13.865733+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:13.865733+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.865733+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:27.906253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'4","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:51.967573+0000","last_change":"2024-09-11T11:05:51.967638+0000","last_active":"2024-09-11T11:05:51.967573+0000","last_peered":"2024-09-11T11:05:51.967573+0000","last_clean":"2024-09-11T11:05:51.967573+0000","last_became_active":"2024-09-11T11:01:05.342651+0000","last_became_peered":"2024-09-11T11:01:05.342651+0000","last_unstale":"2024-09-11T11:05:51.967573+0000","last_undegraded":"2024-09-11T11:05:51.967573+0000","last_fullsized":"2024-09-11T11:05:51.967573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:51.967339+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:51.967339+0000","last_clean_scrub_stamp":"2024-09-11T11:05:51.967339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:00.169028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:39.502850+0000","last_change":"2024-09-11T11:05:39.502908+0000","last_active":"2024-09-11T11:05:39.502850+0000","last_peered":"2024-09-11T11:05:39.502850+0000","last_clean":"2024-09-11T11:05:39.502850+0000","last_became_active":"2024-09-11T11:01:03.336412+0000","last_became_peered":"2024-09-11T11:01:03.336412+0000","last_unstale":"2024-09-11T11:05:39.502850+0000","last_undegraded":"2024-09-11T11:05:39.502850+0000","last_fullsized":"2024-09-11T11:05:39.502850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:39.502654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:39.502654+0000","last_clean_scrub_stamp":"2024-09-11T11:05:39.502654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:28:26.371096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:45.831023+0000","last_change":"2024-09-11T11:05:45.831080+0000","last_active":"2024-09-11T11:05:45.831023+0000","last_peered":"2024-09-11T11:05:45.831023+0000","last_clean":"2024-09-11T11:05:45.831023+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:05:45.831023+0000","last_undegraded":"2024-09-11T11:05:45.831023+0000","last_fullsized":"2024-09-11T11:05:45.831023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:45.830816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:45.830816+0000","last_clean_scrub_stamp":"2024-09-11T11:05:45.830816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:47:38.851219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.111176+0000","last_change":"2024-09-11T11:05:10.111176+0000","last_active":"2024-09-11T11:05:10.111176+0000","last_peered":"2024-09-11T11:05:10.111176+0000","last_clean":"2024-09-11T11:05:10.111176+0000","last_became_active":"2024-09-11T11:01:07.359228+0000","last_became_peered":"2024-09-11T11:01:07.359228+0000","last_unstale":"2024-09-11T11:05:10.111176+0000","last_undegraded":"2024-09-11T11:05:10.111176+0000","last_fullsized":"2024-09-11T11:05:10.111176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:10.110911+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:10.110911+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.110911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:59:28.679839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'75","reported_seq":156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.920380+0000","last_change":"2024-09-11T11:04:53.920380+0000","last_active":"2024-09-11T11:04:53.920380+0000","last_peered":"2024-09-11T11:04:53.920380+0000","last_clean":"2024-09-11T11:04:53.920380+0000","last_became_active":"2024-09-11T11:01:09.360676+0000","last_became_peered":"2024-09-11T11:01:09.360676+0000","last_unstale":"2024-09-11T11:04:53.920380+0000","last_undegraded":"2024-09-11T11:04:53.920380+0000","last_fullsized":"2024-09-11T11:04:53.920380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'75","last_scrub_stamp":"2024-09-11T11:04:53.920094+0000","last_deep_scrub":"36'75","last_deep_scrub_stamp":"2024-09-11T11:04:53.920094+0000","last_clean_scrub_stamp":"2024-09-11T11:04:53.920094+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:28:47.374212+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.573879+0000","last_change":"2024-09-11T11:05:09.573879+0000","last_active":"2024-09-11T11:05:09.573879+0000","last_peered":"2024-09-11T11:05:09.573879+0000","last_clean":"2024-09-11T11:05:09.573879+0000","last_became_active":"2024-09-11T11:01:11.384826+0000","last_became_peered":"2024-09-11T11:01:11.384826+0000","last_unstale":"2024-09-11T11:05:09.573879+0000","last_undegraded":"2024-09-11T11:05:09.573879+0000","last_fullsized":"2024-09-11T11:05:09.573879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:09.573632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:09.573632+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.573632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:05.190454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:36.323630+0000","last_change":"2024-09-11T11:05:36.323630+0000","last_active":"2024-09-11T11:05:36.323630+0000","last_peered":"2024-09-11T11:05:36.323630+0000","last_clean":"2024-09-11T11:05:36.323630+0000","last_became_active":"2024-09-11T11:01:13.421181+0000","last_became_peered":"2024-09-11T11:01:13.421181+0000","last_unstale":"2024-09-11T11:05:36.323630+0000","last_undegraded":"2024-09-11T11:05:36.323630+0000","last_fullsized":"2024-09-11T11:05:36.323630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:36.323381+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:36.323381+0000","last_clean_scrub_stamp":"2024-09-11T11:05:36.323381+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:11:58.082941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.793875+0000","last_change":"2024-09-11T11:05:20.793990+0000","last_active":"2024-09-11T11:05:20.793875+0000","last_peered":"2024-09-11T11:05:20.793875+0000","last_clean":"2024-09-11T11:05:20.793875+0000","last_became_active":"2024-09-11T11:01:05.353896+0000","last_became_peered":"2024-09-11T11:01:05.353896+0000","last_unstale":"2024-09-11T11:05:20.793875+0000","last_undegraded":"2024-09-11T11:05:20.793875+0000","last_fullsized":"2024-09-11T11:05:20.793875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:20.793577+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:20.793577+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.793577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:36.069658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:49.965419+0000","last_change":"2024-09-11T11:05:49.965476+0000","last_active":"2024-09-11T11:05:49.965419+0000","last_peered":"2024-09-11T11:05:49.965419+0000","last_clean":"2024-09-11T11:05:49.965419+0000","last_became_active":"2024-09-11T11:01:03.324923+0000","last_became_peered":"2024-09-11T11:01:03.324923+0000","last_unstale":"2024-09-11T11:05:49.965419+0000","last_undegraded":"2024-09-11T11:05:49.965419+0000","last_fullsized":"2024-09-11T11:05:49.965419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:49.965229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:49.965229+0000","last_clean_scrub_stamp":"2024-09-11T11:05:49.965229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:22:57.195197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439091+0000","last_change":"2024-09-11T11:00:55.883708+0000","last_active":"2024-09-11T11:04:52.439091+0000","last_peered":"2024-09-11T11:04:52.439091+0000","last_clean":"2024-09-11T11:04:52.439091+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:04:52.439091+0000","last_undegraded":"2024-09-11T11:04:52.439091+0000","last_fullsized":"2024-09-11T11:04:52.439091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.566765+0000","last_change":"2024-09-11T11:04:54.566765+0000","last_active":"2024-09-11T11:04:54.566765+0000","last_peered":"2024-09-11T11:04:54.566765+0000","last_clean":"2024-09-11T11:04:54.566765+0000","last_became_active":"2024-09-11T11:01:07.360208+0000","last_became_peered":"2024-09-11T11:01:07.360208+0000","last_unstale":"2024-09-11T11:04:54.566765+0000","last_undegraded":"2024-09-11T11:04:54.566765+0000","last_fullsized":"2024-09-11T11:04:54.566765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.566514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.566514+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.566514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:47.862061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.895963+0000","last_change":"2024-09-11T11:05:02.895963+0000","last_active":"2024-09-11T11:05:02.895963+0000","last_peered":"2024-09-11T11:05:02.895963+0000","last_clean":"2024-09-11T11:05:02.895963+0000","last_became_active":"2024-09-11T11:01:09.382364+0000","last_became_peered":"2024-09-11T11:01:09.382364+0000","last_unstale":"2024-09-11T11:05:02.895963+0000","last_undegraded":"2024-09-11T11:05:02.895963+0000","last_fullsized":"2024-09-11T11:05:02.895963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:02.895625+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:02.895625+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.895625+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:58.883525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":364,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.863644+0000","last_change":"2024-09-11T11:04:57.863644+0000","last_active":"2024-09-11T11:04:57.863644+0000","last_peered":"2024-09-11T11:04:57.863644+0000","last_clean":"2024-09-11T11:04:57.863644+0000","last_became_active":"2024-09-11T11:01:11.395016+0000","last_became_peered":"2024-09-11T11:01:11.395016+0000","last_unstale":"2024-09-11T11:04:57.863644+0000","last_undegraded":"2024-09-11T11:04:57.863644+0000","last_fullsized":"2024-09-11T11:04:57.863644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:04:57.863404+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:04:57.863404+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.863404+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:48.423461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'2","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.789763+0000","last_change":"2024-09-11T11:01:13.423655+0000","last_active":"2024-09-11T11:04:53.789763+0000","last_peered":"2024-09-11T11:04:53.789763+0000","last_clean":"2024-09-11T11:04:53.789763+0000","last_became_active":"2024-09-11T11:01:13.422825+0000","last_became_peered":"2024-09-11T11:01:13.422825+0000","last_unstale":"2024-09-11T11:04:53.789763+0000","last_undegraded":"2024-09-11T11:04:53.789763+0000","last_fullsized":"2024-09-11T11:04:53.789763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'12","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:40.321522+0000","last_change":"2024-09-11T11:05:40.321522+0000","last_active":"2024-09-11T11:05:40.321522+0000","last_peered":"2024-09-11T11:05:40.321522+0000","last_clean":"2024-09-11T11:05:40.321522+0000","last_became_active":"2024-09-11T11:01:42.049256+0000","last_became_peered":"2024-09-11T11:01:42.049256+0000","last_unstale":"2024-09-11T11:05:40.321522+0000","last_undegraded":"2024-09-11T11:05:40.321522+0000","last_fullsized":"2024-09-11T11:05:40.321522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:40.321274+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:40.321274+0000","last_clean_scrub_stamp":"2024-09-11T11:05:40.321274+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:24.506137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:40.911403+0000","last_change":"2024-09-11T11:05:40.911461+0000","last_active":"2024-09-11T11:05:40.911403+0000","last_peered":"2024-09-11T11:05:40.911403+0000","last_clean":"2024-09-11T11:05:40.911403+0000","last_became_active":"2024-09-11T11:01:03.349487+0000","last_became_peered":"2024-09-11T11:01:03.349487+0000","last_unstale":"2024-09-11T11:05:40.911403+0000","last_undegraded":"2024-09-11T11:05:40.911403+0000","last_fullsized":"2024-09-11T11:05:40.911403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:40.911211+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:40.911211+0000","last_clean_scrub_stamp":"2024-09-11T11:05:40.911211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:23:15.801381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:44.818890+0000","last_change":"2024-09-11T11:05:44.818945+0000","last_active":"2024-09-11T11:05:44.818890+0000","last_peered":"2024-09-11T11:05:44.818890+0000","last_clean":"2024-09-11T11:05:44.818890+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:05:44.818890+0000","last_undegraded":"2024-09-11T11:05:44.818890+0000","last_fullsized":"2024-09-11T11:05:44.818890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:44.818698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:44.818698+0000","last_clean_scrub_stamp":"2024-09-11T11:05:44.818698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:49:58.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.474692+0000","last_change":"2024-09-11T11:05:00.474692+0000","last_active":"2024-09-11T11:05:00.474692+0000","last_peered":"2024-09-11T11:05:00.474692+0000","last_clean":"2024-09-11T11:05:00.474692+0000","last_became_active":"2024-09-11T11:01:07.344021+0000","last_became_peered":"2024-09-11T11:01:07.344021+0000","last_unstale":"2024-09-11T11:05:00.474692+0000","last_undegraded":"2024-09-11T11:05:00.474692+0000","last_fullsized":"2024-09-11T11:05:00.474692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.474433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.474433+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.474433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:50:53.854590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.695956+0000","last_change":"2024-09-11T11:04:56.695956+0000","last_active":"2024-09-11T11:04:56.695956+0000","last_peered":"2024-09-11T11:04:56.695956+0000","last_clean":"2024-09-11T11:04:56.695956+0000","last_became_active":"2024-09-11T11:01:09.379372+0000","last_became_peered":"2024-09-11T11:01:09.379372+0000","last_unstale":"2024-09-11T11:04:56.695956+0000","last_undegraded":"2024-09-11T11:04:56.695956+0000","last_fullsized":"2024-09-11T11:04:56.695956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:04:56.695654+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:04:56.695654+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.695654+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:10.244955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'286","reported_seq":436,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.884364+0000","last_change":"2024-09-11T11:05:26.884426+0000","last_active":"2024-09-11T11:05:26.884364+0000","last_peered":"2024-09-11T11:05:26.884364+0000","last_clean":"2024-09-11T11:05:26.884364+0000","last_became_active":"2024-09-11T11:01:11.403355+0000","last_became_peered":"2024-09-11T11:01:11.403355+0000","last_unstale":"2024-09-11T11:05:26.884364+0000","last_undegraded":"2024-09-11T11:05:26.884364+0000","last_fullsized":"2024-09-11T11:05:26.884364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-11T11:05:26.884181+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-11T11:05:26.884181+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.884181+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:03.502606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.883598+0000","last_change":"2024-09-11T11:01:13.420938+0000","last_active":"2024-09-11T11:04:52.883598+0000","last_peered":"2024-09-11T11:04:52.883598+0000","last_clean":"2024-09-11T11:04:52.883598+0000","last_became_active":"2024-09-11T11:01:13.415413+0000","last_became_peered":"2024-09-11T11:01:13.415413+0000","last_unstale":"2024-09-11T11:04:52.883598+0000","last_undegraded":"2024-09-11T11:04:52.883598+0000","last_fullsized":"2024-09-11T11:04:52.883598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.122525+0000","last_change":"2024-09-11T11:05:16.122525+0000","last_active":"2024-09-11T11:05:16.122525+0000","last_peered":"2024-09-11T11:05:16.122525+0000","last_clean":"2024-09-11T11:05:16.122525+0000","last_became_active":"2024-09-11T11:01:05.338465+0000","last_became_peered":"2024-09-11T11:01:05.338465+0000","last_unstale":"2024-09-11T11:05:16.122525+0000","last_undegraded":"2024-09-11T11:05:16.122525+0000","last_fullsized":"2024-09-11T11:05:16.122525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:16.122266+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:16.122266+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.122266+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:53:41.559513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:42.817565+0000","last_change":"2024-09-11T11:05:42.817627+0000","last_active":"2024-09-11T11:05:42.817565+0000","last_peered":"2024-09-11T11:05:42.817565+0000","last_clean":"2024-09-11T11:05:42.817565+0000","last_became_active":"2024-09-11T11:01:03.325009+0000","last_became_peered":"2024-09-11T11:01:03.325009+0000","last_unstale":"2024-09-11T11:05:42.817565+0000","last_undegraded":"2024-09-11T11:05:42.817565+0000","last_fullsized":"2024-09-11T11:05:42.817565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:42.817373+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:42.817373+0000","last_clean_scrub_stamp":"2024-09-11T11:05:42.817373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:49.036208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439149+0000","last_change":"2024-09-11T11:00:55.884159+0000","last_active":"2024-09-11T11:04:52.439149+0000","last_peered":"2024-09-11T11:04:52.439149+0000","last_clean":"2024-09-11T11:04:52.439149+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:04:52.439149+0000","last_undegraded":"2024-09-11T11:04:52.439149+0000","last_fullsized":"2024-09-11T11:04:52.439149+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:00:52.854226+0000","last_clean_scrub_stamp":"2024-09-11T11:00:52.854226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.729363+0000","last_change":"2024-09-11T11:05:03.729363+0000","last_active":"2024-09-11T11:05:03.729363+0000","last_peered":"2024-09-11T11:05:03.729363+0000","last_clean":"2024-09-11T11:05:03.729363+0000","last_became_active":"2024-09-11T11:01:07.363499+0000","last_became_peered":"2024-09-11T11:01:07.363499+0000","last_unstale":"2024-09-11T11:05:03.729363+0000","last_undegraded":"2024-09-11T11:05:03.729363+0000","last_fullsized":"2024-09-11T11:05:03.729363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:03.729049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:03.729049+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.729049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:46:05.674496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'96","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.645636+0000","last_change":"2024-09-11T11:05:12.645636+0000","last_active":"2024-09-11T11:05:12.645636+0000","last_peered":"2024-09-11T11:05:12.645636+0000","last_clean":"2024-09-11T11:05:12.645636+0000","last_became_active":"2024-09-11T11:01:09.371312+0000","last_became_peered":"2024-09-11T11:01:09.371312+0000","last_unstale":"2024-09-11T11:05:12.645636+0000","last_undegraded":"2024-09-11T11:05:12.645636+0000","last_fullsized":"2024-09-11T11:05:12.645636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-09-11T11:05:12.645367+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-09-11T11:05:12.645367+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.645367+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:06.981705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.747278+0000","last_change":"2024-09-11T11:05:07.747278+0000","last_active":"2024-09-11T11:05:07.747278+0000","last_peered":"2024-09-11T11:05:07.747278+0000","last_clean":"2024-09-11T11:05:07.747278+0000","last_became_active":"2024-09-11T11:01:11.383342+0000","last_became_peered":"2024-09-11T11:01:11.383342+0000","last_unstale":"2024-09-11T11:05:07.747278+0000","last_undegraded":"2024-09-11T11:05:07.747278+0000","last_fullsized":"2024-09-11T11:05:07.747278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:07.747023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:07.747023+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.747023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:47.852841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.101719+0000","last_change":"2024-09-11T11:04:54.101719+0000","last_active":"2024-09-11T11:04:54.101719+0000","last_peered":"2024-09-11T11:04:54.101719+0000","last_clean":"2024-09-11T11:04:54.101719+0000","last_became_active":"2024-09-11T11:01:13.413156+0000","last_became_peered":"2024-09-11T11:01:13.413156+0000","last_unstale":"2024-09-11T11:04:54.101719+0000","last_undegraded":"2024-09-11T11:04:54.101719+0000","last_fullsized":"2024-09-11T11:04:54.101719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.101491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.101491+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.101491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:08.443409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.084086+0000","last_change":"2024-09-11T11:04:57.084086+0000","last_active":"2024-09-11T11:04:57.084086+0000","last_peered":"2024-09-11T11:04:57.084086+0000","last_clean":"2024-09-11T11:04:57.084086+0000","last_became_active":"2024-09-11T11:01:13.413535+0000","last_became_peered":"2024-09-11T11:01:13.413535+0000","last_unstale":"2024-09-11T11:04:57.084086+0000","last_undegraded":"2024-09-11T11:04:57.084086+0000","last_fullsized":"2024-09-11T11:04:57.084086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:57.083842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:57.083842+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.083842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:07:45.181339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.135493+0000","last_change":"2024-09-11T11:05:18.135493+0000","last_active":"2024-09-11T11:05:18.135493+0000","last_peered":"2024-09-11T11:05:18.135493+0000","last_clean":"2024-09-11T11:05:18.135493+0000","last_became_active":"2024-09-11T11:01:05.337509+0000","last_became_peered":"2024-09-11T11:01:05.337509+0000","last_unstale":"2024-09-11T11:05:18.135493+0000","last_undegraded":"2024-09-11T11:05:18.135493+0000","last_fullsized":"2024-09-11T11:05:18.135493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-11T11:05:18.135238+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-11T11:05:18.135238+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.135238+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:48:42.915671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.439610+0000","last_change":"2024-09-11T11:01:03.321762+0000","last_active":"2024-09-11T11:04:52.439610+0000","last_peered":"2024-09-11T11:04:52.439610+0000","last_clean":"2024-09-11T11:04:52.439610+0000","last_became_active":"2024-09-11T11:01:03.320981+0000","last_became_peered":"2024-09-11T11:01:03.320981+0000","last_unstale":"2024-09-11T11:04:52.439610+0000","last_undegraded":"2024-09-11T11:04:52.439610+0000","last_fullsized":"2024-09-11T11:04:52.439610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.904364+0000","last_change":"2024-09-11T11:05:08.904364+0000","last_active":"2024-09-11T11:05:08.904364+0000","last_peered":"2024-09-11T11:05:08.904364+0000","last_clean":"2024-09-11T11:05:08.904364+0000","last_became_active":"2024-09-11T11:01:07.367778+0000","last_became_peered":"2024-09-11T11:01:07.367778+0000","last_unstale":"2024-09-11T11:05:08.904364+0000","last_undegraded":"2024-09-11T11:05:08.904364+0000","last_fullsized":"2024-09-11T11:05:08.904364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:08.904124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:08.904124+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.904124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:30:05.699592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.666250+0000","last_change":"2024-09-11T11:04:57.666250+0000","last_active":"2024-09-11T11:04:57.666250+0000","last_peered":"2024-09-11T11:04:57.666250+0000","last_clean":"2024-09-11T11:04:57.666250+0000","last_became_active":"2024-09-11T11:01:09.369318+0000","last_became_peered":"2024-09-11T11:01:09.369318+0000","last_unstale":"2024-09-11T11:04:57.666250+0000","last_undegraded":"2024-09-11T11:04:57.666250+0000","last_fullsized":"2024-09-11T11:04:57.666250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-11T11:04:57.665979+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-11T11:04:57.665979+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.665979+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:54:56.063485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.760491+0000","last_change":"2024-09-11T11:05:06.760491+0000","last_active":"2024-09-11T11:05:06.760491+0000","last_peered":"2024-09-11T11:05:06.760491+0000","last_clean":"2024-09-11T11:05:06.760491+0000","last_became_active":"2024-09-11T11:01:11.396833+0000","last_became_peered":"2024-09-11T11:01:11.396833+0000","last_unstale":"2024-09-11T11:05:06.760491+0000","last_undegraded":"2024-09-11T11:05:06.760491+0000","last_fullsized":"2024-09-11T11:05:06.760491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:06.760244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:06.760244+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.760244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:21:01.442882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.789907+0000","last_change":"2024-09-11T11:01:13.408361+0000","last_active":"2024-09-11T11:04:53.789907+0000","last_peered":"2024-09-11T11:04:53.789907+0000","last_clean":"2024-09-11T11:04:53.789907+0000","last_became_active":"2024-09-11T11:01:13.407663+0000","last_became_peered":"2024-09-11T11:01:13.407663+0000","last_unstale":"2024-09-11T11:04:53.789907+0000","last_undegraded":"2024-09-11T11:04:53.789907+0000","last_fullsized":"2024-09-11T11:04:53.789907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:35.793127+0000","last_change":"2024-09-11T11:05:35.793127+0000","last_active":"2024-09-11T11:05:35.793127+0000","last_peered":"2024-09-11T11:05:35.793127+0000","last_clean":"2024-09-11T11:05:35.793127+0000","last_became_active":"2024-09-11T11:01:05.340457+0000","last_became_peered":"2024-09-11T11:01:05.340457+0000","last_unstale":"2024-09-11T11:05:35.793127+0000","last_undegraded":"2024-09-11T11:05:35.793127+0000","last_fullsized":"2024-09-11T11:05:35.793127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:35.792888+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:35.792888+0000","last_clean_scrub_stamp":"2024-09-11T11:05:35.792888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:59:24.482862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.224918+0000","last_change":"2024-09-11T11:05:26.224918+0000","last_active":"2024-09-11T11:05:26.224918+0000","last_peered":"2024-09-11T11:05:26.224918+0000","last_clean":"2024-09-11T11:05:26.224918+0000","last_became_active":"2024-09-11T11:01:03.335235+0000","last_became_peered":"2024-09-11T11:01:03.335235+0000","last_unstale":"2024-09-11T11:05:26.224918+0000","last_undegraded":"2024-09-11T11:05:26.224918+0000","last_fullsized":"2024-09-11T11:05:26.224918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:26.224557+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:26.224557+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.224557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:35:54.595969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.663228+0000","last_change":"2024-09-11T11:04:59.663228+0000","last_active":"2024-09-11T11:04:59.663228+0000","last_peered":"2024-09-11T11:04:59.663228+0000","last_clean":"2024-09-11T11:04:59.663228+0000","last_became_active":"2024-09-11T11:02:42.501867+0000","last_became_peered":"2024-09-11T11:02:42.501867+0000","last_unstale":"2024-09-11T11:04:59.663228+0000","last_undegraded":"2024-09-11T11:04:59.663228+0000","last_fullsized":"2024-09-11T11:04:59.663228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.662970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.662970+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.662970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:06.928697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.868678+0000","last_change":"2024-09-11T11:05:06.868678+0000","last_active":"2024-09-11T11:05:06.868678+0000","last_peered":"2024-09-11T11:05:06.868678+0000","last_clean":"2024-09-11T11:05:06.868678+0000","last_became_active":"2024-09-11T11:01:09.362975+0000","last_became_peered":"2024-09-11T11:01:09.362975+0000","last_unstale":"2024-09-11T11:05:06.868678+0000","last_undegraded":"2024-09-11T11:05:06.868678+0000","last_fullsized":"2024-09-11T11:05:06.868678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:06.868398+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:06.868398+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.868398+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:14.134126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.975001+0000","last_change":"2024-09-11T11:05:01.975001+0000","last_active":"2024-09-11T11:05:01.975001+0000","last_peered":"2024-09-11T11:05:01.975001+0000","last_clean":"2024-09-11T11:05:01.975001+0000","last_became_active":"2024-09-11T11:01:11.393181+0000","last_became_peered":"2024-09-11T11:01:11.393181+0000","last_unstale":"2024-09-11T11:05:01.975001+0000","last_undegraded":"2024-09-11T11:05:01.975001+0000","last_fullsized":"2024-09-11T11:05:01.975001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.974738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.974738+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.974738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:29.665900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'8","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:52.952703+0000","last_change":"2024-09-11T11:05:52.952771+0000","last_active":"2024-09-11T11:05:52.952703+0000","last_peered":"2024-09-11T11:05:52.952703+0000","last_clean":"2024-09-11T11:05:52.952703+0000","last_became_active":"2024-09-11T11:01:13.419238+0000","last_became_peered":"2024-09-11T11:01:13.419238+0000","last_unstale":"2024-09-11T11:05:52.952703+0000","last_undegraded":"2024-09-11T11:05:52.952703+0000","last_fullsized":"2024-09-11T11:05:52.952703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:52.952478+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:52.952478+0000","last_clean_scrub_stamp":"2024-09-11T11:05:52.952478+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:28:39.820919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'10","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:41.308773+0000","last_change":"2024-09-11T11:05:41.308946+0000","last_active":"2024-09-11T11:05:41.308773+0000","last_peered":"2024-09-11T11:05:41.308773+0000","last_clean":"2024-09-11T11:05:41.308773+0000","last_became_active":"2024-09-11T11:01:42.058258+0000","last_became_peered":"2024-09-11T11:01:42.058258+0000","last_unstale":"2024-09-11T11:05:41.308773+0000","last_undegraded":"2024-09-11T11:05:41.308773+0000","last_fullsized":"2024-09-11T11:05:41.308773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-11T11:05:41.308518+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-11T11:05:41.308518+0000","last_clean_scrub_stamp":"2024-09-11T11:05:41.308518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:41:32.809838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:45.602033+0000","last_change":"2024-09-11T11:05:45.602087+0000","last_active":"2024-09-11T11:05:45.602033+0000","last_peered":"2024-09-11T11:05:45.602033+0000","last_clean":"2024-09-11T11:05:45.602033+0000","last_became_active":"2024-09-11T11:01:03.337144+0000","last_became_peered":"2024-09-11T11:01:03.337144+0000","last_unstale":"2024-09-11T11:05:45.602033+0000","last_undegraded":"2024-09-11T11:05:45.602033+0000","last_fullsized":"2024-09-11T11:05:45.602033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:45.601834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:45.601834+0000","last_clean_scrub_stamp":"2024-09-11T11:05:45.601834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:15.978339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"36'5","reported_seq":243,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.547593+0000","last_change":"2024-09-11T11:04:58.547593+0000","last_active":"2024-09-11T11:04:58.547593+0000","last_peered":"2024-09-11T11:04:58.547593+0000","last_clean":"2024-09-11T11:04:58.547593+0000","last_became_active":"2024-09-11T11:01:07.358156+0000","last_became_peered":"2024-09-11T11:01:07.358156+0000","last_unstale":"2024-09-11T11:04:58.547593+0000","last_undegraded":"2024-09-11T11:04:58.547593+0000","last_fullsized":"2024-09-11T11:04:58.547593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-11T11:04:58.547344+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-11T11:04:58.547344+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.547344+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:46:00.492791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'50","reported_seq":127,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.732707+0000","last_change":"2024-09-11T11:05:02.732707+0000","last_active":"2024-09-11T11:05:02.732707+0000","last_peered":"2024-09-11T11:05:02.732707+0000","last_clean":"2024-09-11T11:05:02.732707+0000","last_became_active":"2024-09-11T11:01:09.380595+0000","last_became_peered":"2024-09-11T11:01:09.380595+0000","last_unstale":"2024-09-11T11:05:02.732707+0000","last_undegraded":"2024-09-11T11:05:02.732707+0000","last_fullsized":"2024-09-11T11:05:02.732707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'50","last_scrub_stamp":"2024-09-11T11:05:02.732310+0000","last_deep_scrub":"36'50","last_deep_scrub_stamp":"2024-09-11T11:05:02.732310+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.732310+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:04.576806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":83,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.877523+0000","last_change":"2024-09-11T11:05:01.877523+0000","last_active":"2024-09-11T11:05:01.877523+0000","last_peered":"2024-09-11T11:05:01.877523+0000","last_clean":"2024-09-11T11:05:01.877523+0000","last_became_active":"2024-09-11T11:01:11.401847+0000","last_became_peered":"2024-09-11T11:01:11.401847+0000","last_unstale":"2024-09-11T11:05:01.877523+0000","last_undegraded":"2024-09-11T11:05:01.877523+0000","last_fullsized":"2024-09-11T11:05:01.877523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.877282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.877282+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.877282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:36.973759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:34.978917+0000","last_change":"2024-09-11T11:05:34.978971+0000","last_active":"2024-09-11T11:05:34.978917+0000","last_peered":"2024-09-11T11:05:34.978917+0000","last_clean":"2024-09-11T11:05:34.978917+0000","last_became_active":"2024-09-11T11:01:13.395231+0000","last_became_peered":"2024-09-11T11:01:13.395231+0000","last_unstale":"2024-09-11T11:05:34.978917+0000","last_undegraded":"2024-09-11T11:05:34.978917+0000","last_fullsized":"2024-09-11T11:05:34.978917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:34.978741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:34.978741+0000","last_clean_scrub_stamp":"2024-09-11T11:05:34.978741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:07:25.619468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'12","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.785513+0000","last_change":"2024-09-11T11:05:20.785513+0000","last_active":"2024-09-11T11:05:20.785513+0000","last_peered":"2024-09-11T11:05:20.785513+0000","last_clean":"2024-09-11T11:05:20.785513+0000","last_became_active":"2024-09-11T11:01:05.348002+0000","last_became_peered":"2024-09-11T11:01:05.348002+0000","last_unstale":"2024-09-11T11:05:20.785513+0000","last_undegraded":"2024-09-11T11:05:20.785513+0000","last_fullsized":"2024-09-11T11:05:20.785513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:20.785263+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:20.785263+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.785263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:15:03.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:38.815600+0000","last_change":"2024-09-11T11:05:38.815600+0000","last_active":"2024-09-11T11:05:38.815600+0000","last_peered":"2024-09-11T11:05:38.815600+0000","last_clean":"2024-09-11T11:05:38.815600+0000","last_became_active":"2024-09-11T11:01:03.330782+0000","last_became_peered":"2024-09-11T11:01:03.330782+0000","last_unstale":"2024-09-11T11:05:38.815600+0000","last_undegraded":"2024-09-11T11:05:38.815600+0000","last_fullsized":"2024-09-11T11:05:38.815600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:38.815353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:38.815353+0000","last_clean_scrub_stamp":"2024-09-11T11:05:38.815353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:13:21.421632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.796271+0000","last_change":"2024-09-11T11:05:19.796271+0000","last_active":"2024-09-11T11:05:19.796271+0000","last_peered":"2024-09-11T11:05:19.796271+0000","last_clean":"2024-09-11T11:05:19.796271+0000","last_became_active":"2024-09-11T11:01:07.350685+0000","last_became_peered":"2024-09-11T11:01:07.350685+0000","last_unstale":"2024-09-11T11:05:19.796271+0000","last_undegraded":"2024-09-11T11:05:19.796271+0000","last_fullsized":"2024-09-11T11:05:19.796271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:19.796009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:19.796009+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.796009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:34:29.117828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'37","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.597808+0000","last_change":"2024-09-11T11:04:55.597808+0000","last_active":"2024-09-11T11:04:55.597808+0000","last_peered":"2024-09-11T11:04:55.597808+0000","last_clean":"2024-09-11T11:04:55.597808+0000","last_became_active":"2024-09-11T11:01:09.362483+0000","last_became_peered":"2024-09-11T11:01:09.362483+0000","last_unstale":"2024-09-11T11:04:55.597808+0000","last_undegraded":"2024-09-11T11:04:55.597808+0000","last_fullsized":"2024-09-11T11:04:55.597808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:04:55.597543+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:04:55.597543+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.597543+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:28.136198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.018297+0000","last_change":"2024-09-11T11:04:59.018297+0000","last_active":"2024-09-11T11:04:59.018297+0000","last_peered":"2024-09-11T11:04:59.018297+0000","last_clean":"2024-09-11T11:04:59.018297+0000","last_became_active":"2024-09-11T11:01:11.398843+0000","last_became_peered":"2024-09-11T11:01:11.398843+0000","last_unstale":"2024-09-11T11:04:59.018297+0000","last_undegraded":"2024-09-11T11:04:59.018297+0000","last_fullsized":"2024-09-11T11:04:59.018297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.018045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.018045+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.018045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:30:20.573633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.485209+0000","last_change":"2024-09-11T11:05:22.485267+0000","last_active":"2024-09-11T11:05:22.485209+0000","last_peered":"2024-09-11T11:05:22.485209+0000","last_clean":"2024-09-11T11:05:22.485209+0000","last_became_active":"2024-09-11T11:01:05.347496+0000","last_became_peered":"2024-09-11T11:01:05.347496+0000","last_unstale":"2024-09-11T11:05:22.485209+0000","last_undegraded":"2024-09-11T11:05:22.485209+0000","last_fullsized":"2024-09-11T11:05:22.485209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:22.485029+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:22.485029+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.485029+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:12.896348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:39.911197+0000","last_change":"2024-09-11T11:05:39.911197+0000","last_active":"2024-09-11T11:05:39.911197+0000","last_peered":"2024-09-11T11:05:39.911197+0000","last_clean":"2024-09-11T11:05:39.911197+0000","last_became_active":"2024-09-11T11:01:03.348849+0000","last_became_peered":"2024-09-11T11:01:03.348849+0000","last_unstale":"2024-09-11T11:05:39.911197+0000","last_undegraded":"2024-09-11T11:05:39.911197+0000","last_fullsized":"2024-09-11T11:05:39.911197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:39.910952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:39.910952+0000","last_clean_scrub_stamp":"2024-09-11T11:05:39.910952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:11.858531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.904463+0000","last_change":"2024-09-11T11:05:12.904513+0000","last_active":"2024-09-11T11:05:12.904463+0000","last_peered":"2024-09-11T11:05:12.904463+0000","last_clean":"2024-09-11T11:05:12.904463+0000","last_became_active":"2024-09-11T11:01:07.365953+0000","last_became_peered":"2024-09-11T11:01:07.365953+0000","last_unstale":"2024-09-11T11:05:12.904463+0000","last_undegraded":"2024-09-11T11:05:12.904463+0000","last_fullsized":"2024-09-11T11:05:12.904463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:12.904281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:12.904281+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.904281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:06.284437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":140,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.899052+0000","last_change":"2024-09-11T11:05:04.899131+0000","last_active":"2024-09-11T11:05:04.899052+0000","last_peered":"2024-09-11T11:05:04.899052+0000","last_clean":"2024-09-11T11:05:04.899052+0000","last_became_active":"2024-09-11T11:01:09.374937+0000","last_became_peered":"2024-09-11T11:01:09.374937+0000","last_unstale":"2024-09-11T11:05:04.899052+0000","last_undegraded":"2024-09-11T11:05:04.899052+0000","last_fullsized":"2024-09-11T11:05:04.899052+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-11T11:05:04.898835+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-11T11:05:04.898835+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.898835+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:55:03.296341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.012953+0000","last_change":"2024-09-11T11:05:00.013009+0000","last_active":"2024-09-11T11:05:00.012953+0000","last_peered":"2024-09-11T11:05:00.012953+0000","last_clean":"2024-09-11T11:05:00.012953+0000","last_became_active":"2024-09-11T11:01:11.394849+0000","last_became_peered":"2024-09-11T11:01:11.394849+0000","last_unstale":"2024-09-11T11:05:00.012953+0000","last_undegraded":"2024-09-11T11:05:00.012953+0000","last_fullsized":"2024-09-11T11:05:00.012953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.012754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.012754+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.012754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:50.213447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.790037+0000","last_change":"2024-09-11T11:01:13.416940+0000","last_active":"2024-09-11T11:04:53.790037+0000","last_peered":"2024-09-11T11:04:53.790037+0000","last_clean":"2024-09-11T11:04:53.790037+0000","last_became_active":"2024-09-11T11:01:13.416414+0000","last_became_peered":"2024-09-11T11:01:13.416414+0000","last_unstale":"2024-09-11T11:04:53.790037+0000","last_undegraded":"2024-09-11T11:04:53.790037+0000","last_fullsized":"2024-09-11T11:04:53.790037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.777103+0000","last_change":"2024-09-11T11:05:31.777167+0000","last_active":"2024-09-11T11:05:31.777103+0000","last_peered":"2024-09-11T11:05:31.777103+0000","last_clean":"2024-09-11T11:05:31.777103+0000","last_became_active":"2024-09-11T11:01:05.339898+0000","last_became_peered":"2024-09-11T11:01:05.339898+0000","last_unstale":"2024-09-11T11:05:31.777103+0000","last_undegraded":"2024-09-11T11:05:31.777103+0000","last_fullsized":"2024-09-11T11:05:31.777103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:31.776907+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:31.776907+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.776907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:10.381824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881350+0000","last_change":"2024-09-11T11:01:42.094568+0000","last_active":"2024-09-11T11:04:52.881350+0000","last_peered":"2024-09-11T11:04:52.881350+0000","last_clean":"2024-09-11T11:04:52.881350+0000","last_became_active":"2024-09-11T11:01:42.058648+0000","last_became_peered":"2024-09-11T11:01:42.058648+0000","last_unstale":"2024-09-11T11:04:52.881350+0000","last_undegraded":"2024-09-11T11:04:52.881350+0000","last_fullsized":"2024-09-11T11:04:52.881350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.564057+0000","last_change":"2024-09-11T11:05:16.564057+0000","last_active":"2024-09-11T11:05:16.564057+0000","last_peered":"2024-09-11T11:05:16.564057+0000","last_clean":"2024-09-11T11:05:16.564057+0000","last_became_active":"2024-09-11T11:01:07.340147+0000","last_became_peered":"2024-09-11T11:01:07.340147+0000","last_unstale":"2024-09-11T11:05:16.564057+0000","last_undegraded":"2024-09-11T11:05:16.564057+0000","last_fullsized":"2024-09-11T11:05:16.564057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.563796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.563796+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.563796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:18.185050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.646330+0000","last_change":"2024-09-11T11:05:11.646407+0000","last_active":"2024-09-11T11:05:11.646330+0000","last_peered":"2024-09-11T11:05:11.646330+0000","last_clean":"2024-09-11T11:05:11.646330+0000","last_became_active":"2024-09-11T11:01:09.371522+0000","last_became_peered":"2024-09-11T11:01:09.371522+0000","last_unstale":"2024-09-11T11:05:11.646330+0000","last_undegraded":"2024-09-11T11:05:11.646330+0000","last_fullsized":"2024-09-11T11:05:11.646330+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:05:11.646224+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:05:11.646224+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.646224+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:29:32.853566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.888423+0000","last_change":"2024-09-11T11:04:55.888485+0000","last_active":"2024-09-11T11:04:55.888423+0000","last_peered":"2024-09-11T11:04:55.888423+0000","last_clean":"2024-09-11T11:04:55.888423+0000","last_became_active":"2024-09-11T11:01:11.392489+0000","last_became_peered":"2024-09-11T11:01:11.392489+0000","last_unstale":"2024-09-11T11:04:55.888423+0000","last_undegraded":"2024-09-11T11:04:55.888423+0000","last_fullsized":"2024-09-11T11:04:55.888423+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:55.888202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:55.888202+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.888202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:10:13.122333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042146+0000","last_change":"2024-09-11T11:01:13.405032+0000","last_active":"2024-09-11T11:03:36.042146+0000","last_peered":"2024-09-11T11:03:36.042146+0000","last_clean":"2024-09-11T11:03:36.042146+0000","last_became_active":"2024-09-11T11:01:13.404341+0000","last_became_peered":"2024-09-11T11:01:13.404341+0000","last_unstale":"2024-09-11T11:03:36.042146+0000","last_undegraded":"2024-09-11T11:03:36.042146+0000","last_fullsized":"2024-09-11T11:03:36.042146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'18","reported_seq":89,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.804764+0000","last_change":"2024-09-11T11:05:21.804823+0000","last_active":"2024-09-11T11:05:21.804764+0000","last_peered":"2024-09-11T11:05:21.804764+0000","last_clean":"2024-09-11T11:05:21.804764+0000","last_became_active":"2024-09-11T11:01:05.347745+0000","last_became_peered":"2024-09-11T11:01:05.347745+0000","last_unstale":"2024-09-11T11:05:21.804764+0000","last_undegraded":"2024-09-11T11:05:21.804764+0000","last_fullsized":"2024-09-11T11:05:21.804764+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:21.804546+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:21.804546+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.804546+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:23.425800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:50.719916+0000","last_change":"2024-09-11T11:05:50.719967+0000","last_active":"2024-09-11T11:05:50.719916+0000","last_peered":"2024-09-11T11:05:50.719916+0000","last_clean":"2024-09-11T11:05:50.719916+0000","last_became_active":"2024-09-11T11:01:03.321106+0000","last_became_peered":"2024-09-11T11:01:03.321106+0000","last_unstale":"2024-09-11T11:05:50.719916+0000","last_undegraded":"2024-09-11T11:05:50.719916+0000","last_fullsized":"2024-09-11T11:05:50.719916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:50.719719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:50.719719+0000","last_clean_scrub_stamp":"2024-09-11T11:05:50.719719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:11.794125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.487689+0000","last_change":"2024-09-11T11:05:02.487740+0000","last_active":"2024-09-11T11:05:02.487689+0000","last_peered":"2024-09-11T11:05:02.487689+0000","last_clean":"2024-09-11T11:05:02.487689+0000","last_became_active":"2024-09-11T11:01:07.342760+0000","last_became_peered":"2024-09-11T11:01:07.342760+0000","last_unstale":"2024-09-11T11:05:02.487689+0000","last_undegraded":"2024-09-11T11:05:02.487689+0000","last_fullsized":"2024-09-11T11:05:02.487689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:02.487502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:02.487502+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.487502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:42.593320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'41","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.821592+0000","last_change":"2024-09-11T11:05:13.821592+0000","last_active":"2024-09-11T11:05:13.821592+0000","last_peered":"2024-09-11T11:05:13.821592+0000","last_clean":"2024-09-11T11:05:13.821592+0000","last_became_active":"2024-09-11T11:01:09.389548+0000","last_became_peered":"2024-09-11T11:01:09.389548+0000","last_unstale":"2024-09-11T11:05:13.821592+0000","last_undegraded":"2024-09-11T11:05:13.821592+0000","last_fullsized":"2024-09-11T11:05:13.821592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-11T11:05:13.821343+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-11T11:05:13.821343+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.821343+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:01:03.574623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.814732+0000","last_change":"2024-09-11T11:04:58.814732+0000","last_active":"2024-09-11T11:04:58.814732+0000","last_peered":"2024-09-11T11:04:58.814732+0000","last_clean":"2024-09-11T11:04:58.814732+0000","last_became_active":"2024-09-11T11:01:11.391080+0000","last_became_peered":"2024-09-11T11:01:11.391080+0000","last_unstale":"2024-09-11T11:04:58.814732+0000","last_undegraded":"2024-09-11T11:04:58.814732+0000","last_fullsized":"2024-09-11T11:04:58.814732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:58.814489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:58.814489+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.814489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:30:05.782233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042125+0000","last_change":"2024-09-11T11:01:13.421751+0000","last_active":"2024-09-11T11:03:36.042125+0000","last_peered":"2024-09-11T11:03:36.042125+0000","last_clean":"2024-09-11T11:03:36.042125+0000","last_became_active":"2024-09-11T11:01:13.420844+0000","last_became_peered":"2024-09-11T11:01:13.420844+0000","last_unstale":"2024-09-11T11:03:36.042125+0000","last_undegraded":"2024-09-11T11:03:36.042125+0000","last_fullsized":"2024-09-11T11:03:36.042125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":73,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.077237+0000","last_change":"2024-09-11T11:05:14.077302+0000","last_active":"2024-09-11T11:05:14.077237+0000","last_peered":"2024-09-11T11:05:14.077237+0000","last_clean":"2024-09-11T11:05:14.077237+0000","last_became_active":"2024-09-11T11:01:05.338036+0000","last_became_peered":"2024-09-11T11:01:05.338036+0000","last_unstale":"2024-09-11T11:05:14.077237+0000","last_undegraded":"2024-09-11T11:05:14.077237+0000","last_fullsized":"2024-09-11T11:05:14.077237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:14.077033+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:14.077033+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.077033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:34:09.324339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.914162+0000","last_change":"2024-09-11T11:01:03.336252+0000","last_active":"2024-09-11T11:04:17.914162+0000","last_peered":"2024-09-11T11:04:17.914162+0000","last_clean":"2024-09-11T11:04:17.914162+0000","last_became_active":"2024-09-11T11:01:03.335959+0000","last_became_peered":"2024-09-11T11:01:03.335959+0000","last_unstale":"2024-09-11T11:04:17.914162+0000","last_undegraded":"2024-09-11T11:04:17.914162+0000","last_fullsized":"2024-09-11T11:04:17.914162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.936685+0000","last_change":"2024-09-11T11:04:52.936737+0000","last_active":"2024-09-11T11:04:52.936685+0000","last_peered":"2024-09-11T11:04:52.936685+0000","last_clean":"2024-09-11T11:04:52.936685+0000","last_became_active":"2024-09-11T11:01:07.368853+0000","last_became_peered":"2024-09-11T11:01:07.368853+0000","last_unstale":"2024-09-11T11:04:52.936685+0000","last_undegraded":"2024-09-11T11:04:52.936685+0000","last_fullsized":"2024-09-11T11:04:52.936685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:52.936491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:52.936491+0000","last_clean_scrub_stamp":"2024-09-11T11:04:52.936491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:47:53.282179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.798050+0000","last_change":"2024-09-11T11:05:11.798050+0000","last_active":"2024-09-11T11:05:11.798050+0000","last_peered":"2024-09-11T11:05:11.798050+0000","last_clean":"2024-09-11T11:05:11.798050+0000","last_became_active":"2024-09-11T11:01:09.391249+0000","last_became_peered":"2024-09-11T11:01:09.391249+0000","last_unstale":"2024-09-11T11:05:11.798050+0000","last_undegraded":"2024-09-11T11:05:11.798050+0000","last_fullsized":"2024-09-11T11:05:11.798050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:05:11.797766+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:05:11.797766+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.797766+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:17:35.030060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'286","reported_seq":385,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.559818+0000","last_change":"2024-09-11T11:05:33.559884+0000","last_active":"2024-09-11T11:05:33.559818+0000","last_peered":"2024-09-11T11:05:33.559818+0000","last_clean":"2024-09-11T11:05:33.559818+0000","last_became_active":"2024-09-11T11:01:11.401400+0000","last_became_peered":"2024-09-11T11:01:11.401400+0000","last_unstale":"2024-09-11T11:05:33.559818+0000","last_undegraded":"2024-09-11T11:05:33.559818+0000","last_fullsized":"2024-09-11T11:05:33.559818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-11T11:05:33.559634+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-11T11:05:33.559634+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.559634+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:40.844398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.041975+0000","last_change":"2024-09-11T11:01:13.403086+0000","last_active":"2024-09-11T11:03:36.041975+0000","last_peered":"2024-09-11T11:03:36.041975+0000","last_clean":"2024-09-11T11:03:36.041975+0000","last_became_active":"2024-09-11T11:01:13.402406+0000","last_became_peered":"2024-09-11T11:01:13.402406+0000","last_unstale":"2024-09-11T11:03:36.041975+0000","last_undegraded":"2024-09-11T11:03:36.041975+0000","last_fullsized":"2024-09-11T11:03:36.041975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.182058+0000","last_change":"2024-09-11T11:05:19.182120+0000","last_active":"2024-09-11T11:05:19.182058+0000","last_peered":"2024-09-11T11:05:19.182058+0000","last_clean":"2024-09-11T11:05:19.182058+0000","last_became_active":"2024-09-11T11:01:05.353214+0000","last_became_peered":"2024-09-11T11:01:05.353214+0000","last_unstale":"2024-09-11T11:05:19.182058+0000","last_undegraded":"2024-09-11T11:05:19.182058+0000","last_fullsized":"2024-09-11T11:05:19.182058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:19.181864+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:19.181864+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.181864+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:55.950071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:34.833154+0000","last_change":"2024-09-11T11:05:34.833209+0000","last_active":"2024-09-11T11:05:34.833154+0000","last_peered":"2024-09-11T11:05:34.833154+0000","last_clean":"2024-09-11T11:05:34.833154+0000","last_became_active":"2024-09-11T11:01:03.346318+0000","last_became_peered":"2024-09-11T11:01:03.346318+0000","last_unstale":"2024-09-11T11:05:34.833154+0000","last_undegraded":"2024-09-11T11:05:34.833154+0000","last_fullsized":"2024-09-11T11:05:34.833154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:34.832964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:34.832964+0000","last_clean_scrub_stamp":"2024-09-11T11:05:34.832964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:41:37.672737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.915520+0000","last_change":"2024-09-11T11:04:54.915574+0000","last_active":"2024-09-11T11:04:54.915520+0000","last_peered":"2024-09-11T11:04:54.915520+0000","last_clean":"2024-09-11T11:04:54.915520+0000","last_became_active":"2024-09-11T11:01:07.368713+0000","last_became_peered":"2024-09-11T11:01:07.368713+0000","last_unstale":"2024-09-11T11:04:54.915520+0000","last_undegraded":"2024-09-11T11:04:54.915520+0000","last_fullsized":"2024-09-11T11:04:54.915520+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.915331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.915331+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.915331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:04.269950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":107,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.531652+0000","last_change":"2024-09-11T11:04:57.531736+0000","last_active":"2024-09-11T11:04:57.531652+0000","last_peered":"2024-09-11T11:04:57.531652+0000","last_clean":"2024-09-11T11:04:57.531652+0000","last_became_active":"2024-09-11T11:01:09.363530+0000","last_became_peered":"2024-09-11T11:01:09.363530+0000","last_unstale":"2024-09-11T11:04:57.531652+0000","last_undegraded":"2024-09-11T11:04:57.531652+0000","last_fullsized":"2024-09-11T11:04:57.531652+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:04:57.531466+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:04:57.531466+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.531466+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:53.383843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.753485+0000","last_change":"2024-09-11T11:05:08.753629+0000","last_active":"2024-09-11T11:05:08.753485+0000","last_peered":"2024-09-11T11:05:08.753485+0000","last_clean":"2024-09-11T11:05:08.753485+0000","last_became_active":"2024-09-11T11:01:11.371526+0000","last_became_peered":"2024-09-11T11:01:11.371526+0000","last_unstale":"2024-09-11T11:05:08.753485+0000","last_undegraded":"2024-09-11T11:05:08.753485+0000","last_fullsized":"2024-09-11T11:05:08.753485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:08.753213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:08.753213+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.753213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:50.699884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":24,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:41.043763+0000","last_change":"2024-09-11T11:01:13.421954+0000","last_active":"2024-09-11T11:03:41.043763+0000","last_peered":"2024-09-11T11:03:41.043763+0000","last_clean":"2024-09-11T11:03:41.043763+0000","last_became_active":"2024-09-11T11:01:13.421220+0000","last_became_peered":"2024-09-11T11:01:13.421220+0000","last_unstale":"2024-09-11T11:03:41.043763+0000","last_undegraded":"2024-09-11T11:03:41.043763+0000","last_fullsized":"2024-09-11T11:03:41.043763+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.529896+0000","last_change":"2024-09-11T11:05:19.529955+0000","last_active":"2024-09-11T11:05:19.529896+0000","last_peered":"2024-09-11T11:05:19.529896+0000","last_clean":"2024-09-11T11:05:19.529896+0000","last_became_active":"2024-09-11T11:01:05.348256+0000","last_became_peered":"2024-09-11T11:01:05.348256+0000","last_unstale":"2024-09-11T11:05:19.529896+0000","last_undegraded":"2024-09-11T11:05:19.529896+0000","last_fullsized":"2024-09-11T11:05:19.529896+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:19.529705+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:19.529705+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.529705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:22:58.134622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:40.504254+0000","last_change":"2024-09-11T11:05:40.504308+0000","last_active":"2024-09-11T11:05:40.504254+0000","last_peered":"2024-09-11T11:05:40.504254+0000","last_clean":"2024-09-11T11:05:40.504254+0000","last_became_active":"2024-09-11T11:01:03.323106+0000","last_became_peered":"2024-09-11T11:01:03.323106+0000","last_unstale":"2024-09-11T11:05:40.504254+0000","last_undegraded":"2024-09-11T11:05:40.504254+0000","last_fullsized":"2024-09-11T11:05:40.504254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:40.504062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:40.504062+0000","last_clean_scrub_stamp":"2024-09-11T11:05:40.504062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:40:50.517351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.514431+0000","last_change":"2024-09-11T11:04:59.514486+0000","last_active":"2024-09-11T11:04:59.514431+0000","last_peered":"2024-09-11T11:04:59.514431+0000","last_clean":"2024-09-11T11:04:59.514431+0000","last_became_active":"2024-09-11T11:01:07.346507+0000","last_became_peered":"2024-09-11T11:01:07.346507+0000","last_unstale":"2024-09-11T11:04:59.514431+0000","last_undegraded":"2024-09-11T11:04:59.514431+0000","last_fullsized":"2024-09-11T11:04:59.514431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.514205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.514205+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.514205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:09.294520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":95,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.992718+0000","last_change":"2024-09-11T11:05:05.992792+0000","last_active":"2024-09-11T11:05:05.992718+0000","last_peered":"2024-09-11T11:05:05.992718+0000","last_clean":"2024-09-11T11:05:05.992718+0000","last_became_active":"2024-09-11T11:01:09.367104+0000","last_became_peered":"2024-09-11T11:01:09.367104+0000","last_unstale":"2024-09-11T11:05:05.992718+0000","last_undegraded":"2024-09-11T11:05:05.992718+0000","last_fullsized":"2024-09-11T11:05:05.992718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-11T11:05:05.992530+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-11T11:05:05.992530+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.992530+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:53:54.568734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.594385+0000","last_change":"2024-09-11T11:05:25.594444+0000","last_active":"2024-09-11T11:05:25.594385+0000","last_peered":"2024-09-11T11:05:25.594385+0000","last_clean":"2024-09-11T11:05:25.594385+0000","last_became_active":"2024-09-11T11:01:11.400269+0000","last_became_peered":"2024-09-11T11:01:11.400269+0000","last_unstale":"2024-09-11T11:05:25.594385+0000","last_undegraded":"2024-09-11T11:05:25.594385+0000","last_fullsized":"2024-09-11T11:05:25.594385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:25.594179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:25.594179+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.594179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:41.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:38.041445+0000","last_change":"2024-09-11T11:01:13.424386+0000","last_active":"2024-09-11T11:03:38.041445+0000","last_peered":"2024-09-11T11:03:38.041445+0000","last_clean":"2024-09-11T11:03:38.041445+0000","last_became_active":"2024-09-11T11:01:13.423466+0000","last_became_peered":"2024-09-11T11:01:13.423466+0000","last_unstale":"2024-09-11T11:03:38.041445+0000","last_undegraded":"2024-09-11T11:03:38.041445+0000","last_fullsized":"2024-09-11T11:03:38.041445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":80,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:35.960050+0000","last_change":"2024-09-11T11:05:35.960108+0000","last_active":"2024-09-11T11:05:35.960050+0000","last_peered":"2024-09-11T11:05:35.960050+0000","last_clean":"2024-09-11T11:05:35.960050+0000","last_became_active":"2024-09-11T11:01:05.334141+0000","last_became_peered":"2024-09-11T11:01:05.334141+0000","last_unstale":"2024-09-11T11:05:35.960050+0000","last_undegraded":"2024-09-11T11:05:35.960050+0000","last_fullsized":"2024-09-11T11:05:35.960050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:35.959856+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:35.959856+0000","last_clean_scrub_stamp":"2024-09-11T11:05:35.959856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:31.341749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787452+0000","last_change":"2024-09-11T11:01:03.340441+0000","last_active":"2024-09-11T11:04:53.787452+0000","last_peered":"2024-09-11T11:04:53.787452+0000","last_clean":"2024-09-11T11:04:53.787452+0000","last_became_active":"2024-09-11T11:01:03.337584+0000","last_became_peered":"2024-09-11T11:01:03.337584+0000","last_unstale":"2024-09-11T11:04:53.787452+0000","last_undegraded":"2024-09-11T11:04:53.787452+0000","last_fullsized":"2024-09-11T11:04:53.787452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.834278+0000","last_change":"2024-09-11T11:05:14.834334+0000","last_active":"2024-09-11T11:05:14.834278+0000","last_peered":"2024-09-11T11:05:14.834278+0000","last_clean":"2024-09-11T11:05:14.834278+0000","last_became_active":"2024-09-11T11:01:07.365791+0000","last_became_peered":"2024-09-11T11:01:07.365791+0000","last_unstale":"2024-09-11T11:05:14.834278+0000","last_undegraded":"2024-09-11T11:05:14.834278+0000","last_fullsized":"2024-09-11T11:05:14.834278+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:14.834085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:14.834085+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.834085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:21.684279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":87,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.678435+0000","last_change":"2024-09-11T11:04:58.678503+0000","last_active":"2024-09-11T11:04:58.678435+0000","last_peered":"2024-09-11T11:04:58.678435+0000","last_clean":"2024-09-11T11:04:58.678435+0000","last_became_active":"2024-09-11T11:01:09.380531+0000","last_became_peered":"2024-09-11T11:01:09.380531+0000","last_unstale":"2024-09-11T11:04:58.678435+0000","last_undegraded":"2024-09-11T11:04:58.678435+0000","last_fullsized":"2024-09-11T11:04:58.678435+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-11T11:04:58.678237+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-11T11:04:58.678237+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.678237+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:51.973784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.571459+0000","last_change":"2024-09-11T11:05:17.571511+0000","last_active":"2024-09-11T11:05:17.571459+0000","last_peered":"2024-09-11T11:05:17.571459+0000","last_clean":"2024-09-11T11:05:17.571459+0000","last_became_active":"2024-09-11T11:01:11.386302+0000","last_became_peered":"2024-09-11T11:01:11.386302+0000","last_unstale":"2024-09-11T11:05:17.571459+0000","last_undegraded":"2024-09-11T11:05:17.571459+0000","last_fullsized":"2024-09-11T11:05:17.571459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:17.571262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:17.571262+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.571262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:34.402557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'8","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:17.595893+0000","last_change":"2024-09-11T11:01:13.423002+0000","last_active":"2024-09-11T11:04:17.595893+0000","last_peered":"2024-09-11T11:04:17.595893+0000","last_clean":"2024-09-11T11:04:17.595893+0000","last_became_active":"2024-09-11T11:01:13.422285+0000","last_became_peered":"2024-09-11T11:01:13.422285+0000","last_unstale":"2024-09-11T11:04:17.595893+0000","last_undegraded":"2024-09-11T11:04:17.595893+0000","last_fullsized":"2024-09-11T11:04:17.595893+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.627315+0000","last_change":"2024-09-11T11:05:28.627375+0000","last_active":"2024-09-11T11:05:28.627315+0000","last_peered":"2024-09-11T11:05:28.627315+0000","last_clean":"2024-09-11T11:05:28.627315+0000","last_became_active":"2024-09-11T11:01:05.336680+0000","last_became_peered":"2024-09-11T11:01:05.336680+0000","last_unstale":"2024-09-11T11:05:28.627315+0000","last_undegraded":"2024-09-11T11:05:28.627315+0000","last_fullsized":"2024-09-11T11:05:28.627315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:28.627119+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:28.627119+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.627119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:20:00.550003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:40.809797+0000","last_change":"2024-09-11T11:05:40.809854+0000","last_active":"2024-09-11T11:05:40.809797+0000","last_peered":"2024-09-11T11:05:40.809797+0000","last_clean":"2024-09-11T11:05:40.809797+0000","last_became_active":"2024-09-11T11:01:03.331816+0000","last_became_peered":"2024-09-11T11:01:03.331816+0000","last_unstale":"2024-09-11T11:05:40.809797+0000","last_undegraded":"2024-09-11T11:05:40.809797+0000","last_fullsized":"2024-09-11T11:05:40.809797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:40.809578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:40.809578+0000","last_clean_scrub_stamp":"2024-09-11T11:05:40.809578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:50:44.841905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":45,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.790257+0000","last_change":"2024-09-11T11:05:15.790325+0000","last_active":"2024-09-11T11:05:15.790257+0000","last_peered":"2024-09-11T11:05:15.790257+0000","last_clean":"2024-09-11T11:05:15.790257+0000","last_became_active":"2024-09-11T11:01:07.363545+0000","last_became_peered":"2024-09-11T11:01:07.363545+0000","last_unstale":"2024-09-11T11:05:15.790257+0000","last_undegraded":"2024-09-11T11:05:15.790257+0000","last_fullsized":"2024-09-11T11:05:15.790257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-11T11:05:15.790071+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-11T11:05:15.790071+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.790071+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:57.736742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'39","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.503812+0000","last_change":"2024-09-11T11:05:04.503885+0000","last_active":"2024-09-11T11:05:04.503812+0000","last_peered":"2024-09-11T11:05:04.503812+0000","last_clean":"2024-09-11T11:05:04.503812+0000","last_became_active":"2024-09-11T11:01:09.377586+0000","last_became_peered":"2024-09-11T11:01:09.377586+0000","last_unstale":"2024-09-11T11:05:04.503812+0000","last_undegraded":"2024-09-11T11:05:04.503812+0000","last_fullsized":"2024-09-11T11:05:04.503812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-11T11:05:04.503625+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-11T11:05:04.503625+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.503625+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:19.713646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.130713+0000","last_change":"2024-09-11T11:04:56.130847+0000","last_active":"2024-09-11T11:04:56.130713+0000","last_peered":"2024-09-11T11:04:56.130713+0000","last_clean":"2024-09-11T11:04:56.130713+0000","last_became_active":"2024-09-11T11:01:11.401078+0000","last_became_peered":"2024-09-11T11:01:11.401078+0000","last_unstale":"2024-09-11T11:04:56.130713+0000","last_undegraded":"2024-09-11T11:04:56.130713+0000","last_fullsized":"2024-09-11T11:04:56.130713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:56.130494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:56.130494+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.130494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:45.639114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:36.042291+0000","last_change":"2024-09-11T11:01:13.422050+0000","last_active":"2024-09-11T11:03:36.042291+0000","last_peered":"2024-09-11T11:03:36.042291+0000","last_clean":"2024-09-11T11:03:36.042291+0000","last_became_active":"2024-09-11T11:01:13.421231+0000","last_became_peered":"2024-09-11T11:01:13.421231+0000","last_unstale":"2024-09-11T11:03:36.042291+0000","last_undegraded":"2024-09-11T11:03:36.042291+0000","last_fullsized":"2024-09-11T11:03:36.042291+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:12.355636+0000","last_clean_scrub_stamp":"2024-09-11T11:01:12.355636+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'12","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.802589+0000","last_change":"2024-09-11T11:05:33.802705+0000","last_active":"2024-09-11T11:05:33.802589+0000","last_peered":"2024-09-11T11:05:33.802589+0000","last_clean":"2024-09-11T11:05:33.802589+0000","last_became_active":"2024-09-11T11:01:05.339760+0000","last_became_peered":"2024-09-11T11:01:05.339760+0000","last_unstale":"2024-09-11T11:05:33.802589+0000","last_undegraded":"2024-09-11T11:05:33.802589+0000","last_fullsized":"2024-09-11T11:05:33.802589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:33.802362+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:33.802362+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.802362+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:01:51.550433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.228509+0000","last_change":"2024-09-11T11:05:24.228568+0000","last_active":"2024-09-11T11:05:24.228509+0000","last_peered":"2024-09-11T11:05:24.228509+0000","last_clean":"2024-09-11T11:05:24.228509+0000","last_became_active":"2024-09-11T11:01:03.338039+0000","last_became_peered":"2024-09-11T11:01:03.338039+0000","last_unstale":"2024-09-11T11:05:24.228509+0000","last_undegraded":"2024-09-11T11:05:24.228509+0000","last_fullsized":"2024-09-11T11:05:24.228509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:24.228296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:24.228296+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.228296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:21:06.516380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.735670+0000","last_change":"2024-09-11T11:05:30.735753+0000","last_active":"2024-09-11T11:05:30.735670+0000","last_peered":"2024-09-11T11:05:30.735670+0000","last_clean":"2024-09-11T11:05:30.735670+0000","last_became_active":"2024-09-11T11:01:05.332632+0000","last_became_peered":"2024-09-11T11:01:05.332632+0000","last_unstale":"2024-09-11T11:05:30.735670+0000","last_undegraded":"2024-09-11T11:05:30.735670+0000","last_fullsized":"2024-09-11T11:05:30.735670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:30.735470+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:30.735470+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.735470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:53.829897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.266178+0000","last_change":"2024-09-11T11:05:30.266240+0000","last_active":"2024-09-11T11:05:30.266178+0000","last_peered":"2024-09-11T11:05:30.266178+0000","last_clean":"2024-09-11T11:05:30.266178+0000","last_became_active":"2024-09-11T11:01:03.327428+0000","last_became_peered":"2024-09-11T11:01:03.327428+0000","last_unstale":"2024-09-11T11:05:30.266178+0000","last_undegraded":"2024-09-11T11:05:30.266178+0000","last_fullsized":"2024-09-11T11:05:30.266178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:30.265963+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:30.265963+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.265963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:58.012199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.534760+0000","last_change":"2024-09-11T11:05:18.534760+0000","last_active":"2024-09-11T11:05:18.534760+0000","last_peered":"2024-09-11T11:05:18.534760+0000","last_clean":"2024-09-11T11:05:18.534760+0000","last_became_active":"2024-09-11T11:01:05.348827+0000","last_became_peered":"2024-09-11T11:01:05.348827+0000","last_unstale":"2024-09-11T11:05:18.534760+0000","last_undegraded":"2024-09-11T11:05:18.534760+0000","last_fullsized":"2024-09-11T11:05:18.534760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:18.534472+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:18.534472+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.534472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:41.628898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'3","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:52.986416+0000","last_change":"2024-09-11T11:05:52.986489+0000","last_active":"2024-09-11T11:05:52.986416+0000","last_peered":"2024-09-11T11:05:52.986416+0000","last_clean":"2024-09-11T11:05:52.986416+0000","last_became_active":"2024-09-11T11:01:03.333729+0000","last_became_peered":"2024-09-11T11:01:03.333729+0000","last_unstale":"2024-09-11T11:05:52.986416+0000","last_undegraded":"2024-09-11T11:05:52.986416+0000","last_fullsized":"2024-09-11T11:05:52.986416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-11T11:05:52.986207+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-11T11:05:52.986207+0000","last_clean_scrub_stamp":"2024-09-11T11:05:52.986207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:31.940476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.775042+0000","last_change":"2024-09-11T11:05:27.775042+0000","last_active":"2024-09-11T11:05:27.775042+0000","last_peered":"2024-09-11T11:05:27.775042+0000","last_clean":"2024-09-11T11:05:27.775042+0000","last_became_active":"2024-09-11T11:01:05.332274+0000","last_became_peered":"2024-09-11T11:01:05.332274+0000","last_unstale":"2024-09-11T11:05:27.775042+0000","last_undegraded":"2024-09-11T11:05:27.775042+0000","last_fullsized":"2024-09-11T11:05:27.775042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:27.774642+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:27.774642+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.774642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:25:43.946676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.224359+0000","last_change":"2024-09-11T11:05:31.224414+0000","last_active":"2024-09-11T11:05:31.224359+0000","last_peered":"2024-09-11T11:05:31.224359+0000","last_clean":"2024-09-11T11:05:31.224359+0000","last_became_active":"2024-09-11T11:01:03.335054+0000","last_became_peered":"2024-09-11T11:01:03.335054+0000","last_unstale":"2024-09-11T11:05:31.224359+0000","last_undegraded":"2024-09-11T11:05:31.224359+0000","last_fullsized":"2024-09-11T11:05:31.224359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:31.224173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:31.224173+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.224173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:49:48.898919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.000601+0000","last_change":"2024-09-11T11:05:33.000653+0000","last_active":"2024-09-11T11:05:33.000601+0000","last_peered":"2024-09-11T11:05:33.000601+0000","last_clean":"2024-09-11T11:05:33.000601+0000","last_became_active":"2024-09-11T11:01:05.330065+0000","last_became_peered":"2024-09-11T11:01:05.330065+0000","last_unstale":"2024-09-11T11:05:33.000601+0000","last_undegraded":"2024-09-11T11:05:33.000601+0000","last_fullsized":"2024-09-11T11:05:33.000601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:33.000394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:33.000394+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.000394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:54.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:42.964248+0000","last_change":"2024-09-11T11:05:42.964365+0000","last_active":"2024-09-11T11:05:42.964248+0000","last_peered":"2024-09-11T11:05:42.964248+0000","last_clean":"2024-09-11T11:05:42.964248+0000","last_became_active":"2024-09-11T11:01:03.349971+0000","last_became_peered":"2024-09-11T11:01:03.349971+0000","last_unstale":"2024-09-11T11:05:42.964248+0000","last_undegraded":"2024-09-11T11:05:42.964248+0000","last_fullsized":"2024-09-11T11:05:42.964248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:42.964013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:42.964013+0000","last_clean_scrub_stamp":"2024-09-11T11:05:42.964013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:57:00.215465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:39.850138+0000","last_change":"2024-09-11T11:05:39.850205+0000","last_active":"2024-09-11T11:05:39.850138+0000","last_peered":"2024-09-11T11:05:39.850138+0000","last_clean":"2024-09-11T11:05:39.850138+0000","last_became_active":"2024-09-11T11:01:05.342092+0000","last_became_peered":"2024-09-11T11:01:05.342092+0000","last_unstale":"2024-09-11T11:05:39.850138+0000","last_undegraded":"2024-09-11T11:05:39.850138+0000","last_fullsized":"2024-09-11T11:05:39.850138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:39.849914+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:39.849914+0000","last_clean_scrub_stamp":"2024-09-11T11:05:39.849914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:18.516667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.881250+0000","last_change":"2024-09-11T11:01:42.061260+0000","last_active":"2024-09-11T11:04:52.881250+0000","last_peered":"2024-09-11T11:04:52.881250+0000","last_clean":"2024-09-11T11:04:52.881250+0000","last_became_active":"2024-09-11T11:01:42.060500+0000","last_became_peered":"2024-09-11T11:01:42.060500+0000","last_unstale":"2024-09-11T11:04:52.881250+0000","last_undegraded":"2024-09-11T11:04:52.881250+0000","last_fullsized":"2024-09-11T11:04:52.881250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.941170+0000","last_change":"2024-09-11T11:05:28.941231+0000","last_active":"2024-09-11T11:05:28.941170+0000","last_peered":"2024-09-11T11:05:28.941170+0000","last_clean":"2024-09-11T11:05:28.941170+0000","last_became_active":"2024-09-11T11:01:05.346179+0000","last_became_peered":"2024-09-11T11:01:05.346179+0000","last_unstale":"2024-09-11T11:05:28.941170+0000","last_undegraded":"2024-09-11T11:05:28.941170+0000","last_fullsized":"2024-09-11T11:05:28.941170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:28.940973+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:28.940973+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.940973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:40.559614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.256697+0000","last_change":"2024-09-11T11:05:29.256755+0000","last_active":"2024-09-11T11:05:29.256697+0000","last_peered":"2024-09-11T11:05:29.256697+0000","last_clean":"2024-09-11T11:05:29.256697+0000","last_became_active":"2024-09-11T11:01:03.315737+0000","last_became_peered":"2024-09-11T11:01:03.315737+0000","last_unstale":"2024-09-11T11:05:29.256697+0000","last_undegraded":"2024-09-11T11:05:29.256697+0000","last_fullsized":"2024-09-11T11:05:29.256697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:29.256510+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:29.256510+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.256510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:46:54.652124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:32.603791+0000","last_change":"2024-09-11T11:05:32.603853+0000","last_active":"2024-09-11T11:05:32.603791+0000","last_peered":"2024-09-11T11:05:32.603791+0000","last_clean":"2024-09-11T11:05:32.603791+0000","last_became_active":"2024-09-11T11:01:05.331901+0000","last_became_peered":"2024-09-11T11:01:05.331901+0000","last_unstale":"2024-09-11T11:05:32.603791+0000","last_undegraded":"2024-09-11T11:05:32.603791+0000","last_fullsized":"2024-09-11T11:05:32.603791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:32.603612+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:32.603612+0000","last_clean_scrub_stamp":"2024-09-11T11:05:32.603612+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:32.665425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:44.969641+0000","last_change":"2024-09-11T11:05:44.969693+0000","last_active":"2024-09-11T11:05:44.969641+0000","last_peered":"2024-09-11T11:05:44.969641+0000","last_clean":"2024-09-11T11:05:44.969641+0000","last_became_active":"2024-09-11T11:01:03.351125+0000","last_became_peered":"2024-09-11T11:01:03.351125+0000","last_unstale":"2024-09-11T11:05:44.969641+0000","last_undegraded":"2024-09-11T11:05:44.969641+0000","last_fullsized":"2024-09-11T11:05:44.969641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:44.969429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:44.969429+0000","last_clean_scrub_stamp":"2024-09-11T11:05:44.969429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:28:31.837871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.761851+0000","last_change":"2024-09-11T11:05:28.761851+0000","last_active":"2024-09-11T11:05:28.761851+0000","last_peered":"2024-09-11T11:05:28.761851+0000","last_clean":"2024-09-11T11:05:28.761851+0000","last_became_active":"2024-09-11T11:01:05.332203+0000","last_became_peered":"2024-09-11T11:01:05.332203+0000","last_unstale":"2024-09-11T11:05:28.761851+0000","last_undegraded":"2024-09-11T11:05:28.761851+0000","last_fullsized":"2024-09-11T11:05:28.761851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:28.761615+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:28.761615+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.761615+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:26.880299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787676+0000","last_change":"2024-09-11T11:01:03.337164+0000","last_active":"2024-09-11T11:04:53.787676+0000","last_peered":"2024-09-11T11:04:53.787676+0000","last_clean":"2024-09-11T11:04:53.787676+0000","last_became_active":"2024-09-11T11:01:03.336786+0000","last_became_peered":"2024-09-11T11:01:03.336786+0000","last_unstale":"2024-09-11T11:04:53.787676+0000","last_undegraded":"2024-09-11T11:04:53.787676+0000","last_fullsized":"2024-09-11T11:04:53.787676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'14","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:50.973925+0000","last_change":"2024-09-11T11:05:50.974037+0000","last_active":"2024-09-11T11:05:50.973925+0000","last_peered":"2024-09-11T11:05:50.973925+0000","last_clean":"2024-09-11T11:05:50.973925+0000","last_became_active":"2024-09-11T11:01:05.332747+0000","last_became_peered":"2024-09-11T11:01:05.332747+0000","last_unstale":"2024-09-11T11:05:50.973925+0000","last_undegraded":"2024-09-11T11:05:50.973925+0000","last_fullsized":"2024-09-11T11:05:50.973925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:50.973617+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:50.973617+0000","last_clean_scrub_stamp":"2024-09-11T11:05:50.973617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:21.350122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.787722+0000","last_change":"2024-09-11T11:01:03.336167+0000","last_active":"2024-09-11T11:04:53.787722+0000","last_peered":"2024-09-11T11:04:53.787722+0000","last_clean":"2024-09-11T11:04:53.787722+0000","last_became_active":"2024-09-11T11:01:03.335854+0000","last_became_peered":"2024-09-11T11:01:03.335854+0000","last_unstale":"2024-09-11T11:04:53.787722+0000","last_undegraded":"2024-09-11T11:04:53.787722+0000","last_fullsized":"2024-09-11T11:04:53.787722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.048283+0000","last_change":"2024-09-11T11:05:13.048283+0000","last_active":"2024-09-11T11:05:13.048283+0000","last_peered":"2024-09-11T11:05:13.048283+0000","last_clean":"2024-09-11T11:05:13.048283+0000","last_became_active":"2024-09-11T11:01:05.343590+0000","last_became_peered":"2024-09-11T11:01:05.343590+0000","last_unstale":"2024-09-11T11:05:13.048283+0000","last_undegraded":"2024-09-11T11:05:13.048283+0000","last_fullsized":"2024-09-11T11:05:13.048283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:13.048016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:13.048016+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.048016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:34.967696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:43.546093+0000","last_change":"2024-09-11T11:05:43.546146+0000","last_active":"2024-09-11T11:05:43.546093+0000","last_peered":"2024-09-11T11:05:43.546093+0000","last_clean":"2024-09-11T11:05:43.546093+0000","last_became_active":"2024-09-11T11:01:03.336224+0000","last_became_peered":"2024-09-11T11:01:03.336224+0000","last_unstale":"2024-09-11T11:05:43.546093+0000","last_undegraded":"2024-09-11T11:05:43.546093+0000","last_fullsized":"2024-09-11T11:05:43.546093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:43.545891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:43.545891+0000","last_clean_scrub_stamp":"2024-09-11T11:05:43.545891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:53.685691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:37.775220+0000","last_change":"2024-09-11T11:05:37.775220+0000","last_active":"2024-09-11T11:05:37.775220+0000","last_peered":"2024-09-11T11:05:37.775220+0000","last_clean":"2024-09-11T11:05:37.775220+0000","last_became_active":"2024-09-11T11:01:05.341761+0000","last_became_peered":"2024-09-11T11:01:05.341761+0000","last_unstale":"2024-09-11T11:05:37.775220+0000","last_undegraded":"2024-09-11T11:05:37.775220+0000","last_fullsized":"2024-09-11T11:05:37.775220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:37.774962+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:37.774962+0000","last_clean_scrub_stamp":"2024-09-11T11:05:37.774962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:49.393603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:46.839649+0000","last_change":"2024-09-11T11:05:46.839720+0000","last_active":"2024-09-11T11:05:46.839649+0000","last_peered":"2024-09-11T11:05:46.839649+0000","last_clean":"2024-09-11T11:05:46.839649+0000","last_became_active":"2024-09-11T11:01:03.318984+0000","last_became_peered":"2024-09-11T11:01:03.318984+0000","last_unstale":"2024-09-11T11:05:46.839649+0000","last_undegraded":"2024-09-11T11:05:46.839649+0000","last_fullsized":"2024-09-11T11:05:46.839649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:46.839445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:46.839445+0000","last_clean_scrub_stamp":"2024-09-11T11:05:46.839445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:54.124210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'6","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:38.316114+0000","last_change":"2024-09-11T11:05:38.316172+0000","last_active":"2024-09-11T11:05:38.316114+0000","last_peered":"2024-09-11T11:05:38.316114+0000","last_clean":"2024-09-11T11:05:38.316114+0000","last_became_active":"2024-09-11T11:01:42.059147+0000","last_became_peered":"2024-09-11T11:01:42.059147+0000","last_unstale":"2024-09-11T11:05:38.316114+0000","last_undegraded":"2024-09-11T11:05:38.316114+0000","last_fullsized":"2024-09-11T11:05:38.316114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:38.315897+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:38.315897+0000","last_clean_scrub_stamp":"2024-09-11T11:05:38.315897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:36:13.862126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:38.905434+0000","last_change":"2024-09-11T11:05:38.905487+0000","last_active":"2024-09-11T11:05:38.905434+0000","last_peered":"2024-09-11T11:05:38.905434+0000","last_clean":"2024-09-11T11:05:38.905434+0000","last_became_active":"2024-09-11T11:01:03.349120+0000","last_became_peered":"2024-09-11T11:01:03.349120+0000","last_unstale":"2024-09-11T11:05:38.905434+0000","last_undegraded":"2024-09-11T11:05:38.905434+0000","last_fullsized":"2024-09-11T11:05:38.905434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:38.905241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:38.905241+0000","last_clean_scrub_stamp":"2024-09-11T11:05:38.905241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:46.190006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'8","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.792959+0000","last_change":"2024-09-11T11:05:26.792959+0000","last_active":"2024-09-11T11:05:26.792959+0000","last_peered":"2024-09-11T11:05:26.792959+0000","last_clean":"2024-09-11T11:05:26.792959+0000","last_became_active":"2024-09-11T11:01:05.343121+0000","last_became_peered":"2024-09-11T11:01:05.343121+0000","last_unstale":"2024-09-11T11:05:26.792959+0000","last_undegraded":"2024-09-11T11:05:26.792959+0000","last_fullsized":"2024-09-11T11:05:26.792959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:26.792707+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:26.792707+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.792707+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:14.577427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:03:58.046966+0000","last_change":"2024-09-11T11:01:42.056195+0000","last_active":"2024-09-11T11:03:58.046966+0000","last_peered":"2024-09-11T11:03:58.046966+0000","last_clean":"2024-09-11T11:03:58.046966+0000","last_became_active":"2024-09-11T11:01:42.055356+0000","last_became_peered":"2024-09-11T11:01:42.055356+0000","last_unstale":"2024-09-11T11:03:58.046966+0000","last_undegraded":"2024-09-11T11:03:58.046966+0000","last_fullsized":"2024-09-11T11:03:58.046966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:01:02.287269+0000","last_clean_scrub_stamp":"2024-09-11T11:01:02.287269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.928276+0000","last_change":"2024-09-11T11:05:27.928276+0000","last_active":"2024-09-11T11:05:27.928276+0000","last_peered":"2024-09-11T11:05:27.928276+0000","last_clean":"2024-09-11T11:05:27.928276+0000","last_became_active":"2024-09-11T11:01:05.346563+0000","last_became_peered":"2024-09-11T11:01:05.346563+0000","last_unstale":"2024-09-11T11:05:27.928276+0000","last_undegraded":"2024-09-11T11:05:27.928276+0000","last_fullsized":"2024-09-11T11:05:27.928276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:27.927866+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:27.927866+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.927866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:18.339185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.247847+0000","last_change":"2024-09-11T11:05:28.247847+0000","last_active":"2024-09-11T11:05:28.247847+0000","last_peered":"2024-09-11T11:05:28.247847+0000","last_clean":"2024-09-11T11:05:28.247847+0000","last_became_active":"2024-09-11T11:01:03.315651+0000","last_became_peered":"2024-09-11T11:01:03.315651+0000","last_unstale":"2024-09-11T11:05:28.247847+0000","last_undegraded":"2024-09-11T11:05:28.247847+0000","last_fullsized":"2024-09-11T11:05:28.247847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:28.247584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:28.247584+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.247584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:05:01.500658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.572672+0000","last_change":"2024-09-11T11:05:20.572672+0000","last_active":"2024-09-11T11:05:20.572672+0000","last_peered":"2024-09-11T11:05:20.572672+0000","last_clean":"2024-09-11T11:05:20.572672+0000","last_became_active":"2024-09-11T11:01:05.347760+0000","last_became_peered":"2024-09-11T11:01:05.347760+0000","last_unstale":"2024-09-11T11:05:20.572672+0000","last_undegraded":"2024-09-11T11:05:20.572672+0000","last_fullsized":"2024-09-11T11:05:20.572672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:20.572423+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:20.572423+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.572423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:49:41.914766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:51.936595+0000","last_change":"2024-09-11T11:05:51.936678+0000","last_active":"2024-09-11T11:05:51.936595+0000","last_peered":"2024-09-11T11:05:51.936595+0000","last_clean":"2024-09-11T11:05:51.936595+0000","last_became_active":"2024-09-11T11:01:03.337667+0000","last_became_peered":"2024-09-11T11:01:03.337667+0000","last_unstale":"2024-09-11T11:05:51.936595+0000","last_undegraded":"2024-09-11T11:05:51.936595+0000","last_fullsized":"2024-09-11T11:05:51.936595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:51.936382+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:51.936382+0000","last_clean_scrub_stamp":"2024-09-11T11:05:51.936382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:20.122217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:48.658576+0000","last_change":"2024-09-11T11:05:48.658633+0000","last_active":"2024-09-11T11:05:48.658576+0000","last_peered":"2024-09-11T11:05:48.658576+0000","last_clean":"2024-09-11T11:05:48.658576+0000","last_became_active":"2024-09-11T11:01:03.321242+0000","last_became_peered":"2024-09-11T11:01:03.321242+0000","last_unstale":"2024-09-11T11:05:48.658576+0000","last_undegraded":"2024-09-11T11:05:48.658576+0000","last_fullsized":"2024-09-11T11:05:48.658576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:48.658363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:48.658363+0000","last_clean_scrub_stamp":"2024-09-11T11:05:48.658363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:04:52.441433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'12","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.098992+0000","last_change":"2024-09-11T11:05:15.099143+0000","last_active":"2024-09-11T11:05:15.098992+0000","last_peered":"2024-09-11T11:05:15.098992+0000","last_clean":"2024-09-11T11:05:15.098992+0000","last_became_active":"2024-09-11T11:01:05.344285+0000","last_became_peered":"2024-09-11T11:01:05.344285+0000","last_unstale":"2024-09-11T11:05:15.098992+0000","last_undegraded":"2024-09-11T11:05:15.098992+0000","last_fullsized":"2024-09-11T11:05:15.098992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:15.098771+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:15.098771+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.098771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:54:16.965356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:47.888341+0000","last_change":"2024-09-11T11:05:47.888393+0000","last_active":"2024-09-11T11:05:47.888341+0000","last_peered":"2024-09-11T11:05:47.888341+0000","last_clean":"2024-09-11T11:05:47.888341+0000","last_became_active":"2024-09-11T11:01:03.320391+0000","last_became_peered":"2024-09-11T11:01:03.320391+0000","last_unstale":"2024-09-11T11:05:47.888341+0000","last_undegraded":"2024-09-11T11:05:47.888341+0000","last_fullsized":"2024-09-11T11:05:47.888341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:47.888155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:47.888155+0000","last_clean_scrub_stamp":"2024-09-11T11:05:47.888155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:58.012693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:42.277792+0000","last_change":"2024-09-11T11:05:42.277852+0000","last_active":"2024-09-11T11:05:42.277792+0000","last_peered":"2024-09-11T11:05:42.277792+0000","last_clean":"2024-09-11T11:05:42.277792+0000","last_became_active":"2024-09-11T11:01:42.069954+0000","last_became_peered":"2024-09-11T11:01:42.069954+0000","last_unstale":"2024-09-11T11:05:42.277792+0000","last_undegraded":"2024-09-11T11:05:42.277792+0000","last_fullsized":"2024-09-11T11:05:42.277792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:42.277598+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:42.277598+0000","last_clean_scrub_stamp":"2024-09-11T11:05:42.277598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:25:59.622429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2282,"ondisk_log_size":2282,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1524,"ondisk_log_size":1524,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1608,"num_read_kb":1498,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673024,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":454656,"data_stored":155251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673024,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":744125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673025,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40556,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331284,"statfs":{"total":96636764160,"available":96595234816,"internally_reserved":0,"allocated":1077248,"data_stored":746823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":156613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:05:55.434 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.434 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.435 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.435 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.435 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.435 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.435 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.436 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.436 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-11T11:01:04.296343+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=4, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.436 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.436 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.437 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.437 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.437 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.437 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.437 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.438 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.438 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.438 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.438 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T11:00:52.854226+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=0, tm_sec=52, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.438 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.439 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.439 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.439 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.439 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.439 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.439 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.440 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.440 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.440 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.440 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.440 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.440 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-11T11:01:12.355636+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=12, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.441 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.441 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.441 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.441 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-11T11:01:02.287269+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=1, tm_sec=2, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=11, tm_min=4, tm_sec=50, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T11:05:55.441 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T11:06:15.443 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T11:06:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.570+0000 7f14833c6640 1 Processor -- start 2024-09-11T11:06:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.570+0000 7f14833c6640 1 -- start start 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.570+0000 7f14833c6640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f147c06dbd0 0x7f147c138440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.570+0000 7f14833c6640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f147c06eb20 con 0x7f147c06d0e0 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.570+0000 7f14833c6640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f147c072f80 con 0x7f147c06dbd0 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f1481162640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f147c06d0e0 0x7f147c06d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37188/0 (socket says 172.21.15.102:37188) 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f1481162640 1 -- 172.21.15.102:0/2770108504 learned_addr learned my addr 172.21.15.102:0/2770108504 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f1480961640 1 --2- 172.21.15.102:0/2770108504 >> v2:172.21.15.102:3300/0 conn(0x7f147c06dbd0 0x7f147c138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f146ffff640 1 -- 172.21.15.102:0/2770108504 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252506533 0 0) 0x7f147c06eb20 con 0x7f147c06d0e0 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f146ffff640 1 -- 172.21.15.102:0/2770108504 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1468003530 con 0x7f147c06d0e0 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f1480961640 1 -- 172.21.15.102:0/2770108504 >> v1:172.21.15.102:6789/0 conn(0x7f147c06d0e0 legacy=0x7f147c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:06:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f1480961640 1 -- 172.21.15.102:0/2770108504 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c098b90 con 0x7f147c06dbd0 2024-09-11T11:06:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f1480961640 1 --2- 172.21.15.102:0/2770108504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06dbd0 0x7f147c138440 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f1478009d90 tx=0x7f147801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fb20257e0cdda6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:06:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f146ffff640 1 -- 172.21.15.102:0/2770108504 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14780b2070 con 0x7f147c06dbd0 2024-09-11T11:06:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f146ffff640 1 -- 172.21.15.102:0/2770108504 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780a5740 con 0x7f147c06dbd0 2024-09-11T11:06:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f146ffff640 1 -- 172.21.15.102:0/2770108504 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14780a5a40 con 0x7f147c06dbd0 2024-09-11T11:06:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f14833c6640 1 -- 172.21.15.102:0/2770108504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06dbd0 msgr2=0x7f147c138440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:06:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f14833c6640 1 --2- 172.21.15.102:0/2770108504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06dbd0 0x7f147c138440 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f1478009d90 tx=0x7f147801c8c0 comp rx=0 tx=0).stop 2024-09-11T11:06:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f14833c6640 1 -- 172.21.15.102:0/2770108504 shutdown_connections 2024-09-11T11:06:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f14833c6640 1 --2- 172.21.15.102:0/2770108504 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06dbd0 0x7f147c138440 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:06:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f14833c6640 1 -- 172.21.15.102:0/2770108504 >> 172.21.15.102:0/2770108504 conn(0x7f147c099a50 msgr2=0x7f147c0972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:06:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f14833c6640 1 -- 172.21.15.102:0/2770108504 shutdown_connections 2024-09-11T11:06:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.574+0000 7f14833c6640 1 -- 172.21.15.102:0/2770108504 wait complete. 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f14833c6640 1 Processor -- start 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f14833c6640 1 -- start start 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f14833c6640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06d0e0 0x7f147c12f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f14833c6640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f147c13b3b0 con 0x7f147c06d0e0 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f1481162640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06d0e0 0x7f147c12f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f1481162640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06d0e0 0x7f147c12f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36036/0 (socket says 172.21.15.102:36036) 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f1481162640 1 -- 172.21.15.102:0/2745914866 learned_addr learned my addr 172.21.15.102:0/2745914866 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f1481162640 1 -- 172.21.15.102:0/2745914866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147c130f10 con 0x7f147c06d0e0 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f1481162640 1 --2- 172.21.15.102:0/2745914866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06d0e0 0x7f147c12f1a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f147000c450 tx=0x7f147000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:06:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f146dffb640 1 -- 172.21.15.102:0/2745914866 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1470017070 con 0x7f147c06d0e0 2024-09-11T11:06:15.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f146dffb640 1 -- 172.21.15.102:0/2745914866 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1470005c20 con 0x7f147c06d0e0 2024-09-11T11:06:15.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147c0725e0 con 0x7f147c06d0e0 2024-09-11T11:06:15.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f146dffb640 1 -- 172.21.15.102:0/2745914866 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1470007070 con 0x7f147c06d0e0 2024-09-11T11:06:15.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f147c131ba0 con 0x7f147c06d0e0 2024-09-11T11:06:15.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147c130330 con 0x7f147c06d0e0 2024-09-11T11:06:15.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f146dffb640 1 -- 172.21.15.102:0/2745914866 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f147001a070 con 0x7f147c06d0e0 2024-09-11T11:06:15.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f146dffb640 1 --2- 172.21.15.102:0/2745914866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1460035db0 0x7f1460038270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:06:15.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f146dffb640 1 -- 172.21.15.102:0/2745914866 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f1470048390 con 0x7f147c06d0e0 2024-09-11T11:06:15.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.578+0000 7f1480961640 1 --2- 172.21.15.102:0/2745914866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1460035db0 0x7f1460038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:06:15.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.582+0000 7f1480961640 1 --2- 172.21.15.102:0/2745914866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1460035db0 0x7f1460038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f14780af000 tx=0x7f14780a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:06:15.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.582+0000 7f146dffb640 1 -- 172.21.15.102:0/2745914866 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f147001b3b0 con 0x7f147c06d0e0 2024-09-11T11:06:15.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.738+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 --> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f147c131700 con 0x7f1460035db0 2024-09-11T11:06:15.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.782+0000 7f146dffb640 1 -- 172.21.15.102:0/2745914866 <== mgr.4100 v2:172.21.15.145:6824/53826467 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665957 (secure 0 0 0) 0x7f147c131700 con 0x7f1460035db0 2024-09-11T11:06:15.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-11T11:06:15.797 INFO:teuthology.orchestra.run.smithi102.stderr:dumped all 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1460035db0 msgr2=0x7f1460038270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 --2- 172.21.15.102:0/2745914866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1460035db0 0x7f1460038270 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f14780af000 tx=0x7f14780a7070 comp rx=0 tx=0).stop 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06d0e0 msgr2=0x7f147c12f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 --2- 172.21.15.102:0/2745914866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06d0e0 0x7f147c12f1a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f147000c450 tx=0x7f147000c910 comp rx=0 tx=0).stop 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 shutdown_connections 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 --2- 172.21.15.102:0/2745914866 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f1460035db0 0x7f1460038270 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 --2- 172.21.15.102:0/2745914866 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f147c06d0e0 0x7f147c12f1a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 >> 172.21.15.102:0/2745914866 conn(0x7f147c099a50 msgr2=0x7f147c135340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:06:15.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 shutdown_connections 2024-09-11T11:06:15.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.786+0000 7f14833c6640 1 -- 172.21.15.102:0/2745914866 wait complete. 2024-09-11T11:06:15.805 INFO:teuthology.orchestra.run.smithi102.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-09-11T11:06:15.092939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605402,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5090,"num_read_kb":4675,"num_write":2181,"num_write_kb":61376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4793,"ondisk_log_size":4793,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":160992,"kb_used_data":2976,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326368,"statfs":{"total":386547056640,"available":386382200832,"internally_reserved":0,"allocated":3047424,"data_stored":1802812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006414"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:35.526672+0000","last_change":"2024-09-11T11:05:35.526727+0000","last_active":"2024-09-11T11:05:35.526672+0000","last_peered":"2024-09-11T11:05:35.526672+0000","last_clean":"2024-09-11T11:05:35.526672+0000","last_became_active":"2024-09-11T11:01:03.336333+0000","last_became_peered":"2024-09-11T11:01:03.336333+0000","last_unstale":"2024-09-11T11:05:35.526672+0000","last_undegraded":"2024-09-11T11:05:35.526672+0000","last_fullsized":"2024-09-11T11:05:35.526672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:35.526457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:35.526457+0000","last_clean_scrub_stamp":"2024-09-11T11:05:35.526457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:23:10.416627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.638687+0000","last_change":"2024-09-11T11:05:30.638687+0000","last_active":"2024-09-11T11:05:30.638687+0000","last_peered":"2024-09-11T11:05:30.638687+0000","last_clean":"2024-09-11T11:05:30.638687+0000","last_became_active":"2024-09-11T11:01:05.332897+0000","last_became_peered":"2024-09-11T11:01:05.332897+0000","last_unstale":"2024-09-11T11:05:30.638687+0000","last_undegraded":"2024-09-11T11:05:30.638687+0000","last_fullsized":"2024-09-11T11:05:30.638687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:30.638397+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:30.638397+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.638397+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:26.020290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:36.786479+0000","last_change":"2024-09-11T11:05:36.786537+0000","last_active":"2024-09-11T11:05:36.786479+0000","last_peered":"2024-09-11T11:05:36.786479+0000","last_clean":"2024-09-11T11:05:36.786479+0000","last_became_active":"2024-09-11T11:01:03.346113+0000","last_became_peered":"2024-09-11T11:01:03.346113+0000","last_unstale":"2024-09-11T11:05:36.786479+0000","last_undegraded":"2024-09-11T11:05:36.786479+0000","last_fullsized":"2024-09-11T11:05:36.786479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:36.786303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:36.786303+0000","last_clean_scrub_stamp":"2024-09-11T11:05:36.786303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:05:09.126121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"36'6","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:01.002100+0000","last_change":"2024-09-11T11:06:01.002100+0000","last_active":"2024-09-11T11:06:01.002100+0000","last_peered":"2024-09-11T11:06:01.002100+0000","last_clean":"2024-09-11T11:06:01.002100+0000","last_became_active":"2024-09-11T11:01:05.330885+0000","last_became_peered":"2024-09-11T11:01:05.330885+0000","last_unstale":"2024-09-11T11:06:01.002100+0000","last_undegraded":"2024-09-11T11:06:01.002100+0000","last_fullsized":"2024-09-11T11:06:01.002100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:06:01.001846+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:06:01.001846+0000","last_clean_scrub_stamp":"2024-09-11T11:06:01.001846+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:32:53.713810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:45.980138+0000","last_change":"2024-09-11T11:05:45.980191+0000","last_active":"2024-09-11T11:05:45.980138+0000","last_peered":"2024-09-11T11:05:45.980138+0000","last_clean":"2024-09-11T11:05:45.980138+0000","last_became_active":"2024-09-11T11:01:03.345673+0000","last_became_peered":"2024-09-11T11:01:03.345673+0000","last_unstale":"2024-09-11T11:05:45.980138+0000","last_undegraded":"2024-09-11T11:05:45.980138+0000","last_fullsized":"2024-09-11T11:05:45.980138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:45.979942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:45.979942+0000","last_clean_scrub_stamp":"2024-09-11T11:05:45.979942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:40:55.993232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"36'12","reported_seq":93,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:48.996945+0000","last_change":"2024-09-11T11:05:48.996945+0000","last_active":"2024-09-11T11:05:48.996945+0000","last_peered":"2024-09-11T11:05:48.996945+0000","last_clean":"2024-09-11T11:05:48.996945+0000","last_became_active":"2024-09-11T11:01:05.330639+0000","last_became_peered":"2024-09-11T11:01:05.330639+0000","last_unstale":"2024-09-11T11:05:48.996945+0000","last_undegraded":"2024-09-11T11:05:48.996945+0000","last_fullsized":"2024-09-11T11:05:48.996945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:48.996690+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:48.996690+0000","last_clean_scrub_stamp":"2024-09-11T11:05:48.996690+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:59.136490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:32.267553+0000","last_change":"2024-09-11T11:05:32.267614+0000","last_active":"2024-09-11T11:05:32.267553+0000","last_peered":"2024-09-11T11:05:32.267553+0000","last_clean":"2024-09-11T11:05:32.267553+0000","last_became_active":"2024-09-11T11:01:03.335132+0000","last_became_peered":"2024-09-11T11:01:03.335132+0000","last_unstale":"2024-09-11T11:05:32.267553+0000","last_undegraded":"2024-09-11T11:05:32.267553+0000","last_fullsized":"2024-09-11T11:05:32.267553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:32.267363+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:32.267363+0000","last_clean_scrub_stamp":"2024-09-11T11:05:32.267363+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:39:39.620550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"36'6","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.976154+0000","last_change":"2024-09-11T11:05:29.976154+0000","last_active":"2024-09-11T11:05:29.976154+0000","last_peered":"2024-09-11T11:05:29.976154+0000","last_clean":"2024-09-11T11:05:29.976154+0000","last_became_active":"2024-09-11T11:01:05.339018+0000","last_became_peered":"2024-09-11T11:01:05.339018+0000","last_unstale":"2024-09-11T11:05:29.976154+0000","last_undegraded":"2024-09-11T11:05:29.976154+0000","last_fullsized":"2024-09-11T11:05:29.976154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:29.975892+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:29.975892+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.975892+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:54:20.926150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:42.524642+0000","last_change":"2024-09-11T11:05:42.524642+0000","last_active":"2024-09-11T11:05:42.524642+0000","last_peered":"2024-09-11T11:05:42.524642+0000","last_clean":"2024-09-11T11:05:42.524642+0000","last_became_active":"2024-09-11T11:01:03.322877+0000","last_became_peered":"2024-09-11T11:01:03.322877+0000","last_unstale":"2024-09-11T11:05:42.524642+0000","last_undegraded":"2024-09-11T11:05:42.524642+0000","last_fullsized":"2024-09-11T11:05:42.524642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:42.524386+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:42.524386+0000","last_clean_scrub_stamp":"2024-09-11T11:05:42.524386+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:13.145812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.759603+0000","last_change":"2024-09-11T11:05:19.759671+0000","last_active":"2024-09-11T11:05:19.759603+0000","last_peered":"2024-09-11T11:05:19.759603+0000","last_clean":"2024-09-11T11:05:19.759603+0000","last_became_active":"2024-09-11T11:01:05.353908+0000","last_became_peered":"2024-09-11T11:01:05.353908+0000","last_unstale":"2024-09-11T11:05:19.759603+0000","last_undegraded":"2024-09-11T11:05:19.759603+0000","last_fullsized":"2024-09-11T11:05:19.759603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:19.759407+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:19.759407+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.759407+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:40.655656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:49.697968+0000","last_change":"2024-09-11T11:05:49.697968+0000","last_active":"2024-09-11T11:05:49.697968+0000","last_peered":"2024-09-11T11:05:49.697968+0000","last_clean":"2024-09-11T11:05:49.697968+0000","last_became_active":"2024-09-11T11:01:03.345964+0000","last_became_peered":"2024-09-11T11:01:03.345964+0000","last_unstale":"2024-09-11T11:05:49.697968+0000","last_undegraded":"2024-09-11T11:05:49.697968+0000","last_fullsized":"2024-09-11T11:05:49.697968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:49.697720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:49.697720+0000","last_clean_scrub_stamp":"2024-09-11T11:05:49.697720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:43:07.988491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"36'14","reported_seq":83,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.563987+0000","last_change":"2024-09-11T11:05:26.564047+0000","last_active":"2024-09-11T11:05:26.563987+0000","last_peered":"2024-09-11T11:05:26.563987+0000","last_clean":"2024-09-11T11:05:26.563987+0000","last_became_active":"2024-09-11T11:01:05.345664+0000","last_became_peered":"2024-09-11T11:01:05.345664+0000","last_unstale":"2024-09-11T11:05:26.563987+0000","last_undegraded":"2024-09-11T11:05:26.563987+0000","last_fullsized":"2024-09-11T11:05:26.563987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:26.563791+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:26.563791+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.563791+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:18.491908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"32'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:41.928864+0000","last_change":"2024-09-11T11:05:41.928864+0000","last_active":"2024-09-11T11:05:41.928864+0000","last_peered":"2024-09-11T11:05:41.928864+0000","last_clean":"2024-09-11T11:05:41.928864+0000","last_became_active":"2024-09-11T11:01:03.348822+0000","last_became_peered":"2024-09-11T11:01:03.348822+0000","last_unstale":"2024-09-11T11:05:41.928864+0000","last_undegraded":"2024-09-11T11:05:41.928864+0000","last_fullsized":"2024-09-11T11:05:41.928864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:41.928439+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:41.928439+0000","last_clean_scrub_stamp":"2024-09-11T11:05:41.928439+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:18:42.464276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"34'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.557877+0000","last_change":"2024-09-11T11:05:24.557938+0000","last_active":"2024-09-11T11:05:24.557877+0000","last_peered":"2024-09-11T11:05:24.557877+0000","last_clean":"2024-09-11T11:05:24.557877+0000","last_became_active":"2024-09-11T11:01:05.345698+0000","last_became_peered":"2024-09-11T11:01:05.345698+0000","last_unstale":"2024-09-11T11:05:24.557877+0000","last_undegraded":"2024-09-11T11:05:24.557877+0000","last_fullsized":"2024-09-11T11:05:24.557877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:24.557683+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:24.557683+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.557683+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:54:15.507940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:57.014498+0000","last_change":"2024-09-11T11:05:57.014498+0000","last_active":"2024-09-11T11:05:57.014498+0000","last_peered":"2024-09-11T11:05:57.014498+0000","last_clean":"2024-09-11T11:05:57.014498+0000","last_became_active":"2024-09-11T11:01:03.335830+0000","last_became_peered":"2024-09-11T11:01:03.335830+0000","last_unstale":"2024-09-11T11:05:57.014498+0000","last_undegraded":"2024-09-11T11:05:57.014498+0000","last_fullsized":"2024-09-11T11:05:57.014498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:57.014237+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:57.014237+0000","last_clean_scrub_stamp":"2024-09-11T11:05:57.014237+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:28:13.487603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":38,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.099939+0000","last_change":"2024-09-11T11:05:11.099939+0000","last_active":"2024-09-11T11:05:11.099939+0000","last_peered":"2024-09-11T11:05:11.099939+0000","last_clean":"2024-09-11T11:05:11.099939+0000","last_became_active":"2024-09-11T11:01:05.343805+0000","last_became_peered":"2024-09-11T11:01:05.343805+0000","last_unstale":"2024-09-11T11:05:11.099939+0000","last_undegraded":"2024-09-11T11:05:11.099939+0000","last_fullsized":"2024-09-11T11:05:11.099939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:11.099653+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:11.099653+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.099653+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:26:10.519865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.625311+0000","last_change":"2024-09-11T11:05:31.625311+0000","last_active":"2024-09-11T11:05:31.625311+0000","last_peered":"2024-09-11T11:05:31.625311+0000","last_clean":"2024-09-11T11:05:31.625311+0000","last_became_active":"2024-09-11T11:01:05.332915+0000","last_became_peered":"2024-09-11T11:01:05.332915+0000","last_unstale":"2024-09-11T11:05:31.625311+0000","last_undegraded":"2024-09-11T11:05:31.625311+0000","last_fullsized":"2024-09-11T11:05:31.625311+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:31.625052+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:31.625052+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.625052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:46:56.650684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"34'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:32.818873+0000","last_change":"2024-09-11T11:05:32.818873+0000","last_active":"2024-09-11T11:05:32.818873+0000","last_peered":"2024-09-11T11:05:32.818873+0000","last_clean":"2024-09-11T11:05:32.818873+0000","last_became_active":"2024-09-11T11:01:03.346878+0000","last_became_peered":"2024-09-11T11:01:03.346878+0000","last_unstale":"2024-09-11T11:05:32.818873+0000","last_undegraded":"2024-09-11T11:05:32.818873+0000","last_fullsized":"2024-09-11T11:05:32.818873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:32.818568+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:32.818568+0000","last_clean_scrub_stamp":"2024-09-11T11:05:32.818568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:06:00.813359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"36'8","reported_seq":41,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:37.350600+0000","last_change":"2024-09-11T11:05:37.350680+0000","last_active":"2024-09-11T11:05:37.350600+0000","last_peered":"2024-09-11T11:05:37.350600+0000","last_clean":"2024-09-11T11:05:37.350600+0000","last_became_active":"2024-09-11T11:01:42.050609+0000","last_became_peered":"2024-09-11T11:01:42.050609+0000","last_unstale":"2024-09-11T11:05:37.350600+0000","last_undegraded":"2024-09-11T11:05:37.350600+0000","last_fullsized":"2024-09-11T11:05:37.350600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:37.350371+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:37.350371+0000","last_clean_scrub_stamp":"2024-09-11T11:05:37.350371+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:39:50.143752+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.314221+0000","last_change":"2024-09-11T11:05:33.314221+0000","last_active":"2024-09-11T11:05:33.314221+0000","last_peered":"2024-09-11T11:05:33.314221+0000","last_clean":"2024-09-11T11:05:33.314221+0000","last_became_active":"2024-09-11T11:01:03.335121+0000","last_became_peered":"2024-09-11T11:01:03.335121+0000","last_unstale":"2024-09-11T11:05:33.314221+0000","last_undegraded":"2024-09-11T11:05:33.314221+0000","last_fullsized":"2024-09-11T11:05:33.314221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:33.313854+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:33.313854+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.313854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:45:52.502378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"34'6","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:34.549971+0000","last_change":"2024-09-11T11:05:34.549971+0000","last_active":"2024-09-11T11:05:34.549971+0000","last_peered":"2024-09-11T11:05:34.549971+0000","last_clean":"2024-09-11T11:05:34.549971+0000","last_became_active":"2024-09-11T11:01:05.332299+0000","last_became_peered":"2024-09-11T11:01:05.332299+0000","last_unstale":"2024-09-11T11:05:34.549971+0000","last_undegraded":"2024-09-11T11:05:34.549971+0000","last_fullsized":"2024-09-11T11:05:34.549971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-11T11:05:34.549716+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-11T11:05:34.549716+0000","last_clean_scrub_stamp":"2024-09-11T11:05:34.549716+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:06.497295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:47.653060+0000","last_change":"2024-09-11T11:05:47.653060+0000","last_active":"2024-09-11T11:05:47.653060+0000","last_peered":"2024-09-11T11:05:47.653060+0000","last_clean":"2024-09-11T11:05:47.653060+0000","last_became_active":"2024-09-11T11:01:03.345528+0000","last_became_peered":"2024-09-11T11:01:03.345528+0000","last_unstale":"2024-09-11T11:05:47.653060+0000","last_undegraded":"2024-09-11T11:05:47.653060+0000","last_fullsized":"2024-09-11T11:05:47.653060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:47.652748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:47.652748+0000","last_clean_scrub_stamp":"2024-09-11T11:05:47.652748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:26.607016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"36'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.098881+0000","last_change":"2024-09-11T11:05:17.098881+0000","last_active":"2024-09-11T11:05:17.098881+0000","last_peered":"2024-09-11T11:05:17.098881+0000","last_clean":"2024-09-11T11:05:17.098881+0000","last_became_active":"2024-09-11T11:01:05.352754+0000","last_became_peered":"2024-09-11T11:01:05.352754+0000","last_unstale":"2024-09-11T11:05:17.098881+0000","last_undegraded":"2024-09-11T11:05:17.098881+0000","last_fullsized":"2024-09-11T11:05:17.098881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:17.098602+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:17.098602+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.098602+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:55:03.563158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:44.594034+0000","last_change":"2024-09-11T11:05:44.594034+0000","last_active":"2024-09-11T11:05:44.594034+0000","last_peered":"2024-09-11T11:05:44.594034+0000","last_clean":"2024-09-11T11:05:44.594034+0000","last_became_active":"2024-09-11T11:01:03.321411+0000","last_became_peered":"2024-09-11T11:01:03.321411+0000","last_unstale":"2024-09-11T11:05:44.594034+0000","last_undegraded":"2024-09-11T11:05:44.594034+0000","last_fullsized":"2024-09-11T11:05:44.594034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:44.593722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:44.593722+0000","last_clean_scrub_stamp":"2024-09-11T11:05:44.593722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:30.905715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"36'32","reported_seq":121,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.206736+0000","last_change":"2024-09-11T11:05:22.206736+0000","last_active":"2024-09-11T11:05:22.206736+0000","last_peered":"2024-09-11T11:05:22.206736+0000","last_clean":"2024-09-11T11:05:22.206736+0000","last_became_active":"2024-09-11T11:01:05.337040+0000","last_became_peered":"2024-09-11T11:01:05.337040+0000","last_unstale":"2024-09-11T11:05:22.206736+0000","last_undegraded":"2024-09-11T11:05:22.206736+0000","last_fullsized":"2024-09-11T11:05:22.206736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'32","last_scrub_stamp":"2024-09-11T11:05:22.206344+0000","last_deep_scrub":"36'32","last_deep_scrub_stamp":"2024-09-11T11:05:22.206344+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.206344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:41:54.884487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":103,"num_write":40,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"36'4","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:54.016544+0000","last_change":"2024-09-11T11:05:54.016604+0000","last_active":"2024-09-11T11:05:54.016544+0000","last_peered":"2024-09-11T11:05:54.016544+0000","last_clean":"2024-09-11T11:05:54.016544+0000","last_became_active":"2024-09-11T11:01:03.333820+0000","last_became_peered":"2024-09-11T11:01:03.333820+0000","last_unstale":"2024-09-11T11:05:54.016544+0000","last_undegraded":"2024-09-11T11:05:54.016544+0000","last_fullsized":"2024-09-11T11:05:54.016544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:54.016349+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:54.016349+0000","last_clean_scrub_stamp":"2024-09-11T11:05:54.016349+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:04:57.799419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:41.801724+0000","last_change":"2024-09-11T11:05:41.801724+0000","last_active":"2024-09-11T11:05:41.801724+0000","last_peered":"2024-09-11T11:05:41.801724+0000","last_clean":"2024-09-11T11:05:41.801724+0000","last_became_active":"2024-09-11T11:01:05.342461+0000","last_became_peered":"2024-09-11T11:01:05.342461+0000","last_unstale":"2024-09-11T11:05:41.801724+0000","last_undegraded":"2024-09-11T11:05:41.801724+0000","last_fullsized":"2024-09-11T11:05:41.801724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:41.801462+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:41.801462+0000","last_clean_scrub_stamp":"2024-09-11T11:05:41.801462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:02:49.901613+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"36'4","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:43.946070+0000","last_change":"2024-09-11T11:05:43.946131+0000","last_active":"2024-09-11T11:05:43.946070+0000","last_peered":"2024-09-11T11:05:43.946070+0000","last_clean":"2024-09-11T11:05:43.946070+0000","last_became_active":"2024-09-11T11:01:03.345866+0000","last_became_peered":"2024-09-11T11:01:03.345866+0000","last_unstale":"2024-09-11T11:05:43.946070+0000","last_undegraded":"2024-09-11T11:05:43.946070+0000","last_fullsized":"2024-09-11T11:05:43.946070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:43.945871+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:43.945871+0000","last_clean_scrub_stamp":"2024-09-11T11:05:43.945871+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:52.147561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":4721,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"36'38","reported_seq":119,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.928423+0000","last_change":"2024-09-11T11:05:09.928423+0000","last_active":"2024-09-11T11:05:09.928423+0000","last_peered":"2024-09-11T11:05:09.928423+0000","last_clean":"2024-09-11T11:05:09.928423+0000","last_became_active":"2024-09-11T11:01:13.410232+0000","last_became_peered":"2024-09-11T11:01:13.410232+0000","last_unstale":"2024-09-11T11:05:09.928423+0000","last_undegraded":"2024-09-11T11:05:09.928423+0000","last_fullsized":"2024-09-11T11:05:09.928423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'38","last_scrub_stamp":"2024-09-11T11:05:09.928140+0000","last_deep_scrub":"36'38","last_deep_scrub_stamp":"2024-09-11T11:05:09.928140+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.928140+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:11.772636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":184,"num_read_kb":181,"num_write":102,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"36'14","reported_seq":103,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.871402+0000","last_change":"2024-09-11T11:05:25.871402+0000","last_active":"2024-09-11T11:05:25.871402+0000","last_peered":"2024-09-11T11:05:25.871402+0000","last_clean":"2024-09-11T11:05:25.871402+0000","last_became_active":"2024-09-11T11:01:05.347254+0000","last_became_peered":"2024-09-11T11:01:05.347254+0000","last_unstale":"2024-09-11T11:05:25.871402+0000","last_undegraded":"2024-09-11T11:05:25.871402+0000","last_fullsized":"2024-09-11T11:05:25.871402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:25.871155+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:25.871155+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.871155+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:49:47.213499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":73,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:49.957858+0000","last_change":"2024-09-11T11:05:49.957921+0000","last_active":"2024-09-11T11:05:49.957858+0000","last_peered":"2024-09-11T11:05:49.957858+0000","last_clean":"2024-09-11T11:05:49.957858+0000","last_became_active":"2024-09-11T11:01:03.340851+0000","last_became_peered":"2024-09-11T11:01:03.340851+0000","last_unstale":"2024-09-11T11:05:49.957858+0000","last_undegraded":"2024-09-11T11:05:49.957858+0000","last_fullsized":"2024-09-11T11:05:49.957858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:49.957655+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:49.957655+0000","last_clean_scrub_stamp":"2024-09-11T11:05:49.957655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:36.269648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.702297+0000","last_change":"2024-09-11T11:05:00.702297+0000","last_active":"2024-09-11T11:05:00.702297+0000","last_peered":"2024-09-11T11:05:00.702297+0000","last_clean":"2024-09-11T11:05:00.702297+0000","last_became_active":"2024-09-11T11:01:07.363392+0000","last_became_peered":"2024-09-11T11:01:07.363392+0000","last_unstale":"2024-09-11T11:05:00.702297+0000","last_undegraded":"2024-09-11T11:05:00.702297+0000","last_fullsized":"2024-09-11T11:05:00.702297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.702044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.702044+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.702044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:35.422637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"36'37","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.718768+0000","last_change":"2024-09-11T11:05:09.718768+0000","last_active":"2024-09-11T11:05:09.718768+0000","last_peered":"2024-09-11T11:05:09.718768+0000","last_clean":"2024-09-11T11:05:09.718768+0000","last_became_active":"2024-09-11T11:01:09.392044+0000","last_became_peered":"2024-09-11T11:01:09.392044+0000","last_unstale":"2024-09-11T11:05:09.718768+0000","last_undegraded":"2024-09-11T11:05:09.718768+0000","last_fullsized":"2024-09-11T11:05:09.718768+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:05:09.718489+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:05:09.718489+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.718489+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:24.928510+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.525939+0000","last_change":"2024-09-11T11:05:21.525939+0000","last_active":"2024-09-11T11:05:21.525939+0000","last_peered":"2024-09-11T11:05:21.525939+0000","last_clean":"2024-09-11T11:05:21.525939+0000","last_became_active":"2024-09-11T11:01:11.399820+0000","last_became_peered":"2024-09-11T11:01:11.399820+0000","last_unstale":"2024-09-11T11:05:21.525939+0000","last_undegraded":"2024-09-11T11:05:21.525939+0000","last_fullsized":"2024-09-11T11:05:21.525939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:21.525658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:21.525658+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.525658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:11:58.144083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.19","version":"34'7","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:02.866342+0000","last_change":"2024-09-11T11:06:02.866342+0000","last_active":"2024-09-11T11:06:02.866342+0000","last_peered":"2024-09-11T11:06:02.866342+0000","last_clean":"2024-09-11T11:06:02.866342+0000","last_became_active":"2024-09-11T11:01:13.420843+0000","last_became_peered":"2024-09-11T11:01:13.420843+0000","last_unstale":"2024-09-11T11:06:02.866342+0000","last_undegraded":"2024-09-11T11:06:02.866342+0000","last_fullsized":"2024-09-11T11:06:02.866342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'7","last_scrub_stamp":"2024-09-11T11:06:02.866084+0000","last_deep_scrub":"34'7","last_deep_scrub_stamp":"2024-09-11T11:06:02.866084+0000","last_clean_scrub_stamp":"2024-09-11T11:06:02.866084+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:14.308534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"36'18","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.982877+0000","last_change":"2024-09-11T11:05:33.982877+0000","last_active":"2024-09-11T11:05:33.982877+0000","last_peered":"2024-09-11T11:05:33.982877+0000","last_clean":"2024-09-11T11:05:33.982877+0000","last_became_active":"2024-09-11T11:01:05.334085+0000","last_became_peered":"2024-09-11T11:01:05.334085+0000","last_unstale":"2024-09-11T11:05:33.982877+0000","last_undegraded":"2024-09-11T11:05:33.982877+0000","last_fullsized":"2024-09-11T11:05:33.982877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:33.982608+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:33.982608+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.982608+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:20:05.905492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":43,"num_read_kb":39,"num_write":19,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:34.321025+0000","last_change":"2024-09-11T11:05:34.321025+0000","last_active":"2024-09-11T11:05:34.321025+0000","last_peered":"2024-09-11T11:05:34.321025+0000","last_clean":"2024-09-11T11:05:34.321025+0000","last_became_active":"2024-09-11T11:01:03.335439+0000","last_became_peered":"2024-09-11T11:01:03.335439+0000","last_unstale":"2024-09-11T11:05:34.321025+0000","last_undegraded":"2024-09-11T11:05:34.321025+0000","last_fullsized":"2024-09-11T11:05:34.321025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:34.320743+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:34.320743+0000","last_clean_scrub_stamp":"2024-09-11T11:05:34.320743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:08:11.922999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.792269+0000","last_change":"2024-09-11T11:05:17.792269+0000","last_active":"2024-09-11T11:05:17.792269+0000","last_peered":"2024-09-11T11:05:17.792269+0000","last_clean":"2024-09-11T11:05:17.792269+0000","last_became_active":"2024-09-11T11:01:07.350851+0000","last_became_peered":"2024-09-11T11:01:07.350851+0000","last_unstale":"2024-09-11T11:05:17.792269+0000","last_undegraded":"2024-09-11T11:05:17.792269+0000","last_fullsized":"2024-09-11T11:05:17.792269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:17.792030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:17.792030+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.792030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:12.128368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'9","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.834620+0000","last_change":"2024-09-11T11:05:00.834620+0000","last_active":"2024-09-11T11:05:00.834620+0000","last_peered":"2024-09-11T11:05:00.834620+0000","last_clean":"2024-09-11T11:05:00.834620+0000","last_became_active":"2024-09-11T11:01:09.382890+0000","last_became_peered":"2024-09-11T11:01:09.382890+0000","last_unstale":"2024-09-11T11:05:00.834620+0000","last_undegraded":"2024-09-11T11:05:00.834620+0000","last_fullsized":"2024-09-11T11:05:00.834620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:00.834344+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:00.834344+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.834344+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:37:29.350377+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.589554+0000","last_change":"2024-09-11T11:05:29.589554+0000","last_active":"2024-09-11T11:05:29.589554+0000","last_peered":"2024-09-11T11:05:29.589554+0000","last_clean":"2024-09-11T11:05:29.589554+0000","last_became_active":"2024-09-11T11:01:11.400881+0000","last_became_peered":"2024-09-11T11:01:11.400881+0000","last_unstale":"2024-09-11T11:05:29.589554+0000","last_undegraded":"2024-09-11T11:05:29.589554+0000","last_fullsized":"2024-09-11T11:05:29.589554+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:29.589300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:29.589300+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.589300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:07:20.230027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1a","version":"34'6","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:06.930040+0000","last_change":"2024-09-11T11:06:06.930040+0000","last_active":"2024-09-11T11:06:06.930040+0000","last_peered":"2024-09-11T11:06:06.930040+0000","last_clean":"2024-09-11T11:06:06.930040+0000","last_became_active":"2024-09-11T11:01:13.422439+0000","last_became_peered":"2024-09-11T11:01:13.422439+0000","last_unstale":"2024-09-11T11:06:06.930040+0000","last_undegraded":"2024-09-11T11:06:06.930040+0000","last_fullsized":"2024-09-11T11:06:06.930040+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'6","last_scrub_stamp":"2024-09-11T11:06:06.929676+0000","last_deep_scrub":"34'6","last_deep_scrub_stamp":"2024-09-11T11:06:06.929676+0000","last_clean_scrub_stamp":"2024-09-11T11:06:06.929676+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:58:08.543058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.949348+0000","last_change":"2024-09-11T11:05:31.949348+0000","last_active":"2024-09-11T11:05:31.949348+0000","last_peered":"2024-09-11T11:05:31.949348+0000","last_clean":"2024-09-11T11:05:31.949348+0000","last_became_active":"2024-09-11T11:01:05.343489+0000","last_became_peered":"2024-09-11T11:01:05.343489+0000","last_unstale":"2024-09-11T11:05:31.949348+0000","last_undegraded":"2024-09-11T11:05:31.949348+0000","last_fullsized":"2024-09-11T11:05:31.949348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:31.949083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:31.949083+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.949083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:42:23.877200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"34'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:41.481083+0000","last_change":"2024-09-11T11:05:41.481083+0000","last_active":"2024-09-11T11:05:41.481083+0000","last_peered":"2024-09-11T11:05:41.481083+0000","last_clean":"2024-09-11T11:05:41.481083+0000","last_became_active":"2024-09-11T11:01:03.337993+0000","last_became_peered":"2024-09-11T11:01:03.337993+0000","last_unstale":"2024-09-11T11:05:41.481083+0000","last_undegraded":"2024-09-11T11:05:41.481083+0000","last_fullsized":"2024-09-11T11:05:41.481083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:41.480819+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:41.480819+0000","last_clean_scrub_stamp":"2024-09-11T11:05:41.480819+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:57:36.269805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.680805+0000","last_change":"2024-09-11T11:05:01.680805+0000","last_active":"2024-09-11T11:05:01.680805+0000","last_peered":"2024-09-11T11:05:01.680805+0000","last_clean":"2024-09-11T11:05:01.680805+0000","last_became_active":"2024-09-11T11:01:07.363656+0000","last_became_peered":"2024-09-11T11:01:07.363656+0000","last_unstale":"2024-09-11T11:05:01.680805+0000","last_undegraded":"2024-09-11T11:05:01.680805+0000","last_fullsized":"2024-09-11T11:05:01.680805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.680409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.680409+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.680409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:58.475877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.060236+0000","last_change":"2024-09-11T11:05:08.060383+0000","last_active":"2024-09-11T11:05:08.060236+0000","last_peered":"2024-09-11T11:05:08.060236+0000","last_clean":"2024-09-11T11:05:08.060236+0000","last_became_active":"2024-09-11T11:01:09.365291+0000","last_became_peered":"2024-09-11T11:01:09.365291+0000","last_unstale":"2024-09-11T11:05:08.060236+0000","last_undegraded":"2024-09-11T11:05:08.060236+0000","last_fullsized":"2024-09-11T11:05:08.060236+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:05:08.060026+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:05:08.060026+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.060026+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:05:14.856797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"36'285","reported_seq":399,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.459650+0000","last_change":"2024-09-11T11:05:03.459650+0000","last_active":"2024-09-11T11:05:03.459650+0000","last_peered":"2024-09-11T11:05:03.459650+0000","last_clean":"2024-09-11T11:05:03.459650+0000","last_became_active":"2024-09-11T11:01:11.384635+0000","last_became_peered":"2024-09-11T11:01:11.384635+0000","last_unstale":"2024-09-11T11:05:03.459650+0000","last_undegraded":"2024-09-11T11:05:03.459650+0000","last_fullsized":"2024-09-11T11:05:03.459650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:03.459391+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:03.459391+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.459391+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:45.406062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1b","version":"32'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.952144+0000","last_change":"2024-09-11T11:05:04.952144+0000","last_active":"2024-09-11T11:05:04.952144+0000","last_peered":"2024-09-11T11:05:04.952144+0000","last_clean":"2024-09-11T11:05:04.952144+0000","last_became_active":"2024-09-11T11:01:13.413465+0000","last_became_peered":"2024-09-11T11:01:13.413465+0000","last_unstale":"2024-09-11T11:05:04.952144+0000","last_undegraded":"2024-09-11T11:05:04.952144+0000","last_fullsized":"2024-09-11T11:05:04.952144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:04.951892+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:04.951892+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.951892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:22.063365+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"36'18","reported_seq":77,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.851968+0000","last_change":"2024-09-11T11:05:24.851968+0000","last_active":"2024-09-11T11:05:24.851968+0000","last_peered":"2024-09-11T11:05:24.851968+0000","last_clean":"2024-09-11T11:05:24.851968+0000","last_became_active":"2024-09-11T11:01:05.347434+0000","last_became_peered":"2024-09-11T11:01:05.347434+0000","last_unstale":"2024-09-11T11:05:24.851968+0000","last_undegraded":"2024-09-11T11:05:24.851968+0000","last_fullsized":"2024-09-11T11:05:24.851968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:24.851668+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:24.851668+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.851668+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:03.456585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":50,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"36'6","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:58.800428+0000","last_change":"2024-09-11T11:05:58.800487+0000","last_active":"2024-09-11T11:05:58.800428+0000","last_peered":"2024-09-11T11:05:58.800428+0000","last_clean":"2024-09-11T11:05:58.800428+0000","last_became_active":"2024-09-11T11:01:03.320684+0000","last_became_peered":"2024-09-11T11:01:03.320684+0000","last_unstale":"2024-09-11T11:05:58.800428+0000","last_undegraded":"2024-09-11T11:05:58.800428+0000","last_fullsized":"2024-09-11T11:05:58.800428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:58.800232+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:58.800232+0000","last_clean_scrub_stamp":"2024-09-11T11:05:58.800232+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:05:26.427233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":14,"num_write_kb":8193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.523485+0000","last_change":"2024-09-11T11:05:15.523485+0000","last_active":"2024-09-11T11:05:15.523485+0000","last_peered":"2024-09-11T11:05:15.523485+0000","last_clean":"2024-09-11T11:05:15.523485+0000","last_became_active":"2024-09-11T11:01:07.342607+0000","last_became_peered":"2024-09-11T11:01:07.342607+0000","last_unstale":"2024-09-11T11:05:15.523485+0000","last_undegraded":"2024-09-11T11:05:15.523485+0000","last_fullsized":"2024-09-11T11:05:15.523485+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:15.523235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:15.523235+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.523235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:14:57.922368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"36'36","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.529010+0000","last_change":"2024-09-11T11:05:01.529010+0000","last_active":"2024-09-11T11:05:01.529010+0000","last_peered":"2024-09-11T11:05:01.529010+0000","last_clean":"2024-09-11T11:05:01.529010+0000","last_became_active":"2024-09-11T11:01:09.366811+0000","last_became_peered":"2024-09-11T11:01:09.366811+0000","last_unstale":"2024-09-11T11:05:01.529010+0000","last_undegraded":"2024-09-11T11:05:01.529010+0000","last_fullsized":"2024-09-11T11:05:01.529010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-11T11:05:01.528740+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-11T11:05:01.528740+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.528740+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:15.569259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"36'285","reported_seq":428,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.811502+0000","last_change":"2024-09-11T11:05:14.811502+0000","last_active":"2024-09-11T11:05:14.811502+0000","last_peered":"2024-09-11T11:05:14.811502+0000","last_clean":"2024-09-11T11:05:14.811502+0000","last_became_active":"2024-09-11T11:01:11.399213+0000","last_became_peered":"2024-09-11T11:01:11.399213+0000","last_unstale":"2024-09-11T11:05:14.811502+0000","last_undegraded":"2024-09-11T11:05:14.811502+0000","last_fullsized":"2024-09-11T11:05:14.811502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:14.811094+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:14.811094+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.811094+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:21.184720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:46.950733+0000","last_change":"2024-09-11T11:05:46.950801+0000","last_active":"2024-09-11T11:05:46.950733+0000","last_peered":"2024-09-11T11:05:46.950733+0000","last_clean":"2024-09-11T11:05:46.950733+0000","last_became_active":"2024-09-11T11:01:05.330091+0000","last_became_peered":"2024-09-11T11:01:05.330091+0000","last_unstale":"2024-09-11T11:05:46.950733+0000","last_undegraded":"2024-09-11T11:05:46.950733+0000","last_fullsized":"2024-09-11T11:05:46.950733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:46.950544+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:46.950544+0000","last_clean_scrub_stamp":"2024-09-11T11:05:46.950544+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:57:41.739529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"32'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:37.578146+0000","last_change":"2024-09-11T11:05:37.578204+0000","last_active":"2024-09-11T11:05:37.578146+0000","last_peered":"2024-09-11T11:05:37.578146+0000","last_clean":"2024-09-11T11:05:37.578146+0000","last_became_active":"2024-09-11T11:01:03.337496+0000","last_became_peered":"2024-09-11T11:01:03.337496+0000","last_unstale":"2024-09-11T11:05:37.578146+0000","last_undegraded":"2024-09-11T11:05:37.578146+0000","last_fullsized":"2024-09-11T11:05:37.578146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:37.577957+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:37.577957+0000","last_clean_scrub_stamp":"2024-09-11T11:05:37.577957+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:56:54.829409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.926709+0000","last_change":"2024-09-11T11:05:11.926709+0000","last_active":"2024-09-11T11:05:11.926709+0000","last_peered":"2024-09-11T11:05:11.926709+0000","last_clean":"2024-09-11T11:05:11.926709+0000","last_became_active":"2024-09-11T11:01:07.366115+0000","last_became_peered":"2024-09-11T11:01:07.366115+0000","last_unstale":"2024-09-11T11:05:11.926709+0000","last_undegraded":"2024-09-11T11:05:11.926709+0000","last_fullsized":"2024-09-11T11:05:11.926709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:11.926427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:11.926427+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.926427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:21.706743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"36'51","reported_seq":116,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.567491+0000","last_change":"2024-09-11T11:05:08.567491+0000","last_active":"2024-09-11T11:05:08.567491+0000","last_peered":"2024-09-11T11:05:08.567491+0000","last_clean":"2024-09-11T11:05:08.567491+0000","last_became_active":"2024-09-11T11:01:09.376242+0000","last_became_peered":"2024-09-11T11:01:09.376242+0000","last_unstale":"2024-09-11T11:05:08.567491+0000","last_undegraded":"2024-09-11T11:05:08.567491+0000","last_fullsized":"2024-09-11T11:05:08.567491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'51","last_scrub_stamp":"2024-09-11T11:05:08.567207+0000","last_deep_scrub":"36'51","last_deep_scrub_stamp":"2024-09-11T11:05:08.567207+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.567207+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:00:58.320487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.791900+0000","last_change":"2024-09-11T11:04:59.791900+0000","last_active":"2024-09-11T11:04:59.791900+0000","last_peered":"2024-09-11T11:04:59.791900+0000","last_clean":"2024-09-11T11:04:59.791900+0000","last_became_active":"2024-09-11T11:01:11.377655+0000","last_became_peered":"2024-09-11T11:01:11.377655+0000","last_unstale":"2024-09-11T11:04:59.791900+0000","last_undegraded":"2024-09-11T11:04:59.791900+0000","last_fullsized":"2024-09-11T11:04:59.791900+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.791500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.791500+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.791500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:50.251368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"34'5","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.100323+0000","last_change":"2024-09-11T11:05:09.100323+0000","last_active":"2024-09-11T11:05:09.100323+0000","last_peered":"2024-09-11T11:05:09.100323+0000","last_clean":"2024-09-11T11:05:09.100323+0000","last_became_active":"2024-09-11T11:01:13.420299+0000","last_became_peered":"2024-09-11T11:01:13.420299+0000","last_unstale":"2024-09-11T11:05:09.100323+0000","last_undegraded":"2024-09-11T11:05:09.100323+0000","last_fullsized":"2024-09-11T11:05:09.100323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'5","last_scrub_stamp":"2024-09-11T11:05:09.099958+0000","last_deep_scrub":"34'5","last_deep_scrub_stamp":"2024-09-11T11:05:09.099958+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.099958+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:33:10.200502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":11,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.768459+0000","last_change":"2024-09-11T11:05:18.768459+0000","last_active":"2024-09-11T11:05:18.768459+0000","last_peered":"2024-09-11T11:05:18.768459+0000","last_clean":"2024-09-11T11:05:18.768459+0000","last_became_active":"2024-09-11T11:01:05.355135+0000","last_became_peered":"2024-09-11T11:01:05.355135+0000","last_unstale":"2024-09-11T11:05:18.768459+0000","last_undegraded":"2024-09-11T11:05:18.768459+0000","last_fullsized":"2024-09-11T11:05:18.768459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:18.768214+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:18.768214+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.768214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:21:01.255786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:46.645430+0000","last_change":"2024-09-11T11:05:46.645481+0000","last_active":"2024-09-11T11:05:46.645430+0000","last_peered":"2024-09-11T11:05:46.645430+0000","last_clean":"2024-09-11T11:05:46.645430+0000","last_became_active":"2024-09-11T11:01:03.320605+0000","last_became_peered":"2024-09-11T11:01:03.320605+0000","last_unstale":"2024-09-11T11:05:46.645430+0000","last_undegraded":"2024-09-11T11:05:46.645430+0000","last_fullsized":"2024-09-11T11:05:46.645430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:46.645205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:46.645205+0000","last_clean_scrub_stamp":"2024-09-11T11:05:46.645205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:14.831040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.228408+0000","last_change":"2024-09-11T11:05:25.228408+0000","last_active":"2024-09-11T11:05:25.228408+0000","last_peered":"2024-09-11T11:05:25.228408+0000","last_clean":"2024-09-11T11:05:25.228408+0000","last_became_active":"2024-09-11T11:01:07.348627+0000","last_became_peered":"2024-09-11T11:01:07.348627+0000","last_unstale":"2024-09-11T11:05:25.228408+0000","last_undegraded":"2024-09-11T11:05:25.228408+0000","last_fullsized":"2024-09-11T11:05:25.228408+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:25.228148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:25.228148+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.228148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:47.980976+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'37","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.803733+0000","last_change":"2024-09-11T11:05:15.803733+0000","last_active":"2024-09-11T11:05:15.803733+0000","last_peered":"2024-09-11T11:05:15.803733+0000","last_clean":"2024-09-11T11:05:15.803733+0000","last_became_active":"2024-09-11T11:01:09.384478+0000","last_became_peered":"2024-09-11T11:01:09.384478+0000","last_unstale":"2024-09-11T11:05:15.803733+0000","last_undegraded":"2024-09-11T11:05:15.803733+0000","last_fullsized":"2024-09-11T11:05:15.803733+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:05:15.803452+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:05:15.803452+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.803452+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:02:03.374998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.809410+0000","last_change":"2024-09-11T11:05:22.809410+0000","last_active":"2024-09-11T11:05:22.809410+0000","last_peered":"2024-09-11T11:05:22.809410+0000","last_clean":"2024-09-11T11:05:22.809410+0000","last_became_active":"2024-09-11T11:01:11.401382+0000","last_became_peered":"2024-09-11T11:01:11.401382+0000","last_unstale":"2024-09-11T11:05:22.809410+0000","last_undegraded":"2024-09-11T11:05:22.809410+0000","last_fullsized":"2024-09-11T11:05:22.809410+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:22.809156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:22.809156+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.809156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:39.640451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"36'4","reported_seq":38,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.782301+0000","last_change":"2024-09-11T11:05:25.782361+0000","last_active":"2024-09-11T11:05:25.782301+0000","last_peered":"2024-09-11T11:05:25.782301+0000","last_clean":"2024-09-11T11:05:25.782301+0000","last_became_active":"2024-09-11T11:01:13.415041+0000","last_became_peered":"2024-09-11T11:01:13.415041+0000","last_unstale":"2024-09-11T11:05:25.782301+0000","last_undegraded":"2024-09-11T11:05:25.782301+0000","last_fullsized":"2024-09-11T11:05:25.782301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:25.782127+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:25.782127+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.782127+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:59:13.498641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"36'8","reported_seq":71,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.510039+0000","last_change":"2024-09-11T11:05:23.510039+0000","last_active":"2024-09-11T11:05:23.510039+0000","last_peered":"2024-09-11T11:05:23.510039+0000","last_clean":"2024-09-11T11:05:23.510039+0000","last_became_active":"2024-09-11T11:01:05.347137+0000","last_became_peered":"2024-09-11T11:01:05.347137+0000","last_unstale":"2024-09-11T11:05:23.510039+0000","last_undegraded":"2024-09-11T11:05:23.510039+0000","last_fullsized":"2024-09-11T11:05:23.510039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:23.509784+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:23.509784+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.509784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:35.128425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"32'2","reported_seq":63,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:06.891463+0000","last_change":"2024-09-11T11:06:06.891525+0000","last_active":"2024-09-11T11:06:06.891463+0000","last_peered":"2024-09-11T11:06:06.891463+0000","last_clean":"2024-09-11T11:06:06.891463+0000","last_became_active":"2024-09-11T11:01:42.065732+0000","last_became_peered":"2024-09-11T11:01:42.065732+0000","last_unstale":"2024-09-11T11:06:06.891463+0000","last_undegraded":"2024-09-11T11:06:06.891463+0000","last_fullsized":"2024-09-11T11:06:06.891463+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:06:06.891263+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:06:06.891263+0000","last_clean_scrub_stamp":"2024-09-11T11:06:06.891263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:04:11.019936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:39.344584+0000","last_change":"2024-09-11T11:05:39.344638+0000","last_active":"2024-09-11T11:05:39.344584+0000","last_peered":"2024-09-11T11:05:39.344584+0000","last_clean":"2024-09-11T11:05:39.344584+0000","last_became_active":"2024-09-11T11:01:42.062781+0000","last_became_peered":"2024-09-11T11:01:42.062781+0000","last_unstale":"2024-09-11T11:05:39.344584+0000","last_undegraded":"2024-09-11T11:05:39.344584+0000","last_fullsized":"2024-09-11T11:05:39.344584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:39.344388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:39.344388+0000","last_clean_scrub_stamp":"2024-09-11T11:05:39.344388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:02:59.563125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'45","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.540432+0000","last_change":"2024-09-11T11:04:53.540432+0000","last_active":"2024-09-11T11:04:53.540432+0000","last_peered":"2024-09-11T11:04:53.540432+0000","last_clean":"2024-09-11T11:04:53.540432+0000","last_became_active":"2024-09-11T11:01:09.362260+0000","last_became_peered":"2024-09-11T11:01:09.362260+0000","last_unstale":"2024-09-11T11:04:53.540432+0000","last_undegraded":"2024-09-11T11:04:53.540432+0000","last_fullsized":"2024-09-11T11:04:53.540432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:04:53.540311+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:04:53.540311+0000","last_clean_scrub_stamp":"2024-09-11T11:04:53.540311+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:22:12.396021+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"36'285","reported_seq":393,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.964081+0000","last_change":"2024-09-11T11:05:03.964081+0000","last_active":"2024-09-11T11:05:03.964081+0000","last_peered":"2024-09-11T11:05:03.964081+0000","last_clean":"2024-09-11T11:05:03.964081+0000","last_became_active":"2024-09-11T11:01:11.391826+0000","last_became_peered":"2024-09-11T11:01:11.391826+0000","last_unstale":"2024-09-11T11:05:03.964081+0000","last_undegraded":"2024-09-11T11:05:03.964081+0000","last_fullsized":"2024-09-11T11:05:03.964081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:03.963831+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:03.963831+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.963831+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:53:34.267498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:55.835424+0000","last_change":"2024-09-11T11:05:55.835482+0000","last_active":"2024-09-11T11:05:55.835424+0000","last_peered":"2024-09-11T11:05:55.835424+0000","last_clean":"2024-09-11T11:05:55.835424+0000","last_became_active":"2024-09-11T11:01:13.428914+0000","last_became_peered":"2024-09-11T11:01:13.428914+0000","last_unstale":"2024-09-11T11:05:55.835424+0000","last_undegraded":"2024-09-11T11:05:55.835424+0000","last_fullsized":"2024-09-11T11:05:55.835424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:55.835229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:55.835229+0000","last_clean_scrub_stamp":"2024-09-11T11:05:55.835229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:26.456655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.074666+0000","last_change":"2024-09-11T11:05:12.074666+0000","last_active":"2024-09-11T11:05:12.074666+0000","last_peered":"2024-09-11T11:05:12.074666+0000","last_clean":"2024-09-11T11:05:12.074666+0000","last_became_active":"2024-09-11T11:01:05.340069+0000","last_became_peered":"2024-09-11T11:01:05.340069+0000","last_unstale":"2024-09-11T11:05:12.074666+0000","last_undegraded":"2024-09-11T11:05:12.074666+0000","last_fullsized":"2024-09-11T11:05:12.074666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:12.074380+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:12.074380+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.074380+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:40.669898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:36.567094+0000","last_change":"2024-09-11T11:05:36.567242+0000","last_active":"2024-09-11T11:05:36.567094+0000","last_peered":"2024-09-11T11:05:36.567094+0000","last_clean":"2024-09-11T11:05:36.567094+0000","last_became_active":"2024-09-11T11:01:03.333740+0000","last_became_peered":"2024-09-11T11:01:03.333740+0000","last_unstale":"2024-09-11T11:05:36.567094+0000","last_undegraded":"2024-09-11T11:05:36.567094+0000","last_fullsized":"2024-09-11T11:05:36.567094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:36.566790+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:36.566790+0000","last_clean_scrub_stamp":"2024-09-11T11:05:36.566790+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:18:37.102627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:35.343780+0000","last_change":"2024-09-11T11:05:35.343842+0000","last_active":"2024-09-11T11:05:35.343780+0000","last_peered":"2024-09-11T11:05:35.343780+0000","last_clean":"2024-09-11T11:05:35.343780+0000","last_became_active":"2024-09-11T11:01:07.354827+0000","last_became_peered":"2024-09-11T11:01:07.354827+0000","last_unstale":"2024-09-11T11:05:35.343780+0000","last_undegraded":"2024-09-11T11:05:35.343780+0000","last_fullsized":"2024-09-11T11:05:35.343780+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:35.343551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:35.343551+0000","last_clean_scrub_stamp":"2024-09-11T11:05:35.343551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:18:53.785510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'63","reported_seq":141,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.696179+0000","last_change":"2024-09-11T11:04:55.696179+0000","last_active":"2024-09-11T11:04:55.696179+0000","last_peered":"2024-09-11T11:04:55.696179+0000","last_clean":"2024-09-11T11:04:55.696179+0000","last_became_active":"2024-09-11T11:01:09.374320+0000","last_became_peered":"2024-09-11T11:01:09.374320+0000","last_unstale":"2024-09-11T11:04:55.696179+0000","last_undegraded":"2024-09-11T11:04:55.696179+0000","last_fullsized":"2024-09-11T11:04:55.696179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-11T11:04:55.695776+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-11T11:04:55.695776+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.695776+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:06.417243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.036052+0000","last_change":"2024-09-11T11:04:58.036052+0000","last_active":"2024-09-11T11:04:58.036052+0000","last_peered":"2024-09-11T11:04:58.036052+0000","last_clean":"2024-09-11T11:04:58.036052+0000","last_became_active":"2024-09-11T11:01:11.399118+0000","last_became_peered":"2024-09-11T11:01:11.399118+0000","last_unstale":"2024-09-11T11:04:58.036052+0000","last_undegraded":"2024-09-11T11:04:58.036052+0000","last_fullsized":"2024-09-11T11:04:58.036052+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:58.035800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:58.035800+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.035800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:38.887084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"36'21","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.813199+0000","last_change":"2024-09-11T11:05:21.813199+0000","last_active":"2024-09-11T11:05:21.813199+0000","last_peered":"2024-09-11T11:05:21.813199+0000","last_clean":"2024-09-11T11:05:21.813199+0000","last_became_active":"2024-09-11T11:01:13.415242+0000","last_became_peered":"2024-09-11T11:01:13.415242+0000","last_unstale":"2024-09-11T11:05:21.813199+0000","last_undegraded":"2024-09-11T11:05:21.813199+0000","last_fullsized":"2024-09-11T11:05:21.813199+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:21.812919+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:21.812919+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.812919+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:48:28.186545+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.825139+0000","last_change":"2024-09-11T11:05:23.825139+0000","last_active":"2024-09-11T11:05:23.825139+0000","last_peered":"2024-09-11T11:05:23.825139+0000","last_clean":"2024-09-11T11:05:23.825139+0000","last_became_active":"2024-09-11T11:01:05.347367+0000","last_became_peered":"2024-09-11T11:01:05.347367+0000","last_unstale":"2024-09-11T11:05:23.825139+0000","last_undegraded":"2024-09-11T11:05:23.825139+0000","last_fullsized":"2024-09-11T11:05:23.825139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:23.824889+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:23.824889+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.824889+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:06:33.988458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:36.921243+0000","last_change":"2024-09-11T11:05:36.921304+0000","last_active":"2024-09-11T11:05:36.921243+0000","last_peered":"2024-09-11T11:05:36.921243+0000","last_clean":"2024-09-11T11:05:36.921243+0000","last_became_active":"2024-09-11T11:01:03.349051+0000","last_became_peered":"2024-09-11T11:01:03.349051+0000","last_unstale":"2024-09-11T11:05:36.921243+0000","last_undegraded":"2024-09-11T11:05:36.921243+0000","last_fullsized":"2024-09-11T11:05:36.921243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:36.921036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:36.921036+0000","last_clean_scrub_stamp":"2024-09-11T11:05:36.921036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:47:01.946669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.160763+0000","last_change":"2024-09-11T11:05:21.160763+0000","last_active":"2024-09-11T11:05:21.160763+0000","last_peered":"2024-09-11T11:05:21.160763+0000","last_clean":"2024-09-11T11:05:21.160763+0000","last_became_active":"2024-09-11T11:01:07.344509+0000","last_became_peered":"2024-09-11T11:01:07.344509+0000","last_unstale":"2024-09-11T11:05:21.160763+0000","last_undegraded":"2024-09-11T11:05:21.160763+0000","last_fullsized":"2024-09-11T11:05:21.160763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:21.160509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:21.160509+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.160509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:21.895766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'39","reported_seq":100,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.481681+0000","last_change":"2024-09-11T11:05:06.481681+0000","last_active":"2024-09-11T11:05:06.481681+0000","last_peered":"2024-09-11T11:05:06.481681+0000","last_clean":"2024-09-11T11:05:06.481681+0000","last_became_active":"2024-09-11T11:01:09.376576+0000","last_became_peered":"2024-09-11T11:01:09.376576+0000","last_unstale":"2024-09-11T11:05:06.481681+0000","last_undegraded":"2024-09-11T11:05:06.481681+0000","last_fullsized":"2024-09-11T11:05:06.481681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-11T11:05:06.481402+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-11T11:05:06.481402+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.481402+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:17:29.713697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.760504+0000","last_change":"2024-09-11T11:05:05.760504+0000","last_active":"2024-09-11T11:05:05.760504+0000","last_peered":"2024-09-11T11:05:05.760504+0000","last_clean":"2024-09-11T11:05:05.760504+0000","last_became_active":"2024-09-11T11:01:11.394215+0000","last_became_peered":"2024-09-11T11:01:11.394215+0000","last_unstale":"2024-09-11T11:05:05.760504+0000","last_undegraded":"2024-09-11T11:05:05.760504+0000","last_fullsized":"2024-09-11T11:05:05.760504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:05.760254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:05.760254+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.760254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:50:59.140410+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"36'8","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.944316+0000","last_change":"2024-09-11T11:05:30.944380+0000","last_active":"2024-09-11T11:05:30.944316+0000","last_peered":"2024-09-11T11:05:30.944316+0000","last_clean":"2024-09-11T11:05:30.944316+0000","last_became_active":"2024-09-11T11:01:13.390538+0000","last_became_peered":"2024-09-11T11:01:13.390538+0000","last_unstale":"2024-09-11T11:05:30.944316+0000","last_undegraded":"2024-09-11T11:05:30.944316+0000","last_fullsized":"2024-09-11T11:05:30.944316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:30.944123+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:30.944123+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.944123+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:47.191730+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":14,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"36'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:59.810580+0000","last_change":"2024-09-11T11:05:59.810643+0000","last_active":"2024-09-11T11:05:59.810580+0000","last_peered":"2024-09-11T11:05:59.810580+0000","last_clean":"2024-09-11T11:05:59.810580+0000","last_became_active":"2024-09-11T11:01:05.332138+0000","last_became_peered":"2024-09-11T11:01:05.332138+0000","last_unstale":"2024-09-11T11:05:59.810580+0000","last_undegraded":"2024-09-11T11:05:59.810580+0000","last_fullsized":"2024-09-11T11:05:59.810580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:59.810360+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:59.810360+0000","last_clean_scrub_stamp":"2024-09-11T11:05:59.810360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:35:20.296344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:56.802302+0000","last_change":"2024-09-11T11:05:56.802359+0000","last_active":"2024-09-11T11:05:56.802302+0000","last_peered":"2024-09-11T11:05:56.802302+0000","last_clean":"2024-09-11T11:05:56.802302+0000","last_became_active":"2024-09-11T11:01:03.320906+0000","last_became_peered":"2024-09-11T11:01:03.320906+0000","last_unstale":"2024-09-11T11:05:56.802302+0000","last_undegraded":"2024-09-11T11:05:56.802302+0000","last_fullsized":"2024-09-11T11:05:56.802302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:56.802111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:56.802111+0000","last_clean_scrub_stamp":"2024-09-11T11:05:56.802111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:59:50.521896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.947793+0000","last_change":"2024-09-11T11:05:10.947793+0000","last_active":"2024-09-11T11:05:10.947793+0000","last_peered":"2024-09-11T11:05:10.947793+0000","last_clean":"2024-09-11T11:05:10.947793+0000","last_became_active":"2024-09-11T11:01:07.367554+0000","last_became_peered":"2024-09-11T11:01:07.367554+0000","last_unstale":"2024-09-11T11:05:10.947793+0000","last_undegraded":"2024-09-11T11:05:10.947793+0000","last_fullsized":"2024-09-11T11:05:10.947793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:10.947506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:10.947506+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.947506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:32:44.583302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'47","reported_seq":110,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.027543+0000","last_change":"2024-09-11T11:05:07.027543+0000","last_active":"2024-09-11T11:05:07.027543+0000","last_peered":"2024-09-11T11:05:07.027543+0000","last_clean":"2024-09-11T11:05:07.027543+0000","last_became_active":"2024-09-11T11:01:09.367246+0000","last_became_peered":"2024-09-11T11:01:09.367246+0000","last_unstale":"2024-09-11T11:05:07.027543+0000","last_undegraded":"2024-09-11T11:05:07.027543+0000","last_fullsized":"2024-09-11T11:05:07.027543+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'47","last_scrub_stamp":"2024-09-11T11:05:07.027243+0000","last_deep_scrub":"36'47","last_deep_scrub_stamp":"2024-09-11T11:05:07.027243+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.027243+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:08:09.945366+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":59,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"36'285","reported_seq":427,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.968427+0000","last_change":"2024-09-11T11:05:02.968427+0000","last_active":"2024-09-11T11:05:02.968427+0000","last_peered":"2024-09-11T11:05:02.968427+0000","last_clean":"2024-09-11T11:05:02.968427+0000","last_became_active":"2024-09-11T11:01:11.392359+0000","last_became_peered":"2024-09-11T11:01:11.392359+0000","last_unstale":"2024-09-11T11:05:02.968427+0000","last_undegraded":"2024-09-11T11:05:02.968427+0000","last_fullsized":"2024-09-11T11:05:02.968427+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:02.968136+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:02.968136+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.968136+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:59.277030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"36'17","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.770923+0000","last_change":"2024-09-11T11:05:17.770923+0000","last_active":"2024-09-11T11:05:17.770923+0000","last_peered":"2024-09-11T11:05:17.770923+0000","last_clean":"2024-09-11T11:05:17.770923+0000","last_became_active":"2024-09-11T11:01:13.415115+0000","last_became_peered":"2024-09-11T11:01:13.415115+0000","last_unstale":"2024-09-11T11:05:17.770923+0000","last_undegraded":"2024-09-11T11:05:17.770923+0000","last_fullsized":"2024-09-11T11:05:17.770923+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'17","last_scrub_stamp":"2024-09-11T11:05:17.770533+0000","last_deep_scrub":"36'17","last_deep_scrub_stamp":"2024-09-11T11:05:17.770533+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.770533+0000","objects_scrubbed":1,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:46.446476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'8","reported_seq":72,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.168321+0000","last_change":"2024-09-11T11:05:20.168321+0000","last_active":"2024-09-11T11:05:20.168321+0000","last_peered":"2024-09-11T11:05:20.168321+0000","last_clean":"2024-09-11T11:05:20.168321+0000","last_became_active":"2024-09-11T11:01:05.337055+0000","last_became_peered":"2024-09-11T11:01:05.337055+0000","last_unstale":"2024-09-11T11:05:20.168321+0000","last_undegraded":"2024-09-11T11:05:20.168321+0000","last_fullsized":"2024-09-11T11:05:20.168321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:20.168067+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:20.168067+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.168067+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:11.957107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:57.974094+0000","last_change":"2024-09-11T11:05:57.974157+0000","last_active":"2024-09-11T11:05:57.974094+0000","last_peered":"2024-09-11T11:05:57.974094+0000","last_clean":"2024-09-11T11:05:57.974094+0000","last_became_active":"2024-09-11T11:01:03.334392+0000","last_became_peered":"2024-09-11T11:01:03.334392+0000","last_unstale":"2024-09-11T11:05:57.974094+0000","last_undegraded":"2024-09-11T11:05:57.974094+0000","last_fullsized":"2024-09-11T11:05:57.974094+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:57.973910+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:57.973910+0000","last_clean_scrub_stamp":"2024-09-11T11:05:57.973910+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:46:09.208033+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'5","reported_seq":433,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.571458+0000","last_change":"2024-09-11T11:04:56.571458+0000","last_active":"2024-09-11T11:04:56.571458+0000","last_peered":"2024-09-11T11:04:56.571458+0000","last_clean":"2024-09-11T11:04:56.571458+0000","last_became_active":"2024-09-11T11:01:07.360348+0000","last_became_peered":"2024-09-11T11:01:07.360348+0000","last_unstale":"2024-09-11T11:04:56.571458+0000","last_undegraded":"2024-09-11T11:04:56.571458+0000","last_fullsized":"2024-09-11T11:04:56.571458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-11T11:04:56.571190+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-11T11:04:56.571190+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.571190+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:48.525894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.c","version":"36'15","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.692151+0000","last_change":"2024-09-11T11:04:54.692151+0000","last_active":"2024-09-11T11:04:54.692151+0000","last_peered":"2024-09-11T11:04:54.692151+0000","last_clean":"2024-09-11T11:04:54.692151+0000","last_became_active":"2024-09-11T11:02:42.501712+0000","last_became_peered":"2024-09-11T11:02:42.501712+0000","last_unstale":"2024-09-11T11:04:54.692151+0000","last_undegraded":"2024-09-11T11:04:54.692151+0000","last_fullsized":"2024-09-11T11:04:54.692151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'15","last_scrub_stamp":"2024-09-11T11:04:54.691868+0000","last_deep_scrub":"36'15","last_deep_scrub_stamp":"2024-09-11T11:04:54.691868+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.691868+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:58:19.231371+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"36'285","reported_seq":517,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.466674+0000","last_change":"2024-09-11T11:05:05.466674+0000","last_active":"2024-09-11T11:05:05.466674+0000","last_peered":"2024-09-11T11:05:05.466674+0000","last_clean":"2024-09-11T11:05:05.466674+0000","last_became_active":"2024-09-11T11:01:11.384776+0000","last_became_peered":"2024-09-11T11:01:11.384776+0000","last_unstale":"2024-09-11T11:05:05.466674+0000","last_undegraded":"2024-09-11T11:05:05.466674+0000","last_fullsized":"2024-09-11T11:05:05.466674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:05:05.466396+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:05:05.466396+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.466396+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:00:09.842981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"36'6","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.007820+0000","last_change":"2024-09-11T11:05:01.007820+0000","last_active":"2024-09-11T11:05:01.007820+0000","last_peered":"2024-09-11T11:05:01.007820+0000","last_clean":"2024-09-11T11:05:01.007820+0000","last_became_active":"2024-09-11T11:01:13.418296+0000","last_became_peered":"2024-09-11T11:01:13.418296+0000","last_unstale":"2024-09-11T11:05:01.007820+0000","last_undegraded":"2024-09-11T11:05:01.007820+0000","last_fullsized":"2024-09-11T11:05:01.007820+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:01.007547+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:01.007547+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.007547+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:55:18.550703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"36'18","reported_seq":86,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.805924+0000","last_change":"2024-09-11T11:05:22.805924+0000","last_active":"2024-09-11T11:05:22.805924+0000","last_peered":"2024-09-11T11:05:22.805924+0000","last_clean":"2024-09-11T11:05:22.805924+0000","last_became_active":"2024-09-11T11:01:05.347644+0000","last_became_peered":"2024-09-11T11:01:05.347644+0000","last_unstale":"2024-09-11T11:05:22.805924+0000","last_undegraded":"2024-09-11T11:05:22.805924+0000","last_fullsized":"2024-09-11T11:05:22.805924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:22.805671+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:22.805671+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.805671+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:31.023813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:37.886385+0000","last_change":"2024-09-11T11:05:37.886436+0000","last_active":"2024-09-11T11:05:37.886385+0000","last_peered":"2024-09-11T11:05:37.886385+0000","last_clean":"2024-09-11T11:05:37.886385+0000","last_became_active":"2024-09-11T11:01:03.349605+0000","last_became_peered":"2024-09-11T11:01:03.349605+0000","last_unstale":"2024-09-11T11:05:37.886385+0000","last_undegraded":"2024-09-11T11:05:37.886385+0000","last_fullsized":"2024-09-11T11:05:37.886385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:37.886201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:37.886201+0000","last_clean_scrub_stamp":"2024-09-11T11:05:37.886201+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:37.948015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.793239+0000","last_change":"2024-09-11T11:05:16.793239+0000","last_active":"2024-09-11T11:05:16.793239+0000","last_peered":"2024-09-11T11:05:16.793239+0000","last_clean":"2024-09-11T11:05:16.793239+0000","last_became_active":"2024-09-11T11:01:07.351403+0000","last_became_peered":"2024-09-11T11:01:07.351403+0000","last_unstale":"2024-09-11T11:05:16.793239+0000","last_undegraded":"2024-09-11T11:05:16.793239+0000","last_fullsized":"2024-09-11T11:05:16.793239+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.792993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.792993+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.792993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:52:24.716938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"36'48","reported_seq":112,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.534340+0000","last_change":"2024-09-11T11:05:07.534340+0000","last_active":"2024-09-11T11:05:07.534340+0000","last_peered":"2024-09-11T11:05:07.534340+0000","last_clean":"2024-09-11T11:05:07.534340+0000","last_became_active":"2024-09-11T11:01:09.376340+0000","last_became_peered":"2024-09-11T11:01:09.376340+0000","last_unstale":"2024-09-11T11:05:07.534340+0000","last_undegraded":"2024-09-11T11:05:07.534340+0000","last_fullsized":"2024-09-11T11:05:07.534340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'48","last_scrub_stamp":"2024-09-11T11:05:07.534061+0000","last_deep_scrub":"36'48","last_deep_scrub_stamp":"2024-09-11T11:05:07.534061+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.534061+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:50.271487+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.598087+0000","last_change":"2024-09-11T11:05:13.598087+0000","last_active":"2024-09-11T11:05:13.598087+0000","last_peered":"2024-09-11T11:05:13.598087+0000","last_clean":"2024-09-11T11:05:13.598087+0000","last_became_active":"2024-09-11T11:01:11.385523+0000","last_became_peered":"2024-09-11T11:01:11.385523+0000","last_unstale":"2024-09-11T11:05:13.598087+0000","last_undegraded":"2024-09-11T11:05:13.598087+0000","last_fullsized":"2024-09-11T11:05:13.598087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:13.597842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:13.597842+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.597842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:47.342062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3","version":"36'7","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.876239+0000","last_change":"2024-09-11T11:05:05.876239+0000","last_active":"2024-09-11T11:05:05.876239+0000","last_peered":"2024-09-11T11:05:05.876239+0000","last_clean":"2024-09-11T11:05:05.876239+0000","last_became_active":"2024-09-11T11:01:13.403125+0000","last_became_peered":"2024-09-11T11:01:13.403125+0000","last_unstale":"2024-09-11T11:05:05.876239+0000","last_undegraded":"2024-09-11T11:05:05.876239+0000","last_fullsized":"2024-09-11T11:05:05.876239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'7","last_scrub_stamp":"2024-09-11T11:05:05.875973+0000","last_deep_scrub":"36'7","last_deep_scrub_stamp":"2024-09-11T11:05:05.875973+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.875973+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:59.171520+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"36'22","reported_seq":91,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.588013+0000","last_change":"2024-09-11T11:05:27.588075+0000","last_active":"2024-09-11T11:05:27.588013+0000","last_peered":"2024-09-11T11:05:27.588013+0000","last_clean":"2024-09-11T11:05:27.588013+0000","last_became_active":"2024-09-11T11:01:05.345474+0000","last_became_peered":"2024-09-11T11:01:05.345474+0000","last_unstale":"2024-09-11T11:05:27.588013+0000","last_undegraded":"2024-09-11T11:05:27.588013+0000","last_fullsized":"2024-09-11T11:05:27.588013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'22","last_scrub_stamp":"2024-09-11T11:05:27.587826+0000","last_deep_scrub":"36'22","last_deep_scrub_stamp":"2024-09-11T11:05:27.587826+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.587826+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:48.653691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":55,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"36'119","reported_seq":218,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:43.792273+0000","last_change":"2024-09-11T11:05:43.792342+0000","last_active":"2024-09-11T11:05:43.792273+0000","last_peered":"2024-09-11T11:05:43.792273+0000","last_clean":"2024-09-11T11:05:43.792273+0000","last_became_active":"2024-09-11T11:00:51.368994+0000","last_became_peered":"2024-09-11T11:00:51.368994+0000","last_unstale":"2024-09-11T11:05:43.792273+0000","last_undegraded":"2024-09-11T11:05:43.792273+0000","last_fullsized":"2024-09-11T11:05:43.792273+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2024-09-11T11:05:43.792088+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2024-09-11T11:05:43.792088+0000","last_clean_scrub_stamp":"2024-09-11T11:05:43.792088+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:02:23.310483+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'2","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:55.757454+0000","last_change":"2024-09-11T11:05:55.757526+0000","last_active":"2024-09-11T11:05:55.757454+0000","last_peered":"2024-09-11T11:05:55.757454+0000","last_clean":"2024-09-11T11:05:55.757454+0000","last_became_active":"2024-09-11T11:00:53.874359+0000","last_became_peered":"2024-09-11T11:00:53.874359+0000","last_unstale":"2024-09-11T11:05:55.757454+0000","last_undegraded":"2024-09-11T11:05:55.757454+0000","last_fullsized":"2024-09-11T11:05:55.757454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:55.757248+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:55.757248+0000","last_clean_scrub_stamp":"2024-09-11T11:05:55.757248+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:32:48.469212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0028212649999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:47.962335+0000","last_change":"2024-09-11T11:05:47.962386+0000","last_active":"2024-09-11T11:05:47.962335+0000","last_peered":"2024-09-11T11:05:47.962335+0000","last_clean":"2024-09-11T11:05:47.962335+0000","last_became_active":"2024-09-11T11:01:03.334611+0000","last_became_peered":"2024-09-11T11:01:03.334611+0000","last_unstale":"2024-09-11T11:05:47.962335+0000","last_undegraded":"2024-09-11T11:05:47.962335+0000","last_fullsized":"2024-09-11T11:05:47.962335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:47.962146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:47.962146+0000","last_clean_scrub_stamp":"2024-09-11T11:05:47.962146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:18.583571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.806822+0000","last_change":"2024-09-11T11:05:16.806822+0000","last_active":"2024-09-11T11:05:16.806822+0000","last_peered":"2024-09-11T11:05:16.806822+0000","last_clean":"2024-09-11T11:05:16.806822+0000","last_became_active":"2024-09-11T11:01:07.348530+0000","last_became_peered":"2024-09-11T11:01:07.348530+0000","last_unstale":"2024-09-11T11:05:16.806822+0000","last_undegraded":"2024-09-11T11:05:16.806822+0000","last_fullsized":"2024-09-11T11:05:16.806822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.806573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.806573+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.806573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:00:07.850946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"36'87","reported_seq":182,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.560070+0000","last_change":"2024-09-11T11:05:14.560070+0000","last_active":"2024-09-11T11:05:14.560070+0000","last_peered":"2024-09-11T11:05:14.560070+0000","last_clean":"2024-09-11T11:05:14.560070+0000","last_became_active":"2024-09-11T11:01:09.369066+0000","last_became_peered":"2024-09-11T11:01:09.369066+0000","last_unstale":"2024-09-11T11:05:14.560070+0000","last_undegraded":"2024-09-11T11:05:14.560070+0000","last_fullsized":"2024-09-11T11:05:14.560070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'87","last_scrub_stamp":"2024-09-11T11:05:14.559823+0000","last_deep_scrub":"36'87","last_deep_scrub_stamp":"2024-09-11T11:05:14.559823+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.559823+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:34:23.881642+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.727517+0000","last_change":"2024-09-11T11:05:04.727517+0000","last_active":"2024-09-11T11:05:04.727517+0000","last_peered":"2024-09-11T11:05:04.727517+0000","last_clean":"2024-09-11T11:05:04.727517+0000","last_became_active":"2024-09-11T11:01:11.394277+0000","last_became_peered":"2024-09-11T11:01:11.394277+0000","last_unstale":"2024-09-11T11:05:04.727517+0000","last_undegraded":"2024-09-11T11:05:04.727517+0000","last_fullsized":"2024-09-11T11:05:04.727517+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:04.727229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:04.727229+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.727229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:14.507545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"36'82","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.089631+0000","last_change":"2024-09-11T11:04:55.089631+0000","last_active":"2024-09-11T11:04:55.089631+0000","last_peered":"2024-09-11T11:04:55.089631+0000","last_clean":"2024-09-11T11:04:55.089631+0000","last_became_active":"2024-09-11T11:01:13.412615+0000","last_became_peered":"2024-09-11T11:01:13.412615+0000","last_unstale":"2024-09-11T11:04:55.089631+0000","last_undegraded":"2024-09-11T11:04:55.089631+0000","last_fullsized":"2024-09-11T11:04:55.089631+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'82","last_scrub_stamp":"2024-09-11T11:04:55.089351+0000","last_deep_scrub":"36'82","last_deep_scrub_stamp":"2024-09-11T11:04:55.089351+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.089351+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:52:06.508319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":215,"num_read_kb":213,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"36'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.805718+0000","last_change":"2024-09-11T11:05:23.805718+0000","last_active":"2024-09-11T11:05:23.805718+0000","last_peered":"2024-09-11T11:05:23.805718+0000","last_clean":"2024-09-11T11:05:23.805718+0000","last_became_active":"2024-09-11T11:01:05.346710+0000","last_became_peered":"2024-09-11T11:01:05.346710+0000","last_unstale":"2024-09-11T11:05:23.805718+0000","last_undegraded":"2024-09-11T11:05:23.805718+0000","last_fullsized":"2024-09-11T11:05:23.805718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:23.805304+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:23.805304+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.805304+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:46.899730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:51.715832+0000","last_change":"2024-09-11T11:05:51.715887+0000","last_active":"2024-09-11T11:05:51.715832+0000","last_peered":"2024-09-11T11:05:51.715832+0000","last_clean":"2024-09-11T11:05:51.715832+0000","last_became_active":"2024-09-11T11:00:53.870212+0000","last_became_peered":"2024-09-11T11:00:53.870212+0000","last_unstale":"2024-09-11T11:05:51.715832+0000","last_undegraded":"2024-09-11T11:05:51.715832+0000","last_fullsized":"2024-09-11T11:05:51.715832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:51.715642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:51.715642+0000","last_clean_scrub_stamp":"2024-09-11T11:05:51.715642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:28:08.189007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093804900000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:50.975161+0000","last_change":"2024-09-11T11:05:50.975265+0000","last_active":"2024-09-11T11:05:50.975161+0000","last_peered":"2024-09-11T11:05:50.975161+0000","last_clean":"2024-09-11T11:05:50.975161+0000","last_became_active":"2024-09-11T11:01:03.325795+0000","last_became_peered":"2024-09-11T11:01:03.325795+0000","last_unstale":"2024-09-11T11:05:50.975161+0000","last_undegraded":"2024-09-11T11:05:50.975161+0000","last_fullsized":"2024-09-11T11:05:50.975161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:50.974863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:50.974863+0000","last_clean_scrub_stamp":"2024-09-11T11:05:50.974863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:16:03.129341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.500469+0000","last_change":"2024-09-11T11:04:52.500469+0000","last_active":"2024-09-11T11:04:52.500469+0000","last_peered":"2024-09-11T11:04:52.500469+0000","last_clean":"2024-09-11T11:04:52.500469+0000","last_became_active":"2024-09-11T11:01:07.360718+0000","last_became_peered":"2024-09-11T11:01:07.360718+0000","last_unstale":"2024-09-11T11:04:52.500469+0000","last_undegraded":"2024-09-11T11:04:52.500469+0000","last_fullsized":"2024-09-11T11:04:52.500469+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:52.500353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:52.500353+0000","last_clean_scrub_stamp":"2024-09-11T11:04:52.500353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:05.966274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.4","version":"36'290","reported_seq":521,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.939512+0000","last_change":"2024-09-11T11:05:03.939512+0000","last_active":"2024-09-11T11:05:03.939512+0000","last_peered":"2024-09-11T11:05:03.939512+0000","last_clean":"2024-09-11T11:05:03.939512+0000","last_became_active":"2024-09-11T11:01:09.376555+0000","last_became_peered":"2024-09-11T11:01:09.376555+0000","last_unstale":"2024-09-11T11:05:03.939512+0000","last_undegraded":"2024-09-11T11:05:03.939512+0000","last_fullsized":"2024-09-11T11:05:03.939512+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'290","last_scrub_stamp":"2024-09-11T11:05:03.939238+0000","last_deep_scrub":"36'290","last_deep_scrub_stamp":"2024-09-11T11:05:03.939238+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.939238+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:17.488538+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.787021+0000","last_change":"2024-09-11T11:05:18.787021+0000","last_active":"2024-09-11T11:05:18.787021+0000","last_peered":"2024-09-11T11:05:18.787021+0000","last_clean":"2024-09-11T11:05:18.787021+0000","last_became_active":"2024-09-11T11:01:11.400253+0000","last_became_peered":"2024-09-11T11:01:11.400253+0000","last_unstale":"2024-09-11T11:05:18.787021+0000","last_undegraded":"2024-09-11T11:05:18.787021+0000","last_fullsized":"2024-09-11T11:05:18.787021+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:18.786712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:18.786712+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.786712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:36:52.530932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"34'11","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:54.883932+0000","last_change":"2024-09-11T11:05:54.884011+0000","last_active":"2024-09-11T11:05:54.883932+0000","last_peered":"2024-09-11T11:05:54.883932+0000","last_clean":"2024-09-11T11:05:54.883932+0000","last_became_active":"2024-09-11T11:01:13.421491+0000","last_became_peered":"2024-09-11T11:01:13.421491+0000","last_unstale":"2024-09-11T11:05:54.883932+0000","last_undegraded":"2024-09-11T11:05:54.883932+0000","last_fullsized":"2024-09-11T11:05:54.883932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'11","last_scrub_stamp":"2024-09-11T11:05:54.883699+0000","last_deep_scrub":"34'11","last_deep_scrub_stamp":"2024-09-11T11:05:54.883699+0000","last_clean_scrub_stamp":"2024-09-11T11:05:54.883699+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:57:49.672685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"36'4","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.828471+0000","last_change":"2024-09-11T11:05:24.828471+0000","last_active":"2024-09-11T11:05:24.828471+0000","last_peered":"2024-09-11T11:05:24.828471+0000","last_clean":"2024-09-11T11:05:24.828471+0000","last_became_active":"2024-09-11T11:01:05.347359+0000","last_became_peered":"2024-09-11T11:01:05.347359+0000","last_unstale":"2024-09-11T11:05:24.828471+0000","last_undegraded":"2024-09-11T11:05:24.828471+0000","last_fullsized":"2024-09-11T11:05:24.828471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:24.828225+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:24.828225+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.828225+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:15:55.815883+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.223190+0000","last_change":"2024-09-11T11:05:27.223243+0000","last_active":"2024-09-11T11:05:27.223190+0000","last_peered":"2024-09-11T11:05:27.223190+0000","last_clean":"2024-09-11T11:05:27.223190+0000","last_became_active":"2024-09-11T11:00:54.046993+0000","last_became_peered":"2024-09-11T11:00:54.046993+0000","last_unstale":"2024-09-11T11:05:27.223190+0000","last_undegraded":"2024-09-11T11:05:27.223190+0000","last_fullsized":"2024-09-11T11:05:27.223190+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:27.223007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:27.223007+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.223007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:50.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00077355100000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:48.920712+0000","last_change":"2024-09-11T11:05:48.920764+0000","last_active":"2024-09-11T11:05:48.920712+0000","last_peered":"2024-09-11T11:05:48.920712+0000","last_clean":"2024-09-11T11:05:48.920712+0000","last_became_active":"2024-09-11T11:01:03.325168+0000","last_became_peered":"2024-09-11T11:01:03.325168+0000","last_unstale":"2024-09-11T11:05:48.920712+0000","last_undegraded":"2024-09-11T11:05:48.920712+0000","last_fullsized":"2024-09-11T11:05:48.920712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:48.920515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:48.920515+0000","last_clean_scrub_stamp":"2024-09-11T11:05:48.920515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:16:09.558068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"36'4","reported_seq":237,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:23.215881+0000","last_change":"2024-09-11T11:05:23.215881+0000","last_active":"2024-09-11T11:05:23.215881+0000","last_peered":"2024-09-11T11:05:23.215881+0000","last_clean":"2024-09-11T11:05:23.215881+0000","last_became_active":"2024-09-11T11:01:07.345998+0000","last_became_peered":"2024-09-11T11:01:07.345998+0000","last_unstale":"2024-09-11T11:05:23.215881+0000","last_undegraded":"2024-09-11T11:05:23.215881+0000","last_fullsized":"2024-09-11T11:05:23.215881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:23.215586+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:23.215586+0000","last_clean_scrub_stamp":"2024-09-11T11:05:23.215586+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:14.462637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'25","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.622163+0000","last_change":"2024-09-11T11:05:10.622163+0000","last_active":"2024-09-11T11:05:10.622163+0000","last_peered":"2024-09-11T11:05:10.622163+0000","last_clean":"2024-09-11T11:05:10.622163+0000","last_became_active":"2024-09-11T11:01:09.371816+0000","last_became_peered":"2024-09-11T11:01:09.371816+0000","last_unstale":"2024-09-11T11:05:10.622163+0000","last_undegraded":"2024-09-11T11:05:10.622163+0000","last_fullsized":"2024-09-11T11:05:10.622163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'25","last_scrub_stamp":"2024-09-11T11:05:10.621907+0000","last_deep_scrub":"36'25","last_deep_scrub_stamp":"2024-09-11T11:05:10.621907+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.621907+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:01:58.193453+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.900932+0000","last_change":"2024-09-11T11:04:56.900932+0000","last_active":"2024-09-11T11:04:56.900932+0000","last_peered":"2024-09-11T11:04:56.900932+0000","last_clean":"2024-09-11T11:04:56.900932+0000","last_became_active":"2024-09-11T11:01:11.392208+0000","last_became_peered":"2024-09-11T11:01:11.392208+0000","last_unstale":"2024-09-11T11:04:56.900932+0000","last_undegraded":"2024-09-11T11:04:56.900932+0000","last_fullsized":"2024-09-11T11:04:56.900932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:56.900687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:56.900687+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.900687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:46:38.581779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:02.993080+0000","last_change":"2024-09-11T11:06:02.993132+0000","last_active":"2024-09-11T11:06:02.993080+0000","last_peered":"2024-09-11T11:06:02.993080+0000","last_clean":"2024-09-11T11:06:02.993080+0000","last_became_active":"2024-09-11T11:01:13.406863+0000","last_became_peered":"2024-09-11T11:01:13.406863+0000","last_unstale":"2024-09-11T11:06:02.993080+0000","last_undegraded":"2024-09-11T11:06:02.993080+0000","last_fullsized":"2024-09-11T11:06:02.993080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:06:02.992864+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:06:02.992864+0000","last_clean_scrub_stamp":"2024-09-11T11:06:02.992864+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:42:22.300750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"34'4","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.751460+0000","last_change":"2024-09-11T11:05:29.751522+0000","last_active":"2024-09-11T11:05:29.751460+0000","last_peered":"2024-09-11T11:05:29.751460+0000","last_clean":"2024-09-11T11:05:29.751460+0000","last_became_active":"2024-09-11T11:01:05.332361+0000","last_became_peered":"2024-09-11T11:01:05.332361+0000","last_unstale":"2024-09-11T11:05:29.751460+0000","last_undegraded":"2024-09-11T11:05:29.751460+0000","last_fullsized":"2024-09-11T11:05:29.751460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:29.751228+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:29.751228+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.751228+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:46.582523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"36'3","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:52.754925+0000","last_change":"2024-09-11T11:05:52.754994+0000","last_active":"2024-09-11T11:05:52.754925+0000","last_peered":"2024-09-11T11:05:52.754925+0000","last_clean":"2024-09-11T11:05:52.754925+0000","last_became_active":"2024-09-11T11:00:53.870348+0000","last_became_peered":"2024-09-11T11:00:53.870348+0000","last_unstale":"2024-09-11T11:05:52.754925+0000","last_undegraded":"2024-09-11T11:05:52.754925+0000","last_fullsized":"2024-09-11T11:05:52.754925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-11T11:05:52.754741+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-11T11:05:52.754741+0000","last_clean_scrub_stamp":"2024-09-11T11:05:52.754741+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:46:03.988864+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0019572140000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:38.531896+0000","last_change":"2024-09-11T11:05:38.531955+0000","last_active":"2024-09-11T11:05:38.531896+0000","last_peered":"2024-09-11T11:05:38.531896+0000","last_clean":"2024-09-11T11:05:38.531896+0000","last_became_active":"2024-09-11T11:01:03.327456+0000","last_became_peered":"2024-09-11T11:01:03.327456+0000","last_unstale":"2024-09-11T11:05:38.531896+0000","last_undegraded":"2024-09-11T11:05:38.531896+0000","last_fullsized":"2024-09-11T11:05:38.531896+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:38.531676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:38.531676+0000","last_clean_scrub_stamp":"2024-09-11T11:05:38.531676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:46.733365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.856498+0000","last_change":"2024-09-11T11:05:07.856498+0000","last_active":"2024-09-11T11:05:07.856498+0000","last_peered":"2024-09-11T11:05:07.856498+0000","last_clean":"2024-09-11T11:05:07.856498+0000","last_became_active":"2024-09-11T11:01:07.367962+0000","last_became_peered":"2024-09-11T11:01:07.367962+0000","last_unstale":"2024-09-11T11:05:07.856498+0000","last_undegraded":"2024-09-11T11:05:07.856498+0000","last_fullsized":"2024-09-11T11:05:07.856498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:07.856251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:07.856251+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.856251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:45:42.576844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"36'21","reported_seq":68,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.823311+0000","last_change":"2024-09-11T11:05:12.823311+0000","last_active":"2024-09-11T11:05:12.823311+0000","last_peered":"2024-09-11T11:05:12.823311+0000","last_clean":"2024-09-11T11:05:12.823311+0000","last_became_active":"2024-09-11T11:01:09.389732+0000","last_became_peered":"2024-09-11T11:01:09.389732+0000","last_unstale":"2024-09-11T11:05:12.823311+0000","last_undegraded":"2024-09-11T11:05:12.823311+0000","last_fullsized":"2024-09-11T11:05:12.823311+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:12.823022+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:12.823022+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.823022+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:31:55.560448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.739913+0000","last_change":"2024-09-11T11:05:10.739913+0000","last_active":"2024-09-11T11:05:10.739913+0000","last_peered":"2024-09-11T11:05:10.739913+0000","last_clean":"2024-09-11T11:05:10.739913+0000","last_became_active":"2024-09-11T11:01:11.397467+0000","last_became_peered":"2024-09-11T11:01:11.397467+0000","last_unstale":"2024-09-11T11:05:10.739913+0000","last_undegraded":"2024-09-11T11:05:10.739913+0000","last_fullsized":"2024-09-11T11:05:10.739913+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:10.739645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:10.739645+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.739645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:04:39.415587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"36'9","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.865986+0000","last_change":"2024-09-11T11:05:13.865986+0000","last_active":"2024-09-11T11:05:13.865986+0000","last_peered":"2024-09-11T11:05:13.865986+0000","last_clean":"2024-09-11T11:05:13.865986+0000","last_became_active":"2024-09-11T11:01:13.414898+0000","last_became_peered":"2024-09-11T11:01:13.414898+0000","last_unstale":"2024-09-11T11:05:13.865986+0000","last_undegraded":"2024-09-11T11:05:13.865986+0000","last_fullsized":"2024-09-11T11:05:13.865986+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:13.865733+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:13.865733+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.865733+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:27.906253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'4","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:51.967573+0000","last_change":"2024-09-11T11:05:51.967638+0000","last_active":"2024-09-11T11:05:51.967573+0000","last_peered":"2024-09-11T11:05:51.967573+0000","last_clean":"2024-09-11T11:05:51.967573+0000","last_became_active":"2024-09-11T11:01:05.342651+0000","last_became_peered":"2024-09-11T11:01:05.342651+0000","last_unstale":"2024-09-11T11:05:51.967573+0000","last_undegraded":"2024-09-11T11:05:51.967573+0000","last_fullsized":"2024-09-11T11:05:51.967573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:51.967339+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:51.967339+0000","last_clean_scrub_stamp":"2024-09-11T11:05:51.967339+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:00.169028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:39.502850+0000","last_change":"2024-09-11T11:05:39.502908+0000","last_active":"2024-09-11T11:05:39.502850+0000","last_peered":"2024-09-11T11:05:39.502850+0000","last_clean":"2024-09-11T11:05:39.502850+0000","last_became_active":"2024-09-11T11:01:03.336412+0000","last_became_peered":"2024-09-11T11:01:03.336412+0000","last_unstale":"2024-09-11T11:05:39.502850+0000","last_undegraded":"2024-09-11T11:05:39.502850+0000","last_fullsized":"2024-09-11T11:05:39.502850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:39.502654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:39.502654+0000","last_clean_scrub_stamp":"2024-09-11T11:05:39.502654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:28:26.371096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:45.831023+0000","last_change":"2024-09-11T11:05:45.831080+0000","last_active":"2024-09-11T11:05:45.831023+0000","last_peered":"2024-09-11T11:05:45.831023+0000","last_clean":"2024-09-11T11:05:45.831023+0000","last_became_active":"2024-09-11T11:00:54.047153+0000","last_became_peered":"2024-09-11T11:00:54.047153+0000","last_unstale":"2024-09-11T11:05:45.831023+0000","last_undegraded":"2024-09-11T11:05:45.831023+0000","last_fullsized":"2024-09-11T11:05:45.831023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:45.830816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:45.830816+0000","last_clean_scrub_stamp":"2024-09-11T11:05:45.830816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:47:38.851219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071001099999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"36'2","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:10.111176+0000","last_change":"2024-09-11T11:05:10.111176+0000","last_active":"2024-09-11T11:05:10.111176+0000","last_peered":"2024-09-11T11:05:10.111176+0000","last_clean":"2024-09-11T11:05:10.111176+0000","last_became_active":"2024-09-11T11:01:07.359228+0000","last_became_peered":"2024-09-11T11:01:07.359228+0000","last_unstale":"2024-09-11T11:05:10.111176+0000","last_undegraded":"2024-09-11T11:05:10.111176+0000","last_fullsized":"2024-09-11T11:05:10.111176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:10.110911+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:10.110911+0000","last_clean_scrub_stamp":"2024-09-11T11:05:10.110911+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:59:28.679839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"36'75","reported_seq":156,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:53.920380+0000","last_change":"2024-09-11T11:04:53.920380+0000","last_active":"2024-09-11T11:04:53.920380+0000","last_peered":"2024-09-11T11:04:53.920380+0000","last_clean":"2024-09-11T11:04:53.920380+0000","last_became_active":"2024-09-11T11:01:09.360676+0000","last_became_peered":"2024-09-11T11:01:09.360676+0000","last_unstale":"2024-09-11T11:04:53.920380+0000","last_undegraded":"2024-09-11T11:04:53.920380+0000","last_fullsized":"2024-09-11T11:04:53.920380+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'75","last_scrub_stamp":"2024-09-11T11:04:53.920094+0000","last_deep_scrub":"36'75","last_deep_scrub_stamp":"2024-09-11T11:04:53.920094+0000","last_clean_scrub_stamp":"2024-09-11T11:04:53.920094+0000","objects_scrubbed":9,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:28:47.374212+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:09.573879+0000","last_change":"2024-09-11T11:05:09.573879+0000","last_active":"2024-09-11T11:05:09.573879+0000","last_peered":"2024-09-11T11:05:09.573879+0000","last_clean":"2024-09-11T11:05:09.573879+0000","last_became_active":"2024-09-11T11:01:11.384826+0000","last_became_peered":"2024-09-11T11:01:11.384826+0000","last_unstale":"2024-09-11T11:05:09.573879+0000","last_undegraded":"2024-09-11T11:05:09.573879+0000","last_fullsized":"2024-09-11T11:05:09.573879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:09.573632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:09.573632+0000","last_clean_scrub_stamp":"2024-09-11T11:05:09.573632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:05.190454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.e","version":"36'9","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:36.323630+0000","last_change":"2024-09-11T11:05:36.323630+0000","last_active":"2024-09-11T11:05:36.323630+0000","last_peered":"2024-09-11T11:05:36.323630+0000","last_clean":"2024-09-11T11:05:36.323630+0000","last_became_active":"2024-09-11T11:01:13.421181+0000","last_became_peered":"2024-09-11T11:01:13.421181+0000","last_unstale":"2024-09-11T11:05:36.323630+0000","last_undegraded":"2024-09-11T11:05:36.323630+0000","last_fullsized":"2024-09-11T11:05:36.323630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'9","last_scrub_stamp":"2024-09-11T11:05:36.323381+0000","last_deep_scrub":"36'9","last_deep_scrub_stamp":"2024-09-11T11:05:36.323381+0000","last_clean_scrub_stamp":"2024-09-11T11:05:36.323381+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:11:58.082941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"36'6","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.793875+0000","last_change":"2024-09-11T11:05:20.793990+0000","last_active":"2024-09-11T11:05:20.793875+0000","last_peered":"2024-09-11T11:05:20.793875+0000","last_clean":"2024-09-11T11:05:20.793875+0000","last_became_active":"2024-09-11T11:01:05.353896+0000","last_became_peered":"2024-09-11T11:01:05.353896+0000","last_unstale":"2024-09-11T11:05:20.793875+0000","last_undegraded":"2024-09-11T11:05:20.793875+0000","last_fullsized":"2024-09-11T11:05:20.793875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:20.793577+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:20.793577+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.793577+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:36.069658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:49.965419+0000","last_change":"2024-09-11T11:05:49.965476+0000","last_active":"2024-09-11T11:05:49.965419+0000","last_peered":"2024-09-11T11:05:49.965419+0000","last_clean":"2024-09-11T11:05:49.965419+0000","last_became_active":"2024-09-11T11:01:03.324923+0000","last_became_peered":"2024-09-11T11:01:03.324923+0000","last_unstale":"2024-09-11T11:05:49.965419+0000","last_undegraded":"2024-09-11T11:05:49.965419+0000","last_fullsized":"2024-09-11T11:05:49.965419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:49.965229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:49.965229+0000","last_clean_scrub_stamp":"2024-09-11T11:05:49.965229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:22:57.195197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:54.792959+0000","last_change":"2024-09-11T11:05:54.793013+0000","last_active":"2024-09-11T11:05:54.792959+0000","last_peered":"2024-09-11T11:05:54.792959+0000","last_clean":"2024-09-11T11:05:54.792959+0000","last_became_active":"2024-09-11T11:00:53.874324+0000","last_became_peered":"2024-09-11T11:00:53.874324+0000","last_unstale":"2024-09-11T11:05:54.792959+0000","last_undegraded":"2024-09-11T11:05:54.792959+0000","last_fullsized":"2024-09-11T11:05:54.792959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:54.792762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:54.792762+0000","last_clean_scrub_stamp":"2024-09-11T11:05:54.792762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:48:21.594756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021421600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.566765+0000","last_change":"2024-09-11T11:04:54.566765+0000","last_active":"2024-09-11T11:04:54.566765+0000","last_peered":"2024-09-11T11:04:54.566765+0000","last_clean":"2024-09-11T11:04:54.566765+0000","last_became_active":"2024-09-11T11:01:07.360208+0000","last_became_peered":"2024-09-11T11:01:07.360208+0000","last_unstale":"2024-09-11T11:04:54.566765+0000","last_undegraded":"2024-09-11T11:04:54.566765+0000","last_fullsized":"2024-09-11T11:04:54.566765+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.566514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.566514+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.566514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:47.862061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"36'21","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.895963+0000","last_change":"2024-09-11T11:05:02.895963+0000","last_active":"2024-09-11T11:05:02.895963+0000","last_peered":"2024-09-11T11:05:02.895963+0000","last_clean":"2024-09-11T11:05:02.895963+0000","last_became_active":"2024-09-11T11:01:09.382364+0000","last_became_peered":"2024-09-11T11:01:09.382364+0000","last_unstale":"2024-09-11T11:05:02.895963+0000","last_undegraded":"2024-09-11T11:05:02.895963+0000","last_fullsized":"2024-09-11T11:05:02.895963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'21","last_scrub_stamp":"2024-09-11T11:05:02.895625+0000","last_deep_scrub":"36'21","last_deep_scrub_stamp":"2024-09-11T11:05:02.895625+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.895625+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:21:58.883525+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"36'285","reported_seq":364,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.863644+0000","last_change":"2024-09-11T11:04:57.863644+0000","last_active":"2024-09-11T11:04:57.863644+0000","last_peered":"2024-09-11T11:04:57.863644+0000","last_clean":"2024-09-11T11:04:57.863644+0000","last_became_active":"2024-09-11T11:01:11.395016+0000","last_became_peered":"2024-09-11T11:01:11.395016+0000","last_unstale":"2024-09-11T11:04:57.863644+0000","last_undegraded":"2024-09-11T11:04:57.863644+0000","last_fullsized":"2024-09-11T11:04:57.863644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'285","last_scrub_stamp":"2024-09-11T11:04:57.863404+0000","last_deep_scrub":"36'285","last_deep_scrub_stamp":"2024-09-11T11:04:57.863404+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.863404+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:25:48.423461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"36'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:05.943335+0000","last_change":"2024-09-11T11:06:05.943399+0000","last_active":"2024-09-11T11:06:05.943335+0000","last_peered":"2024-09-11T11:06:05.943335+0000","last_clean":"2024-09-11T11:06:05.943335+0000","last_became_active":"2024-09-11T11:01:13.422825+0000","last_became_peered":"2024-09-11T11:01:13.422825+0000","last_unstale":"2024-09-11T11:06:05.943335+0000","last_undegraded":"2024-09-11T11:06:05.943335+0000","last_fullsized":"2024-09-11T11:06:05.943335+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:06:05.943092+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:06:05.943092+0000","last_clean_scrub_stamp":"2024-09-11T11:06:05.943092+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:28.602185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"36'12","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:40.321522+0000","last_change":"2024-09-11T11:05:40.321522+0000","last_active":"2024-09-11T11:05:40.321522+0000","last_peered":"2024-09-11T11:05:40.321522+0000","last_clean":"2024-09-11T11:05:40.321522+0000","last_became_active":"2024-09-11T11:01:42.049256+0000","last_became_peered":"2024-09-11T11:01:42.049256+0000","last_unstale":"2024-09-11T11:05:40.321522+0000","last_undegraded":"2024-09-11T11:05:40.321522+0000","last_fullsized":"2024-09-11T11:05:40.321522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:40.321274+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:40.321274+0000","last_clean_scrub_stamp":"2024-09-11T11:05:40.321274+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:24.506137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:40.911403+0000","last_change":"2024-09-11T11:05:40.911461+0000","last_active":"2024-09-11T11:05:40.911403+0000","last_peered":"2024-09-11T11:05:40.911403+0000","last_clean":"2024-09-11T11:05:40.911403+0000","last_became_active":"2024-09-11T11:01:03.349487+0000","last_became_peered":"2024-09-11T11:01:03.349487+0000","last_unstale":"2024-09-11T11:05:40.911403+0000","last_undegraded":"2024-09-11T11:05:40.911403+0000","last_fullsized":"2024-09-11T11:05:40.911403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:40.911211+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:40.911211+0000","last_clean_scrub_stamp":"2024-09-11T11:05:40.911211+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:23:15.801381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:44.818890+0000","last_change":"2024-09-11T11:05:44.818945+0000","last_active":"2024-09-11T11:05:44.818890+0000","last_peered":"2024-09-11T11:05:44.818890+0000","last_clean":"2024-09-11T11:05:44.818890+0000","last_became_active":"2024-09-11T11:00:53.870222+0000","last_became_peered":"2024-09-11T11:00:53.870222+0000","last_unstale":"2024-09-11T11:05:44.818890+0000","last_undegraded":"2024-09-11T11:05:44.818890+0000","last_fullsized":"2024-09-11T11:05:44.818890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:44.818698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:44.818698+0000","last_clean_scrub_stamp":"2024-09-11T11:05:44.818698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:49:58.553831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070078800000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.474692+0000","last_change":"2024-09-11T11:05:00.474692+0000","last_active":"2024-09-11T11:05:00.474692+0000","last_peered":"2024-09-11T11:05:00.474692+0000","last_clean":"2024-09-11T11:05:00.474692+0000","last_became_active":"2024-09-11T11:01:07.344021+0000","last_became_peered":"2024-09-11T11:01:07.344021+0000","last_unstale":"2024-09-11T11:05:00.474692+0000","last_undegraded":"2024-09-11T11:05:00.474692+0000","last_fullsized":"2024-09-11T11:05:00.474692+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.474433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.474433+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.474433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:50:53.854590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.695956+0000","last_change":"2024-09-11T11:04:56.695956+0000","last_active":"2024-09-11T11:04:56.695956+0000","last_peered":"2024-09-11T11:04:56.695956+0000","last_clean":"2024-09-11T11:04:56.695956+0000","last_became_active":"2024-09-11T11:01:09.379372+0000","last_became_peered":"2024-09-11T11:01:09.379372+0000","last_unstale":"2024-09-11T11:04:56.695956+0000","last_undegraded":"2024-09-11T11:04:56.695956+0000","last_fullsized":"2024-09-11T11:04:56.695956+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:04:56.695654+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:04:56.695654+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.695654+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:10.244955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"36'286","reported_seq":436,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.884364+0000","last_change":"2024-09-11T11:05:26.884426+0000","last_active":"2024-09-11T11:05:26.884364+0000","last_peered":"2024-09-11T11:05:26.884364+0000","last_clean":"2024-09-11T11:05:26.884364+0000","last_became_active":"2024-09-11T11:01:11.403355+0000","last_became_peered":"2024-09-11T11:01:11.403355+0000","last_unstale":"2024-09-11T11:05:26.884364+0000","last_undegraded":"2024-09-11T11:05:26.884364+0000","last_fullsized":"2024-09-11T11:05:26.884364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-11T11:05:26.884181+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-11T11:05:26.884181+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.884181+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:03.502606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"32'3","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:53.910975+0000","last_change":"2024-09-11T11:05:53.911035+0000","last_active":"2024-09-11T11:05:53.910975+0000","last_peered":"2024-09-11T11:05:53.910975+0000","last_clean":"2024-09-11T11:05:53.910975+0000","last_became_active":"2024-09-11T11:01:13.415413+0000","last_became_peered":"2024-09-11T11:01:13.415413+0000","last_unstale":"2024-09-11T11:05:53.910975+0000","last_undegraded":"2024-09-11T11:05:53.910975+0000","last_fullsized":"2024-09-11T11:05:53.910975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-09-11T11:05:53.910787+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-09-11T11:05:53.910787+0000","last_clean_scrub_stamp":"2024-09-11T11:05:53.910787+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:41:03.924077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"36'14","reported_seq":76,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.122525+0000","last_change":"2024-09-11T11:05:16.122525+0000","last_active":"2024-09-11T11:05:16.122525+0000","last_peered":"2024-09-11T11:05:16.122525+0000","last_clean":"2024-09-11T11:05:16.122525+0000","last_became_active":"2024-09-11T11:01:05.338465+0000","last_became_peered":"2024-09-11T11:01:05.338465+0000","last_unstale":"2024-09-11T11:05:16.122525+0000","last_undegraded":"2024-09-11T11:05:16.122525+0000","last_fullsized":"2024-09-11T11:05:16.122525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:16.122266+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:16.122266+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.122266+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:53:41.559513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:42.817565+0000","last_change":"2024-09-11T11:05:42.817627+0000","last_active":"2024-09-11T11:05:42.817565+0000","last_peered":"2024-09-11T11:05:42.817565+0000","last_clean":"2024-09-11T11:05:42.817565+0000","last_became_active":"2024-09-11T11:01:03.325009+0000","last_became_peered":"2024-09-11T11:01:03.325009+0000","last_unstale":"2024-09-11T11:05:42.817565+0000","last_undegraded":"2024-09-11T11:05:42.817565+0000","last_fullsized":"2024-09-11T11:05:42.817565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:42.817373+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:42.817373+0000","last_clean_scrub_stamp":"2024-09-11T11:05:42.817373+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:40:49.036208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:53.758427+0000","last_change":"2024-09-11T11:05:53.758488+0000","last_active":"2024-09-11T11:05:53.758427+0000","last_peered":"2024-09-11T11:05:53.758427+0000","last_clean":"2024-09-11T11:05:53.758427+0000","last_became_active":"2024-09-11T11:00:53.870502+0000","last_became_peered":"2024-09-11T11:00:53.870502+0000","last_unstale":"2024-09-11T11:05:53.758427+0000","last_undegraded":"2024-09-11T11:05:53.758427+0000","last_fullsized":"2024-09-11T11:05:53.758427+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:53.758196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:53.758196+0000","last_clean_scrub_stamp":"2024-09-11T11:05:53.758196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:24.370550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025652299999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:03.729363+0000","last_change":"2024-09-11T11:05:03.729363+0000","last_active":"2024-09-11T11:05:03.729363+0000","last_peered":"2024-09-11T11:05:03.729363+0000","last_clean":"2024-09-11T11:05:03.729363+0000","last_became_active":"2024-09-11T11:01:07.363499+0000","last_became_peered":"2024-09-11T11:01:07.363499+0000","last_unstale":"2024-09-11T11:05:03.729363+0000","last_undegraded":"2024-09-11T11:05:03.729363+0000","last_fullsized":"2024-09-11T11:05:03.729363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:03.729049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:03.729049+0000","last_clean_scrub_stamp":"2024-09-11T11:05:03.729049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:46:05.674496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'96","reported_seq":194,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.645636+0000","last_change":"2024-09-11T11:05:12.645636+0000","last_active":"2024-09-11T11:05:12.645636+0000","last_peered":"2024-09-11T11:05:12.645636+0000","last_clean":"2024-09-11T11:05:12.645636+0000","last_became_active":"2024-09-11T11:01:09.371312+0000","last_became_peered":"2024-09-11T11:01:09.371312+0000","last_unstale":"2024-09-11T11:05:12.645636+0000","last_undegraded":"2024-09-11T11:05:12.645636+0000","last_fullsized":"2024-09-11T11:05:12.645636+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'96","last_scrub_stamp":"2024-09-11T11:05:12.645367+0000","last_deep_scrub":"36'96","last_deep_scrub_stamp":"2024-09-11T11:05:12.645367+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.645367+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:06.981705+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:07.747278+0000","last_change":"2024-09-11T11:05:07.747278+0000","last_active":"2024-09-11T11:05:07.747278+0000","last_peered":"2024-09-11T11:05:07.747278+0000","last_clean":"2024-09-11T11:05:07.747278+0000","last_became_active":"2024-09-11T11:01:11.383342+0000","last_became_peered":"2024-09-11T11:01:11.383342+0000","last_unstale":"2024-09-11T11:05:07.747278+0000","last_undegraded":"2024-09-11T11:05:07.747278+0000","last_fullsized":"2024-09-11T11:05:07.747278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:07.747023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:07.747023+0000","last_clean_scrub_stamp":"2024-09-11T11:05:07.747023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:47.852841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.101719+0000","last_change":"2024-09-11T11:04:54.101719+0000","last_active":"2024-09-11T11:04:54.101719+0000","last_peered":"2024-09-11T11:04:54.101719+0000","last_clean":"2024-09-11T11:04:54.101719+0000","last_became_active":"2024-09-11T11:01:13.413156+0000","last_became_peered":"2024-09-11T11:01:13.413156+0000","last_unstale":"2024-09-11T11:04:54.101719+0000","last_undegraded":"2024-09-11T11:04:54.101719+0000","last_fullsized":"2024-09-11T11:04:54.101719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.101491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.101491+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.101491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:19:08.443409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.084086+0000","last_change":"2024-09-11T11:04:57.084086+0000","last_active":"2024-09-11T11:04:57.084086+0000","last_peered":"2024-09-11T11:04:57.084086+0000","last_clean":"2024-09-11T11:04:57.084086+0000","last_became_active":"2024-09-11T11:01:13.413535+0000","last_became_peered":"2024-09-11T11:01:13.413535+0000","last_unstale":"2024-09-11T11:04:57.084086+0000","last_undegraded":"2024-09-11T11:04:57.084086+0000","last_fullsized":"2024-09-11T11:04:57.084086+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:57.083842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:57.083842+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.083842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:07:45.181339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"36'10","reported_seq":75,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.135493+0000","last_change":"2024-09-11T11:05:18.135493+0000","last_active":"2024-09-11T11:05:18.135493+0000","last_peered":"2024-09-11T11:05:18.135493+0000","last_clean":"2024-09-11T11:05:18.135493+0000","last_became_active":"2024-09-11T11:01:05.337509+0000","last_became_peered":"2024-09-11T11:01:05.337509+0000","last_unstale":"2024-09-11T11:05:18.135493+0000","last_undegraded":"2024-09-11T11:05:18.135493+0000","last_fullsized":"2024-09-11T11:05:18.135493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-11T11:05:18.135238+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-11T11:05:18.135238+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.135238+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:48:42.915671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"34'2","reported_seq":55,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:57.787041+0000","last_change":"2024-09-11T11:05:57.787104+0000","last_active":"2024-09-11T11:05:57.787041+0000","last_peered":"2024-09-11T11:05:57.787041+0000","last_clean":"2024-09-11T11:05:57.787041+0000","last_became_active":"2024-09-11T11:01:03.320981+0000","last_became_peered":"2024-09-11T11:01:03.320981+0000","last_unstale":"2024-09-11T11:05:57.787041+0000","last_undegraded":"2024-09-11T11:05:57.787041+0000","last_fullsized":"2024-09-11T11:05:57.787041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:57.786841+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:57.786841+0000","last_clean_scrub_stamp":"2024-09-11T11:05:57.786841+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:42:17.094727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.904364+0000","last_change":"2024-09-11T11:05:08.904364+0000","last_active":"2024-09-11T11:05:08.904364+0000","last_peered":"2024-09-11T11:05:08.904364+0000","last_clean":"2024-09-11T11:05:08.904364+0000","last_became_active":"2024-09-11T11:01:07.367778+0000","last_became_peered":"2024-09-11T11:01:07.367778+0000","last_unstale":"2024-09-11T11:05:08.904364+0000","last_undegraded":"2024-09-11T11:05:08.904364+0000","last_fullsized":"2024-09-11T11:05:08.904364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:08.904124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:08.904124+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.904124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:30:05.699592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'40","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.666250+0000","last_change":"2024-09-11T11:04:57.666250+0000","last_active":"2024-09-11T11:04:57.666250+0000","last_peered":"2024-09-11T11:04:57.666250+0000","last_clean":"2024-09-11T11:04:57.666250+0000","last_became_active":"2024-09-11T11:01:09.369318+0000","last_became_peered":"2024-09-11T11:01:09.369318+0000","last_unstale":"2024-09-11T11:04:57.666250+0000","last_undegraded":"2024-09-11T11:04:57.666250+0000","last_fullsized":"2024-09-11T11:04:57.666250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'40","last_scrub_stamp":"2024-09-11T11:04:57.665979+0000","last_deep_scrub":"36'40","last_deep_scrub_stamp":"2024-09-11T11:04:57.665979+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.665979+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:54:56.063485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.760491+0000","last_change":"2024-09-11T11:05:06.760491+0000","last_active":"2024-09-11T11:05:06.760491+0000","last_peered":"2024-09-11T11:05:06.760491+0000","last_clean":"2024-09-11T11:05:06.760491+0000","last_became_active":"2024-09-11T11:01:11.396833+0000","last_became_peered":"2024-09-11T11:01:11.396833+0000","last_unstale":"2024-09-11T11:05:06.760491+0000","last_undegraded":"2024-09-11T11:05:06.760491+0000","last_fullsized":"2024-09-11T11:05:06.760491+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:06.760244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:06.760244+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.760244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:21:01.442882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"36'3","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:01.975673+0000","last_change":"2024-09-11T11:06:01.975758+0000","last_active":"2024-09-11T11:06:01.975673+0000","last_peered":"2024-09-11T11:06:01.975673+0000","last_clean":"2024-09-11T11:06:01.975673+0000","last_became_active":"2024-09-11T11:01:13.407663+0000","last_became_peered":"2024-09-11T11:01:13.407663+0000","last_unstale":"2024-09-11T11:06:01.975673+0000","last_undegraded":"2024-09-11T11:06:01.975673+0000","last_fullsized":"2024-09-11T11:06:01.975673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-11T11:06:01.975443+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-11T11:06:01.975443+0000","last_clean_scrub_stamp":"2024-09-11T11:06:01.975443+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:19:11.143509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"36'8","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:35.793127+0000","last_change":"2024-09-11T11:05:35.793127+0000","last_active":"2024-09-11T11:05:35.793127+0000","last_peered":"2024-09-11T11:05:35.793127+0000","last_clean":"2024-09-11T11:05:35.793127+0000","last_became_active":"2024-09-11T11:01:05.340457+0000","last_became_peered":"2024-09-11T11:01:05.340457+0000","last_unstale":"2024-09-11T11:05:35.793127+0000","last_undegraded":"2024-09-11T11:05:35.793127+0000","last_fullsized":"2024-09-11T11:05:35.793127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:35.792888+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:35.792888+0000","last_clean_scrub_stamp":"2024-09-11T11:05:35.792888+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:59:24.482862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.224918+0000","last_change":"2024-09-11T11:05:26.224918+0000","last_active":"2024-09-11T11:05:26.224918+0000","last_peered":"2024-09-11T11:05:26.224918+0000","last_clean":"2024-09-11T11:05:26.224918+0000","last_became_active":"2024-09-11T11:01:03.335235+0000","last_became_peered":"2024-09-11T11:01:03.335235+0000","last_unstale":"2024-09-11T11:05:26.224918+0000","last_undegraded":"2024-09-11T11:05:26.224918+0000","last_fullsized":"2024-09-11T11:05:26.224918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:26.224557+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:26.224557+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.224557+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:35:54.595969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.663228+0000","last_change":"2024-09-11T11:04:59.663228+0000","last_active":"2024-09-11T11:04:59.663228+0000","last_peered":"2024-09-11T11:04:59.663228+0000","last_clean":"2024-09-11T11:04:59.663228+0000","last_became_active":"2024-09-11T11:02:42.501867+0000","last_became_peered":"2024-09-11T11:02:42.501867+0000","last_unstale":"2024-09-11T11:04:59.663228+0000","last_undegraded":"2024-09-11T11:04:59.663228+0000","last_fullsized":"2024-09-11T11:04:59.663228+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.662970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.662970+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.662970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:06.928697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'8","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:06.868678+0000","last_change":"2024-09-11T11:05:06.868678+0000","last_active":"2024-09-11T11:05:06.868678+0000","last_peered":"2024-09-11T11:05:06.868678+0000","last_clean":"2024-09-11T11:05:06.868678+0000","last_became_active":"2024-09-11T11:01:09.362975+0000","last_became_peered":"2024-09-11T11:01:09.362975+0000","last_unstale":"2024-09-11T11:05:06.868678+0000","last_undegraded":"2024-09-11T11:05:06.868678+0000","last_fullsized":"2024-09-11T11:05:06.868678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:06.868398+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:06.868398+0000","last_clean_scrub_stamp":"2024-09-11T11:05:06.868398+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:45:14.134126+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.975001+0000","last_change":"2024-09-11T11:05:01.975001+0000","last_active":"2024-09-11T11:05:01.975001+0000","last_peered":"2024-09-11T11:05:01.975001+0000","last_clean":"2024-09-11T11:05:01.975001+0000","last_became_active":"2024-09-11T11:01:11.393181+0000","last_became_peered":"2024-09-11T11:01:11.393181+0000","last_unstale":"2024-09-11T11:05:01.975001+0000","last_undegraded":"2024-09-11T11:05:01.975001+0000","last_fullsized":"2024-09-11T11:05:01.975001+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.974738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.974738+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.974738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:27:29.665900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"36'8","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:52.952771+0000","last_change":"2024-09-11T11:05:52.952771+0000","last_active":"2024-09-11T11:05:52.952771+0000","last_peered":"2024-09-11T11:05:52.952771+0000","last_clean":"2024-09-11T11:05:52.952771+0000","last_became_active":"2024-09-11T11:01:13.419238+0000","last_became_peered":"2024-09-11T11:01:13.419238+0000","last_unstale":"2024-09-11T11:05:52.952771+0000","last_undegraded":"2024-09-11T11:05:52.952771+0000","last_fullsized":"2024-09-11T11:05:52.952771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:52.952478+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:52.952478+0000","last_clean_scrub_stamp":"2024-09-11T11:05:52.952478+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:28:39.820919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"36'10","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:41.308773+0000","last_change":"2024-09-11T11:05:41.308946+0000","last_active":"2024-09-11T11:05:41.308773+0000","last_peered":"2024-09-11T11:05:41.308773+0000","last_clean":"2024-09-11T11:05:41.308773+0000","last_became_active":"2024-09-11T11:01:42.058258+0000","last_became_peered":"2024-09-11T11:01:42.058258+0000","last_unstale":"2024-09-11T11:05:41.308773+0000","last_undegraded":"2024-09-11T11:05:41.308773+0000","last_fullsized":"2024-09-11T11:05:41.308773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'10","last_scrub_stamp":"2024-09-11T11:05:41.308518+0000","last_deep_scrub":"36'10","last_deep_scrub_stamp":"2024-09-11T11:05:41.308518+0000","last_clean_scrub_stamp":"2024-09-11T11:05:41.308518+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:41:32.809838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:45.602087+0000","last_change":"2024-09-11T11:05:45.602087+0000","last_active":"2024-09-11T11:05:45.602087+0000","last_peered":"2024-09-11T11:05:45.602087+0000","last_clean":"2024-09-11T11:05:45.602087+0000","last_became_active":"2024-09-11T11:01:03.337144+0000","last_became_peered":"2024-09-11T11:01:03.337144+0000","last_unstale":"2024-09-11T11:05:45.602087+0000","last_undegraded":"2024-09-11T11:05:45.602087+0000","last_fullsized":"2024-09-11T11:05:45.602087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:45.601834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:45.601834+0000","last_clean_scrub_stamp":"2024-09-11T11:05:45.601834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:15.978339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"36'5","reported_seq":243,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.547593+0000","last_change":"2024-09-11T11:04:58.547593+0000","last_active":"2024-09-11T11:04:58.547593+0000","last_peered":"2024-09-11T11:04:58.547593+0000","last_clean":"2024-09-11T11:04:58.547593+0000","last_became_active":"2024-09-11T11:01:07.358156+0000","last_became_peered":"2024-09-11T11:01:07.358156+0000","last_unstale":"2024-09-11T11:04:58.547593+0000","last_undegraded":"2024-09-11T11:04:58.547593+0000","last_fullsized":"2024-09-11T11:04:58.547593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'5","last_scrub_stamp":"2024-09-11T11:04:58.547344+0000","last_deep_scrub":"36'5","last_deep_scrub_stamp":"2024-09-11T11:04:58.547344+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.547344+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:46:00.492791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"36'50","reported_seq":127,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.732707+0000","last_change":"2024-09-11T11:05:02.732707+0000","last_active":"2024-09-11T11:05:02.732707+0000","last_peered":"2024-09-11T11:05:02.732707+0000","last_clean":"2024-09-11T11:05:02.732707+0000","last_became_active":"2024-09-11T11:01:09.380595+0000","last_became_peered":"2024-09-11T11:01:09.380595+0000","last_unstale":"2024-09-11T11:05:02.732707+0000","last_undegraded":"2024-09-11T11:05:02.732707+0000","last_fullsized":"2024-09-11T11:05:02.732707+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'50","last_scrub_stamp":"2024-09-11T11:05:02.732310+0000","last_deep_scrub":"36'50","last_deep_scrub_stamp":"2024-09-11T11:05:02.732310+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.732310+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:42:04.576806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":72,"num_read_kb":83,"num_write":52,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:01.877523+0000","last_change":"2024-09-11T11:05:01.877523+0000","last_active":"2024-09-11T11:05:01.877523+0000","last_peered":"2024-09-11T11:05:01.877523+0000","last_clean":"2024-09-11T11:05:01.877523+0000","last_became_active":"2024-09-11T11:01:11.401847+0000","last_became_peered":"2024-09-11T11:01:11.401847+0000","last_unstale":"2024-09-11T11:05:01.877523+0000","last_undegraded":"2024-09-11T11:05:01.877523+0000","last_fullsized":"2024-09-11T11:05:01.877523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:01.877282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:01.877282+0000","last_clean_scrub_stamp":"2024-09-11T11:05:01.877282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:36.973759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:34.978971+0000","last_change":"2024-09-11T11:05:34.978971+0000","last_active":"2024-09-11T11:05:34.978971+0000","last_peered":"2024-09-11T11:05:34.978971+0000","last_clean":"2024-09-11T11:05:34.978971+0000","last_became_active":"2024-09-11T11:01:13.395231+0000","last_became_peered":"2024-09-11T11:01:13.395231+0000","last_unstale":"2024-09-11T11:05:34.978971+0000","last_undegraded":"2024-09-11T11:05:34.978971+0000","last_fullsized":"2024-09-11T11:05:34.978971+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:34.978741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:34.978741+0000","last_clean_scrub_stamp":"2024-09-11T11:05:34.978741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:07:25.619468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'12","reported_seq":85,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.785513+0000","last_change":"2024-09-11T11:05:20.785513+0000","last_active":"2024-09-11T11:05:20.785513+0000","last_peered":"2024-09-11T11:05:20.785513+0000","last_clean":"2024-09-11T11:05:20.785513+0000","last_became_active":"2024-09-11T11:01:05.348002+0000","last_became_peered":"2024-09-11T11:01:05.348002+0000","last_unstale":"2024-09-11T11:05:20.785513+0000","last_undegraded":"2024-09-11T11:05:20.785513+0000","last_fullsized":"2024-09-11T11:05:20.785513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:20.785263+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:20.785263+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.785263+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:15:03.184396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":50,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:38.815600+0000","last_change":"2024-09-11T11:05:38.815600+0000","last_active":"2024-09-11T11:05:38.815600+0000","last_peered":"2024-09-11T11:05:38.815600+0000","last_clean":"2024-09-11T11:05:38.815600+0000","last_became_active":"2024-09-11T11:01:03.330782+0000","last_became_peered":"2024-09-11T11:01:03.330782+0000","last_unstale":"2024-09-11T11:05:38.815600+0000","last_undegraded":"2024-09-11T11:05:38.815600+0000","last_fullsized":"2024-09-11T11:05:38.815600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:38.815353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:38.815353+0000","last_clean_scrub_stamp":"2024-09-11T11:05:38.815353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:13:21.421632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.796271+0000","last_change":"2024-09-11T11:05:19.796271+0000","last_active":"2024-09-11T11:05:19.796271+0000","last_peered":"2024-09-11T11:05:19.796271+0000","last_clean":"2024-09-11T11:05:19.796271+0000","last_became_active":"2024-09-11T11:01:07.350685+0000","last_became_peered":"2024-09-11T11:01:07.350685+0000","last_unstale":"2024-09-11T11:05:19.796271+0000","last_undegraded":"2024-09-11T11:05:19.796271+0000","last_fullsized":"2024-09-11T11:05:19.796271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:19.796009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:19.796009+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.796009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:34:29.117828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"36'37","reported_seq":97,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.597808+0000","last_change":"2024-09-11T11:04:55.597808+0000","last_active":"2024-09-11T11:04:55.597808+0000","last_peered":"2024-09-11T11:04:55.597808+0000","last_clean":"2024-09-11T11:04:55.597808+0000","last_became_active":"2024-09-11T11:01:09.362483+0000","last_became_peered":"2024-09-11T11:01:09.362483+0000","last_unstale":"2024-09-11T11:04:55.597808+0000","last_undegraded":"2024-09-11T11:04:55.597808+0000","last_fullsized":"2024-09-11T11:04:55.597808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'37","last_scrub_stamp":"2024-09-11T11:04:55.597543+0000","last_deep_scrub":"36'37","last_deep_scrub_stamp":"2024-09-11T11:04:55.597543+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.597543+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:28.136198+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.018297+0000","last_change":"2024-09-11T11:04:59.018297+0000","last_active":"2024-09-11T11:04:59.018297+0000","last_peered":"2024-09-11T11:04:59.018297+0000","last_clean":"2024-09-11T11:04:59.018297+0000","last_became_active":"2024-09-11T11:01:11.398843+0000","last_became_peered":"2024-09-11T11:01:11.398843+0000","last_unstale":"2024-09-11T11:04:59.018297+0000","last_undegraded":"2024-09-11T11:04:59.018297+0000","last_fullsized":"2024-09-11T11:04:59.018297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.018045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.018045+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.018045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:30:20.573633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"36'8","reported_seq":67,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:22.485209+0000","last_change":"2024-09-11T11:05:22.485267+0000","last_active":"2024-09-11T11:05:22.485209+0000","last_peered":"2024-09-11T11:05:22.485209+0000","last_clean":"2024-09-11T11:05:22.485209+0000","last_became_active":"2024-09-11T11:01:05.347496+0000","last_became_peered":"2024-09-11T11:01:05.347496+0000","last_unstale":"2024-09-11T11:05:22.485209+0000","last_undegraded":"2024-09-11T11:05:22.485209+0000","last_fullsized":"2024-09-11T11:05:22.485209+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:22.485029+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:22.485029+0000","last_clean_scrub_stamp":"2024-09-11T11:05:22.485029+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:12.896348+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:39.911197+0000","last_change":"2024-09-11T11:05:39.911197+0000","last_active":"2024-09-11T11:05:39.911197+0000","last_peered":"2024-09-11T11:05:39.911197+0000","last_clean":"2024-09-11T11:05:39.911197+0000","last_became_active":"2024-09-11T11:01:03.348849+0000","last_became_peered":"2024-09-11T11:01:03.348849+0000","last_unstale":"2024-09-11T11:05:39.911197+0000","last_undegraded":"2024-09-11T11:05:39.911197+0000","last_fullsized":"2024-09-11T11:05:39.911197+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:39.910952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:39.910952+0000","last_clean_scrub_stamp":"2024-09-11T11:05:39.910952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:22:11.858531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:12.904463+0000","last_change":"2024-09-11T11:05:12.904513+0000","last_active":"2024-09-11T11:05:12.904463+0000","last_peered":"2024-09-11T11:05:12.904463+0000","last_clean":"2024-09-11T11:05:12.904463+0000","last_became_active":"2024-09-11T11:01:07.365953+0000","last_became_peered":"2024-09-11T11:01:07.365953+0000","last_unstale":"2024-09-11T11:05:12.904463+0000","last_undegraded":"2024-09-11T11:05:12.904463+0000","last_fullsized":"2024-09-11T11:05:12.904463+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:12.904281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:12.904281+0000","last_clean_scrub_stamp":"2024-09-11T11:05:12.904281+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:06.284437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1d","version":"36'63","reported_seq":141,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.899131+0000","last_change":"2024-09-11T11:05:04.899131+0000","last_active":"2024-09-11T11:05:04.899131+0000","last_peered":"2024-09-11T11:05:04.899131+0000","last_clean":"2024-09-11T11:05:04.899131+0000","last_became_active":"2024-09-11T11:01:09.374937+0000","last_became_peered":"2024-09-11T11:01:09.374937+0000","last_unstale":"2024-09-11T11:05:04.899131+0000","last_undegraded":"2024-09-11T11:05:04.899131+0000","last_fullsized":"2024-09-11T11:05:04.899131+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-09-11T11:05:04.898835+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-09-11T11:05:04.898835+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.898835+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:55:03.296341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:00.013009+0000","last_change":"2024-09-11T11:05:00.013009+0000","last_active":"2024-09-11T11:05:00.013009+0000","last_peered":"2024-09-11T11:05:00.013009+0000","last_clean":"2024-09-11T11:05:00.013009+0000","last_became_active":"2024-09-11T11:01:11.394849+0000","last_became_peered":"2024-09-11T11:01:11.394849+0000","last_unstale":"2024-09-11T11:05:00.013009+0000","last_undegraded":"2024-09-11T11:05:00.013009+0000","last_fullsized":"2024-09-11T11:05:00.013009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:00.012754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:00.012754+0000","last_clean_scrub_stamp":"2024-09-11T11:05:00.012754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:06:50.213447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"36'14","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:03.965068+0000","last_change":"2024-09-11T11:06:03.965132+0000","last_active":"2024-09-11T11:06:03.965068+0000","last_peered":"2024-09-11T11:06:03.965068+0000","last_clean":"2024-09-11T11:06:03.965068+0000","last_became_active":"2024-09-11T11:01:13.416414+0000","last_became_peered":"2024-09-11T11:01:13.416414+0000","last_unstale":"2024-09-11T11:06:03.965068+0000","last_undegraded":"2024-09-11T11:06:03.965068+0000","last_fullsized":"2024-09-11T11:06:03.965068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:06:03.964882+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:06:03.964882+0000","last_clean_scrub_stamp":"2024-09-11T11:06:03.964882+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:05:31.591883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"34'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.777103+0000","last_change":"2024-09-11T11:05:31.777167+0000","last_active":"2024-09-11T11:05:31.777103+0000","last_peered":"2024-09-11T11:05:31.777103+0000","last_clean":"2024-09-11T11:05:31.777103+0000","last_became_active":"2024-09-11T11:01:05.339898+0000","last_became_peered":"2024-09-11T11:01:05.339898+0000","last_unstale":"2024-09-11T11:05:31.777103+0000","last_undegraded":"2024-09-11T11:05:31.777103+0000","last_fullsized":"2024-09-11T11:05:31.777103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:31.776907+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:31.776907+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.776907+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:10.381824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"36'4","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:58.813867+0000","last_change":"2024-09-11T11:05:58.813994+0000","last_active":"2024-09-11T11:05:58.813867+0000","last_peered":"2024-09-11T11:05:58.813867+0000","last_clean":"2024-09-11T11:05:58.813867+0000","last_became_active":"2024-09-11T11:01:42.058648+0000","last_became_peered":"2024-09-11T11:01:42.058648+0000","last_unstale":"2024-09-11T11:05:58.813867+0000","last_undegraded":"2024-09-11T11:05:58.813867+0000","last_fullsized":"2024-09-11T11:05:58.813867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:58.813640+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:58.813640+0000","last_clean_scrub_stamp":"2024-09-11T11:05:58.813640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:29.190145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:16.564057+0000","last_change":"2024-09-11T11:05:16.564057+0000","last_active":"2024-09-11T11:05:16.564057+0000","last_peered":"2024-09-11T11:05:16.564057+0000","last_clean":"2024-09-11T11:05:16.564057+0000","last_became_active":"2024-09-11T11:01:07.340147+0000","last_became_peered":"2024-09-11T11:01:07.340147+0000","last_unstale":"2024-09-11T11:05:16.564057+0000","last_undegraded":"2024-09-11T11:05:16.564057+0000","last_fullsized":"2024-09-11T11:05:16.564057+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:16.563796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:16.563796+0000","last_clean_scrub_stamp":"2024-09-11T11:05:16.563796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:18.185050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1c","version":"36'45","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.646407+0000","last_change":"2024-09-11T11:05:11.646407+0000","last_active":"2024-09-11T11:05:11.646407+0000","last_peered":"2024-09-11T11:05:11.646407+0000","last_clean":"2024-09-11T11:05:11.646407+0000","last_became_active":"2024-09-11T11:01:09.371522+0000","last_became_peered":"2024-09-11T11:01:09.371522+0000","last_unstale":"2024-09-11T11:05:11.646407+0000","last_undegraded":"2024-09-11T11:05:11.646407+0000","last_fullsized":"2024-09-11T11:05:11.646407+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:05:11.646224+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:05:11.646224+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.646224+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:29:32.853566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:55.888485+0000","last_change":"2024-09-11T11:04:55.888485+0000","last_active":"2024-09-11T11:04:55.888485+0000","last_peered":"2024-09-11T11:04:55.888485+0000","last_clean":"2024-09-11T11:04:55.888485+0000","last_became_active":"2024-09-11T11:01:11.392489+0000","last_became_peered":"2024-09-11T11:01:11.392489+0000","last_unstale":"2024-09-11T11:04:55.888485+0000","last_undegraded":"2024-09-11T11:04:55.888485+0000","last_fullsized":"2024-09-11T11:04:55.888485+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:55.888202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:55.888202+0000","last_clean_scrub_stamp":"2024-09-11T11:04:55.888202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:10:13.122333+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:01.857784+0000","last_change":"2024-09-11T11:06:01.857885+0000","last_active":"2024-09-11T11:06:01.857784+0000","last_peered":"2024-09-11T11:06:01.857784+0000","last_clean":"2024-09-11T11:06:01.857784+0000","last_became_active":"2024-09-11T11:01:13.404341+0000","last_became_peered":"2024-09-11T11:01:13.404341+0000","last_unstale":"2024-09-11T11:06:01.857784+0000","last_undegraded":"2024-09-11T11:06:01.857784+0000","last_fullsized":"2024-09-11T11:06:01.857784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:06:01.857551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:06:01.857551+0000","last_clean_scrub_stamp":"2024-09-11T11:06:01.857551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:39:09.516911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"36'18","reported_seq":90,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:21.804823+0000","last_change":"2024-09-11T11:05:21.804823+0000","last_active":"2024-09-11T11:05:21.804823+0000","last_peered":"2024-09-11T11:05:21.804823+0000","last_clean":"2024-09-11T11:05:21.804823+0000","last_became_active":"2024-09-11T11:01:05.347745+0000","last_became_peered":"2024-09-11T11:01:05.347745+0000","last_unstale":"2024-09-11T11:05:21.804823+0000","last_undegraded":"2024-09-11T11:05:21.804823+0000","last_fullsized":"2024-09-11T11:05:21.804823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'18","last_scrub_stamp":"2024-09-11T11:05:21.804546+0000","last_deep_scrub":"36'18","last_deep_scrub_stamp":"2024-09-11T11:05:21.804546+0000","last_clean_scrub_stamp":"2024-09-11T11:05:21.804546+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:24:23.425800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:50.719967+0000","last_change":"2024-09-11T11:05:50.719967+0000","last_active":"2024-09-11T11:05:50.719967+0000","last_peered":"2024-09-11T11:05:50.719967+0000","last_clean":"2024-09-11T11:05:50.719967+0000","last_became_active":"2024-09-11T11:01:03.321106+0000","last_became_peered":"2024-09-11T11:01:03.321106+0000","last_unstale":"2024-09-11T11:05:50.719967+0000","last_undegraded":"2024-09-11T11:05:50.719967+0000","last_fullsized":"2024-09-11T11:05:50.719967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:50.719719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:50.719719+0000","last_clean_scrub_stamp":"2024-09-11T11:05:50.719719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:11.794125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:02.487740+0000","last_change":"2024-09-11T11:05:02.487740+0000","last_active":"2024-09-11T11:05:02.487740+0000","last_peered":"2024-09-11T11:05:02.487740+0000","last_clean":"2024-09-11T11:05:02.487740+0000","last_became_active":"2024-09-11T11:01:07.342760+0000","last_became_peered":"2024-09-11T11:01:07.342760+0000","last_unstale":"2024-09-11T11:05:02.487740+0000","last_undegraded":"2024-09-11T11:05:02.487740+0000","last_fullsized":"2024-09-11T11:05:02.487740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:02.487502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:02.487502+0000","last_clean_scrub_stamp":"2024-09-11T11:05:02.487502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:42.593320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"36'41","reported_seq":102,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.821592+0000","last_change":"2024-09-11T11:05:13.821592+0000","last_active":"2024-09-11T11:05:13.821592+0000","last_peered":"2024-09-11T11:05:13.821592+0000","last_clean":"2024-09-11T11:05:13.821592+0000","last_became_active":"2024-09-11T11:01:09.389548+0000","last_became_peered":"2024-09-11T11:01:09.389548+0000","last_unstale":"2024-09-11T11:05:13.821592+0000","last_undegraded":"2024-09-11T11:05:13.821592+0000","last_fullsized":"2024-09-11T11:05:13.821592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'41","last_scrub_stamp":"2024-09-11T11:05:13.821343+0000","last_deep_scrub":"36'41","last_deep_scrub_stamp":"2024-09-11T11:05:13.821343+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.821343+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:01:03.574623+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.814732+0000","last_change":"2024-09-11T11:04:58.814732+0000","last_active":"2024-09-11T11:04:58.814732+0000","last_peered":"2024-09-11T11:04:58.814732+0000","last_clean":"2024-09-11T11:04:58.814732+0000","last_became_active":"2024-09-11T11:01:11.391080+0000","last_became_peered":"2024-09-11T11:01:11.391080+0000","last_unstale":"2024-09-11T11:04:58.814732+0000","last_undegraded":"2024-09-11T11:04:58.814732+0000","last_fullsized":"2024-09-11T11:04:58.814732+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:58.814489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:58.814489+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.814489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:30:05.782233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"36'3","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:03.893474+0000","last_change":"2024-09-11T11:06:03.893537+0000","last_active":"2024-09-11T11:06:03.893474+0000","last_peered":"2024-09-11T11:06:03.893474+0000","last_clean":"2024-09-11T11:06:03.893474+0000","last_became_active":"2024-09-11T11:01:13.420844+0000","last_became_peered":"2024-09-11T11:01:13.420844+0000","last_unstale":"2024-09-11T11:06:03.893474+0000","last_undegraded":"2024-09-11T11:06:03.893474+0000","last_fullsized":"2024-09-11T11:06:03.893474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-11T11:06:03.893286+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-11T11:06:03.893286+0000","last_clean_scrub_stamp":"2024-09-11T11:06:03.893286+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:50:06.028938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"36'8","reported_seq":74,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.077302+0000","last_change":"2024-09-11T11:05:14.077302+0000","last_active":"2024-09-11T11:05:14.077302+0000","last_peered":"2024-09-11T11:05:14.077302+0000","last_clean":"2024-09-11T11:05:14.077302+0000","last_became_active":"2024-09-11T11:01:05.338036+0000","last_became_peered":"2024-09-11T11:01:05.338036+0000","last_unstale":"2024-09-11T11:05:14.077302+0000","last_undegraded":"2024-09-11T11:05:14.077302+0000","last_fullsized":"2024-09-11T11:05:14.077302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:14.077033+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:14.077033+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.077033+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:34:09.324339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:56.059889+0000","last_change":"2024-09-11T11:05:56.059889+0000","last_active":"2024-09-11T11:05:56.059889+0000","last_peered":"2024-09-11T11:05:56.059889+0000","last_clean":"2024-09-11T11:05:56.059889+0000","last_became_active":"2024-09-11T11:01:03.335959+0000","last_became_peered":"2024-09-11T11:01:03.335959+0000","last_unstale":"2024-09-11T11:05:56.059889+0000","last_undegraded":"2024-09-11T11:05:56.059889+0000","last_fullsized":"2024-09-11T11:05:56.059889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:56.059606+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:56.059606+0000","last_clean_scrub_stamp":"2024-09-11T11:05:56.059606+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:05:17.134012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:52.936737+0000","last_change":"2024-09-11T11:04:52.936737+0000","last_active":"2024-09-11T11:04:52.936737+0000","last_peered":"2024-09-11T11:04:52.936737+0000","last_clean":"2024-09-11T11:04:52.936737+0000","last_became_active":"2024-09-11T11:01:07.368853+0000","last_became_peered":"2024-09-11T11:01:07.368853+0000","last_unstale":"2024-09-11T11:04:52.936737+0000","last_undegraded":"2024-09-11T11:04:52.936737+0000","last_fullsized":"2024-09-11T11:04:52.936737+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:52.936491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:52.936491+0000","last_clean_scrub_stamp":"2024-09-11T11:04:52.936491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:47:53.282179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'16","reported_seq":60,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:11.798050+0000","last_change":"2024-09-11T11:05:11.798050+0000","last_active":"2024-09-11T11:05:11.798050+0000","last_peered":"2024-09-11T11:05:11.798050+0000","last_clean":"2024-09-11T11:05:11.798050+0000","last_became_active":"2024-09-11T11:01:09.391249+0000","last_became_peered":"2024-09-11T11:01:09.391249+0000","last_unstale":"2024-09-11T11:05:11.798050+0000","last_undegraded":"2024-09-11T11:05:11.798050+0000","last_fullsized":"2024-09-11T11:05:11.798050+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'16","last_scrub_stamp":"2024-09-11T11:05:11.797766+0000","last_deep_scrub":"36'16","last_deep_scrub_stamp":"2024-09-11T11:05:11.797766+0000","last_clean_scrub_stamp":"2024-09-11T11:05:11.797766+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:17:35.030060+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"36'286","reported_seq":385,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.559818+0000","last_change":"2024-09-11T11:05:33.559884+0000","last_active":"2024-09-11T11:05:33.559818+0000","last_peered":"2024-09-11T11:05:33.559818+0000","last_clean":"2024-09-11T11:05:33.559818+0000","last_became_active":"2024-09-11T11:01:11.401400+0000","last_became_peered":"2024-09-11T11:01:11.401400+0000","last_unstale":"2024-09-11T11:05:33.559818+0000","last_undegraded":"2024-09-11T11:05:33.559818+0000","last_fullsized":"2024-09-11T11:05:33.559818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'286","last_scrub_stamp":"2024-09-11T11:05:33.559634+0000","last_deep_scrub":"36'286","last_deep_scrub_stamp":"2024-09-11T11:05:33.559634+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.559634+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:40.844398+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:00.815706+0000","last_change":"2024-09-11T11:06:00.815758+0000","last_active":"2024-09-11T11:06:00.815706+0000","last_peered":"2024-09-11T11:06:00.815706+0000","last_clean":"2024-09-11T11:06:00.815706+0000","last_became_active":"2024-09-11T11:01:13.402406+0000","last_became_peered":"2024-09-11T11:01:13.402406+0000","last_unstale":"2024-09-11T11:06:00.815706+0000","last_undegraded":"2024-09-11T11:06:00.815706+0000","last_fullsized":"2024-09-11T11:06:00.815706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:06:00.815511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:06:00.815511+0000","last_clean_scrub_stamp":"2024-09-11T11:06:00.815511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:33:23.474605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"36'6","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.182120+0000","last_change":"2024-09-11T11:05:19.182120+0000","last_active":"2024-09-11T11:05:19.182120+0000","last_peered":"2024-09-11T11:05:19.182120+0000","last_clean":"2024-09-11T11:05:19.182120+0000","last_became_active":"2024-09-11T11:01:05.353214+0000","last_became_peered":"2024-09-11T11:01:05.353214+0000","last_unstale":"2024-09-11T11:05:19.182120+0000","last_undegraded":"2024-09-11T11:05:19.182120+0000","last_fullsized":"2024-09-11T11:05:19.182120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:19.181864+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:19.181864+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.181864+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:55.950071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:34.833209+0000","last_change":"2024-09-11T11:05:34.833209+0000","last_active":"2024-09-11T11:05:34.833209+0000","last_peered":"2024-09-11T11:05:34.833209+0000","last_clean":"2024-09-11T11:05:34.833209+0000","last_became_active":"2024-09-11T11:01:03.346318+0000","last_became_peered":"2024-09-11T11:01:03.346318+0000","last_unstale":"2024-09-11T11:05:34.833209+0000","last_undegraded":"2024-09-11T11:05:34.833209+0000","last_fullsized":"2024-09-11T11:05:34.833209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:34.832964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:34.832964+0000","last_clean_scrub_stamp":"2024-09-11T11:05:34.832964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:41:37.672737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:54.915574+0000","last_change":"2024-09-11T11:04:54.915574+0000","last_active":"2024-09-11T11:04:54.915574+0000","last_peered":"2024-09-11T11:04:54.915574+0000","last_clean":"2024-09-11T11:04:54.915574+0000","last_became_active":"2024-09-11T11:01:07.368713+0000","last_became_peered":"2024-09-11T11:01:07.368713+0000","last_unstale":"2024-09-11T11:04:54.915574+0000","last_undegraded":"2024-09-11T11:04:54.915574+0000","last_fullsized":"2024-09-11T11:04:54.915574+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:54.915331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:54.915331+0000","last_clean_scrub_stamp":"2024-09-11T11:04:54.915331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:12:04.269950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"36'45","reported_seq":108,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:57.531736+0000","last_change":"2024-09-11T11:04:57.531736+0000","last_active":"2024-09-11T11:04:57.531736+0000","last_peered":"2024-09-11T11:04:57.531736+0000","last_clean":"2024-09-11T11:04:57.531736+0000","last_became_active":"2024-09-11T11:01:09.363530+0000","last_became_peered":"2024-09-11T11:01:09.363530+0000","last_unstale":"2024-09-11T11:04:57.531736+0000","last_undegraded":"2024-09-11T11:04:57.531736+0000","last_fullsized":"2024-09-11T11:04:57.531736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'45","last_scrub_stamp":"2024-09-11T11:04:57.531466+0000","last_deep_scrub":"36'45","last_deep_scrub_stamp":"2024-09-11T11:04:57.531466+0000","last_clean_scrub_stamp":"2024-09-11T11:04:57.531466+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:04:53.383843+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:08.753629+0000","last_change":"2024-09-11T11:05:08.753629+0000","last_active":"2024-09-11T11:05:08.753629+0000","last_peered":"2024-09-11T11:05:08.753629+0000","last_clean":"2024-09-11T11:05:08.753629+0000","last_became_active":"2024-09-11T11:01:11.371526+0000","last_became_peered":"2024-09-11T11:01:11.371526+0000","last_unstale":"2024-09-11T11:05:08.753629+0000","last_undegraded":"2024-09-11T11:05:08.753629+0000","last_fullsized":"2024-09-11T11:05:08.753629+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:08.753213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:08.753213+0000","last_clean_scrub_stamp":"2024-09-11T11:05:08.753213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:50.699884+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"34'2","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:04.891919+0000","last_change":"2024-09-11T11:06:04.891919+0000","last_active":"2024-09-11T11:06:04.891919+0000","last_peered":"2024-09-11T11:06:04.891919+0000","last_clean":"2024-09-11T11:06:04.891919+0000","last_became_active":"2024-09-11T11:01:13.421220+0000","last_became_peered":"2024-09-11T11:01:13.421220+0000","last_unstale":"2024-09-11T11:06:04.891919+0000","last_undegraded":"2024-09-11T11:06:04.891919+0000","last_fullsized":"2024-09-11T11:06:04.891919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:06:04.891661+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:06:04.891661+0000","last_clean_scrub_stamp":"2024-09-11T11:06:04.891661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:39:41.423868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"36'4","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:19.529955+0000","last_change":"2024-09-11T11:05:19.529955+0000","last_active":"2024-09-11T11:05:19.529955+0000","last_peered":"2024-09-11T11:05:19.529955+0000","last_clean":"2024-09-11T11:05:19.529955+0000","last_became_active":"2024-09-11T11:01:05.348256+0000","last_became_peered":"2024-09-11T11:01:05.348256+0000","last_unstale":"2024-09-11T11:05:19.529955+0000","last_undegraded":"2024-09-11T11:05:19.529955+0000","last_fullsized":"2024-09-11T11:05:19.529955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:19.529705+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:19.529705+0000","last_clean_scrub_stamp":"2024-09-11T11:05:19.529705+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:22:58.134622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:40.504308+0000","last_change":"2024-09-11T11:05:40.504308+0000","last_active":"2024-09-11T11:05:40.504308+0000","last_peered":"2024-09-11T11:05:40.504308+0000","last_clean":"2024-09-11T11:05:40.504308+0000","last_became_active":"2024-09-11T11:01:03.323106+0000","last_became_peered":"2024-09-11T11:01:03.323106+0000","last_unstale":"2024-09-11T11:05:40.504308+0000","last_undegraded":"2024-09-11T11:05:40.504308+0000","last_fullsized":"2024-09-11T11:05:40.504308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:40.504062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:40.504062+0000","last_clean_scrub_stamp":"2024-09-11T11:05:40.504062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:40:50.517351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:59.514486+0000","last_change":"2024-09-11T11:04:59.514486+0000","last_active":"2024-09-11T11:04:59.514486+0000","last_peered":"2024-09-11T11:04:59.514486+0000","last_clean":"2024-09-11T11:04:59.514486+0000","last_became_active":"2024-09-11T11:01:07.346507+0000","last_became_peered":"2024-09-11T11:01:07.346507+0000","last_unstale":"2024-09-11T11:04:59.514486+0000","last_undegraded":"2024-09-11T11:04:59.514486+0000","last_fullsized":"2024-09-11T11:04:59.514486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:59.514205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:59.514205+0000","last_clean_scrub_stamp":"2024-09-11T11:04:59.514205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:51:09.294520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"36'36","reported_seq":96,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:05.992792+0000","last_change":"2024-09-11T11:05:05.992792+0000","last_active":"2024-09-11T11:05:05.992792+0000","last_peered":"2024-09-11T11:05:05.992792+0000","last_clean":"2024-09-11T11:05:05.992792+0000","last_became_active":"2024-09-11T11:01:09.367104+0000","last_became_peered":"2024-09-11T11:01:09.367104+0000","last_unstale":"2024-09-11T11:05:05.992792+0000","last_undegraded":"2024-09-11T11:05:05.992792+0000","last_fullsized":"2024-09-11T11:05:05.992792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'36","last_scrub_stamp":"2024-09-11T11:05:05.992530+0000","last_deep_scrub":"36'36","last_deep_scrub_stamp":"2024-09-11T11:05:05.992530+0000","last_clean_scrub_stamp":"2024-09-11T11:05:05.992530+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:53:54.568734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:25.594444+0000","last_change":"2024-09-11T11:05:25.594444+0000","last_active":"2024-09-11T11:05:25.594444+0000","last_peered":"2024-09-11T11:05:25.594444+0000","last_clean":"2024-09-11T11:05:25.594444+0000","last_became_active":"2024-09-11T11:01:11.400269+0000","last_became_peered":"2024-09-11T11:01:11.400269+0000","last_unstale":"2024-09-11T11:05:25.594444+0000","last_undegraded":"2024-09-11T11:05:25.594444+0000","last_fullsized":"2024-09-11T11:05:25.594444+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:25.594179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:25.594179+0000","last_clean_scrub_stamp":"2024-09-11T11:05:25.594179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:37:41.841786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:07.915180+0000","last_change":"2024-09-11T11:06:07.915234+0000","last_active":"2024-09-11T11:06:07.915180+0000","last_peered":"2024-09-11T11:06:07.915180+0000","last_clean":"2024-09-11T11:06:07.915180+0000","last_became_active":"2024-09-11T11:01:13.423466+0000","last_became_peered":"2024-09-11T11:01:13.423466+0000","last_unstale":"2024-09-11T11:06:07.915180+0000","last_undegraded":"2024-09-11T11:06:07.915180+0000","last_fullsized":"2024-09-11T11:06:07.915180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:06:07.914982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:06:07.914982+0000","last_clean_scrub_stamp":"2024-09-11T11:06:07.914982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:19.357432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"36'8","reported_seq":81,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:35.960108+0000","last_change":"2024-09-11T11:05:35.960108+0000","last_active":"2024-09-11T11:05:35.960108+0000","last_peered":"2024-09-11T11:05:35.960108+0000","last_clean":"2024-09-11T11:05:35.960108+0000","last_became_active":"2024-09-11T11:01:05.334141+0000","last_became_peered":"2024-09-11T11:01:05.334141+0000","last_unstale":"2024-09-11T11:05:35.960108+0000","last_undegraded":"2024-09-11T11:05:35.960108+0000","last_fullsized":"2024-09-11T11:05:35.960108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:35.959856+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:35.959856+0000","last_clean_scrub_stamp":"2024-09-11T11:05:35.959856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:31.341749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:00.020477+0000","last_change":"2024-09-11T11:06:00.020585+0000","last_active":"2024-09-11T11:06:00.020477+0000","last_peered":"2024-09-11T11:06:00.020477+0000","last_clean":"2024-09-11T11:06:00.020477+0000","last_became_active":"2024-09-11T11:01:03.337584+0000","last_became_peered":"2024-09-11T11:01:03.337584+0000","last_unstale":"2024-09-11T11:06:00.020477+0000","last_undegraded":"2024-09-11T11:06:00.020477+0000","last_fullsized":"2024-09-11T11:06:00.020477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:06:00.020165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:06:00.020165+0000","last_clean_scrub_stamp":"2024-09-11T11:06:00.020165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:48:26.822159+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":43,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:14.834334+0000","last_change":"2024-09-11T11:05:14.834334+0000","last_active":"2024-09-11T11:05:14.834334+0000","last_peered":"2024-09-11T11:05:14.834334+0000","last_clean":"2024-09-11T11:05:14.834334+0000","last_became_active":"2024-09-11T11:01:07.365791+0000","last_became_peered":"2024-09-11T11:01:07.365791+0000","last_unstale":"2024-09-11T11:05:14.834334+0000","last_undegraded":"2024-09-11T11:05:14.834334+0000","last_fullsized":"2024-09-11T11:05:14.834334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:14.834085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:14.834085+0000","last_clean_scrub_stamp":"2024-09-11T11:05:14.834085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:21.684279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"36'30","reported_seq":88,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:58.678503+0000","last_change":"2024-09-11T11:04:58.678503+0000","last_active":"2024-09-11T11:04:58.678503+0000","last_peered":"2024-09-11T11:04:58.678503+0000","last_clean":"2024-09-11T11:04:58.678503+0000","last_became_active":"2024-09-11T11:01:09.380531+0000","last_became_peered":"2024-09-11T11:01:09.380531+0000","last_unstale":"2024-09-11T11:04:58.678503+0000","last_undegraded":"2024-09-11T11:04:58.678503+0000","last_fullsized":"2024-09-11T11:04:58.678503+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'30","last_scrub_stamp":"2024-09-11T11:04:58.678237+0000","last_deep_scrub":"36'30","last_deep_scrub_stamp":"2024-09-11T11:04:58.678237+0000","last_clean_scrub_stamp":"2024-09-11T11:04:58.678237+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:51.973784+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:17.571511+0000","last_change":"2024-09-11T11:05:17.571511+0000","last_active":"2024-09-11T11:05:17.571511+0000","last_peered":"2024-09-11T11:05:17.571511+0000","last_clean":"2024-09-11T11:05:17.571511+0000","last_became_active":"2024-09-11T11:01:11.386302+0000","last_became_peered":"2024-09-11T11:01:11.386302+0000","last_unstale":"2024-09-11T11:05:17.571511+0000","last_undegraded":"2024-09-11T11:05:17.571511+0000","last_fullsized":"2024-09-11T11:05:17.571511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:17.571262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:17.571262+0000","last_clean_scrub_stamp":"2024-09-11T11:05:17.571262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:50:34.402557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"36'8","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:04.963076+0000","last_change":"2024-09-11T11:06:04.963142+0000","last_active":"2024-09-11T11:06:04.963076+0000","last_peered":"2024-09-11T11:06:04.963076+0000","last_clean":"2024-09-11T11:06:04.963076+0000","last_became_active":"2024-09-11T11:01:13.422285+0000","last_became_peered":"2024-09-11T11:01:13.422285+0000","last_unstale":"2024-09-11T11:06:04.963076+0000","last_undegraded":"2024-09-11T11:06:04.963076+0000","last_fullsized":"2024-09-11T11:06:04.963076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:06:04.962874+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:06:04.962874+0000","last_clean_scrub_stamp":"2024-09-11T11:06:04.962874+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:35:25.448858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"36'6","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.627375+0000","last_change":"2024-09-11T11:05:28.627375+0000","last_active":"2024-09-11T11:05:28.627375+0000","last_peered":"2024-09-11T11:05:28.627375+0000","last_clean":"2024-09-11T11:05:28.627375+0000","last_became_active":"2024-09-11T11:01:05.336680+0000","last_became_peered":"2024-09-11T11:01:05.336680+0000","last_unstale":"2024-09-11T11:05:28.627375+0000","last_undegraded":"2024-09-11T11:05:28.627375+0000","last_fullsized":"2024-09-11T11:05:28.627375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:28.627119+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:28.627119+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.627119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:20:00.550003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:40.809797+0000","last_change":"2024-09-11T11:05:40.809854+0000","last_active":"2024-09-11T11:05:40.809797+0000","last_peered":"2024-09-11T11:05:40.809797+0000","last_clean":"2024-09-11T11:05:40.809797+0000","last_became_active":"2024-09-11T11:01:03.331816+0000","last_became_peered":"2024-09-11T11:01:03.331816+0000","last_unstale":"2024-09-11T11:05:40.809797+0000","last_undegraded":"2024-09-11T11:05:40.809797+0000","last_fullsized":"2024-09-11T11:05:40.809797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:40.809578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:40.809578+0000","last_clean_scrub_stamp":"2024-09-11T11:05:40.809578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:50:44.841905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"36'3","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.790325+0000","last_change":"2024-09-11T11:05:15.790325+0000","last_active":"2024-09-11T11:05:15.790325+0000","last_peered":"2024-09-11T11:05:15.790325+0000","last_clean":"2024-09-11T11:05:15.790325+0000","last_became_active":"2024-09-11T11:01:07.363545+0000","last_became_peered":"2024-09-11T11:01:07.363545+0000","last_unstale":"2024-09-11T11:05:15.790325+0000","last_undegraded":"2024-09-11T11:05:15.790325+0000","last_fullsized":"2024-09-11T11:05:15.790325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'3","last_scrub_stamp":"2024-09-11T11:05:15.790071+0000","last_deep_scrub":"36'3","last_deep_scrub_stamp":"2024-09-11T11:05:15.790071+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.790071+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:22:57.736742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'39","reported_seq":101,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:04.503885+0000","last_change":"2024-09-11T11:05:04.503885+0000","last_active":"2024-09-11T11:05:04.503885+0000","last_peered":"2024-09-11T11:05:04.503885+0000","last_clean":"2024-09-11T11:05:04.503885+0000","last_became_active":"2024-09-11T11:01:09.377586+0000","last_became_peered":"2024-09-11T11:01:09.377586+0000","last_unstale":"2024-09-11T11:05:04.503885+0000","last_undegraded":"2024-09-11T11:05:04.503885+0000","last_fullsized":"2024-09-11T11:05:04.503885+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'39","last_scrub_stamp":"2024-09-11T11:05:04.503625+0000","last_deep_scrub":"36'39","last_deep_scrub_stamp":"2024-09-11T11:05:04.503625+0000","last_clean_scrub_stamp":"2024-09-11T11:05:04.503625+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:31:19.713646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":35,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:04:56.130847+0000","last_change":"2024-09-11T11:04:56.130847+0000","last_active":"2024-09-11T11:04:56.130847+0000","last_peered":"2024-09-11T11:04:56.130847+0000","last_clean":"2024-09-11T11:04:56.130847+0000","last_became_active":"2024-09-11T11:01:11.401078+0000","last_became_peered":"2024-09-11T11:01:11.401078+0000","last_unstale":"2024-09-11T11:04:56.130847+0000","last_undegraded":"2024-09-11T11:04:56.130847+0000","last_fullsized":"2024-09-11T11:04:56.130847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:04:56.130494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:04:56.130494+0000","last_clean_scrub_stamp":"2024-09-11T11:04:56.130494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:37:45.639114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"36'2","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:06:05.918138+0000","last_change":"2024-09-11T11:06:05.918197+0000","last_active":"2024-09-11T11:06:05.918138+0000","last_peered":"2024-09-11T11:06:05.918138+0000","last_clean":"2024-09-11T11:06:05.918138+0000","last_became_active":"2024-09-11T11:01:13.421231+0000","last_became_peered":"2024-09-11T11:01:13.421231+0000","last_unstale":"2024-09-11T11:06:05.918138+0000","last_undegraded":"2024-09-11T11:06:05.918138+0000","last_fullsized":"2024-09-11T11:06:05.918138+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:06:05.917949+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:06:05.917949+0000","last_clean_scrub_stamp":"2024-09-11T11:06:05.917949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:53.257917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"36'12","reported_seq":79,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.802589+0000","last_change":"2024-09-11T11:05:33.802705+0000","last_active":"2024-09-11T11:05:33.802589+0000","last_peered":"2024-09-11T11:05:33.802589+0000","last_clean":"2024-09-11T11:05:33.802589+0000","last_became_active":"2024-09-11T11:01:05.339760+0000","last_became_peered":"2024-09-11T11:01:05.339760+0000","last_unstale":"2024-09-11T11:05:33.802589+0000","last_undegraded":"2024-09-11T11:05:33.802589+0000","last_fullsized":"2024-09-11T11:05:33.802589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:33.802362+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:33.802362+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.802362+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:01:51.550433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:24.228509+0000","last_change":"2024-09-11T11:05:24.228568+0000","last_active":"2024-09-11T11:05:24.228509+0000","last_peered":"2024-09-11T11:05:24.228509+0000","last_clean":"2024-09-11T11:05:24.228509+0000","last_became_active":"2024-09-11T11:01:03.338039+0000","last_became_peered":"2024-09-11T11:01:03.338039+0000","last_unstale":"2024-09-11T11:05:24.228509+0000","last_undegraded":"2024-09-11T11:05:24.228509+0000","last_fullsized":"2024-09-11T11:05:24.228509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:24.228296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:24.228296+0000","last_clean_scrub_stamp":"2024-09-11T11:05:24.228296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:21:06.516380+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"34'4","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.735670+0000","last_change":"2024-09-11T11:05:30.735753+0000","last_active":"2024-09-11T11:05:30.735670+0000","last_peered":"2024-09-11T11:05:30.735670+0000","last_clean":"2024-09-11T11:05:30.735670+0000","last_became_active":"2024-09-11T11:01:05.332632+0000","last_became_peered":"2024-09-11T11:01:05.332632+0000","last_unstale":"2024-09-11T11:05:30.735670+0000","last_undegraded":"2024-09-11T11:05:30.735670+0000","last_fullsized":"2024-09-11T11:05:30.735670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:30.735470+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:30.735470+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.735470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:53.829897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:30.266178+0000","last_change":"2024-09-11T11:05:30.266240+0000","last_active":"2024-09-11T11:05:30.266178+0000","last_peered":"2024-09-11T11:05:30.266178+0000","last_clean":"2024-09-11T11:05:30.266178+0000","last_became_active":"2024-09-11T11:01:03.327428+0000","last_became_peered":"2024-09-11T11:01:03.327428+0000","last_unstale":"2024-09-11T11:05:30.266178+0000","last_undegraded":"2024-09-11T11:05:30.266178+0000","last_fullsized":"2024-09-11T11:05:30.266178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:30.265963+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:30.265963+0000","last_clean_scrub_stamp":"2024-09-11T11:05:30.265963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T23:00:58.012199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:18.534760+0000","last_change":"2024-09-11T11:05:18.534760+0000","last_active":"2024-09-11T11:05:18.534760+0000","last_peered":"2024-09-11T11:05:18.534760+0000","last_clean":"2024-09-11T11:05:18.534760+0000","last_became_active":"2024-09-11T11:01:05.348827+0000","last_became_peered":"2024-09-11T11:01:05.348827+0000","last_unstale":"2024-09-11T11:05:18.534760+0000","last_undegraded":"2024-09-11T11:05:18.534760+0000","last_fullsized":"2024-09-11T11:05:18.534760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:18.534472+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:18.534472+0000","last_clean_scrub_stamp":"2024-09-11T11:05:18.534472+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:47:41.628898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"34'3","reported_seq":58,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:52.986416+0000","last_change":"2024-09-11T11:05:52.986489+0000","last_active":"2024-09-11T11:05:52.986416+0000","last_peered":"2024-09-11T11:05:52.986416+0000","last_clean":"2024-09-11T11:05:52.986416+0000","last_became_active":"2024-09-11T11:01:03.333729+0000","last_became_peered":"2024-09-11T11:01:03.333729+0000","last_unstale":"2024-09-11T11:05:52.986416+0000","last_undegraded":"2024-09-11T11:05:52.986416+0000","last_fullsized":"2024-09-11T11:05:52.986416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'3","last_scrub_stamp":"2024-09-11T11:05:52.986207+0000","last_deep_scrub":"34'3","last_deep_scrub_stamp":"2024-09-11T11:05:52.986207+0000","last_clean_scrub_stamp":"2024-09-11T11:05:52.986207+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:30:31.940476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"36'6","reported_seq":66,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.775042+0000","last_change":"2024-09-11T11:05:27.775042+0000","last_active":"2024-09-11T11:05:27.775042+0000","last_peered":"2024-09-11T11:05:27.775042+0000","last_clean":"2024-09-11T11:05:27.775042+0000","last_became_active":"2024-09-11T11:01:05.332274+0000","last_became_peered":"2024-09-11T11:01:05.332274+0000","last_unstale":"2024-09-11T11:05:27.775042+0000","last_undegraded":"2024-09-11T11:05:27.775042+0000","last_fullsized":"2024-09-11T11:05:27.775042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:27.774642+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:27.774642+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.774642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:25:43.946676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:31.224359+0000","last_change":"2024-09-11T11:05:31.224414+0000","last_active":"2024-09-11T11:05:31.224359+0000","last_peered":"2024-09-11T11:05:31.224359+0000","last_clean":"2024-09-11T11:05:31.224359+0000","last_became_active":"2024-09-11T11:01:03.335054+0000","last_became_peered":"2024-09-11T11:01:03.335054+0000","last_unstale":"2024-09-11T11:05:31.224359+0000","last_undegraded":"2024-09-11T11:05:31.224359+0000","last_fullsized":"2024-09-11T11:05:31.224359+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:31.224173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:31.224173+0000","last_clean_scrub_stamp":"2024-09-11T11:05:31.224173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T21:49:48.898919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:33.000601+0000","last_change":"2024-09-11T11:05:33.000653+0000","last_active":"2024-09-11T11:05:33.000601+0000","last_peered":"2024-09-11T11:05:33.000601+0000","last_clean":"2024-09-11T11:05:33.000601+0000","last_became_active":"2024-09-11T11:01:05.330065+0000","last_became_peered":"2024-09-11T11:01:05.330065+0000","last_unstale":"2024-09-11T11:05:33.000601+0000","last_undegraded":"2024-09-11T11:05:33.000601+0000","last_fullsized":"2024-09-11T11:05:33.000601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:33.000394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:33.000394+0000","last_clean_scrub_stamp":"2024-09-11T11:05:33.000394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:57:54.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:42.964248+0000","last_change":"2024-09-11T11:05:42.964365+0000","last_active":"2024-09-11T11:05:42.964248+0000","last_peered":"2024-09-11T11:05:42.964248+0000","last_clean":"2024-09-11T11:05:42.964248+0000","last_became_active":"2024-09-11T11:01:03.349971+0000","last_became_peered":"2024-09-11T11:01:03.349971+0000","last_unstale":"2024-09-11T11:05:42.964248+0000","last_undegraded":"2024-09-11T11:05:42.964248+0000","last_fullsized":"2024-09-11T11:05:42.964248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:42.964013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:42.964013+0000","last_clean_scrub_stamp":"2024-09-11T11:05:42.964013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:57:00.215465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"34'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:39.850138+0000","last_change":"2024-09-11T11:05:39.850205+0000","last_active":"2024-09-11T11:05:39.850138+0000","last_peered":"2024-09-11T11:05:39.850138+0000","last_clean":"2024-09-11T11:05:39.850138+0000","last_became_active":"2024-09-11T11:01:05.342092+0000","last_became_peered":"2024-09-11T11:01:05.342092+0000","last_unstale":"2024-09-11T11:05:39.850138+0000","last_undegraded":"2024-09-11T11:05:39.850138+0000","last_fullsized":"2024-09-11T11:05:39.850138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:39.849914+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:39.849914+0000","last_clean_scrub_stamp":"2024-09-11T11:05:39.849914+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:48:18.516667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"34'2","reported_seq":59,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:57.843469+0000","last_change":"2024-09-11T11:05:57.843529+0000","last_active":"2024-09-11T11:05:57.843469+0000","last_peered":"2024-09-11T11:05:57.843469+0000","last_clean":"2024-09-11T11:05:57.843469+0000","last_became_active":"2024-09-11T11:01:42.060500+0000","last_became_peered":"2024-09-11T11:01:42.060500+0000","last_unstale":"2024-09-11T11:05:57.843469+0000","last_undegraded":"2024-09-11T11:05:57.843469+0000","last_fullsized":"2024-09-11T11:05:57.843469+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:57.843248+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:57.843248+0000","last_clean_scrub_stamp":"2024-09-11T11:05:57.843248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:41:44.155241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"36'2","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.941170+0000","last_change":"2024-09-11T11:05:28.941231+0000","last_active":"2024-09-11T11:05:28.941170+0000","last_peered":"2024-09-11T11:05:28.941170+0000","last_clean":"2024-09-11T11:05:28.941170+0000","last_became_active":"2024-09-11T11:01:05.346179+0000","last_became_peered":"2024-09-11T11:01:05.346179+0000","last_unstale":"2024-09-11T11:05:28.941170+0000","last_undegraded":"2024-09-11T11:05:28.941170+0000","last_fullsized":"2024-09-11T11:05:28.941170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:28.940973+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:28.940973+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.940973+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:40.559614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"36'4","reported_seq":56,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:29.256697+0000","last_change":"2024-09-11T11:05:29.256755+0000","last_active":"2024-09-11T11:05:29.256697+0000","last_peered":"2024-09-11T11:05:29.256697+0000","last_clean":"2024-09-11T11:05:29.256697+0000","last_became_active":"2024-09-11T11:01:03.315737+0000","last_became_peered":"2024-09-11T11:01:03.315737+0000","last_unstale":"2024-09-11T11:05:29.256697+0000","last_undegraded":"2024-09-11T11:05:29.256697+0000","last_fullsized":"2024-09-11T11:05:29.256697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'4","last_scrub_stamp":"2024-09-11T11:05:29.256510+0000","last_deep_scrub":"36'4","last_deep_scrub_stamp":"2024-09-11T11:05:29.256510+0000","last_clean_scrub_stamp":"2024-09-11T11:05:29.256510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:46:54.652124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:32.603791+0000","last_change":"2024-09-11T11:05:32.603853+0000","last_active":"2024-09-11T11:05:32.603791+0000","last_peered":"2024-09-11T11:05:32.603791+0000","last_clean":"2024-09-11T11:05:32.603791+0000","last_became_active":"2024-09-11T11:01:05.331901+0000","last_became_peered":"2024-09-11T11:01:05.331901+0000","last_unstale":"2024-09-11T11:05:32.603791+0000","last_undegraded":"2024-09-11T11:05:32.603791+0000","last_fullsized":"2024-09-11T11:05:32.603791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:32.603612+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:32.603612+0000","last_clean_scrub_stamp":"2024-09-11T11:05:32.603612+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:44:32.665425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:44.969641+0000","last_change":"2024-09-11T11:05:44.969693+0000","last_active":"2024-09-11T11:05:44.969641+0000","last_peered":"2024-09-11T11:05:44.969641+0000","last_clean":"2024-09-11T11:05:44.969641+0000","last_became_active":"2024-09-11T11:01:03.351125+0000","last_became_peered":"2024-09-11T11:01:03.351125+0000","last_unstale":"2024-09-11T11:05:44.969641+0000","last_undegraded":"2024-09-11T11:05:44.969641+0000","last_fullsized":"2024-09-11T11:05:44.969641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:44.969429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:44.969429+0000","last_clean_scrub_stamp":"2024-09-11T11:05:44.969429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:28:31.837871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"36'2","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.761851+0000","last_change":"2024-09-11T11:05:28.761851+0000","last_active":"2024-09-11T11:05:28.761851+0000","last_peered":"2024-09-11T11:05:28.761851+0000","last_clean":"2024-09-11T11:05:28.761851+0000","last_became_active":"2024-09-11T11:01:05.332203+0000","last_became_peered":"2024-09-11T11:01:05.332203+0000","last_unstale":"2024-09-11T11:05:28.761851+0000","last_undegraded":"2024-09-11T11:05:28.761851+0000","last_fullsized":"2024-09-11T11:05:28.761851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:28.761615+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:28.761615+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.761615+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:26.880299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"34'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:58.987721+0000","last_change":"2024-09-11T11:05:58.987809+0000","last_active":"2024-09-11T11:05:58.987721+0000","last_peered":"2024-09-11T11:05:58.987721+0000","last_clean":"2024-09-11T11:05:58.987721+0000","last_became_active":"2024-09-11T11:01:03.336786+0000","last_became_peered":"2024-09-11T11:01:03.336786+0000","last_unstale":"2024-09-11T11:05:58.987721+0000","last_undegraded":"2024-09-11T11:05:58.987721+0000","last_fullsized":"2024-09-11T11:05:58.987721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:58.987473+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:58.987473+0000","last_clean_scrub_stamp":"2024-09-11T11:05:58.987473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:29.599827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"36'14","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:50.973925+0000","last_change":"2024-09-11T11:05:50.974037+0000","last_active":"2024-09-11T11:05:50.973925+0000","last_peered":"2024-09-11T11:05:50.973925+0000","last_clean":"2024-09-11T11:05:50.973925+0000","last_became_active":"2024-09-11T11:01:05.332747+0000","last_became_peered":"2024-09-11T11:01:05.332747+0000","last_unstale":"2024-09-11T11:05:50.973925+0000","last_undegraded":"2024-09-11T11:05:50.973925+0000","last_fullsized":"2024-09-11T11:05:50.973925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'14","last_scrub_stamp":"2024-09-11T11:05:50.973617+0000","last_deep_scrub":"36'14","last_deep_scrub_stamp":"2024-09-11T11:05:50.973617+0000","last_clean_scrub_stamp":"2024-09-11T11:05:50.973617+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:21.350122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"36'2","reported_seq":54,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:55.035819+0000","last_change":"2024-09-11T11:05:55.035883+0000","last_active":"2024-09-11T11:05:55.035819+0000","last_peered":"2024-09-11T11:05:55.035819+0000","last_clean":"2024-09-11T11:05:55.035819+0000","last_became_active":"2024-09-11T11:01:03.335854+0000","last_became_peered":"2024-09-11T11:01:03.335854+0000","last_unstale":"2024-09-11T11:05:55.035819+0000","last_undegraded":"2024-09-11T11:05:55.035819+0000","last_fullsized":"2024-09-11T11:05:55.035819+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'2","last_scrub_stamp":"2024-09-11T11:05:55.035586+0000","last_deep_scrub":"36'2","last_deep_scrub_stamp":"2024-09-11T11:05:55.035586+0000","last_clean_scrub_stamp":"2024-09-11T11:05:55.035586+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:43:13.326357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":47,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:13.048283+0000","last_change":"2024-09-11T11:05:13.048283+0000","last_active":"2024-09-11T11:05:13.048283+0000","last_peered":"2024-09-11T11:05:13.048283+0000","last_clean":"2024-09-11T11:05:13.048283+0000","last_became_active":"2024-09-11T11:01:05.343590+0000","last_became_peered":"2024-09-11T11:01:05.343590+0000","last_unstale":"2024-09-11T11:05:13.048283+0000","last_undegraded":"2024-09-11T11:05:13.048283+0000","last_fullsized":"2024-09-11T11:05:13.048283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:13.048016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:13.048016+0000","last_clean_scrub_stamp":"2024-09-11T11:05:13.048016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:34.967696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:43.546093+0000","last_change":"2024-09-11T11:05:43.546146+0000","last_active":"2024-09-11T11:05:43.546093+0000","last_peered":"2024-09-11T11:05:43.546093+0000","last_clean":"2024-09-11T11:05:43.546093+0000","last_became_active":"2024-09-11T11:01:03.336224+0000","last_became_peered":"2024-09-11T11:01:03.336224+0000","last_unstale":"2024-09-11T11:05:43.546093+0000","last_undegraded":"2024-09-11T11:05:43.546093+0000","last_fullsized":"2024-09-11T11:05:43.546093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:43.545891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:43.545891+0000","last_clean_scrub_stamp":"2024-09-11T11:05:43.545891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:28:53.685691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"34'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:37.775220+0000","last_change":"2024-09-11T11:05:37.775220+0000","last_active":"2024-09-11T11:05:37.775220+0000","last_peered":"2024-09-11T11:05:37.775220+0000","last_clean":"2024-09-11T11:05:37.775220+0000","last_became_active":"2024-09-11T11:01:05.341761+0000","last_became_peered":"2024-09-11T11:01:05.341761+0000","last_unstale":"2024-09-11T11:05:37.775220+0000","last_undegraded":"2024-09-11T11:05:37.775220+0000","last_fullsized":"2024-09-11T11:05:37.775220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:37.774962+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:37.774962+0000","last_clean_scrub_stamp":"2024-09-11T11:05:37.774962+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:02:49.393603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:46.839649+0000","last_change":"2024-09-11T11:05:46.839720+0000","last_active":"2024-09-11T11:05:46.839649+0000","last_peered":"2024-09-11T11:05:46.839649+0000","last_clean":"2024-09-11T11:05:46.839649+0000","last_became_active":"2024-09-11T11:01:03.318984+0000","last_became_peered":"2024-09-11T11:01:03.318984+0000","last_unstale":"2024-09-11T11:05:46.839649+0000","last_undegraded":"2024-09-11T11:05:46.839649+0000","last_fullsized":"2024-09-11T11:05:46.839649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:46.839445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:46.839445+0000","last_clean_scrub_stamp":"2024-09-11T11:05:46.839445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:54.124210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"36'6","reported_seq":34,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:38.316172+0000","last_change":"2024-09-11T11:05:38.316172+0000","last_active":"2024-09-11T11:05:38.316172+0000","last_peered":"2024-09-11T11:05:38.316172+0000","last_clean":"2024-09-11T11:05:38.316172+0000","last_became_active":"2024-09-11T11:01:42.059147+0000","last_became_peered":"2024-09-11T11:01:42.059147+0000","last_unstale":"2024-09-11T11:05:38.316172+0000","last_undegraded":"2024-09-11T11:05:38.316172+0000","last_fullsized":"2024-09-11T11:05:38.316172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'6","last_scrub_stamp":"2024-09-11T11:05:38.315897+0000","last_deep_scrub":"36'6","last_deep_scrub_stamp":"2024-09-11T11:05:38.315897+0000","last_clean_scrub_stamp":"2024-09-11T11:05:38.315897+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:36:13.862126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:38.905434+0000","last_change":"2024-09-11T11:05:38.905487+0000","last_active":"2024-09-11T11:05:38.905434+0000","last_peered":"2024-09-11T11:05:38.905434+0000","last_clean":"2024-09-11T11:05:38.905434+0000","last_became_active":"2024-09-11T11:01:03.349120+0000","last_became_peered":"2024-09-11T11:01:03.349120+0000","last_unstale":"2024-09-11T11:05:38.905434+0000","last_undegraded":"2024-09-11T11:05:38.905434+0000","last_fullsized":"2024-09-11T11:05:38.905434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:38.905241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:38.905241+0000","last_clean_scrub_stamp":"2024-09-11T11:05:38.905241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:09:46.190006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"36'8","reported_seq":61,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:26.792959+0000","last_change":"2024-09-11T11:05:26.792959+0000","last_active":"2024-09-11T11:05:26.792959+0000","last_peered":"2024-09-11T11:05:26.792959+0000","last_clean":"2024-09-11T11:05:26.792959+0000","last_became_active":"2024-09-11T11:01:05.343121+0000","last_became_peered":"2024-09-11T11:01:05.343121+0000","last_unstale":"2024-09-11T11:05:26.792959+0000","last_undegraded":"2024-09-11T11:05:26.792959+0000","last_fullsized":"2024-09-11T11:05:26.792959+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:26.792707+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:26.792707+0000","last_clean_scrub_stamp":"2024-09-11T11:05:26.792707+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:18:14.577427+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:56.804603+0000","last_change":"2024-09-11T11:05:56.804603+0000","last_active":"2024-09-11T11:05:56.804603+0000","last_peered":"2024-09-11T11:05:56.804603+0000","last_clean":"2024-09-11T11:05:56.804603+0000","last_became_active":"2024-09-11T11:01:42.055356+0000","last_became_peered":"2024-09-11T11:01:42.055356+0000","last_unstale":"2024-09-11T11:05:56.804603+0000","last_undegraded":"2024-09-11T11:05:56.804603+0000","last_fullsized":"2024-09-11T11:05:56.804603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:56.804362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:56.804362+0000","last_clean_scrub_stamp":"2024-09-11T11:05:56.804362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:29:06.944162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"34'4","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:27.928276+0000","last_change":"2024-09-11T11:05:27.928276+0000","last_active":"2024-09-11T11:05:27.928276+0000","last_peered":"2024-09-11T11:05:27.928276+0000","last_clean":"2024-09-11T11:05:27.928276+0000","last_became_active":"2024-09-11T11:01:05.346563+0000","last_became_peered":"2024-09-11T11:01:05.346563+0000","last_unstale":"2024-09-11T11:05:27.928276+0000","last_undegraded":"2024-09-11T11:05:27.928276+0000","last_fullsized":"2024-09-11T11:05:27.928276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'4","last_scrub_stamp":"2024-09-11T11:05:27.927866+0000","last_deep_scrub":"34'4","last_deep_scrub_stamp":"2024-09-11T11:05:27.927866+0000","last_clean_scrub_stamp":"2024-09-11T11:05:27.927866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:18.339185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:28.247847+0000","last_change":"2024-09-11T11:05:28.247847+0000","last_active":"2024-09-11T11:05:28.247847+0000","last_peered":"2024-09-11T11:05:28.247847+0000","last_clean":"2024-09-11T11:05:28.247847+0000","last_became_active":"2024-09-11T11:01:03.315651+0000","last_became_peered":"2024-09-11T11:01:03.315651+0000","last_unstale":"2024-09-11T11:05:28.247847+0000","last_undegraded":"2024-09-11T11:05:28.247847+0000","last_fullsized":"2024-09-11T11:05:28.247847+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:28.247584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:28.247584+0000","last_clean_scrub_stamp":"2024-09-11T11:05:28.247584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:05:01.500658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"36'8","reported_seq":65,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:20.572672+0000","last_change":"2024-09-11T11:05:20.572672+0000","last_active":"2024-09-11T11:05:20.572672+0000","last_peered":"2024-09-11T11:05:20.572672+0000","last_clean":"2024-09-11T11:05:20.572672+0000","last_became_active":"2024-09-11T11:01:05.347760+0000","last_became_peered":"2024-09-11T11:01:05.347760+0000","last_unstale":"2024-09-11T11:05:20.572672+0000","last_undegraded":"2024-09-11T11:05:20.572672+0000","last_fullsized":"2024-09-11T11:05:20.572672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'8","last_scrub_stamp":"2024-09-11T11:05:20.572423+0000","last_deep_scrub":"36'8","last_deep_scrub_stamp":"2024-09-11T11:05:20.572423+0000","last_clean_scrub_stamp":"2024-09-11T11:05:20.572423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:49:41.914766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"34'2","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:51.936595+0000","last_change":"2024-09-11T11:05:51.936678+0000","last_active":"2024-09-11T11:05:51.936595+0000","last_peered":"2024-09-11T11:05:51.936595+0000","last_clean":"2024-09-11T11:05:51.936595+0000","last_became_active":"2024-09-11T11:01:03.337667+0000","last_became_peered":"2024-09-11T11:01:03.337667+0000","last_unstale":"2024-09-11T11:05:51.936595+0000","last_undegraded":"2024-09-11T11:05:51.936595+0000","last_fullsized":"2024-09-11T11:05:51.936595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"34'2","last_scrub_stamp":"2024-09-11T11:05:51.936382+0000","last_deep_scrub":"34'2","last_deep_scrub_stamp":"2024-09-11T11:05:51.936382+0000","last_clean_scrub_stamp":"2024-09-11T11:05:51.936382+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:52:20.122217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:48.658576+0000","last_change":"2024-09-11T11:05:48.658633+0000","last_active":"2024-09-11T11:05:48.658576+0000","last_peered":"2024-09-11T11:05:48.658576+0000","last_clean":"2024-09-11T11:05:48.658576+0000","last_became_active":"2024-09-11T11:01:03.321242+0000","last_became_peered":"2024-09-11T11:01:03.321242+0000","last_unstale":"2024-09-11T11:05:48.658576+0000","last_undegraded":"2024-09-11T11:05:48.658576+0000","last_fullsized":"2024-09-11T11:05:48.658576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:48.658363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:48.658363+0000","last_clean_scrub_stamp":"2024-09-11T11:05:48.658363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:04:52.441433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"36'12","reported_seq":84,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:15.099143+0000","last_change":"2024-09-11T11:05:15.099143+0000","last_active":"2024-09-11T11:05:15.099143+0000","last_peered":"2024-09-11T11:05:15.099143+0000","last_clean":"2024-09-11T11:05:15.099143+0000","last_became_active":"2024-09-11T11:01:05.344285+0000","last_became_peered":"2024-09-11T11:01:05.344285+0000","last_unstale":"2024-09-11T11:05:15.099143+0000","last_undegraded":"2024-09-11T11:05:15.099143+0000","last_fullsized":"2024-09-11T11:05:15.099143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'12","last_scrub_stamp":"2024-09-11T11:05:15.098771+0000","last_deep_scrub":"36'12","last_deep_scrub_stamp":"2024-09-11T11:05:15.098771+0000","last_clean_scrub_stamp":"2024-09-11T11:05:15.098771+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:54:16.965356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":52,"num_write":15,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":51,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:47.888341+0000","last_change":"2024-09-11T11:05:47.888393+0000","last_active":"2024-09-11T11:05:47.888341+0000","last_peered":"2024-09-11T11:05:47.888341+0000","last_clean":"2024-09-11T11:05:47.888341+0000","last_became_active":"2024-09-11T11:01:03.320391+0000","last_became_peered":"2024-09-11T11:01:03.320391+0000","last_unstale":"2024-09-11T11:05:47.888341+0000","last_undegraded":"2024-09-11T11:05:47.888341+0000","last_fullsized":"2024-09-11T11:05:47.888341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T11:05:47.888155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T11:05:47.888155+0000","last_clean_scrub_stamp":"2024-09-11T11:05:47.888155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T22:45:58.012693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"32'2","reported_seq":28,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-11T11:05:42.277792+0000","last_change":"2024-09-11T11:05:42.277852+0000","last_active":"2024-09-11T11:05:42.277792+0000","last_peered":"2024-09-11T11:05:42.277792+0000","last_clean":"2024-09-11T11:05:42.277792+0000","last_became_active":"2024-09-11T11:01:42.069954+0000","last_became_peered":"2024-09-11T11:01:42.069954+0000","last_unstale":"2024-09-11T11:05:42.277792+0000","last_undegraded":"2024-09-11T11:05:42.277792+0000","last_fullsized":"2024-09-11T11:05:42.277792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-09-11T11:05:42.277598+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-09-11T11:05:42.277598+0000","last_clean_scrub_stamp":"2024-09-11T11:05:42.277598+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T20:25:59.622429+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":657,"num_read_kb":625,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2282,"ondisk_log_size":2282,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1524,"ondisk_log_size":1524,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1608,"num_read_kb":1498,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":83,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":4194304,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":128,"acting":128,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":10,"seq":42949673028,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39948,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331892,"statfs":{"total":96636764160,"available":96595857408,"internally_reserved":0,"allocated":454656,"data_stored":155251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":10,"seq":42949673028,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40492,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331348,"statfs":{"total":96636764160,"available":96595300352,"internally_reserved":0,"allocated":1011712,"data_stored":744125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":10,"seq":42949673029,"num_pgs":131,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40556,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331284,"statfs":{"total":96636764160,"available":96595234816,"internally_reserved":0,"allocated":1077248,"data_stored":746823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":142,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39996,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331844,"statfs":{"total":96636764160,"available":96595808256,"internally_reserved":0,"allocated":503808,"data_stored":156613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":2822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":1788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":217,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T11:06:15.820 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T11:06:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.950+0000 7f776d69a640 1 Processor -- start 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.950+0000 7f776d69a640 1 -- start start 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f776806e0f0 0x7f7768133f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f776806e9c0 con 0x7f776812ed00 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f776806be50 con 0x7f776806e0f0 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f77667fc640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f776806e0f0 0x7f7768133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f7766ffd640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f776812ed00 0x7f776812f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:37202/0 (socket says 172.21.15.102:37202) 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f7766ffd640 1 -- 172.21.15.102:0/2143779031 learned_addr learned my addr 172.21.15.102:0/2143779031 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f77667fc640 1 -- 172.21.15.102:0/2143779031 >> v1:172.21.15.102:6789/0 conn(0x7f776812ed00 legacy=0x7f776812f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f77667fc640 1 -- 172.21.15.102:0/2143779031 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f776806ff00 con 0x7f776806e0f0 2024-09-11T11:06:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f7765ffb640 1 -- 172.21.15.102:0/2143779031 <== mon.0 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998745638 0 0) 0x7f776806e9c0 con 0x7f776812ed00 2024-09-11T11:06:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f77667fc640 1 --2- 172.21.15.102:0/2143779031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f7768133f80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7758009d90 tx=0x7f775801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a377e7c09c433403 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:06:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f7765ffb640 1 -- 172.21.15.102:0/2143779031 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77580a6640 con 0x7f776806e0f0 2024-09-11T11:06:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f7765ffb640 1 -- 172.21.15.102:0/2143779031 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580a67e0 con 0x7f776806e0f0 2024-09-11T11:06:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f7765ffb640 1 -- 172.21.15.102:0/2143779031 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f77580a6ae0 con 0x7f776806e0f0 2024-09-11T11:06:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 -- 172.21.15.102:0/2143779031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 msgr2=0x7f7768133f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:06:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 --2- 172.21.15.102:0/2143779031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f7768133f80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f7758009d90 tx=0x7f775801c8c0 comp rx=0 tx=0).stop 2024-09-11T11:06:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 -- 172.21.15.102:0/2143779031 shutdown_connections 2024-09-11T11:06:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 --2- 172.21.15.102:0/2143779031 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f7768133f80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:06:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 -- 172.21.15.102:0/2143779031 >> 172.21.15.102:0/2143779031 conn(0x7f776809a8a0 msgr2=0x7f776809acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:06:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 -- 172.21.15.102:0/2143779031 shutdown_connections 2024-09-11T11:06:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.954+0000 7f776d69a640 1 -- 172.21.15.102:0/2143779031 wait complete. 2024-09-11T11:06:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f776d69a640 1 Processor -- start 2024-09-11T11:06:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f776d69a640 1 -- start start 2024-09-11T11:06:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f776d69a640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f776812dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:06:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f776d69a640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7768137070 con 0x7f776806e0f0 2024-09-11T11:06:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f7766ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f776812dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:06:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f7766ffd640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f776812dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:36066/0 (socket says 172.21.15.102:36066) 2024-09-11T11:06:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f7766ffd640 1 -- 172.21.15.102:0/2409589579 learned_addr learned my addr 172.21.15.102:0/2409589579 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-11T11:06:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f7766ffd640 1 -- 172.21.15.102:0/2409589579 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7768096570 con 0x7f776806e0f0 2024-09-11T11:06:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f7766ffd640 1 --2- 172.21.15.102:0/2409589579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f776812dd80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f775000c420 tx=0x7f775000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:06:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f775f7fe640 1 -- 172.21.15.102:0/2409589579 <== mon.0 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7750018070 con 0x7f776806e0f0 2024-09-11T11:06:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f775f7fe640 1 -- 172.21.15.102:0/2409589579 <== mon.0 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77500074d0 con 0x7f776806e0f0 2024-09-11T11:06:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7768095bf0 con 0x7f776806e0f0 2024-09-11T11:06:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f775f7fe640 1 -- 172.21.15.102:0/2409589579 <== mon.0 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7750004960 con 0x7f776806e0f0 2024-09-11T11:06:15.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f776812e2c0 con 0x7f776806e0f0 2024-09-11T11:06:15.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7768094870 con 0x7f776806e0f0 2024-09-11T11:06:15.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f775f7fe640 1 -- 172.21.15.102:0/2409589579 <== mon.0 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 44053+0+0 (secure 0 0 0) 0x7f775001b070 con 0x7f776806e0f0 2024-09-11T11:06:15.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f775f7fe640 1 --2- 172.21.15.102:0/2409589579 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7748035d60 0x7f7748038220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T11:06:15.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f775f7fe640 1 -- 172.21.15.102:0/2409589579 <== mon.0 v2:172.21.15.102:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6054+0+0 (secure 0 0 0) 0x7f7750048460 con 0x7f776806e0f0 2024-09-11T11:06:15.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.958+0000 7f77667fc640 1 --2- 172.21.15.102:0/2409589579 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7748035d60 0x7f7748038220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T11:06:15.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.962+0000 7f77667fc640 1 --2- 172.21.15.102:0/2409589579 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7748035d60 0x7f7748038220 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f77580af000 tx=0x7f77580a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T11:06:15.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:15.966+0000 7f775f7fe640 1 -- 172.21.15.102:0/2409589579 <== mon.0 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7768096570 con 0x7f776806e0f0 2024-09-11T11:06:16.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.114+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f776806e570 con 0x7f776806e0f0 2024-09-11T11:06:16.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f775f7fe640 1 -- 172.21.15.102:0/2409589579 <== mon.0 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f775001ae10 con 0x7f776806e0f0 2024-09-11T11:06:16.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f775f7fe640 1 -- 172.21.15.102:0/2409589579 <== mon.0 v2:172.21.15.102:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f775001c940 con 0x7f776806e0f0 2024-09-11T11:06:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7748035d60 msgr2=0x7f7748038220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:06:16.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 --2- 172.21.15.102:0/2409589579 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7748035d60 0x7f7748038220 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f77580af000 tx=0x7f77580a7000 comp rx=0 tx=0).stop 2024-09-11T11:06:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 msgr2=0x7f776812dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T11:06:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 --2- 172.21.15.102:0/2409589579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f776812dd80 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f775000c420 tx=0x7f775000c8e0 comp rx=0 tx=0).stop 2024-09-11T11:06:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 shutdown_connections 2024-09-11T11:06:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 --2- 172.21.15.102:0/2409589579 >> [v2:172.21.15.145:6824/53826467,v1:172.21.15.145:6825/53826467] conn(0x7f7748035d60 0x7f7748038220 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:06:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 --2- 172.21.15.102:0/2409589579 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f776806e0f0 0x7f776812dd80 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T11:06:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 >> 172.21.15.102:0/2409589579 conn(0x7f776809a8a0 msgr2=0x7f77680718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T11:06:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 shutdown_connections 2024-09-11T11:06:16.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-11T11:06:16.118+0000 7f776d69a640 1 -- 172.21.15.102:0/2409589579 wait complete. 2024-09-11T11:06:16.136 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T11:06:16.137 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T11:06:16.137 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T11:06:16.137 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T11:06:16.233 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T11:06:16.233 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T11:06:16.234 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T11:06:16.314 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T11:06:16.315 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T11:06:16.315 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T11:06:16.397 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T11:06:16.398 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T11:06:16.398 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T11:06:16.499 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T11:06:16.499 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T11:06:16.499 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T11:06:16.499 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T11:06:16.530 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T11:06:16.530 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T11:06:16.530 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T11:06:16.530 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T11:06:16.555 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T11:06:16.555 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T11:06:16.556 DEBUG:teuthology.orchestra.run.smithi102:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-11T11:06:16.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-11T11:06:16.617 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T11:06:16.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T11:06:16.873 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T11:06:17.134 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T11:06:17.135 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T11:06:17.346 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T11:06:17.346 DEBUG:teuthology.orchestra.run.smithi145:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T11:06:17.526 INFO:tasks.ceph:Archiving mon data... 2024-09-11T11:06:17.527 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804/data/mon.a.tgz 2024-09-11T11:06:17.528 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-11T11:06:17.533 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.11XjbPGTAP 2024-09-11T11:06:17.533 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.11XjbPGTAP 2024-09-11T11:06:17.659 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.11XjbPGTAP 2024-09-11T11:06:17.722 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.11XjbPGTAP is 277KB 2024-09-11T11:06:17.780 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.11XjbPGTAP 2024-09-11T11:06:17.788 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T11:06:17.789 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T11:06:17.835 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T11:06:17.895 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T11:06:17.904 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T11:06:17.904 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T11:06:17.905 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804/remote/smithi102/crash 2024-09-11T11:06:17.906 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T11:06:17.951 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804/remote/smithi145/crash 2024-09-11T11:06:17.952 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T11:06:17.965 INFO:tasks.ceph:Compressing logs... 2024-09-11T11:06:17.965 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T11:06:18.000 DEBUG:teuthology.orchestra.run.smithi145:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T11:06:18.027 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-11T11:06:18.027 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57415.log 2024-09-11T11:06:18.028 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65085.log 2024-09-11T11:06:18.028 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.57415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55645.log 2024-09-11T11:06:18.029 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78639.log 2024-09-11T11:06:18.029 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.65085.log: /var/log/ceph/ceph-client.0.55645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77471.log 2024-09-11T11:06:18.030 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.78639.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.57415.log.gz 2024-09-11T11:06:18.030 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60955.log 2024-09-11T11:06:18.030 INFO:teuthology.orchestra.run.smithi145.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.78639.log.gz 2024-09-11T11:06:18.031 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40895.log 2024-09-11T11:06:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24648.log 2024-09-11T11:06:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25335.log 2024-09-11T11:06:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24648.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24648.log.gz 2024-09-11T11:06:18.032 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24788.log 2024-09-11T11:06:18.035 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.60955.log: /var/log/ceph/ceph-client.0.77471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88072.log 2024-09-11T11:06:18.035 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55645.log.gz 2024-09-11T11:06:18.035 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.40895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52695.log 2024-09-11T11:06:18.035 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.88072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61545.log 2024-09-11T11:06:18.035 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3%/var/log/ceph/ceph-client.0.52695.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.77471.log.gz 2024-09-11T11:06:18.035 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58595.log 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.65085.log.gz 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40895.log.gz 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.61545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75707.log 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.60955.log.gz 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.58595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35585.log 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80397.log 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.75707.log: -- replaced with /var/log/ceph/ceph-client.0.52695.log.gz 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56235.log 2024-09-11T11:06:18.036 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.35585.log: /var/log/ceph/ceph-client.0.80397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40305.log 2024-09-11T11:06:18.064 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22727.log 2024-09-11T11:06:18.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25335.log: /var/log/ceph/ceph-client.admin.24788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25413.log 2024-09-11T11:06:18.064 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.22727.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.24788.log.gz 2024-09-11T11:06:18.064 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25219.log 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.22727.log.gz 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25335.log.gz 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25413.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24725.log 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25413.log.gz 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25219.log.gz 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25096.log 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.24725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25730.log 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25096.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24725.log.gz 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21463.log 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25096.log.gz 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25097.log 2024-09-11T11:06:18.065 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25730.log: /var/log/ceph/ceph.tmp-client.admin.21463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24789.log 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr: 86.2% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25730.log.gz 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.21463.log.gz 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25097.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25097.log.gz 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25193.log 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24789.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22797.log 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.24789.log.gz 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25101.log 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25193.log.gz 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25309.log 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.22797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25465.log 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25101.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.22797.log.gz 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25309.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.25101.log.gz 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24679.log 2024-09-11T11:06:18.066 INFO:teuthology.orchestra.run.smithi102.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25309.log.gz 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25491.log 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25465.log.gz 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25517.log 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25680.log 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25491.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.24679.log.gz 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.22839.log 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25491.log.gz 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25517.log.gz 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5/var/log/ceph/ceph-client.admin.25680.log: --verbose -- /var/log/ceph/ceph-client.admin.24699.log 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.22839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24787.log 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.25680.log.gz 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.22839.log.gz 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24892.log 2024-09-11T11:06:18.067 INFO:teuthology.orchestra.run.smithi102.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.24699.log.gz 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25706.log 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24892.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.24787.log.gz 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25089.log 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.24892.log.gz 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24885.log 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.25706.log.gz 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25089.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.25089.log.gz 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25595.log 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24885.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24893.log 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.24885.log.gz 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25569.log 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25595.log.gz 2024-09-11T11:06:18.068 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24617.log 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24893.log: /var/log/ceph/ceph-client.admin.25569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25652.log 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.24893.log.gz 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25569.log.gz 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24993.log 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24617.log.gz 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr: 86.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23695.log 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25652.log: /var/log/ceph/ceph-client.admin.24993.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24993.log.gz 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25652.log.gz 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.23695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25361.log 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.23695.log.gz 2024-09-11T11:06:18.069 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24882.log 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose 88.7% -- -- replaced with /var/log/ceph/ceph.audit.log.gz /var/log/ceph/ceph-client.admin.25245.log 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25361.log: /var/log/ceph/ceph-client.admin.24882.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.25361.log.gz 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25624.log 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24882.log.gz 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25387.log 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.25245.log.gz 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24997.log 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24992.log 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25387.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25624.log.gz 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25543.log 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.25387.log.gz 2024-09-11T11:06:18.070 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24997.log.gz 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25283.log 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24992.log.gz 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25439.log 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.25543.log.gz 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24751.log 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24985.log 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.25439.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.25283.log.gz 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24751.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.25439.log.gz 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24786.log 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.24751.log.gz 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.24985.log: /var/log/ceph/ceph-client.admin.24786.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.24985.log.gz 2024-09-11T11:06:18.071 INFO:teuthology.orchestra.run.smithi102.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.24786.log.gz 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.56235.log: 93.4% -- replaced with /var/log/ceph/ceph-client.0.88072.log.gz 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.58595.log.gz 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.61545.log.gz 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.35585.log.gz 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80397.log.gz 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75707.log.gz 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.40305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46795.log 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56235.log.gz 2024-09-11T11:06:18.081 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72755.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32641.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.46795.log: /var/log/ceph/ceph-client.0.72755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63315.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.40305.log.gz 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.32641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54465.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.63315.log: 91.7% 90.6% -- replaced with /var/log/ceph/ceph-client.0.32641.log.gz 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37355.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.72755.log.gz 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.46795.log.gz 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47975.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.54465.log: /var/log/ceph/ceph-client.0.37355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79223.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.47975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82757.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.79223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29022.log 2024-09-11T11:06:18.082 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63315.log.gz 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.37355.log.gz 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.82757.log: 90.7% -- replaced with /var/log/ceph/ceph-client.0.79223.log.gz 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.47975.log.gz 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.54465.log.gz 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69215.log 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82757.log.gz 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.29022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33225.log 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86297.log 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29022.log.gz 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.69215.log: /var/log/ceph/ceph-client.0.33225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52105.log 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.86297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59185.log 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.52105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28950.log 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr: 92.0%/var/log/ceph/ceph-client.0.59185.log: gzip -- replaced with /var/log/ceph/ceph-client.0.33225.log.gz 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.87477.log 2024-09-11T11:06:18.083 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69215.log.gz 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.28950.log: gzip -5 --verbose -- 91.3% /var/log/ceph/ceph-client.0.80987.log 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.86297.log.gz 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.87477.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.28950.log.gz 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68625.log 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37945.log 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.80987.log: 92.1% 91.2% -- replaced with /var/log/ceph/ceph-client.0.52105.log.gz 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.59185.log.gz 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.68625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51515.log 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.37945.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.87477.log.gz 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71575.log 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.51515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25101.log 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80987.log.gz 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.71575.log: gzip -5 --verbose -- 91.5% /var/log/ceph/ceph-client.0.58005.log 2024-09-11T11:06:18.084 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.68625.log.gz 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.25101.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.37945.log.gz 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78055.log 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.25101.log.gz 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.51515.log.gz 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74527.log 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.58005.log: /var/log/ceph/ceph-client.0.78055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41485.log 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.74527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25053.log 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.0.78055.log.gz 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71575.log.gz 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.41485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42075.log 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.25053.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.58005.log.gz 2024-09-11T11:06:18.085 INFO:teuthology.orchestra.run.smithi145.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.25053.log.gz 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.42075.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74527.log.gz 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81577.log 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50925.log 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.41485.log.gz 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.81577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.29691.log 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.50925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43845.log 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.42075.log.gz 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.29691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46205.log 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85117.log 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.43845.log: 91.5%/var/log/ceph/ceph-client.0.46205.log: -- replaced with /var/log/ceph/ceph-client.0.81577.log.gz 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50925.log.gz 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33815.log 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.29691.log.gz 2024-09-11T11:06:18.086 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.85117.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43845.log.gz 91.6% -- replaced with /var/log/ceph/ceph-client.0.46205.log.gz 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75117.log 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.33815.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83937.log 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.75117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43255.log 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85117.log.gz 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.83937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83347.log 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.33815.log.gz 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.43255.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.75117.log.gz 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.83937.log.gz 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.43255.log.gz 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53285.log 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.83347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70395.log 2024-09-11T11:06:18.087 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.53285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65675.log 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.70395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62135.log 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3%/var/log/ceph/ceph-client.0.65675.log: -- replaced with /var/log/ceph/ceph-client.0.83347.log.gz 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69805.log 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.53285.log.gz 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6%/var/log/ceph/ceph-client.0.62135.log: -- replaced with /var/log/ceph/ceph-client.0.70395.log.gz 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72165.log 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.65675.log.gz 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.69805.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.69805.log.gz 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.0.62135.log.gz 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.72165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45615.log 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28974.log 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.45615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25077.log 2024-09-11T11:06:18.088 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.28974.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.72165.log.gz 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.28974.log.gz 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42665.log 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.45615.log.gz 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.25077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48565.log 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.25077.log.gz 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.42665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36175.log 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82167.log 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.48565.log: /var/log/ceph/ceph-client.0.36175.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42665.log.gz 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.48565.log.gz 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.36175.log.gz 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59775.log 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.82167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79807.log 2024-09-11T11:06:18.089 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.59775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76297.log 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.79807.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.82167.log.gz 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34405.log 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59775.log.gz 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.76297.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.79807.log.gz 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47385.log 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.34405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31461.log 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76297.log.gz 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.47385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50335.log 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.31461.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34405.log.gz 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.0.47385.log.gz 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30871.log 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.50335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60365.log 2024-09-11T11:06:18.090 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.31461.log.gz 2024-09-11T11:06:18.091 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.30871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64495.log 2024-09-11T11:06:18.091 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.60365.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.50335.log.gz 2024-09-11T11:06:18.091 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30871.log.gz 2024-09-11T11:06:18.091 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60365.log.gz 2024-09-11T11:06:18.091 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67445.log 2024-09-11T11:06:18.091 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-11T11:06:18.101 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.64495.log: /var/log/ceph/ceph-client.0.67445.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.67445.log.gz 2024-09-11T11:06:18.101 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.30281.log 2024-09-11T11:06:18.101 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.64495.log.gz 2024-09-11T11:06:18.101 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66265.log 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.30281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36765.log 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.66265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34995.log 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.36765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76887.log 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.30281.log.gz 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.34995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39715.log 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6%/var/log/ceph/ceph-client.0.76887.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.36765.log.gz 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr: -- replaced with /var/log/ceph/ceph-client.0.66265.log.gz 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 90.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.76887.log.gz /var/log/ceph/ceph-client.admin.28998.log 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.34995.log.gz 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.39715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39125.log 2024-09-11T11:06:18.102 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.28998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32051.log 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28998.log.gz 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.39125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70985.log 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56825.log 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.32051.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39715.log.gz 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.70985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85707.log 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.39125.log.gz/var/log/ceph/ceph-client.0.56825.log: 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62725.log 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.85707.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.70985.log.gz 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.32051.log.gz 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25029.log 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.56825.log.gz 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.62725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86887.log 2024-09-11T11:06:18.103 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.85707.log.gz 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45025.log 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.admin.25029.log: /var/log/ceph/ceph-client.0.86887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53875.log 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.45025.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.25029.log.gz 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49745.log 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.62725.log.gz 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.53875.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.86887.log.gz 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55055.log 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.45025.log.gz 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.49745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73345.log 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73935.log 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.55055.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53875.log.gz 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.73345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84527.log 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.73935.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.49745.log.gz 2024-09-11T11:06:18.104 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49155.log 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.84527.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55055.log.gz 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68035.log 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.49155.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73345.log.gz 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73935.log.gz 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84527.log.gz 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44435.log 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.68035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38535.log 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.49155.log.gz 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.44435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66855.log 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.38535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63905.log 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr: 91.5%/var/log/ceph/ceph-client.0.66855.log: -- replaced with /var/log/ceph/ceph-client.0.68035.log.gz 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.44435.log.gz 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr:/var/log/ceph/ceph-client.0.63905.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.38535.log.gz 2024-09-11T11:06:18.105 INFO:teuthology.orchestra.run.smithi145.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.66855.log.gz 2024-09-11T11:06:18.106 INFO:teuthology.orchestra.run.smithi145.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.63905.log.gz 2024-09-11T11:06:18.119 INFO:teuthology.orchestra.run.smithi145.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T11:06:18.224 INFO:teuthology.orchestra.run.smithi102.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T11:06:18.826 INFO:teuthology.orchestra.run.smithi145.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T11:06:18.968 INFO:teuthology.orchestra.run.smithi145.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T11:06:18.972 INFO:teuthology.orchestra.run.smithi145.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T11:06:18.973 INFO:teuthology.orchestra.run.smithi145.stderr: 2024-09-11T11:06:18.973 INFO:teuthology.orchestra.run.smithi145.stderr:real 0m0.958s 2024-09-11T11:06:18.973 INFO:teuthology.orchestra.run.smithi145.stderr:user 0m2.821s 2024-09-11T11:06:18.974 INFO:teuthology.orchestra.run.smithi145.stderr:sys 0m0.201s 2024-09-11T11:06:19.010 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T11:06:19.011 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-11T11:06:19.011 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m1.010s 2024-09-11T11:06:19.011 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m1.175s 2024-09-11T11:06:19.012 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.077s 2024-09-11T11:06:19.012 INFO:tasks.ceph:Archiving logs... 2024-09-11T11:06:19.012 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804/remote/smithi102/log 2024-09-11T11:06:19.013 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T11:06:19.262 DEBUG:teuthology.misc:Transferring archived files from smithi145:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804/remote/smithi145/log 2024-09-11T11:06:19.263 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T11:06:19.701 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T11:06:19.712 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T11:06:19.713 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T11:06:19.715 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T11:06:19.783 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T11:06:19.791 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T11:06:19.792 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T11:06:19.794 DEBUG:teuthology.orchestra.run.smithi145:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T11:06:19.804 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T11:06:19.804 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-09-11T11:06:19.804 INFO:teuthology.orchestra.run.smithi102.stdout:+hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.087 +1.398 1.248 2024-09-11T11:06:19.805 INFO:teuthology.orchestra.run.smithi102.stdout:*hv02.front.sepi 63.231.80.2 3 u 6 64 377 0.080 -2.213 1.361 2024-09-11T11:06:19.805 INFO:teuthology.orchestra.run.smithi102.stdout:+hv03.front.sepi 74.6.168.72 3 u 10 64 377 0.095 -2.335 1.278 2024-09-11T11:06:19.805 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T11:06:19.806 INFO:teuthology.orchestra.run.smithi145.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T11:06:19.806 INFO:teuthology.orchestra.run.smithi145.stdout:============================================================================== 2024-09-11T11:06:19.806 INFO:teuthology.orchestra.run.smithi145.stdout:*hv01.front.sepi 67.205.162.81 3 u 14 64 377 0.075 +1.347 1.058 2024-09-11T11:06:19.806 INFO:teuthology.orchestra.run.smithi145.stdout:+hv02.front.sepi 63.231.80.2 3 u 10 64 377 0.086 -0.692 1.724 2024-09-11T11:06:19.806 INFO:teuthology.orchestra.run.smithi145.stdout:+hv03.front.sepi 74.6.168.72 3 u 5 64 377 0.087 -1.805 1.341 2024-09-11T11:06:19.807 INFO:teuthology.orchestra.run.smithi145.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T11:06:19.807 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T11:06:19.816 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T11:06:19.817 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T11:06:19.828 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T11:06:19.836 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T11:06:19.846 INFO:teuthology.task.internal:Duration was 927.149188 seconds 2024-09-11T11:06:19.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T11:06:19.855 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T11:06:19.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T11:06:19.858 DEBUG:teuthology.orchestra.run.smithi145:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T11:06:19.895 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T11:06:19.895 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-11T11:06:19.895 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T11:06:19.948 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi145.front.sepia.ceph.com 2024-09-11T11:06:19.948 DEBUG:teuthology.orchestra.run.smithi145:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T11:06:19.958 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T11:06:19.958 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T11:06:19.991 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T11:06:20.029 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T11:06:20.029 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T11:06:20.059 DEBUG:teuthology.orchestra.run.smithi145:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T11:06:20.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T11:06:20.134 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T11:06:20.134 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T11:06:20.146 DEBUG:teuthology.orchestra.run.smithi145:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T11:06:20.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T11:06:20.167 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T11:06:20.191 DEBUG:teuthology.orchestra.run.smithi145:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T11:06:20.198 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-11T11:06:20.213 INFO:teuthology.orchestra.run.smithi145.stdout:kernel.core_pattern = core 2024-09-11T11:06:20.299 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T11:06:20.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T11:06:20.305 DEBUG:teuthology.orchestra.run.smithi145:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T11:06:20.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T11:06:20.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T11:06:20.358 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T11:06:20.359 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804/remote/smithi102 2024-09-11T11:06:20.359 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T11:06:20.379 DEBUG:teuthology.misc:Transferring archived files from smithi145:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:40:03-rgw-squid-distro-default-smithi/7900804/remote/smithi145 2024-09-11T11:06:20.379 DEBUG:teuthology.orchestra.run.smithi145:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T11:06:20.412 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T11:06:20.412 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T11:06:20.419 DEBUG:teuthology.orchestra.run.smithi145:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T11:06:20.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T11:06:20.467 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T11:06:20.467 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T11:06:20.481 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T11:06:20.481 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T11:06:20.484 DEBUG:teuthology.orchestra.run.smithi145:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T11:06:20.487 INFO:teuthology.orchestra.run.smithi102.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 11:06 /home/ubuntu/cephtest 2024-09-11T11:06:20.504 INFO:teuthology.orchestra.run.smithi145.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 11:06 /home/ubuntu/cephtest 2024-09-11T11:06:20.506 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T11:06:20.517 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T11:06:20.543 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/replicated supported-random-distro$/{ubuntu_latest}} duration: 927.149188041687 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T11:06:20.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T11:06:20.614 INFO:teuthology.run:pass